Designing Context with Intelligence: Inside “Multimodal Architecture”

Multimodal Architecture: Context Creation with AI was an intensive two-day PAACADEMY workshop dedicated to exploring Formas.ai, a groundbreaking multimodal platform that transforms early-stage design into a structured, context-driven workflow. Through hands-on sessions combining Formas.ai, Processing, ComfyUI, and large-language models like ChatGPT, Gemini, and Grok, participants learned how to merge conceptual thinking with environmental intelligence, generating architectural narratives that respond to real-world conditions.

Rather than approaching AI as a rendering assistant, the workshop positioned it as a design reasoning system, a tool for encoding intention, material logic, and site awareness into dynamic, adaptive prototypes. Across two sessions, instructors demonstrated how Formas.ai’s rule-based design engine can turn language into geometry, constraints into massing, and context into atmosphere.

Authoring Architecture: Rules, Language, and Proto-Projects

Day 1 introduced the foundational premise of Formas.ai: that design begins with language. Participants learned to author natural-language rule sets, plain-text statements that govern geometry, massing, and circulation, then watched those sentences transform into 3D structures within Formas.ai’s real-time environment.

Through live demonstrations, instructors revealed how lines of descriptive text could define setbacks, material logic, hierarchy, and environmental behavior. This method reframes architectural ideation as a conversation between words and space, where designers structure intention before form.

Using Processing as a complement, attendees iterated through multiple low-resolution prototypes, testing hierarchy, rhythm, and scale while ComfyUI’s visual workflows illustrated how point clouds and masks could be read as volumetric constraints. By the end of the day, each participant had built a proto-project: a site-responsive model defined entirely by text-based logic and refined through iterative prompts.

Formas.ai in Motion: Atmosphere, Context, and Narrative

Day 2 expanded on Formas.ai’s capacity for storytelling, where architectural context evolves into narrative. Participants learned to integrate lighting, weather, and camera logic directly within the platform, transforming static prototypes into cinematic design sequences.

The instructors guided attendees through Formas.ai’s scene composer, demonstrating how to choreograph atmosphere using parameterized light paths, time-of-day settings, and material reactions. This process transformed digital models into animated fragments of experience, evoking not just how a space looks, but how it feels.

Through ComfyUI demos, participants explored image-to-3D and point-cloud validation, testing how visual data and environmental feedback could reinforce design intent. The workflow bridged 2D sketches, 3D massing, and site-specific conditions into cohesive, data-rich narratives.

The day concluded with a creative showcase: each participant produced a 15-second animated sequence entirely generated and rendered within Formas.ai, a visual story of architecture situated in a real context. Feedback centered on clarity of rule logic, coherence of atmosphere, and integration of environmental parameters.

A New Language of Design: The Promise of Formas.ai

Across both sessions, the workshop revealed Formas.ai as more than a platform; it’s a new language for architectural thinking. By uniting text, image, video, and 3D data into a single multimodal environment, it empowers designers to script intent, simulate context, and narrate architecture with unprecedented precision.

Participants left with a new understanding of design authorship: that AI can think in context, interpreting geometry, light, and narrative through human logic expressed in natural language. The process reframed the architect not as a form-maker, but as a systems composer, guiding networks of meaning across media and scale.

The future outlined in Multimodal Architecture: Context Creation with AI is one where design becomes dialogue, between text and terrain, data and desire, code and craft.

Join the experience! Discover PAACADEMY’s upcoming workshops and stay at the forefront of design and technology.