Taking Control: Midjourney x ControlNet

This workshop will use Midjourney, Stable Diffusion, and ControlNet to refine architectural design skills in geometry, materiality, and atmosphere.

Duration:
8 Hours
Difficulty:
Beginner
Language:
English
Certificate:
Yes
Registration:
€160.00
Members:
136.00 EUR (26.49%) discount
Recordings:
Available Indefinitely

Design workflow has been completely redefined since AI platforms such as Midjourney and Stable Diffusion impacted Architecture and Design. This workshop offers technical knowledge and fosters creative thinking by integrating Midjourney and Stable Diffusion with Rhinoceros to produce open-ended, controlled designs with industry-ready standards. On one hand, we will learn to expand architectural concepts using Midjourney’s commands, such as /image, /blend, and /remix, including image prompts as guidance. On the other hand, we will develop solid skills further to control geometry, materiality, and atmosphere creation using Stable Diffusion + Controlnet, including inpainting techniques. The workshop will combine both tools to maximize potential and optimize them for various design objectives.

Introduction and Overview:


  • A brief introduction to Midjourney and Stable Diffusion
  • Overview of their impact on architectural design workflows
  • Understanding the significance of integrating these tools to produce 3D Models


Midjourney for Architectural Concepts:


  • Introduction to Midjourney’s commands: /image, /blend, and /remix
  • Understanding the use of image prompts for concept generation
  • Hands-on exercises to create and expand architectural concepts using Midjourney


Stable Diffusion + Controlnet for Conceptualization, Materiality and Atmosphere Control:


  • Introduction to Design Possibilities with Stable Diffusion and ControlNet
  • Techniques for controlling materiality and atmosphere in architectural design.
  • Hands-on exercises to develop skills in materiality and atmosphere manipulation


Combining Midjourney, Stable Diffusion, and Rhinoceros for Optimized Design:


  • Strategies for integrating Midjourney and Stable Diffusion within Rhinoceros
  • Methods for optimizing design workflows for various objectives. Impainting.
  • Collaborative exercises to practice combining tools for design exploration


Wrap-up and Next Steps:


  • Recap of the key learnings from the workshop
  • Opportunities for further exploration and skill development
  • Q&A


  • Develop a comprehensive understanding of Midjourney and Stable Diffusion, and their articulation with Rhinoceros to redefine architectural design workflows.
  • Enhance participants’ skills in combining Midjourney’s commands (/image, /blend, /remix) with image prompts for generating and expanding innovative architectural concepts.
  • Build proficiency in controlling materiality and atmosphere using Stable Diffusion + ControlNet, enabling iterations for the creation of immersive and adaptive spaces.
  • Master the integration of Midjourney and Stable Diffusion within Rhinoceros to optimize design workflows, maximize potential, and adapt to various design objectives.

Program:

  • Introduction: The Spectrum of AI-Driven Design Workflows using Midjourney and Stable Diffusion – Maximizing the Strengths of Each Platform 
  • Lecture: When Midjourney Comes to Town: a Design Paradigm Change in Architecture.
  • Tutorial 1: Industry-Ready Architectural Image Generation with Midjourney: prompting with /imagine
  • Tutorial 2: Working with Self and External References: workflows with /blend and /remix
  • Lecture: Taking geometric control: Introduction to Stable Diffusion and ControlN
  • Tutorial 3: Setting up Stable Diffusion – Interface, Introduction, Models, and Initial Experiments
  • Tutorial 4: Strategic Prompting: Inpainting Techniques
  • Project Theme and Assignment for Tomorrow  (Remote Follow Up and Troubleshooting in Miro)


  • Project Interim Review and General Discussion
  • Tutorial 5: Fine-Tuning Constraints: Implementing Multiple ControlNet Layers
  • Tutorial 6: Moving across Midjourney, Stable Diffusion, and Rhinoceros 3D Models. Strategies to create 3D models
  • Project Development (Miro)
  • Presentation of Results: Final Jury Review with Distinguished Guests
  • Gigapixel Enhancement. Selection of the Best Three Projects for Awards


  • Grasshopper 3D
  • Midjourney
  • Adobe Photoshop
  • Stable Diffusion
  • ControlNet
  • Total sessions: 2 sessions (8 Hours).
  • PAACADEMY will provide a certificate of attendance for students.
  • Please be informed that we won’t be able to provide any license, invitation, or educational account, for any of the software listed above. Having the software with a proper license and installing them on the computer is the responsibility of the attendees.

Course Content

Instructors

1 Followers

0 Following

Biography
Carlos Bañón is a pioneering architect and professor integrating AI, computational thinking, and digital fabrication into architectural design. Renowned for his resource-efficient, computationally-driven methodologies, he has reshaped urban landscapes and the built environment over twenty years through his practice, Subarquitectura. As a tenured faculty member at SUTD, he established the Architectural Intelligence Research Lab (AirLab) in 2015. His acclaimed work, showcased in two editions of the Venice Biennale, garnered prestigious awards like the Singapore President’s Design Award and a Nomination for the Mies Van Der Rohe Award. An influential figure in architectural education, he held visiting professor positions at leading institutions such as MIT, EPFL, and KEA, inspiring the next generations with innovative, tech-centric designs.

0 Comments

You must be logged in to comment.