How is ControlNet used with Stable Diffusion for architectural image generation?

ControlNet is a conditioning model that works alongside Stable Diffusion to give designers precise spatial and compositional control over generated images. Instead of relying solely on text prompts, ControlNet accepts inputs such as depth maps, edge detection images, line drawings, or pose references to guide where the model places structure, mass, and detail. In architectural workflows, this allows designers to use existing plans, sections, or 3D renders as generation references, producing AI-enhanced visuals that remain spatially coherent with the original design intent. This workshop covers ControlNet as part of the Stable Diffusion workflow for concept editing and image refinement.

What does the Creative Perspectives workshop at PAACADEMY cover?

The workshop covers Midjourney in depth, including its full command range for mood board creation, concept exploration, theme development, and social media use, with a focus on achieving precise prompting outcomes that align with a designer's vision. It then introduces Stable Diffusion as a local alternative for upscaling and editing using ControlNet. The final phase teaches how to animate and sequence still AI images into project videos using Immersity AI, Runway, and Adobe Premiere Pro and After Effects, ending with a final project combining theme development and video production.

Is this AI workshop suitable for designers with no prior experience in Midjourney or Stable Diffusion?

Yes. The workshop is designed for designers who want to integrate AI image generation into their workflow, whether or not they have used these tools before. The course begins with the fundamentals of Midjourney prompting before progressing to more advanced command techniques, then introduces Stable Diffusion as a supplement. Prior architectural or design experience is beneficial for understanding how to apply these tools to concept development and client communication, but no coding or technical AI knowledge is required.

What will I produce by the end of the Creative Perspectives workshop?

Participants will develop a complete set of AI-generated concept images across multiple architectural themes, refined using Midjourney's editing commands and Stable Diffusion with ControlNet for upscaling and local adjustments. The final project is an AI-generated project video combining still images into a sequenced, animated output using Immersity AI, Runway, and Adobe After Effects, suitable for client presentations or social media publishing.

Enter CartesianForms: Architecture Reimagined competition early to win from a $120,000 prize pool.

Become Member Sign In

Sep 21-22, 202411 lessonsBeginner

Architectural DesignFREE with Full AccessWorkshopSep 21-22, 2024Beginner11 lessons8h 40mAI Concept Design AI Rendering Architectural Animation

Creative Perspectives: Architectural Concepts with AI

Name: Creative Perspectives: Architectural Concepts with AI
Price: 105.00 EUR
Availability: InStock
Rating: 5.00 (2 reviews)

Creative Perspectives: Architectural Concepts with AI is a workshop on PAACADEMY that teaches designers to use Midjourney, Stable Diffusion, and ControlNet for concept development, mood board creation, and image editing. The workshop concludes with a video production phase using Runway, Immersity AI, and Adobe After Effects to turn AI-generated images into project videos for clients and social media. No prior AI tool experience is required.

Learn from Harshdeep Arora

Instructor

Harshdeep Arora1 course

With the advent of image-generative platforms and their ability to create concepts and themes faster than traditional modeling, many individuals—whether familiar with the field or not—are using their imagination to develop innovative ideas. In this competitive environment, designers must leverage their prior knowledge and ability to perceive great designs through traditional means and incorporate quick image generation into their workflow for concept designs or social media management. Platforms like Midjourney and Stable Diffusion can significantly enhance the design process, client discussions, renderings, and marketing. Therefore, learning these software tools is essential for modern designers.

Mastering Image Generation: Leveraging Midjourney for Architectural Concepts
Exploring Creative Command Techniques for Mood Boards and Themes
Enhancing Your Design Process with Stable Diffusion and ControlNet
Creating Engaging Project Videos Using AI and Premiere Pro/After Effects
Developing Publishable-Quality Designs Through Precise Image Editing

How the 2 days are spent, session by session.

Day 1 Program

Saturday · Sep 21, 2024

Session 1:

Introduction to AI generative imagery, Midjourney, Stable Diffusion, and
related software and their potential usage in a designer’s workflow
Learning Midjourney:

Introduction to Discord interface and chat organization

Official website and image organization

Midjourney commands and their usage

Basic prompting techniques

Assignment 01: Create an image of the field/subject of your choice
Student Discussion: Imagination vs. Results – Tips to Improve Results
Advanced prompting and complex methods

Session 2:

Introduction to Stable Diffusion: ComfyUI vs. Automatic 1111 (local install vs. web use)
Using ComfyUI: Commands and connectors
Basic image creation – Img2Img & Txt2Img
Assignment 02: Create a set of images using prompts focused on one theme of choice.

Day 2 Program

Sunday · Sep 22, 2024

Session 1:

Discussion of Assignment 02: Tips and tricks, prompt refinement, and error correction
Inpainting, Correction & Miscellaneous Editing Workflows in Stable Diffusion.
Image Upscale models – Local and web (ComfyUI vs. Magnific AI)
Finalising Image Set from Assignment 02.

Session 2 – Video Creation:

Introduction to SVD, Runway & Immersity AI – Depth map video/GIF vs. Image to video.
Introduction to Premiere Pro/After Effects.
Edit videos, overlays, and export HQ videos for professional & Social uploads.
Final Project: Creating an immersive video using the best images created so far for clients and social media publishing.
Discussion – Q&A

This workshop will teach the tips and tricks of precise image creation using prompting techniques for mood board creation, concept exploration, theme development, and social media. We will focus on using Midjourney to master its use and achieve concepts that align with the designer’s vision and reflect the theme of their project. This workshop will explore the extensive range of commands available to create unique images, personalize them, and edit them to achieve publishable-quality designs.

Additionally, we will cover the basics of Stable Diffusion and its use as an alternative or supplement to Midjourney, including upscaling and editing images locally. Finally, we will learn how to use these still images to create project videos for clients and social media using Immersity AI, Runway, and Premiere Pro/After Effects. Students will develop themes and create engaging videos as their final project.

11 Lessons8h 40m

Software Installation is NOT a part of the workshop! Participants must have all the software installed and ready before the workshop.

Instructor

Harshdeep Arora

View profile

5.0instructor rating1course

Harshdeep Arora, also known as “prspctivs,” is a practicing architect from India with experience in renowned firms in Delhi, Shanghai, and Beijing, including UNStudio, Buro Ole Scheeren, CHAP (Peter Cook), Plasma Studio, DADA Partners, and AECOM. Currently based in Canada, he pursues research and works part-time as a designer for the esteemed firm 1×1 Architecture. His focus includes AI design creation and extending research on Artificial Intelligence (AI) in mainstream architecture and other design fields.Harshdeep, a practicing architect and designer, has been actively involved in AI generations for the past two years. He has recognized the potential of AI to bridge gaps between design, engineering, and cultural fields. His role in AI and architecture involves not just experimenting with and refining designs through AI, but also developing AI models and educating enthusiasts to make these models more user-friendly and informative.

5.022

5.0avg2 Ratings

2 Reviews

IBRAHIM ALJASEMApr 29, 20265.0

great course

carloMar 1, 20255.0

EXCELLENT COURSE!!!

IBRAHIM ALJASEM

Apr 29, 2026

great course

carlo

Mar 1, 2025

EXCELLENT COURSE!!!

Regular Price

Save €20.00

€105.00€125.00

Pay less with membership

Pro Membership€89.25Save €15.75 on this course Full Access€0.00Plus every other course

Sep 21-22, 202411 lessonsBeginner

Architectural DesignFREE with Full AccessWorkshopSep 21-22, 2024Beginner11 lessons8h 40mAI Concept Design AI Rendering Architectural Animation

Creative Perspectives: Architectural Concepts with AI

Learn from Harshdeep Arora

Instructor

Harshdeep Arora1 course

Mastering Image Generation: Leveraging Midjourney for Architectural Concepts
Exploring Creative Command Techniques for Mood Boards and Themes
Enhancing Your Design Process with Stable Diffusion and ControlNet
Creating Engaging Project Videos Using AI and Premiere Pro/After Effects
Developing Publishable-Quality Designs Through Precise Image Editing

How the 2 days are spent, session by session.

Day 1 Program

Saturday · Sep 21, 2024

Session 1:

Introduction to AI generative imagery, Midjourney, Stable Diffusion, and
related software and their potential usage in a designer’s workflow
Learning Midjourney:

Introduction to Discord interface and chat organization

Official website and image organization

Midjourney commands and their usage

Basic prompting techniques

Assignment 01: Create an image of the field/subject of your choice
Student Discussion: Imagination vs. Results – Tips to Improve Results
Advanced prompting and complex methods

Session 2:

Introduction to Stable Diffusion: ComfyUI vs. Automatic 1111 (local install vs. web use)
Using ComfyUI: Commands and connectors
Basic image creation – Img2Img & Txt2Img
Assignment 02: Create a set of images using prompts focused on one theme of choice.

Day 2 Program

Sunday · Sep 22, 2024

Session 1:

Discussion of Assignment 02: Tips and tricks, prompt refinement, and error correction
Inpainting, Correction & Miscellaneous Editing Workflows in Stable Diffusion.
Image Upscale models – Local and web (ComfyUI vs. Magnific AI)
Finalising Image Set from Assignment 02.

Session 2 – Video Creation:

Introduction to SVD, Runway & Immersity AI – Depth map video/GIF vs. Image to video.
Introduction to Premiere Pro/After Effects.
Edit videos, overlays, and export HQ videos for professional & Social uploads.
Final Project: Creating an immersive video using the best images created so far for clients and social media publishing.
Discussion – Q&A

11 Lessons8h 40m

Software Installation is NOT a part of the workshop! Participants must have all the software installed and ready before the workshop.

Instructor

Harshdeep Arora

View profile

5.0instructor rating1course

5.022

5.0avg2 Ratings

2 Reviews

IBRAHIM ALJASEMApr 29, 20265.0

great course

carloMar 1, 20255.0

EXCELLENT COURSE!!!

IBRAHIM ALJASEM

Apr 29, 2026

great course

carlo

Mar 1, 2025

EXCELLENT COURSE!!!

Regular Price

Save €20.00

€105.00€125.00

Pay less with membership

Pro Membership€89.25Save €15.75 on this course Full Access€0.00Plus every other course