PixelSpace: Intro to 3D Generative AI

PixelSpace: Intro to 3D Generative AI focuses on automating 3D scene creation using AI models and Unreal Engine.

00:00

00:00

/

04:59
- 2x
- 1.5x
- Normal
- 0.75x
- 0.5x

Overview
Content
Instructors
Reviews

Duration:

8 Hours

Difficulty:

Beginner

Language:

English

Certificate:

Yes

Registration:

€105.00

Tutor:

Daniel Escobar

Members:

89.25 EUR (28.60%) discount

Recordings:

Available Indefinitely

Gift The Course

Introduction of the workshop:

Recent image and video generation advancements have revolutionized content creation, offering unprecedented possibilities. While we rapidly approach seamless interaction with scenes and videos through text inputs, 3D scene generation remains a fertile ground for exploration. Over the past two years, significant progress has been made in 3D and 4D object generation, mainly through multiview diffusion models. More recently, the application of consistent video generation as a proxy for 3D spatial representation has emerged, paving the way for comprehensive 3D scene generation.

These developments present a unique opportunity to harness deep learning algorithms, allowing us to envision and create immersive 3D scenes, thereby unlocking a new dimension of creative expression.This workshop will explore the cutting-edge techniques of multiview diffusion models conditioned on camera paths for 3D scene generation.

We will dive into the latest methods for representing 3D scenes and geometry and investigate how current research in 3D generative AI leverages pre-trained image and video models for a 3D generation. Participants will learn how to use text and image inputs to generate scenes, which will then be imported into Unreal Engine for post-production and to create a concept reel.

This workshop focuses on the automation of 3D scene generation from text and images. Through theoretical discussions and practical exercises, participants will explore the capabilities of 3D generative AI and its application in fast-tracking design exploration. Key topics include:

Introduction to Multiview Diffusion Models:

Understanding the principles and techniques behind multiview diffusion models.
Exploring case studies of successful applications in 3D scene generation.

3D Scene and Geometry Representation:

Examining recent advancements in the 3D scene and geometry representation.
Discussing the role of different representation techniques in enhancing 3D consistency.

Leveraging Pretrained Models:

Learning how to adapt pre-trained image and video models for a 3D generation.
Hands-on sessions with state-of-the-art algorithms for scene creation.

Text and Image Inputs for Scene Generation:

Text and image inputs are used to automate the generation of 3D scenes.
Practical exercises on integrating inputs to produce coherent scenes.

Integration with Unreal Engine:

Importing AI-generated scenes into Unreal Engine for further development.
Techniques for enhancing interactivity and immersion in Unreal Engine.

What You’ll Learn?

Exploring 3D Generative AI: Understand and utilize advanced AI algorithms for scene generation.

Scene Creation: Learn to automate the process of 3D scene creation using text and image inputs.

Interactive Design: Develop skills in creating interactive and immersive experiences in Unreal Engine.

Creative Exploration: Foster innovation and creativity in architectural design through AI tools.

Methodology:

Inspirational Inputs:

Text and Images: Use descriptive text and images to generate 3D scenes. These inputs will serve as the foundation for your scene’s development.
Scene Development: Experiment with different inputs to see how they influence the generated scenes.

Scene Generation:

Multiview Diffusion Models: Apply these models to generate consistent scenes across multiple views.
Representation Techniques: Use various methods to represent geometry and scene details effectively.

Interactive Experience Creation:

Unreal Engine Integration: Learn to import and refine your AI-generated scenes in Unreal Engine.
Enhancing Immersion: Develop interactive elements to create a fully immersive experience.

Project Showcase:

Concept Reel: Compile your generated scenes into a cohesive concept reel.
Presentation and Feedback: Present your work and receive feedback from peers and instructors.

By the end of this workshop, participants will have a solid understanding of how to leverage 3D generative AI to automate scene generation and create immersive architectural experiences, opening new avenues for creative expression and design exploration.

What You’ll Use?

Chaos Corona

Unreal Engine

Luma AI

Highlights:

Content

Introduction to the course (05:10)

Intro + PAACADEMY Updates

Lecture (01:17:28)

Frontiers in 3D AI

This session explores advances in 3D generative AI, highlighting new diffusion models for creating consistent 3D objects and scenes from 2D images or videos.

Luma AI (24:44)

Introduction to Luma AI

This session demonstrates how Luma Dream Machine uses AI to create animations and 3D reconstructions from images and text, unlocking new creative possibilities.

AI Reconstruction with Blender (36:46)

Exploring AI-Powered 3D Visualization

This session covers 3D reconstruction and visualization using tools like Luma AI and Blender, focusing on point clouds, meshes, and rendering techniques.

3D Model Generation Process (48:55)

Creating 3D Models from Videos

This session explains how to generate 3D models and point clouds—covering setup, dependency installation and managing output files.

Text to 3D scenes (25:43)

generating 3D scenes from text using a text to 3D scene generation model

This session covers generating and visualizing 3D scenes from text, including addressing issues with multi-view stitching.

3D Scene Creation Overview (43:40)

Generating 3D Scenes and Texturing

This session covers generating 3D scenes with a Colab notebook, importing and texturing meshes in Blender, and starting with Unreal Engine.

Unreal Engine Particle System Setup (37:12)

Creating a Basic Particle System

This session explains creating a basic particle system in Unreal Engine, including importing assets, configuring Niagara settings, and applying textures.

Unreal Engine System Setup (32:59)

Creating and Adjusting Particle Systems

This session explains how to set up a particle system in Unreal Engine, including particle sampling, force adjustments, and visualization techniques.

Mesh Particles Setup (34:30)

Setting Up Mesh Particles and Cameras

This session covers setting up mesh particles and animating cameras in Niagara and Blender to visualize and capture particle effects.

3D Scene Generation Overview (37:19)

Generating 3D Scenes from Image combination

This session covers generating 3D scenes by combining images from different camera angles to create the final scene.

Meet Your Instructors

Daniel Escobar

3 Followers

0 Following

Biography

Daniel Escobar is a creative designer and 3D generative AI researcher passionate about pushing the boundaries of creative workflows and enhancing the creative process. His primary focus lies in exploring creative applications for 3D generative neural networks. He cofounded OLA, which focuses on developing projects through various media, including architecture. Daniel has been published at Caadria, Acadia, Archdaily, and Dezeen and has taught multiple workshops exploring the intersection of AI in creative applications. He also founded Diffusion Architecture, a platform that records and disseminates the creative use of AI in architecture and design.

This course is part of a bundle:

thumbnail-ai-conceptual-architecture-4-0-studio-hassan-ragab-7.webp

thumbnail-pixelspace-intro-to-3d-generative-ai-daniel-escobar-5.webp

Artificial Intelligence Bundle 4

AI Conceptual Architecture 4.0, The Diffusion Architect: Stable Diffusion for Practical Workflows, PixelSpace: Intro to 3D Generative AI

€355.00 €220.00

View Bundle

No reviews yet. Be the first to share your thoughts!

No comments found under this tab, you can make first review.

€125.00

€105.00

-16% off

Duration:	8 Hours
Instructor:	Daniel Escobar
Difficulty:	Beginner
Language:	English
Certificate:	Yes, Learn more
Digital Members:	89.25 EUR

Gift The Course

This course is part of a bundle:

Artificial Intelligence Bundle 4

AI Conceptual Architecture 4.0, The Diffusion Architect: Stable Diffusion for Practical Workflows, PixelSpace: Intro to 3D Generative AI

€355.00 €220.00

View Bundle

Transforming Architecture: 3D Models to Ethereal Art

Sculpture Synergy in VR

AI-Driven Architectural Design

Transforming Architecture: 3D Models to Ethereal Art

Sculpture Synergy in VR

AI-Driven Architectural Design

Transforming Architecture: 3D Models to Ethereal Art

Sculpture Synergy in VR

AI-Driven Architectural Design