Flow with corridor: A GAN-based floorplan generator

Page 1

“Flow along the corridor”

A GAN-based floor plan generator

+ FACULTY: Oana Taut + STUDENT: Ziqi Cuit Final Thesist

Intro Case Study

Research Objective

Methodology

Dataset Generation

Training

Conclusion

“Content”

Abstract

Generative design has always been a very hot topic in recent times. Over the past few years, machine  learning tools have emerged as invaluable aids in the creation of more precise and diverse 2D or 3D  building models, fostering greater user engagement in the design process. A retrospective examination of  previous approaches shows that techniques such as diffusion models, generative adversarial networks  (GAN), graph neural networks (GNN) and etc. They all attempt to educate computer to understand the  complexity of a building and reconstruct it.

This research will continue this topic and try to develop another method to let the ML understand, learn  and reconstruct the information in the building plan to develop a generator. The training results  allow users to customize the generation. In addition, it relies on the necessary circulation lines in the  building (ie, corridor space) to generate a reasonable building plan. After verifying the possibility of this methodology, this study propose a feasible solution for  subsequent generation of architectural 3D space.

Key words:generative design, Pix2Pix model, spatial relationship, Graph theory.

ML

INTRO
how to understand spatial information?

Case Study

1, 3D GAN_Voxel based: Synthesis and generation for 3D architecture volume  with generative modeling

User input: /

Scope of application: building geometry

Training model:3D GAN

Dimension: 3D

Limitation: Generate results with low resolution, can  only simply learn the shape characteristics of buildings.

Case Study

2, Graph based: Building GAN

User input: function, graph

Scope of application: single apartment

Training model:GNN+pointer-based cross-modal modules

Dimension: 3D

Advantage: can generate public building with internal spatial  divisions.

Case Study

3, 2D GAN: ArchiGan

User input: boundary

Scope of application: single apartment

Training model:cGAN (pix2pix)

Dimension: 2D

Limitations: Generate pixel-result non-vector images

Case Study

4, GNN+GAN: Graph2plan

User input: entrance, relation of rooms, boundary,  selected room function.

Scope of application:single apartment

Training model:GNN+GAN

Dimension: 2D

Advantage: Allows users to generate interactively,  increasing the controllability of generated results.

Literature Review_3D generation

Agenerative  architecturaland  urbandesignmethod  throughartificial  neuralnetworks

Synthesisand  generationfor3D  architecturevolume  withgenerative  modeling

Buildingmassing  generation usingGANtrainedon  Dutch

3Dcitymodels

UrbanLayout  WorkflowUtilizing

Generative  AdversarialNetwork  (GAN)

Building-GAN

Encodedpoints  andsurfaces

GNN+pointer-based  cross-modalmodules

surrounding

voidspace

withdifferent  information

3Durbanblock  model

Voxelbuilding  modelwithinternal  spatialdivisions

singlepublicbuilding  withinternalspatial  divisions

<p> </p> Title Method Traininginput Scopeofapplication Output
ANN Vector Output  format
high-risebuilding
volume pointsandUV  surfacemodel
2DGAN Vector
blockvolume
layersofimage
Voxel 3DGAN voxelmatrix
high-risebuilding  volume
Voxel
Figure 3Dvoxelmodel
graph
buildingvolume 2DGAN Voxel block
newbuildingsinthe

Literature Review_2D generation

boundary bothsingleandlarge  apartment roomconfigurationwith  detailedfurniture

Architecturallayout  designthroughdeep  learningandagentbasedmodeling:A  hybridapproach

Pix2Pix+cGAN boundary/room  relationship/roomarea

House-GAN++ GANs+  Convolutional  message  passing

roomrelationship

roomconfiguration

boundary/room  relationship/room  location

HouseDiffusion roomrelationship

usionModel

Graph-Constrained  HouseGeneration graphTransfor mer roomrelationship

Pix2pix corridorline/room  area/room  relationship(optional)

roomconfigurationwith  doorposition

roomconfigurationwith  doorposition roomconfigurationwith  doorandwindow  position roomconfiguration

bothsingleapartment  andpublicbuildings

<p> </p> Title Method Userinput Scopeofapplication Output
Raster Outputformat
ArchiGAN Pix2Pix
singleapartment Graph2plan
Vector singleapartment
Ourwork
Vector
Vector
GNN+GAN
GAN singleapartment singleapartment Vector
Raster
floorplanGAN
roomfunction/area
Vector
singleapartment
Figure
roomconfiguration
singleapartment Vector roomconfiguration

Research Objective

Initial idea/ Spatial feature/ Limitation/ Ideal outcome

Research Objective

Most of the previous research started from the relationship between architectural  spaces and reconstructed a plane by letting the user decide some basic information of  the room, such as function, area, and adjacent relationship between rooms. For the  single apartment building plane, this condition enough to produce good results.

However, for other building types such as museums, shopping malls, hospitals, etc.,  traffic circulation is an important element that runs through the space. This study  attempts to introduce another condition on the basis of satisfying the basic constraints,  focusing on the close relationship between the building plane and its traffic space.

Comparison with previous studies, this research will solve this :

1, This research attempts to find a more precise method to capture building features and learn from it.

(both applies to 2d and 3d)

2, not only single apartment, but also explore the possibility to generate public buildings.

3, In addition to meeting the basic conditions for rational building generation, this study will also  introduce ‘circulation’, which is an important element of public buildings.

Public building's configuration follow with their circulation

First propose

room geometry

Adjacency Matrix: a matrix with rows and columns labeled by  graph vertices, with a 1 or 0 in position according to whether and.  are adjacent or not.

Can we use different matrix to reprsent some information?

rooms relationship between each other

room function/area

Distance matrix Adjacency matrix + +
? matrix

Initial workflow

UserInput

1.Drawa referencelineforcorridor.

2.Definethe grossfloorarea(sqm)

3.Definethe entrancelocation

4.Inputthe occupancyratioofdifferentfunctions

5.Inputseed:trydifferentexteriorvolumes

DatasetgenerationinGH

GHGeneration

Distancematrix Labelmatrix Adjacencymatrix Pix2pixModel Predictionimage Inputdataset Groundtruth Adjacencymatrix Distancematrix Labelmatrix
Function

Limitation

But when I start dataset and training , there is some problems:

Lack of real 3D building datasets

Due to the pixel limit of the pix2pix model, it cannot handle large public  buildings with more than 512 feature points.

Considering that the standard floor plan of a public building can represent the layout  of the entire building in general. Therefore, this research will first start with the  generation of 2D floor plans, verify the possibility of this methodology, and propose a  feasible solution for subsequent generation of architectural 3D space.

What's the outcome?

A plan generator that flows with the corridor

user input(constrains) expected outcome

1. Draw a reference line for corridor

2. Define the function and area you want

room01: 28sqm

room02: 7sqm

room03: 13sqm

room04: 18sqm

room05: 16sqm

room06: 14sqm

3. Define the relation of these rooms if you need

Plan configuration result

?

Methodology

Pix2pix model/ Workflow

Methodology_pix2pix model

2D GAN, unsupervised learning, allows learning of adjacency matrix images. pairs of data, with clear output and input, allowing the establishment of a  connection between constraint and outcome.

2D GAN architecture

Methodology_ workflow

roomlabel,roomshape,roomarea,relationbetweenrooms

Datasetgeneration

B200 Input

Labelmatrix Distancematrix Adjacencymatrix

Ground truth

Pix2pix Model Predictionimage

Labelmatrix Distancematrix Adjacencymatrix

A200
training:2004pairsofdata test:802pairsofdata Output
ReconstructioninGH Input image + magnetizing Grasshopper
...16348rolls
27nodes,68edges
...16348rolls
35nodes,64edges
roomlabel,roomshape,roomarea,relationbetweenrooms

Dataset generation Data

generation/ Feature embed

First consider_open dataset

Without labeled corridor information. Lack of dataset on public building plans

Dataset
RPLAN dataset FloorPlanCAD

Embed feature

Here we use nodes and edges to depict a building information.

Nodes connections(yes/no) room

room label, room shape, room area, relation between rooms

Newtable Roomtype Room01 Label Labelinpixel  matrix(0-1) 1 2 Room02 Room03 Room04 Room05 Room06 Room07 3 4 5 6 7 0.777778 Corridor 0.888889 8 0.11111 0.22222 0.33333 0.44444 0.555556 0.666667 1 9 Others Nodesdistance/edgelegnth room label area3=25 area2=9 area1=17 area4=16 area5=16 area6=23 area7=20 1 1 1 1 2 2 2 2 3 3 3 3 4 4 4 5 5 5 5 6 6 6 6 7 7 7 7 8 8 8 8 8 8 8 8 8
edge label
room relation/room geometry
geometry
relation/room
Label matrix
Distance matrix Adjacency matrix

Got input dataset

Output dataset (result from plugin)

area7=20

area4=16

area6=23

area5=16

Area/room label

area4=16

Obtain corresponding Input dataset

area7=20

area5=16

area2=9

area3=25

area1=17

area6=23

area2=9

area3=25

IfuseKangarootosimulatetheseconstrains  andgenerateresult,youcan'tgetperfect  result.

area1=17

Spatial Adjacency

User Input representation

1. Draw a reference line for corridor

2. Define the function and area you want

room01: 28sqm

room02: 7sqm

room03: 13sqm

room04: 18sqm

room05: 16sqm

room06: 14sqm

3. De

Dataset Variation

Around 2000 pairs of data with different area, rooms and configuration

Input Input Input Output Output Output

Training

Prediction results/ Reconstruction/ Problems

Training start

Distance matrix

Step:8999

Generator loss: 8.926547394154905

Generator l1 loss: 5.807867540837871

Discriminator loss: 3.611856884098233

Label matrix

Adjacency matrix
image
image
truth Prediction image Input image Ground truth Prediction image
Input image Ground truth Prediction
Input
Ground

Adjacency matrix

1st Training result _433,999

steps

Step: 433999

Generator loss: 7.69580344655172

Generator l1 loss: 4.187161721570787

Discriminator loss: 4.823407427206053

Label matrix Distance matrix
truth
Input image Ground truth Prediction image
Input image Ground truth Prediction image Input image Ground
Prediction image
Most of generation result has distortion. Prediction 01 Prediction 520 Adjacency Distance Label ≈ 0.111111 (label 01)

Prediction Result

Adjacency matrix

Distance matrix

Label matrix

Input image Ground truth Prediction image

2nd Training result

_988,999 steps

Adjacency matrix

Distance matrix

Step:988999

Generator loss: 7.494118938771732

Generator l1 loss: 3.8295014311102595

Discriminator loss: 4.693514201845212

Label matrix

Prediction Result

Adjacency matrix

Distance matrix

Label matrix

Input image Ground truth Prediction image

Prediction 255

Prediction 655

389

Prediction 430

Generation result still
distortion, but work better than before.
has
Prediction
Reconstruction in GH

User Input AI

Generated Outcome
reference line
rooms and area
room relations area(sqm) 29.5 15.3 14.9 12.6 9.9 23.2 32.4 / Newtable Roomtype Room01 area(sqm) 43.6 12.8 Room02 Room03 Room04 Room05 Room06 Room07 17.8 13 9.4 26.6 29 Corridor /
Reconstruction in GH AI
Input
Input
Input
Generated Input

Conclusion & Discussion

Conclusion/ Limitation/ Potential and Future work

The method used in this study allows ML to accurately capture the shape relationships of  the building plan, such as the foot points of the room, the center point of the room and the  edges which is necessary to form the shape of the room. Theoretically, most linear  geometric shapes can be expressed by the nodes and edges on their boundary. Therefore, compared with methods in some previous studies, the model after deep training  should have the ability to accurately reconstruct complex spaces.

These multiple channels in Pix2Pix model allow us to learn more layers of information

In this study, we added a new layer of channel that can identify room labels based on  adjacency matrix theory. This study verified its feasibility. This also means that it is possible  to add more layers of information to the learning object to generate more complex models.

Conclusion
.

Go back to 3D generator

Theoretically, this methodology is also applicable to the reconstruction of 3D space.

Although this article does not continue an in-depth study on this, it is worth noting: for 3D  generation, maybe we need use pix2pix HD model, which allow max 1024 feature nodes to  depict a building. Of course, 3D space generation is more complicated than 2D. Whether the  coding method needs to be modified requires some further studies.

transfer format training

Limitation

1, Pix2pix HD Model can deal with the image size of 1024 dpi. This generator  cannot generate too big or too complex 3D buildings which has more than  1024 feature nodes.

2, This method has relatively high requirements for the depth of model

training. In the adjacency matrix, a small pixel error will cause a relatively large  deviation. And obtaining an accurate distance matrix often takes longer to  learn.

1, The previous research has shown that this method is feasible. Next, we can  increase the training time or find a dataset that is more consistent with the actual  situation and retrain the model to make the results more ideal.

2, Not only for the floor plan. How to use this method in the generation of 3D  space requires further exploration.

3, It allows us to add more channels for different information. So, change or add  more different constraints( sun hours, surrounding), let users control or interact  with generator more intelligent.

Potential & Future work

THANKS !

Turn static files into dynamic content formats.

Create a flipbook
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.