Automatic reconstruction of heritages in South Yorkshire: From 2D Image Processing to 3D Built Environment Modelling Zixing Yang Registration Number: 140214741 Supervisor: Dr. Tsung-‐Hsien Wang MSc Digital design and interactive building environment School of Architecture University of Sheffield Sheffield, UK September 2015
ACKNOLEDGEMENT I would like to give my special thanks to my dear friends Jiashu Yao and Chunqi Zhang. They encourage me a lot through the process of writing this paper. I also would like to thanks Dr. Tsung-‐Hsien Wang who is my supervisor of this paper. He gives me lots of suggestions and helps which I really appreciate.
1
ABSTRACT Nowadays, in the field of heritage conservation, digital technologies have been widely applied. People use digital technology to gain necessary information of heritage. Heritage building conservation in the UK is highly developed in recent years since thousands of heritages were numbered and shown online with fruitful academic achievements. However, there is a gap between real buildings and online reference. People, including college students and archaeology amateurs, cannot easily identify these heritages without solid professional knowledge. Moreover, the existing reports of conservation characterizations lack metadata, which is harmful for heritage documentation. Lacking in budget of equipment and laboratory operation, more detailed survey cannot be conducted. With 2D modelling technologies, the building information could be easily gained in a short time. It provides us with a great opportunity to automatically reconstruct building in real world. This paper aims to explore the possibility of using 123D (Autodesk software) to gain 3D data of building and to recognize the characteristics of Tudor Architecture (1485-‐1603) in South Yorkshire. Furthermore, the data, including additional colour data, may help to build digital catalogues in grasshopper and return to users.
KEY WORDS: 2D image modelling, automatic reconstruction, heritages
2
CONTENT INTRODUCTION……………………………………………………………………………………………………………………………….08 HERITAGE CONSERVATION IN SOUTH YORKSHIRE………………………………………………………………………….11 SOUTH YOKSHIRE HERITAGE CONDITION…………………………………………………………………………………………………….11 HERITAGE SURVEY…………………………………………………………………………………………………………………………………13 CHARACERISATION AIMS AND OBJECTIVES………………………………………………………………………………………………….14 CURRENTLY MISSING …………………………………………………………………………………………………………………………….14
CONSIDERATION FOR THE HERITAGE AUTOMETIC RECONSTRUCTION………………………………………….16 TUDOR HOUSES……………………………………………………………………………………………………………………………………16 BISHOP’S HOUSE………………………………………………………………………………………………………………………………..17 THE OLD QUEEN’S HEAD………………………………………………………………………………………………………………………17 GEORGIAN ARCHITECTURE………………………………………………………………………………………………………………………18 PARADISE SQUARE……………………………………………………………………………………………………………………………..19 VICTORIAN ARCHITECTURE……………………………………………………………………………………………………………………..19 BUILDIG FEATURES IDENTIFICATION………………………………………………………………………………………………………….20 BUILDING FEATURE GROUPING………………………………………………………………………………………………………………..20
DIGITAL TECHNOLOGY APPLICATION IN THE FIELD OF CONSERVATION…………………………………………21 EARLY STAGE DEVELOPMENT…………………………………………………………………………………………………………………..22 DIGITAL GEOMETRY CONSTRUCTION…………………………………………………………………………………………………………22 PROCEDURE MODELLING………………………………………………………………………………………………………………………..23 AUTOMETIC RECONSTRUCTION………………………………………………………………………………………………………………..25 THE DIGITAL TECHNIQUES APPLIED IN CONSERVATION AREA ………………………………………………………………………….27 RESEARCH AIMS AND CONTRIBUTIONS………………………………………………………………………………………………………27
METHDOLOGY…………………………………………………………………………………………………………………………………29 PART ONE: BUILDING PROFILE IDENTIFICATION…………………………………………………………………………………………….30 BUILDING FEATURES RETRIVIL……………………………………………………………………………………………………………….31 TUDOR ARCHITECTURE………………………………………………………………………………………………………………………..32 GEORGIAN ARCHITECTURE……………………………………………………………………………………………………………………34 PART TWO: DEVELOPING 2D TO 3D AUTOMETIC RECONSTRUCTION PROCEDURE………………………………………………….35 STAGE ONE – TO BUILD PROFILED AND 3D BUILDING MESH RECOGNITION……………………………………………………….37 DEVICES SELECTION – 123D CATCH ……………………………………………………………………………………………………..37 DEVICES SELECTION – 123D MAKE ………………………………………………………………………………………………………38 2D IMAGE MODELLING…………………………………………………………………………………………………………………….40 STAGE TWO – BUILDING MESHES PROCESSING………………………………………………………………………………………….40
3
STAGE THREE – BUILDING INFORAMTION INDENTICATION AND RETRIEVAL………………………………………………………41
DEVELOPMENT OF RECONSTRUCTION……………………………………………………………………………………………42 INDENTIFICATION OF THE INPUT PARAMETERS…………………………………………………………………………………………….42 DESIGN INPUTS…………………………………………………………………………………………………………………………………….44 DESIGN PARAMETERS…………………………………………………………………………………………………………………………….44 DESIGN RATIONALIZATION……………………………………………………………………………………………………….……………..45 ALGORITHM DEVEOPMENT………………………………………………………………………………………………………………….….45 EVALUATE MESHES AND SET INTERSECTION PLANES……………………………………………………………………………………..46 GET CUTTING LINES AND TEST THE CLOSED……………………………………………………………………………………………..…47 TEST THE BUILDING TYPE…………………………………………………………………………………………………………………….…48 RESULTS ANALYSIS…………………………………………………………………………………………………………………………….…49
DISCUSSION……………………………………………………………………………………………………………………………………52 CONSTRAINTS OF 2D IMAGE PROCESSING SOFTWARE………………………………………………………………………………….52 BUILDING PROFILE IDENTIFICATION………………………………………………………………………………………………………….53 AUTOMETIC RECONSTRUCTION………………………………………………………………………………………………………………54 3D MODELLING PROCESS………………………………………………………………………………………………………………………55 MULTI-‐PLATFORM CORPORATION…………………………………………………………………………………………………………..56
CONCLUSION…………………………………………………………………………………………………………………………………57 FUTURE RESEARCHES…………………………………………………………………………………………………………………………..58 OVERALL ACHIEVEMENTS……………………………………………………………………………………………………………………..59
BIBLIOGRAPHY………………………………………………………………………………………………………………………………60 APPENDIX A…………………………………………………………………………………………………………………………………..63
4
LIST OF FIGURES Fig. 1. Heritage at Risk. This written report can be accessed through web. Source: (Risk & Register n.d.) ……………………………………………….…….…………………………………………………………………………………………12 Fig. 2. Heritage at risk in Yorkshire and Humber. Source: (Risk & Register n.d.)……………………………..13 Fig. 3. Bishop’s House. Source: Author……………………………………………….…….…………………………………….17 Fig. 4. Queen’s Head. Source: Author……………………………………………….…….……………………………………….17 Fig. 5. Left: East side buildings. Source: Author……………………………………………….…….………………………..19 Fig. 6. Right: North side buildings. Source: Author……………………………………………….…….……………………19 Fig. 7. The floor polygon data are shown in GIS system. Source:(Steadman 1993)………………………….22 Fig. 8. 3D sculpture using fingers to stretch model. Source: (Sheng et al. 2006)……………………………….23 Fig. 9. Identify the proportion of facades and opening Source: (Dore & Murphy 2013) …………………..24 Fig. 10. Testing classical proportions using orthographic imagery from surveyed classical buildings. Source: (Dore & Murphy 2013)……………………………………………….…….…………………………………………………24 Fig. 11. The appearance of the Battistero deli Ariani. Source: (Manferdini & Galassi 2013)……………..25 Fig. 12. Capturing image inside the Battistero deli Ariani. Source: (Manferdini & Galassi 2013)……….26 Fig. 13. Point Cloud from laser scanner. Source: (Manferdini & Galassi 2013) …………………………………26 Fig. 14. The picture shows shape grammar for a typical column. Source: (Mitchell 1990) processed by author……………………………………………….…….………………………………………………………………………………………31 Fig. 15. Tudor House doors ratios. Source: (Old et al. n.d.) ……………………………………………….…….……..32 Fig. 16. Tudor House windows ratios. Source: (Old et al. n.d.) ……………………………………………….…….…32 Fig. 17. Three wide window grouping. Source: (Old et al. n.d.) ……………………………………………….………33 Fig. 18. Four wide window grouping. Source: (Old et al. n.d.) ……………………………………………….…….….33 Fig. 19. Tudor House’s wall framing. Source: (Yorke 2009) ……………………………………………….…….……..34 Fig. 20. Georgian House building wall proportion. Source: (Design et al. 1827)………………………………34 Fig. 21. The diagram shows the procedure of 2D to 3D automatic reconstruction. Source: Author…36 Fig. 22. Autodesk 123D CATCH mobile phone APP. Source: Author…………………………………………………37 Fig. 23. Autodesk 123D MAKE editing the Bishop’s house. Source: Author………………………………….….39 Fig. 24. Autodesk 123D MAKE editing the Queen’s Head. Source: Author………………………………….……39 Fig. 25. Autodesk 123D MAKE editing the Paradise Square. Source: Author……………………………………39 Fig. 26. A loop of Bishop’s House. Source: Author………………………………….……………………………………….40 Fig. 27. The reconstructed mesh in Rhino. Source: Author.…………………………………………………………….43
5
Fig. 28. The inputs for building feature recognition. Source: Author……………………………………………….44 Fig. 29. The windows data input. Source: Author ……………………………………………….………………………….44 Fig. 30. The data flow logic. Source: Author ……………………………………………….…………………………..……..45 Fig. 31. The grasshopper definition of this step. Source: Author……………………………………………….…….46 Fig. 32. The process of set the intersection planes. Source: Author………………………………………………….47 Fig. 33. The grasshopper definition of this step. Source: Author……………………………………………….……..47 Fig. 34. The process of eliminating unnecessary outlines. Source: Author……………………….………………48 Fig. 35. The procedure of eliminating the incorrect lines. Source: Author……………………….……………….49 Fig. 36. The different output data of different building type. Source: Author……………………….………….50
6
LIST OF TABLES Table. 1. Objectives of Bishop’s House and Queen’s Head Source: Author……………………….……………..18 Table. 2. Building features comparison. Source: Author……………………………………………….…….……………20
7
CHAPTER 1 INTRODUCTION Simplicity is not simple. As computer technology develops, platforms serving creative design are becoming more and more common to people. It means that gaining a lot of pre-‐education on the platform is not necessary now. The platform becomes smart enough to fulfil people’s needs. Even the five-‐year-‐old child can quickly 3D print his portrait on specific platform. As a result, the more automatic the platform is, the more it breaks the boundary between professional and unprofessional users. The 3D scanning technology appeared in the early 21st century, which triggered the complex geometry architecture to develop. Similarly, the technology also helps people detect the local heritage cracks and relevant details in Archaeology. Not only is the achieving process time-‐consuming, it requires high skill as well. However, the heritage conservation is a common issue always calling for people to get involved. The theories of conservation are more acceptable than the tools people conduct. There is a study showing that by enhancing the public awareness of conservation, there will be stronger influence on heritage conservation. (Nyaupane & Timothy 2010) To let more people contribute to this public utility, a more simple and automatic platform allows people to get start easily. This platform should be designed simply but has great potential to complete complex heritage conservation. And the consequences of conservation and a new platform revolution will draw attention from the public. This paper is mainly about the automatic conservation platform building and local heritage resources identification. South Yorkshire stands in the centre of UK, considered as one of the most important heritage conservation areas in the UK. As a result, a specified strategic policy was published to adapt to the risking conditions of South Yorkshire heritages. The aim of this report is to identify the heritage area characteristics and to establish a GIS database. However, the weakness of the paper is metadata missing. As a result, the researcher cannot track single building construction details, and
8
the characteristics of each building could only be written in words. The 3D heritage model data which are called metadata in the report could be a support for building typology study. (South Yorkshire Archaeology Service 2005) People who need to reconstruct the heritages or will clone the same building style for their own house may take advantage of such typology study. Furthermore, this study could be treated as a fundamental digital heritage building catalogue establishment materials. However, recording all detailed information of heritages building in this area is so challenging because of its large quantity and shortage of skilled people. 2D image modelling is a shortcut to 3D database building in digital design area. It is such a simple platform that people with no algorithm background can also handle. It mimics 3D scanning technology by taking photos from different angels. Then, the model would generate automatically and send the photos to cloud, so people can download very quickly. During the whole process, there are no human intervenes, but only computer calculation. Meanwhile, the output model could be further manipulated on other platforms. 2D image modelling would be a great option to solve the problems of heritage building feature extraction. Hence, the research question in this paper is: How can digital tools help automatically retrieve heritage building information with the purpose of 3D model reconstruction? There are several objectives related to the question above that need to highlight: •
The development of South Yorkshire heritage conservation.
•
To identify the heritage building features that could be recognized.
•
Digital selection to satisfy the need of the task.
In conclusion, the research mainly focuses on simplifying digital technique and assisting heritage reconstruction. By evaluating the existing digital tools that were conducted in arachnology, we could develop a new scenario for heritage reconstruction. In the end, the output of this research would
9
not only benefit the archaeology development, but also enhance the public awareness of heritage building conservation.
10
CHAPTER 2 HERITAGE CONSERVATION IN SOUTH YORKSHIRE Heritage conservation is a very important issue in England. In the 15th to 17th century, the first printing catalogues named English Short Title were made to keep the data of every aspect of research including architecture. (Petchey 1999) This could be seen as the first time people trying to keep track of human creating wealth in buildings. However, according to Petchey, the archaeological site was damaged or destroyed every day from the year 1945. (Petchey 1999) This is mostly due to lacking sense of sustainable development. As people realized the importance of protecting the building at risk, they paid a lot of efforts on heritage conservation from both government and public side. In recent years, the tools and methodology updates also benefit the conservation program. To enhance the understanding of the heritage dimension and manage the changes in the whole archaeological environment, people conduct Urban Survey in rural area, which influenced the latter Historic Environment Characterisation (HLC) in South Yorkshire. (South Yorkshire Archaeology Service 2005) Shaping the modern landscape can be seen as a common approach to manage the heritage environment as time goes by. (Dobson 2012) HLC is conceived as a new mapping system that runs based on GIS. In regard of large-‐scale characteristic recognition, HLC always helps to identify the complexity of certain conservation area. Dobson argues that people could take the advantage of conducting HLC system because of its seamlessly tracking process that would never erase the past data. (Dobson 2012) At the same time, the system provides a narrative fingerprint which contains relative description and photography of important heritages. As a result, it creates chance to narrow the gap between geographic map and reports from the past.
SOUTH YOKSHIRE HERITAGE CONDITION
11
Fig. 1. Heritage at Risk Catalogue. This written report can be accessed through web. Source: (Risk & Register n.d.)
The literature review shows that since 1994, people have started historic characterization project among Cornwall area by utilizing GIS technology. (South Yorkshire Archaeology Service, 2005) According to Heritage at risk 2012, there were 9,700 conservation areas in England which were considered as important components to build local identity and cohesive community. (Risk & Register n.d.) Within these areas, there are 3.0% of grade II listed buildings are at risk. In particular, the number in Yorkshire rose to 91 buildings in 2012. (Risk & Register n.d.) To stop heritage buildings from degrading, the local authority set a series of protection plan that was firstly conducted on 15 pilot projects. With this successful approach, they decided to continue with the rest of Grade II listed
12
buildings in Yorkshire area, which will get more people involved. (Risk & Register n.d.) To complete the task, the authority probably needs more efforts on technology updating than on hiring.
Fig. 2. Heritage Conservation area that the paper mainly focus on. Source: (Risk & Register n.d.) Processed by author.
The picture above depicts the conservation areas in Yorkshire, and the yellow circles are South Yorkshire areas. Specifically, the significant feature of South Yorkshire is its long-‐history steel industry culture. Thus, the reflection on the urban scape and settlement patterns is very distinctive. (South Yorkshire Archaeology Service 2005) Considering this, more specific work on building type and detailed pattern analysis will contribute to bigger scale of Urban Survey.
HERITAGE SURVEY
Typical Urban Survey is always conducted on a certain scale. For example, in South Yorkshire historical characterization case, the polygon sizes are around 5-‐10 inches. And for rural area, the mapping scale would be much smaller. (South Yorkshire Archaeology Service 2005) As a result, there will be three main products that the final reports will include:
13
•
Broad character type
•
Attributes
•
Historic environment character
This project provides us with a basic example to understand the possibility of how digital tool helps to achieve in current Archeology and to give us guidelines on future improvement.
CHARACERISATION AIMS AND OBJECTIVES As the paper mentioned before, the HLC system makes numerous differences in recent protection activities. (South Yorkshire Archaeology Service 2005)There are a few that need to highlight to better understand the current situation and give guideline on future development: •
Other datasets (e.g. land use, architecture, environment, building material and condition) have access to GIS data.
•
A bigger community and organization could use the existing data as interpretive tool for various purposes.
•
The GIS-‐based platform is a fast and inexpensive way to finish the digital mapping.
•
Public could access to the dataset and final products of the survey through Internet.
CURRENTLY MISSING As discussed before, the current principle of heritage conservation is still developing. More precisely, something still needs to improve in the technique area. •
Detailed character type is missing. GIS data could only format the heritage distribution maps on a relative large scale. When the archology research comes to segment reconstruction and conservation level, the existing materials could not fulfill their needs.
14
•
3D heritage building model is missing. As South Yorkshire is a large conservation area with a great quantity of heritages. It is hard to get all 3D models heritage in a short time. Instead, the authority only provides verbal reports for government and commercial use.
Current situation in South Yorkshire can improve a lot. It has done a massive solid work and obtained a lot of information, people participating in the future town plan can get a basic understanding of the existing conditions. Meanwhile, the missing part listed above also shows promising possibility of heritage dataset updating if people get more digital technologies involved in the urban survey. In chapter 4, a more specific discussion would build on this topic.
15
CHAPTER 3 CONSIDERATION FOR THE HERITAGE AUTOMETIC RECONSTRUCTION To get a thorough understanding of heritage buildings in South Yorkshire conservation area, the heritage building type research is needed. This chapter gives a basic guide of local heritage building features that could be further implemented in the reconstruction phase. According to Milton, three-‐way classification of building type is recommended. They are activity, fabric / construction and building form. (Steadman 1993) Hence, the building form is chosen as the heritage building classification method in this case. Three main building types appeared in England history in the sequence below. They are:
•
Tudor Houses (1485 – 1603)
•
Georgian Architecture (1714 – 1830)
•
Victorian Architecture (1837 – 1901)
TUDOR HOUSES Tudor Houses appeared during the era of Tudor ruling England. It was characterized with black timbers and white panels, because wood and mud are the easiest to get at that time. However, there are a lot of colonies after Tudor Houses, which are called ‘Mock Tudor’ or ‘Tudor Revival’. These houses kept basic geometrical features of the original Tudor architecture, but are not as perfect as the one later. (Jones 2014) There are numerous elements that could help to tell if it came from Tudor Houses:
•
The upper story extends out farther than the lower one
•
Small paned windows
16
•
Steep pitched porch
•
Multi paneled door
•
Decorative cornice and chimneys (Jones 2014)
In terms of small paned windows, some statistics could summarize the rules of its arrangement: …”The earliest glazing was made up of diamond shaped panes of approximately 125*175mm, and rectangular quarries were introduced in the 17th century. Usually about 180*130mm in size and these quarries can be found up to 200*140mm.” (Jack Bowyer 1980)
Fig. 3. Left: Bishop’s House. Source: Author Fig. 4. Right: Queen’s Head. Source: Author
BISHOP’S HOUSE
Bishop’s house was one of the most well-‐known timber framed houses in Sheffield. It was located in Norton Lees district. Two families owned the house together. It was built in 1500 and the north wing
was rebuilt also in the same year. Meanwhile, it was also conceived as a very typical Tudor Architecture as well as a Grade II listed building. THE OLD QUEEN’S HEAD
17
The old queen’s head is a timber-‐framed public house in the city of Sheffield. It is located on Pond Hill. It was built in 1475, which was thought to be the oldest Tudor House.
Representative Pattern
Bishop’s House
Window Grouping Proportion Ratios (With trim) Paned Types
4 1:4
Queen’s Head
Diamond paned
5 1:4
Diamond paned
Table. 1. Objectives of Bishop’s House and Queen’s Head Source: Author
GEORGIAN ARCHITECTURE In James’s book Georgian Architecture in the Britain Isles, the term ‘Georgian Architecture’ is associated with a kind of brick-‐fronted houses. Other significant features of this kind of building are its white-‐painted elegant sliding sash windows and cast-‐iron balcony rails on the first floor. (Curl 2011; Richard Reid 1989) The reason why the sash window is subdivided into such small panes is that the manufacturing technique is not matured at that time. As a result, people have difficulties in making large windows otherwise the cost would be extremely high. Most of the sash windows share the same sizes unless the owner prefers to articulate the principle rooms. (Richard Reid 1989) The proportions of windows especially for small houses are usually 1.15-‐1.45 times their width. (Richard Reid 1989) And its thickness is always less than 100mm. More features of the Georgian Architecture are listed below:
•
Symmetrical windows and chimneys
•
The front door is in the center
•
Hipped roofs
18
There is an example to help explain the features of Georgian Architecture in detail. PARADISE SQUARE
Paradise Square is a Georgian style square for public meeting. It is located to the northwest of Sheffield Cathedral. The buildings on the east of the square were built in 1736 by Nicholas Broadbent.
Fig. 5. Left: East side buildings. Source: Author Fig. 6. Right: North side buildings. Source: Author
VICTORIAN ARCHITECTURE Victorian architecture has a common feature, which is against the symmetrical rule. During this period, the architects were supposed to use more colorful bricks for exterior walls. The front door tends to be set in pairs rather than on the same side. (Old et al. n.d.) This is a typical change from the past. Meanwhile, the architecture applies more advanced materials, like steel. The glazing industry is pretty alike, which allows the sash window to use larger paned glasses.
19
BUILDIG FEATURES IDENTIFICATION Representative Essential Elements Wall Cladding Roofs Windows Doors Symmetry Chimney
Victorian Architecture (1873 -‐ 1901) The Lyceum Theater Gothic elements
Georgian Architecture (1714 -‐1830) Ashdell Road terrace Pillars in the front of the house
Brick/Colour material
Tudor Architecture (1485 -‐ 1603) Bishop’s House Black timbers and white infill panels Timber and clay
45 degree pitch Large paned windows Door lantern
Steep-‐pitched porch Small paned windows Multi-‐panelled door
No Paired chimney (aside)
No Ornate chimney
The hipped roofs Sash windows A panelled front door in the centre Square symmetrical shapes Paired chimneys (century)
Brick/Wood
Table. 2. Building features comparison. Source: Author
The table depicts the main differences among the three building types. For chimneys, the chimney in Georgian period rose from each side of the roofline instead of from the central. Meanwhile, the Victorian Architecture windows always got small ones on the top of the floor, (Jones 2014) while Tudor Architecture and Georgian Architecture always have windows of the same size. More specifically, windows in Victorian Age had large panes, however, in Tudor Age, the windows had small panes.
BUILDING FEATURE GROUPING The discussion above gives us a clear picture of the three building types. The classification mostly focuses on materials, structures and elements. There is no doubt to point out a building type. The more detailed information we get, the more accurate result we gain. Since each heritage building has significant features grouping method, summary for these “key features” will benefit the archology work in the future.
20
CHAPTER 4 DIGITAL TECHNOLOGY APPLICATION IN THE FIELD OF ARCHAEOLOGY This chapter comes to compare the digital technology that is implemented in Archaeology. Then, we keep analyzing their potentials and limitations to help choose the proper technology that can be used in this paper.
EARLY STAGE DEVELOPMENT In 1993, Milton suggested that the computer could serve the architectural design by storing the information of every building. (Steadman 1993) It is supposed to be a significant step in British building database setting. In particular, the building is defined as several layers of devices when the floor polygon is used as an input of the survey. However, during the urban survey, only a few manual techniques were conducted. People took photos, inspected the target building, and gained supplementary data from trade and business directories. (Steadman 1993) All in all, this early trial showed how the building information could be classified and processed in storable database. As discussed above, the dataset building is the key part of tracking the information of buildings. Apart from the manual survey, as the technology developed in the 21th century, drawing started the area of man-‐machine communication. (Sutherland 1963) After developing for half a decade, the 2D input system was soon replaced by 3D input system.
DIGITAL GEOMETRY CONSTRUCTION Two resources are needed in the heritage conservation, which are documentations and geometry. (Matías et al. 2013) After a fully development of 2D documentation digitalization, 3D digital tools utilizing era is coming. 3D scanning and 3D sculpturing both use digital software to model complex
21
geometries. People working in this field nominated a new phrase called “interactive fabrication”, which is to say, the computer output is moving beyond the two dimensional objects. (Willis et al. 2011; Follmer et al. 2011) The traditional UI diminished at this time.
Fig. 7. The floor polygon data are shown in GIS system. Source:(Steadman 1993)
In the 3D sculpturing area, people have a variety of approaches to three-‐dimensional data input. The most common one is from hand gestures. Surface Drawing is conceived as a 3D Motions Modelling created for artists to liberate their hands in the year of 2001. (Schkolne et al. 2001) Then, in professor Jia’s paper, the Vicon motions capturing system also enables people to interact with virtual 3D models, but add more specific functions, such as Rotation and Scaling. (Sheng et al. 2006) After that, two hands are available and even the body gesture could be conducted. (Kim et al. 2005; Zhang et al. 2013) Recently, in 2014, the mixed real environments of fabrication came out, which created a complete procedure from data input to 3D printable model output. (Weichel et al. 2014)
22
Fig. 8. 3D sculpture using fingers to stretch model. Source: (Sheng et al. 2006)
3D scanning is another design media that brings natural and man-‐made textures into production. (Sadar & Chyon 2011) Moreover, when 3D scanning technology combines with the photogrammetry, each mesh that gained by scanning would characterize by color information. This kind of texture mapping has already benefited the historical building reconstruction in the early stage. (Koska & Kremen 2013) In another paper, the author suggests that 2D building floor plan in different history period is necessary for reconstruction as well, besides the geometry data gained from digital tools. (Guidi et al. 2013) This proposal also corresponds with the result of Urban Survey in early stage: 2D resources are needed. However, there are still some technique limitations when people use them, such as accuracy loss and errors. (Zuo & Shi 2010) Others suggest that these problems are in relation to working time, management costs and operating experience. (Cardinale et al. 2013) Besides these weak points, such cutting age technology could also make something extraordinary. The digital model that was created by 3D scanning could also be used in BIM (Building Information Modelling) software, which highly simplifies the reconstruction process. (Ludwig et al. 2013)
PROCEDURE MODELLING Despite the fact that 3D scanning has a great possibility to reconstruct the heritages, it still requires a lot of manual work. (Müller et al. 2006) A more automatic method appeared in recent years, which is
23
called procedure modeling. People could derive the grammar of similar building from another site and automatically reconstruct it. (Müller et al. 2006) The basic methodology of this technique is to use a set of GIS data and 2D maps and to process them with building 2D facades. Then, by dealing with different layers, the facade defined by the location of windows and doors could be split into grids.(Parish & Müller 2001) The dimension of grids then can be calculated as an output of building reconstruction. In this circumstance, 3D scanning could also be treated as data input technique. (Müller et al. 2007)
Fig. 9. Identify the proportion of facades and opening Source: (Dore & Murphy 2013)
Fig. 10. Testing classical proportions using orthographic imagery from surveyed classical buildings. Source: (Dore & Murphy 2013)
24
As the literature review shows above, algorithm is firstly combined with other 3D and 2D data input
technologies in archeology field in the first decade of the 21st century. Drawbacks still exist, for example, if the texture is too small, it won’t be able to be detected or reconstructed. (Leuven 2000) As a result, 2D image aid is necessary at this stage.
AUTOMETIC RECONSTRUCTION To speed up the modeling process, people then turned to algorithm techniques. The data that were obtained from 3D scanning always came into cloud point format. These cloud points provide opportunities for users to reconstruct new meshes of the original building in virtual environments. The process dealing with such points could be automatically manipulated with algorithm platforms. For instance, some people designed scrip that could automatically do 3D modeling in Rhino. (El Meouche et al. 2013) As they proposed, the noise points are eliminated and the remaining points help to rebuild the building outlines. As a result, it simplifies the cloud points during the whole modeling process with minimum manual operation. (El Meouche et al. 2013)
Fig. 11. The appearance of the Battistero deli Ariani. Source: (Manferdini & Galassi 2013)
25
Fig. 12. Capturing image inside the Battistero deli Ariani. Source: (Manferdini & Galassi 2013)
Fig. 13. Point Cloud from laser scanner. Source: (Manferdini & Galassi 2013)
26
THE DIGITAL TECHNIQUES APPLIED IN CONSERVATION AREA As discussed above, there are several significant features that appeared in digital reconstruction field: •
3D scanning technology simplification. No matter 2D image modelling or 2.5D interactive map, the core intention behind developing these techniques is to simplify the existing 3D scanning technology. In long period of time, this technology has a limited user group because of its high cost and inconvenient user interface (UI). The simplified techniques meet the standards of 3D complex geometry reconstruction, and avoid previous disadvantages of cost and UI.
•
Algorithm intervenes in the 3D detailed urban scale model generating. People are more enthusiastic to digitalize all the information they gain to find the rules in compromising objects. Once they have the ideas that how the natural world is operating, they are possibly mimicking their own universe in a virtual world.
•
Devices updating. The 3D capturing and reconstruction software could successfully be built in mobile phones and other portable devices as the technology developed nowadays. Meanwhile, the cloud computing also liberates the memory of personal computers, and brings down the standards of hardware and software.
RESEARCH AIMS AND CONTRIBUTIONS After identifying the needs of South Yorkshire conservation and the limitations of current technology, research aims come about, which is to select a proper technology to reconstruct the heritage buildings in a most time saving, most convenient, and can be applied in a wide community especially. Then, we can get a more precise conclusion on how the research outputs benefit both professional experts and common people.
27
Benefits for professional people:
•
3D metadata corporates with the existing 2D data
•
More adoptable devices and fewer cost
Benefits for common people: •
To improve public awareness of heritage conservation
•
To encourage more people to attend in.
•
A good teaching and learning resources for teachers and students who study Archeology
28
CHAPTER 5 METHDOLOGY The research aim is to digitalize the process of 2D to 3D automatic reconstruction in relation to heritage buildings. The previous chapters have already recognized the current situations of South Yorkshire heritage conservation and pointed out some significant architecture under conservation. Meanwhile, the paper also gives a specific evaluation of digital technologies nowadays that are applied in Archeology. Based on the research, we can summarize the objectives at this stage:
•
The situation of South Yorkshire heritage conservation is still under developing which draws more attention from small scale Urban Survey.
•
More detailed analysis of the local heritage architectures could not only benefit the heritage conservation or reconstruction, but also improve the protection awareness among the public.
•
The technology that is typically applied in the archology field is not the best choice, as the evolution of the software and hardware update. The tools selection would be more delicate which could meet the need of tasks.
•
The building features that are chosen to use for identifying the certain building type should be considered as the one that is totally recognizable from other buildings.
Meanwhile, we can also conclude the main aims of the following research:
•
To analyze the building features that could digitalize for building type recognition
•
To design the procedures of 2D to 3D heritage buildings automatic reconstruction
•
To design the procedures of post-‐process of building type, information retrieval and analysis.
After identifying the objectives and aims of the research, we can further establish our research questions:
29
How can 2D image processing help 3D build environment modelling? There are also following questions to be raised in respond to the research topic: What are the basic building features that could be digitalized and used as data input? What is the best approach to build the procedure of automatic 3D reconstruction based on the existing data input? Based on these questions, the design methodology could acknowledge the materials that are related to the topic and give an abstract guideline for future work. Considering this, the methodology comes into two parts. The first part tries to identify the building features that could be used as parts of the data input. And the second part would highlight the design process of 2D to 3D automatic reconstruction process. PART ONE: BUILDING PROFILE IDENTIFICATION In Chapter 3, a research about local heritage building type has already been done. Generally speaking, there is a great deal of information on each building type. Hence, we need to identify the part that could help us tell exactly the specific building type without mistake. To achieve this target, we shall introduce a building catalog logic which is introduced from William J. Mitchell. William J. Mitchell in his book The Logic of Architecture proposed that the architecture grammar should provide a well-‐formed representation of a class of buildings. More precisely, the shape grammar could be used in various types of composition. Also, if the building forms need to be in the correct way, the classical ratios should be encoded. (Mitchell 1990) William’s classical building classification method gives us a good example of how to reconstruct a building after deriving the rules of its shape. On the other hand, the method that people apply for the construction phase could also benefit in the reverse way. The picture below shows a basic template that William summarized in his book. In his view, an element of a building could be subdivided into several small elements.
30
And each small element has its certain logic to compromise the larger one. This small-‐large building compromising logic has also been applied and repeated in most of the classic building.
Fig. 14. The picture shows shape grammar for a typical column. Source: (Mitchell 1990) processed by author.
As a result, according to William’s theory, different building types can be identified by specific elements. In this order, the building is possible to be reconstructed or identified by recognizing the ratios of specific elements of the building. As a result, the following work comes to identify the possible featured elements for further work.
BUILDING FEATURES RETRIVIL There are several considerations for building features selection: •
The selected features should be exclusive to one building type
•
The selected features could be identified and processed by digital tools
•
The selected features would not be too complex in order to satisfy the limitation of computer storage
31
Since there were a lot of previous studies on heritage building construction, the next step is to look for exclusive features that people have already studied before and to give a basic introduction. TUDOR ARCHITECTURE Doors Ratio The doors’ ratios of Tudor Architecture are always supposed to be 1.0/2.70 and 1.0/2.30
Fig. 15. Tudor House doors ratios. Source: (Old et al. n.d.)
Windows Ratio The window’s ratios of Tudor Architecture are 1.0/2.0 and 1.0/4.0
Fig. 16. Tudor House windows ratios. Source: (Old et al. n.d.)
32
Window Grouping There are differ window grouping method for Tudor Architecture.
Fig. 17. Three wide window grouping. Source: (Old et al. n.d.)
Fig. 18. Four wide window grouping. Source: (Old et al. n.d.)
Wall Framing There are four different wall framing types of Tudor Architecture, which are: Medieval framing, Square panel framing, Kentish framing and Close Studding.
33
Fig. 19. Tudor House’s wall framing. Source: (Yorke 2009)
GEORGIAN ARCHITECTURE Wall Proportion Georgian Architecture is famous for its harmony design of proportion and detail, so there are series of rules on construction facades to follow through centuries. Even in the countries for instance, Russian and America, the rules still exist. (Design et al. 1827) The proportions shown below should be highlight as key building features to be identified.
Fig. 20. Georgian House building wall proportion. Source: (Design et al. 1827)
34
PART TWO: DEVELOPING 2D TO 3D AUTOMETIC RECONSTRUCTION PROCEDURE Because of limited research time, the research would only develop one building type and test the whole reconstruction and recognition process. However, we would also give an abstract design procedure of the building types mentioned above and seek for further development. As a result, the selected building types would give a more precise digital processing introduction in the next chapter. As the diagram shows below, the whole procedures could separate into three steps: •
Stage one: To building profiles and 3D building mesh recognition
•
Stage two: To building meshes processing
•
Stage three: To building information identification and retrieval.
The rest of this chapter would discuss these steps in detail.
35
Fig. 21. The diagram shows the procedure of 2D to 3D automatic reconstruction. Source: Author.
36
STAGE ONE – TO BUILD PROFILED AND 3D BUILDING MESH RECOGNITION This stage involves two different data input, which are building profile data input and 3D meshes input. The building profile data are identified and cataloged previously and 3D meshes would be constructed through several digital tools which are 123D CATCH and 123D MAKE.
DEVICES SELECTION – 123D CATCH As discussed in the previous chapter, 2D image has a great value in modeling in 3D context. More precisely, in recent studies, 2D image could help give the rebuilding mesh its original color. Such process could merge with different inputs and streamline the outputs more efficiently. (Levoy et al. 2000) This technology also gives clues for this paper. Earlier studies conducted a software named Shade from Shading, which could help reconstruct the RGB texture according to the images and reflectance of surfaces. (Fernández 2013) In this case, the most suitable platform for this research would combine the 2D and 3D detection functions as well as low cost. Then, the software that finally been chosen is 123D Catch, developed by Autodesk as an Image base modeling device.
Fig. 22. Autodesk 123D CATCH mobile phone APP. Source: Author.
Compared with the traditional 3D modeling system, 123D Catch has such advantages as below:
•
Minimizes the time and costs
•
Portable devices for information obtain (Smart phone or camera).
37
•
The operation process can be conducted by one person, to cut down the labor expenses
•
Cloud computing allows the image match automatically, which makes the software feasible for common users.
•
Completes the modeling with accurate geometry and correct texture that allow further edit with other software. (Storia & Università 2013; Taibi et al. 2013; Manferdini & Galassi 2013)
There are also drawbacks of this software:
•
Modelling process highly demanded on the image.
•
No human intervene during the image processing phase even when errors occur.
•
Internet connection is necessary otherwise it would not be able to communicate with cloud device. (Casu et al. 2013; Storia & Università 2013)
DEVICES SELECTION – 123D MAKE 123D MAKE is software developed by Autodesk that is used to create and edit 3D creation and prepare the geometry for 3D printing. As results of this, the geometry could be transformed into STL format which could be further edited in other 3D modelling software. The mesh input and editing process are shown as below. Three different building types are all chosen as one typical heritage building (Bishop’s House, Queen’s Head and Paradise Square) as data input.
38
Fig. 23. Autodesk 123D MAKE editing the Bishop’s house. Source: Author.
Fig. 24. Autodesk 123D MAKE editing the Queen’s Head. Source: Author.
Fig. 25. Autodesk 123D MAKE editing the Paradise Square. Source: Author.
39
2D IMAGE MODELLING The workflow for the 2D image modelling consists of three parts: I.
Taking more than eight photos including different angles of the target building. The photos should be in a loop.
II.
Uploading 2D photos to cloud computing to create 3D model.
III.
Roughly Editing the mesh in 123D MAKE
IV.
Exporting the meshes as STL format.
Fig. 26. A loop of Bishop’s House. Source: Author.
STAGE TWO – BUILDING MESHES PROCESSING STL FORMAT STL format can be read by any CAD modelling system which aims to dealing with 3D rapid prototyping. The 3D meshes created by 123D system could be transformed into STL format
40
as well. As a result of this, the triangle meshes that have coordinates with each vertex could be read by parametric design software. PARAMETRIC MODELLING At this stage, the data and relative information that has been collected in the earlier research would be identified as constrains for the geometry processing. Meanwhile, several selected elements would be retrieved from the original mesh to evaluate its characteristics. As the whole process request great amount of calculation and automatic selection, the software used here is Rhino and its plug-‐in Grasshopper. STAGE THREE – BUILDING INFORAMTION INDENTICATION AND RETRIEVAL The last but not the least part is the automatic building type selection. The meshes that processed from the last stage would generate several polylines. These polylines will all be tested as closed or not. Then, under the certain building type, there will be several rules to recognize them. As far as the input mesh fit in the certain rules, the building type could be identified successfully.
41
CHAPTER 6 DEVELOPMENT OF 3D BUILT ENVIRONMENT MODELLING The previous chapter provides the logic of the 2D image modelling process in terms of heritage buildings. This chapter would explain in detail how the heritage buildings could be recognized by 3D modelling software. The selected building type and building features would help to build the 3D identification and recognition algorithm. To give a better understanding of the whole scenario, the chapter is arranged as following steps: •
Identification of the input parameters
•
Identification of the design constrains
•
Development of parametric 3D modelling process
•
Testing of the algorithm
The development of 3D heritages modelling would give a basic solution for identification of building type and features. The scenario below could be seen as an attempt to combine different digital tools together and a guideline to solve such kind of problems. INDENTIFICATION OF THE INPUT PARAMETERS The input parameters are consisted of two parts, the building profile and the real-‐time catching meshes. The second part has been recognized in the previous chapter. Hence, here is the identification of first part: Building Profile.
42
In consideration of the research topic, the building type that chosen here should has got a relative deeper understanding of its features. Meanwhile, there should a testing group to prove the efficiency of the whole scenario. Within these constructions, Tudor Architecture and Georgian Architecture are chosen here which both have variety exclusive characteristics.
Fig. 27. The reconstructed mesh in Rhino. Source: Author.
The picture above shows the building elements that has chance to be identified in the next session. In this research, the windows are chosen as the vital design input, the reasons are elaborated as below: •
There is richer building profile information of windows compare with the other two elements.
•
The input mesh has a quality constrains. As a result of this, the doors are hard to identify by 3D modelling software.
43
•
Some input meshes are deformed especially of the roof area. This objective software constrains make the roof detect more difficult to process.
Within these considerations, the building profile for research is mainly focus on the Windows. DESIGN INPUTS The design inputs get involved with two parts: Building Profiles and Meshes. These could be gained by wide ranges of literature review and site surveys.
Fig. 28. The inputs for building feature recognition. Source: Author.
DESIGN PARAMETERS
Fig. 29. The windows data input. Source: Author.
44
The inputs parameter determine by the building type. More specifically, three parameters are set based on the windows’ dimension. The picture above gives an example of the Tudor Architecture window parameters. The x, y and z are defined as followings: •
X is equal to the height of the Window
•
Y is equal to the width of the Window
•
Z is equal to the depth of the Window
•
G is equal to the girth of the Window
DESIGN RATIONALIZATION The diagram below depicts the design logic, which give a brief understanding of how the input data flow alone the whole procedure. More detailed instructions would be given in the rest of this chapter.
Fig. 30. The data flow logic. Source: Author.
ALGORITHM DEVEOPMENT As shown in the previous diagram, there would be four steps in total of the algorithm development:
45
•
Evaluate meshes
•
Set intersection planes
•
Get cutting lines
•
Test the closed and building type
EVALUATE MESHES AND SET INTERSECTION PLANES
Fig. 31. The grasshopper definition of this step. Source: Author.
As STL format can be processed by Rhino, the meshes that generated by 123D Catch and 123D MAKE could be easily input into it. After that, the meshes in Rhino could be read by the parametric software – grasshopper. The meshes using here is from ‘Old Queen House’ which is Tudor Architecture. To gain the dimension of the input meshes, a Bonding Box is used to set the new coordination system. Based on the fixed points, a series of lines could be built. Also, along with the lines, the intersection plane could be generated. The reason why use parametric design tool to create several intersection planes instead of creating only the certain one is that simplify the building elements outline finding process. The Z Value
46
controls the automatically finding process, which is the windows’ depth of every building type. The input meshes would be cut by these intersection meshes and left the according cutting lines on the surface.
Fig. 32. The process of set the intersection planes. Source: Author.
GET CUTTING LINES AND TEST THE CLOSED
Fig. 33. The grasshopper definition of this step. Source: Author.
After the cutting lines are created, the next, which is the most important step is eliminate the unnecessary lines. Some of the irritated lines are not closed; the others are not window
47
outlines when some of the roof and door outlines also have been cut out. Testing weather the line is closed could easily clean some of them up. Then, setting the certain G Value, which is the girth of the windows as constrains, would dump the rest of the left. The cutting lines that could be used to test the building type would be finally identified after this process. Since there are some limitations of the input meshes that some part of them are not fully reconstructed, the whole target window’ outline cannot be all figured out. As long as some of them are recognized, the testing part could get started.
Fig. 34. The process of eliminating unnecessary outlines. Source: Author.
TEST THE BUILDING TYPE First of all, the comparison group is chosen as Georgian Architecture. As described in the previous chapter, it has great deal of differences with the Tudor Architecture. And on top of that, the proportion of window’s size is the most significant one. The window proportion for
48
Tudor Architecture is always come as 1:2 or 1:4 while the proportion for Georgian Architecture is more related to the distance between the two windows. These features give us great opportunity to identify these two different building types through the scanned meshes. Similar as the procedure of dealing with the Tudor Architecture meshes, the window outline of Georgian Architecture can be retrieved in the same way. The results tables are shown as below.
Fig. 35. The procedure of eliminating the incorrect lines. Source: Author.
RESULTS ANALYSIS This process gives a basic introduction about final statistics processing. Since the previous step a relative coordinates has been built, the statistic generated here is also under that system. There are five statistics groups in the tables and each of them could be defined as following:
49
•
A  and  B  help  to  define  the  width  of  the  window Â
•
C  helps  to  check  if  the  windows  are  in  the  same  plane Â
•
D  and  E  help  to  define  the  height  of  the  window Â
Then,  a  calculation  could  be  done  with  these  statistics:                                         Y  =  THE  WIDTH  OF  THE  WINDOW                                         X  =  THE  HEIGHT  OF  THE  WINDOW                                         Y  =   đ??ľ − đ??´                                         X  =  đ??¸ − đ??ˇ  !
!
If   !  =  4  or  !   =  2,  the  windows  would  be  Tudor  Window,  the  building  type  would  be  Tudor  Architecture,  otherwise,  the  building  type  would  be  Georgian  Architecture.  Â
 Fig.  36.  The  different  output  data  of  different  building  type.  Source:  Author. Â
Â
50 Â
Then, in this case, the final calculation results are: !
Georgian Architecture: ! = 1.3 !
Tudor Architecture: ! = 4.2 The results show a weighty answers to the predictions before which Tudor Architecture are more closely to the desired value. These test could preliminary announce the success of the whole modelling procedure.
51
CHAPTER 7 DISCUSSION This chapter would mainly focus on explaining the research results that the paper has discovered in the previous chapter. There will be separated into four different parts. As the main topic of the research is to close the gap among different resources to enhance the acknowledgment of wilder ranges of people in archeology field, it would be very necessary to identify the accessibility of different resources as well as their values. The previous researches show the limitations and constrains of the digital tool because of objective or subjective reasons. Also, as part of the written resources, the building profile research has been done in the literature review part, thus, the identified building features doing a great help with the building type recognition. Finally, the paper will draw a attention on the mesh reconstruction and 3D modelling process which considered to gain more improvement in the future works. CONSTRAINTS OF 2D IMAGE PROCESSING SOFTWARE The 2D image processing software used in this project is 123D Catch. This project has a great power to transform 2D images into 3D models. However, there still some limited conditions of accessibility that need to highlight: •
The numbers of photo to shoot are no less than eight
•
There is a limitation of the photographed materials. No transparent, reflective or glossy subjects could be used.
•
The photographed subject could not move during the photo taking process
52
•
The photography should be given constant lighting. No overexpose or underexpose are acceptable.
After all, in this research, since the subjects that need to be photographed are facades of heritage buildings, more detailed photos should be taken. The more photos people take the more accurate 3D model people will get. Although on their official website, they suggest manually stich the photos when the cloud computing cannot stich the photos accurately. BUILDING PROFILE IDENTIFICATION The building profile identification is based on the existing building style analysis. In this paper, only three building types are reviewed as an example of the building features analysis. In real archology research, more complex building types are getting involved and the classification methods are various. Speaking of Tudor Architecture, the proportion of the window is one of the most significant features of this building type. For Georgian Architecture, there would be a related proportion between the windows size and the distance to the other window. Similarly, people could retrieve the mathematic issues that could be transformed into recognition features for other building type. With a consideration of the further development in 3D modeling software, if the features cannot be transformed into readable data for computer, they would be abandoned in the latter phase. So far, it is still difficult to find relative materials or reports that could conclude the features exclusive for each type of building. It supposed to be possible to have an official guideline for local heritages recognition. The South Yorkshire archeology group has already done the heritage characterization which has been introduced in chapter two. This report provides us a great opportunity to get in touch with the authority archeology data. At the same time,
53
further work need to be done around the 3D data supplementation and 2D metadata improve. Since there is a lack of the metadata, the 2D to 3D automatic reconstruction procedure built would be challenge. Challenges could be opportunities. The need for deeper understanding of the heritage buildings encourages us to pursue more advantage technologies. In consideration of the large quantity of the heritage building and the cost of the traditional equipment, 2D image processing appears to be the best choice at this stage. AUTOMETIC RECONSTRUCTION The digital tools that are chosen for heritage reconstruction are discussed in Chapter four, each tools has its configurations. This gives people chance to select the best tool to fulfill their own need. Different digital technologies could produce different outputs. Meanwhile, the inputs are varied from kind to kind. Some objectives are concluded for future digital tool selection: •
There is a liberty of the 3D reconstruction area which means more and more inputs media would be accepted by computers.
•
There are still constrains of color mapping which always separated with the 3D scanning process. The future work may focus on how to combine these two technologies to make the 3D reconstruction process more efficiently.
•
The outputs of 3D reconstruction could be processed by BIM software.
•
GIS data combine with 2D maps could also be treated as inputs for algorithm urban reconstruction. If the building textures are too small, it will be very hard to manipulate them.
•
When cloud points as inputs for automatic reconstruction algorithms, one of the most important steps is to eliminate the noise points.
54
The acknowledgement of the most advanced technologies that applied in this area would help people get a more clearly understanding of the certain data flow beneath this topic. After that, more enlightened and creative use for these technologies would be promoted and encouraged. Further, the identification of different use of technology would help build a mature hierarchy of the input data resources. 3D MODELLING PROCESS The reconstructed meshes provide us an opportunity to analysis and recognize the building features of heritages. During this process, parametric tools give a lot of help. As the main purpose of detecting the 3D meshes is taking advantage of this kind of data and make it as useful as possible for researchers. Sometimes, the 3D data could do a great help with the heritage reconstruction. In other cases, it may be used as key information retrieval sources. In this research, the 3D building data is processed by different platforms, such as 123D Catch and Grasshopper. As discussed in the previous session, the 2D image processing part is not as accurate as possible. There may be some key information losing in the process of cloud computing. The losing information would affect the following building feature recognition session. In this case, by introducing the parametric design tools, people could eliminate the noise data in a shorter period. The procedure provided in this paper mainly focus on the intersection plane extraction and final data analysis. Parametric design tools always been treated as complex geometry modeling approach, though it has other powerful functions, such as data processing. The core of parametric design is dealing with the dataflow and manipulates the data in a logical sequence. This data driven design process give an initial example of how the algorithm design tool applied in the design industry. Meanwhile, as the input data usually conceived as a variety dataset combination, the scenario design should make a consideration how to make a good use of different dataset. Similarly in this paper, the dataset
55
comes with two parts, which are the building profile and the reconstructed meshes. The building profile used as testing constrains while the reconstruction meshes provide the characteristic information of specific buildings. An accurate building feature data could make the intersection cutting process more easily. On the contrary, if the building feature data is to rough, the building profile would be hard to recognize. The outcome of the parametric modeling could be treated as an attempt to mimic the procedure of heritage building automatic recognition. The 2D image could not only help reconstruct 3D model but also provide a possibility to link to the online heritage catalogs by identify the certain building features. The linking part has not been finished in this paper because of a limitation of research time. But it could be a good start for other people continues creating the links between these datasets.
MULTI-‐PLATFORM CORPORATION In this research, several design software are applied in terms of the 2D to 3D reconstruction process. Moreover, there are complex data transformation and combination process during whole procedure. People can take the original data source – images from the material world than it can be translated into digital data – 3D meshes. This is one pf the most important steps to bridge the real world and digital world. Then, it comes to make the mesh data recognized by variety 3D modelling software. The key point for this process is making the data format readable to keep the data flowing. As parametric design software – grasshopper is professional in data processing. Huge numbers of work can be done with it. No matter the geometry generation or data analysis, it is a powerful visual algorithm platform. In the previous literature review, the GIS data has already been collected by local conservation authority. Although GIS data could also been input into parametric design software, it could only use to generate 3D urban models. Compare with GIS data, the meshes data that automatically generated by 2D image modelling software has more possibilities to manipulate further. The different data sources weight different in the archeology area. GIS data may more suitable for large heritage area documentation but help less in specific building restorations.
56
CHAPTER 8 CONCLUSION To sum up, the 2D processing to 3D modelling procedure in archeology field has a great potential to optimize and develop. The research in this paper only provides one possible approach to the 3D modelling session. There are variety software that could facilities the heritage building reconstruction phase and post-‐reconstruction phase. Based on a thorough literature review around the local conservation condition and the development of digital technologies, a complete scenario has been built successfully. According to the design context, the lacking of metadata problem in local conservation calls for a research of heritage building type features. There are only roughly written materials for some very significant land marks while the rest of the heritages have even been neglected. The digital data construction always relay on a mature non-‐digital system. Since the technology could only help rise up the speed of work but not thinking instead of human being themselves. As one of the purposes to build this procedure is that the final result could significantly reduce the Urban Survey work time. By applying a series of automatic reconstruction software and digital design software, the 3D model of each heritage building could be easily built and manipulated in the computer. This approach could be seen as a big step that trying to shorten the distance between the real-‐time heritage survey and 3D instant analysis. On the other hand, the analysis results could finally benefit the traditional archeology survey with statistic collection and conservation area analysis. It can be treated as a down to top revolution in the archology field. The building type classification and recognition make a big influence in the building identification process. The existing research results provide an example of Tudor Architecture characteristics. To build a more mature 3D instant analysis system, more heritage building characteristics should be
57
discovered. When more building features are taken into account, more constrains for parametric analysis would have. As a results of constrains adding, more detailed analysis would be possible. Speaking of the development of the 2D and 3D digital modelling tools, there are still some limitations and inaccurate exist. The literature reviews results help us to choose the relatively suitable automatic reconstruction software which is low cost and easily to handle to feed research needs. There is still a potential risk of the automatic reconstruction since the whole procedure is conducted by cloud computing and no human intervene chance. People apply this technology cannot correct the data input or output manually which may lead to an inaccurate identification in the later session. How to let the human get control and retrieve data in whatever session they want need to be discussed in the future.
FUTURE RESEARCHES In my point of view, this paper gives a solution of building the procedure of 2D image processing to 3D built environment modelling. The outcome could basically take the responsibility of the automatic reconstruction and 3D instant building profile analysis task. However, there are still a lot of improvements that need to be conducted in the future: •
An urge to finish the building feature analysis according to different building types. Furthermore, the specific dimensions for each building feature should be treated as the main analysis part. This work would benefit the whole conservation area metadata built.
•
Better parametric procedure built and have more building feature included. If the building profile data could be enrich in the future, a more mature and comprehensive scenario would possibly been built. These call for a good understanding of the dataflow and constrain setting.
•
More advanced 2D image processing tool apply. The meshes that generated by the chosen automatic modelling tools are still lacking of accuracy. More researches could be done
58
around a better reconstruction tool selection and the way to raise the accuracy of existing tools. •
A more strict error control should been done in the future work. The error should be carefully evaluated and tracked. If the error is beyond a certain level the related data should be discarded and the procedure could call back a new loop of calculation to get more accurate one.
•
There is a potential to combine different software in one single union platform. With a highly developed automatic system, this platform could have variety use. The professional could document the heritage in real-‐time, students could ‘read’ and learn the heritage building background in a 3D environment. The procedures designed here just give a start of this complex system building.
OVERALL ACHIEVEMENTS In conclusion, the final research results show a successfully 2D to 3D built environment reconstruction process. The research of the local heritage conservation condition and heritage building classification help people understand the main current issues in archeology field. The deeper researches of characterizations of specific types of building also help frame the procedure of building profile retrieval. Meanwhile, this research could be seen as an example of 2D to 3D reconstruction scenario development and finally benefit the future research.
59
BIBLIOGRAPHY Cardinale, T., Valva, R. & Lucarelli, M., 2013. Advanced Representation Technologies Applied To the Temple of Neptune , the Sphinx and the Metope in the Archaeological Park of Paestum. , XL(February), pp.25–26. Casu, P., Computing, C. & Architecture, L.G., 2013. PHOTO-‐MODELING AND CLOUD COMPUTING . APPLICATIONS IN THE SURVEY OF LATE GOTHIC ARCHITECTURAL ELEMENTS. , XL(February), pp.25–26. Curl, J.S., 2011. Georgian Architecture in the Britain Isles 1714-‐1830 Second., English Heritage. Design, E. et al., 1827. History of British Architecture and Landscape Architecture. , 460550. Dobson, S., 2012. Historic landscape characterisation in the urban domain. , 165, pp.11–19. Available at: http://dx.doi.org/10.1680/udap.2012.165.1.11. Dore, C. & Murphy, M., 2013. Semi-‐Automatic Modelling of Building Façades with Shape Grammars Using Historic Building Information Modelling. Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences -‐ 3D Virtual Reconstruction and Visualization of Complex Architectures, XL(February), pp.57–64. Fernández, G., 2013. Iterpretation of topographic data from “Shape from Shading” method, application in Villagarcìa de Campos castle. 3D-‐ARCH 2013 -‐ 3D Virtual Reconstruction and Visualization of Complex Architectures, 25 – 26 February 2013, Trento, Italy, XL(February), pp.93–97. Follmer, S., Johnson, M. & Adelson, E., 2011. deForm: an interactive malleable surface for capturing 2.5 D arbitrary objects, tools and touch. Proceedings of the 24th annual ACM Symposium on User Interface Software and Technology (UIST ’11), pp.527–536. Available at: http://dl.acm.org/citation.cfm?id=2047265. Guidi, G., Russo, M. & Angheleddu, D., 2013. DIGITAL RECONSTRUCTION OF AN ARCHAEOLOGICAL SITE BASED ON THE INTEGRATION OF 3D DATA AND HISTORICAL SOURCES. , XL(February), pp.25–26. Jack Bowyer, 1980. Vernacular building conservation, London: Architectural Press, 1980. Jones, W., 2014. How to read houses, Bloomsbury Visual Arts. Kim, H. et al., 2005. Tangible 3D: Hand Gesture Interaction for Immersive 3D Modeling. Ipt/Egve. Available at: http://www.researchgate.net/publication/220901838_Tangible_3D_Hand_Gesture_Interaction_for_Immersive_3D_ Modeling/file/5046351c9b9a7829bc.pdf. Koska, B. & Kremen, T., 2013. The Combindation of Laser Scanning and Structure from Motion Technology for Creation of Accurate Exterior and Interior Orthophotos of St. Nicholas Baroque Chrich. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences,, XL(February), pp.25–26. Leuven, K.U., 2000. Total Recall : a Plea for Realism in Models of the Past. Technology, (JUNE 2004). Levoy, M. et al., 2000. The Digital Michelangelo Project: 3D Scanning of Large Statues. Most, pp.131–144. Available at: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.26.5681. Ludwig, M. et al., 2013. the Advantages of Parametric Modeling for the Reconstruction of Historic Buildings . the Example of the in War Destroyed Church of St . Catherine ( Katharinenkirche ) in Nuremberg. , XL(February), pp.25–26. Manferdini, A.M. & Galassi, M., 2013. Assessments for 3D reconstructions of cultural heritage using digital technologies. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL(February), pp.167–174. Available at: http://www.int-‐arch-‐photogramm-‐remote-‐sens-‐spatial-‐inf-‐sci.net/XL-‐5-‐ W1/167/2013/isprsarchives-‐XL-‐5-‐W1-‐167-‐2013.pdf.
60
Matías, J. De et al., 2013. LASER SCANNING FOR THE GEOMETRIC STUDY OF THE ALCÁNTARA BRIDGE AND CORIA CATHEDRAL generations . Techniques must therefore be developed to help document heritage and thus improve knowledge and are to obtain geometries of historic buildings and monuments ,. , XL(February), pp.25–26. El Meouche, R. et al., 2013. Automatic Reconstruction of 3D Building Models from Terrestrial Laser Scanner Data. ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, II-‐4/W1(December), pp.7–12. Available at: http://www.isprs-‐ann-‐photogramm-‐remote-‐sens-‐spatial-‐inf-‐sci.net/II-‐4-‐W1/7/2013/. Mitchell, W.J., 1990. The Logic of Architecture: Design, Computation, and Cognition, MIT Press Cambridge, MA, USA. Müller, P. et al., 2007. Image-‐based procedural modeling of facades. ACM Transactions on Graphics, 26(3), p.85. Müller, P. et al., 2006. Procedural 3D Reconstruction of Puuc Buildings in Xkipché. The 7th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST) 2006, pp.139–146. Nyaupane, G.P. & Timothy, D.J., 2010. Heritage awareness and appreciation among community residents: perspectives from Arizona, USA. International Journal of Heritage Studies, 16(3), pp.225–239. Old, A., Selection, W. & Library, A.S., home style pattern book. Parish, Y.I.H. & Müller, P., 2001. Procedural Modeling of Cities. 28th annual conference on Computer graphics and interactive techniques, (August), pp.301–308. Available at: http://portal.acm.org/citation.cfm?doid=383259.383292. Petchey, M., 1999. English Heritage merger planned. History Today, 49, pp.2–3. Richard Reid, 1989. The Georgian house and its details, Bishopsgate Press. Risk, H.A.T. & Register, T.H.E., English Heritage / Heritage at Risk Register 2012. Sadar, J.S. & Chyon, G., 2011. 3D Scanning and Printing As a New Medium for Creativity in Product Design. Procedings of the Second Conference on Creativity and Innovation in Design, pp.15–20. Available at: http://doi.acm.org/10.1145/2079216.2079218. Schkolne, S., Pruett, M. & Schröder, P., 2001. Surface Drawing : Creating Organic 3D Shapes with the Hand and Tangible Tools. Proceedings of the ACM Conference on Human Factors in Computing Systems, pp.261–268. Available at: http://portal.acm.org/citation.cfm?id=365114. Sheng, J., Balakrishnan, R. & Singh, K., 2006. An interface for virtual {3D} sculpting via physical proxy. Proceedings of the 4th International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia, pp.213–220. South Yorkshire Archaeology Service, 2005. South Yorkshire Historic Environment Characterisation: Revised Project Design. Environment, (0114), p.46. Steadman, P., 1993. A database of the non-‐domestic building stock of Britain. Automation in Construction, 2(1), pp.31–45. Storia, D. & Università, S., 2013. THE REVERSE MODELLING REALIZED BY DIGITAL SCANS AND FOTOMODELLAZIONE : BASED ON POST-‐PROCESSING COMPARED SEVERAL NOTEWORTHY EPISODES CONTAINED IN THE BASILICAL COMPLEX OF SAN. , XL(February), pp.25–26. Sutherland, I.E., 1963. SKETCHPAD A MAN-‐MACHINE GRAPHICAL COMMUNICATION by R-‐3 R-‐4. , pp.3–20. Taibi, G. et al., 2013. Crabnebula Digital Suite , an Algorithm of Survey and 3D Modelling for the Preservation and Management of Urban Heritage. International Archives of Photogrammetry Remote Sensing and Spatial Information Sciences, 30(5/W1), pp.227–234.
61
Weichel, C. et al., 2014. MixFab: A Mixed-‐Reality Environment for Personal Fabrication. Proceedings of the 32nd annual ACM conference on Human factors in computing systems -‐ CHI ’14, pp.3855–3864. Available at: http://dl.acm.org/citation.cfm?doid=2556288.2557090. Willis, K., Xu, C. & Wu, K., 2011. Interactive fabrication: new interfaces for digital fabrication. Proceedings of the fifth …, pp.69–72. Available at: http://dl.acm.org/citation.cfm?id=1935716. Yorke, T., 2009. Tudor Houses Explained: Britain’s living History, MRM Associates Ltd. Zhang, Y. et al., 2013. BodyAvatar: creating freeform 3D avatars using first-‐person body gestures. Proc. UIST, pp.387–396. Available at: http://dl.acm.org/citation.cfm?id=2502015. Zuo, G. & Shi, G., 2010. Research on 3D laser scanning field working method of ancient architecture scene. 2nd International Conference on Information Science and Engineering, ICISE2010 -‐ Proceedings, (2004064), pp.3912– 3916.
62
APPENDIX A GRASSHOPPER DEFINITION
63