TIER 1 UNIVERSITY TRANSPORTATION CENTER (UTC) Sponsored by the Office of the Assistant Secretary for Research and Technology in the U.S. Department of Transportation
INSPECTING AND PRESERVING INFRASTRUCTURE THROUGH ROBOTIC EXPLORATION VOL. 7 | ISSUE 2 | FALL 2023 INSPIRE-UTC Biannual Publication
In this issue: Director's Message News Research Article Outreach Activity Upcoming Events Awarded in December of 2016 by the U.S. Department of Transportation, the five-year INSPIRE UTC is a Tier 1 University Transportation Center with a research priority of preserving the existing transportation system as part of the UTC Program (https://www. transportation.gov/utc/2016-utc-grantees) that was authorized under the Fixing America’s Surface Transportation Act.
CONSORTIUM MEMBERS
Director’s Message Greetings to our esteemed colleagues and friends! I am delighted to share the latest edition of our newsletter, brimming with noteworthy accomplishments and leaderships from the Center for Intelligent Infrastructure (CII) – a Missouri S&T university research center that administers the INSPIRE UTC. To start with, Dr. Anil Agrawal from the City College of New York, a fellow INSPIRE UTC investigator, was recently elected to be one of the 2023 top 10 distinguished professionals by the American Society of Civil Engineers (ASCE). Back home at Missouri S&T, Dr. Grace Yan, a fellow CII member, was elected to chair the 15th Americas Conference on Wind Engineering to be held on May 23-25, 2025, in St. Louis, Missouri. This significant role reflects Dr. Yan's dedication, expertise, and leadership in the field of wind engineering. I am humbled to join this elite group to become one of the five inaugural Fellows in Taylor Geospatial Institute – an eight-institution consortium headquartered in St. Louis University. I was also honored to deliver the plenary keynote address at the prestigious 14th International Workshop on Structural Health Monitoring (IWSHM), Stanford University, California. In this edition, we take pride in welcoming fresh faces to our vibrant community. Among them, a research engineer, a program/project coordinator, an undergraduate student, and a faculty member, Dr. Weibing Gong, have joined our ranks. This diverse expertise adds a dynamic layer to our collaborative environment, promising exciting prospects for future endeavors. Our upcoming INSPIRE webinar features Missouri S&T’s recent accomplishments on "Multidimensional Digital Twin in the Built Environment." Join us as we delve into the world of multifunctional modeling and its broader impacts on December 4, 2023. As we look to the future, CII is actively searching for talented individuals to fill two postdoctoral positions. This presents a unique opportunity for enthusiastic researchers to contribute to innovative projects within the fields of optical sensing, machine learning, and robotic engineering to foster research in our collaborative and innovative environment. Beyond our research endeavors, CII has actively engaged in various outreach programs, including a Mi STEM (Minority Introduction to STEM) initiative, an engaging engineering robotic summer camp, and an exciting aerospace summer camp. These initiatives align with our commitment to fostering interest and diversity in STEM fields. Thank you for your continued support as we celebrate these achievements and look forward to a future filled with exciting opportunities and advancements. Genda Chen, Ph.D., P.E., F. ASCE, F. SEI, F. ISHMII, F.SPIE, F. TGI Director, INSPIRE University Transportation Center Director, the Center for Intelligent Infrastructure
NEWS Chen named inaugural fellow of the Taylor Geospatial Institute
DEAN MESSAGE
Dr. Genda Chen, the Robert W. Abbett Distinguished Professor of Civil Engineering at Missouri S&T, has been named as one of the five inaugural fellows for the Taylor Geospatial Institute (TGI), marking a significant achievement in his career. This prestigious honor recognizes his exceptional contributions to the field of geospatial science particulary related to remote sensing in the built environment. The Taylor Geospatial Institute is a consortium of eight prominent academic institutions, including, Saint Louis University, the Donald Danforth Plant Science Center, Harris-Stowe State University, Missouri S&T, University of Illinois Urbana-Champaign, University of Missouri-Columbia, University of Missouri-St. Louis, and Washington University in St. Louis. Together, these institutions boast a combined faculty of over 5,000 members and serve more than 100,000 students. The primary goal of the TGI is to promote geospatial science and facilitate innovative solutions to pressing societal challenges. Dr. Chen's involvement as a fellow underscores his commitment to advancing this field and contributing to groundbreaking research in geospatial science. As a TGI fellow, Dr. Chen will receive valuable support from the institute, including discretionary funding, access to cutting-edge data analytics and computing resources, and guidance for the development of grant proposals. Additionally, he will have the opportunity to collaborate with other esteemed TGI fellows, all of whom are dedicated to furthering the boundaries of remote sensing and data analytics of the built environment. The TGI's mission is aligned with Dr. Chen's own vision for the future of remote sensing applications in civil infrastructure. The institute focuses on various core areas within the field, such as geospatial health, food systems, and national security. Through collaborative research and training environments, the TGI seeks to foster a culture of innovation and problemsolving.
2 INSPIRE NEWSLETTER
The Kummer College of Innovation, Entrepreneurship, and Economic Development is dedicated to the study and application of value creation for individuals, communities, and society. The College’s aim is to develop leaders who can translate discoveries into societal value. This translation includes identifying new product, process, and business opportunities, leveraging private equity, and managing an organization’s rapid growth. The first critical step of identifying the value-creation transformation of discoveries requires a deep understanding of science and engineering, as well as the needs of the market. This also requires the discoverers themselves to be intimately engaged in valuecreation. Researcher engagement in translation starts with a mindset shift; going beyond scientific understanding to the search for the science’s potential impact. Dr. Chen’s INSPIRE exemplifies this mindset shift and takes it to the next level by applying the new technology to problems in the real world. The Kummer College is excited to partner with Dr. Chen, INSPIRE, and other forward-thinking researchers across campus to establish S&T as a leader in the value creation of scientific breakthroughs.
Dr. Tim Faley Interim Vice Provost/Dean of Kummer College of Innovation, Entrepreneurship, and Economic Development.
INSPECTING AND PRESERVING INFRASTRUCTURE THROUGH ROBOTIC EXPLORATION | inspire-utc.mst.edu
Agrawal is new ASCE distinguished member Anil K. Agrawal, Herbert G. Keyser Professor of Civil Engineering in the Grove School of Engineering at The City College of New York, is one of 10 top professionals elected American Society of Civil Engineers (ASCE) distinguished members. The class of 2023 will be inducted at ceremonies during the ASCE 2023 Convention, October 18-21 in Chicago. Distinguished membership is the highest honor ASCE can bestow upon a member. It is reserved for civil engineers who are either ASCE members or fellows and have attained recognized superiority in position, character, and achievement through significant contributions to the profession. Founded in 1852, ASCE represents more than 150,000 members of the profession in 177 countries. Agrawal is recognized by his peers worldwide as a pioneering researcher in bridge structures. His distinguished membership is for “significant and definitive contributions in extreme hazards and mitigation for bridges and service to the Society as editor of ASCE’s Journal of Bridge Engineering.” He served as editor-in-chief of the ASCE’s “Bridge Engineering” (2009- 2021), which in 2017 was ranked #18 among structural engineering journals by Google Scholar metrics. This success garnered him 2019’s Richard R. Torrens Award for outstanding performance. In addition, Agrawal chaired the Society’s SEI Committee on Bridge Inspection, Rehabilitation, and Monitoring, as well as the SEI Committee on Structural Control and Sensing. He has also headed the Engineering Mechanics Committee of the ASCE Metropolitan Section since 2013. He is the recipient of several prestigious awards, including CUNY’s Performance Excellence Award in 2000 and ASCE’s 2019 Arthur M. Wellington Prize for the paper “Heavy Truck Collision with Bridge Piers: Computational Simulation Study,” as well as the Society’s Ernest E. Howard Award last year. Aside from other recognitions attesting to his stellar character and teaching excellence, the models Agrawal developed have resulted in over 100 dissertations. His work on impact on bridges by over-Height vehicles is being followed by researchers around the world. In 2022 he was awarded a patent on his Laser Ranging Over-Height Vehicle Detector System (LRA-OHVD) by the U.S. Patent Office. During the past 24 years he has received some $15 million in research Original Version Posted May 04, 2023 -Civil Engineering Source
ElGawady speaks at civil infrastructure, construction materials conference Dr. Mohamed ElGawady delivered an invited talk focused on his study on over-height truck impact with bridge girders during the second International Conference on Advances in Civil Infrastructure and Construction Materials July 26-28 in Bangladesh. ElGawady is the interim director of the Center for Infrastructure Engineering Studies and professor in civil, architectural and environmental engineering. During his presentation, Dr. Mohamed ElGawady emphasized the critical need for innovative solutions to mitigate the risks associated with over-height trucks colliding with bridge girders, a pressing concern in modern infrastructure development. His insightful talk showcased the importance of interdisciplinary research in addressing the challenges faced by the civil engineering industry. As an esteemed professional in civil, architectural, and environmental engineering, Dr. ElGawady's contributions continue to shape the field and inspire the next generation of infrastructure experts. Original Version Posted August 08, 2023 - Missouri S&T eConnection
INSPIRE NEWSLETTER 3
INSPECTING AND PRESERVING INFRASTRUCTURE THROUGH ROBOTIC EXPLORATION | inspire-utc.mst.edu
Six CII members recognized among top 2% cited scientists in their fields for career or single-year impact A total of 87 researchers affiliated with Missouri S&T are among top 2% cited scientists in their fields for career or single -year impact. Among them, six researchers serve as CII members as measured by their career research records, according to a recent analysis of standardized citation indicators of the Elsevier Data Repository published by Stanford University. The Stanford study published October 4, 2023, analyzes citations, h-index, and other metrics of research productivity and impact including a composite indicator (c-score). The analysis provides listings of top-scientists based on career-long and single-year impact. The study classifies individuals into 22 scientific fields and 174 sub-fields. The fields include agriculture, biology, biomedical, built environment and design, chemistry, clinical medicine, economics and business, engineering, historical studies, information and communication technologies, mathematics and statistics, physics, psychology, public health, social sciences, and others. The top 2% includes approximately 210,000 individuals from a field of over 9.6 million authors worldwide who have at least 5 papers published in the Elsevier Scopus database. See Fig. 1 for their distribution around the world. Career-long data are updated through the end of 2022, and the selection is based on the top 100,000 researchers as determined by a composite citation metric known as a “c-score” (with and without selfcitations) or by their percentile rank of 2% or above. “These rankings show quantitatively the profound global impact of Missouri S&T researchers,” says Dr. Kamal Khayat, vice chancellor for research and innovation. “Their unwavering dedication to advancing knowledge Fig. 1 Number of top 2% world scientist by country in their respective fields is evident in the quantitative data presented. We applaud our researchers for their exceptional work, which stands as a testament to their expertise and commitment.” CII researchers included in the study are as follows. “Career” denotes those recognized for their career-long impact in their fields, “2022” denotes those recognized for their single-year research productivity for 2022, and “both” denotes individuals recognized for both their career-long impact and research productivity for 2022. Chemistry •
Dr. Shelley Minteer, director of the Kummer Institute Center for Resource Sustainability (both)
Civil engineering •
Dr. Genda Chen, Robert W. Abbett Distinguished Chair in Civil Engineering and director of the Center for Intelligent Infrastructure (both)
•
Dr. Mohamed ElGawady, professor of civil, architectural and environmental engineering and interim director of Center for Infrastructure Engineering Studies (both)
•
Dr. Hongyan Ma, associate professor of civil, architectural and environmental engineering (both)
Computer science •
Dr. Sajal Das, Daniel St. Clair Chair and Curators’ Distinguished Professor of computer science (both)
•
Dr. Sanjay Madria, Curators’ Distinguished Professor of computer science (career)
4 INSPIRE NEWSLETTER
Original Version Posted November 3, 2023 - Missouri S&T eConnection
NEWS Zhang delivers lecture at International Conference on Unsaturated Soils Dr. Xiong Zhang, long-standing CII member, delivered an invited themed lecture at the 8th International Conference on Unsaturated Soils. The conference, the most important series in the field of unsaturated soils, was held Wednesday, May 3, to Friday, May 5, in Milos, Greece. Zhang delivered one of eight themed lectures titled “Calibration of BBM Parameters using the Modified State Surface Approach.” He also coauthored another themed lecture titled “A Unified Two Independent Stress Variable Approach to Shrink-Swell and Collapse,” which was delivered by Dr. Sandra Houston, professor emerita at Arizona State. Original Version Posted June 6, 2023 - Missouri S&T eConnection
El-adaway named inaugural associate dean for academic partnerships Missouri S&T leaders plan to develop additional academic partnerships with corporations and industry groups, and they appointed Dr. Islam El-adaway to spearhead the efforts El-adaway, who is S&T’s Hurst-McCarthy Professor of Civil Engineering, will take on an additional role as associate dean for academic partnerships for the College of Engineering and Computing. He starts his new duties on Friday, September, 1 2023. “Dr. El-adaway is a perfect fit for this position,” says Dr. David Borrok, vice provost and dean of the college. “He has already been successful in establishing meaningful partnerships with dozens of companies in the construction industry and is well-prepared and positioned to expand his focus to our corporate education initiatives.” El-adaway says he will first focus on the St. Louis area and eventually collaborate with partners in Kansas City and other urban areas that would benefit from Missouri S&T programs. Original Version Posted August 24, 2023 - Missouri S&T eConnection
Yan to host 15th Americas Conference on Wind Engineering During the closing ceremony of the 16th International Conference on Wind Engineering, Dr. Claudia Borri and Dr. Ahsan Kareem, the current and past presidents of the International Association of Wind Engineering, announced that Dr. Grace Yan, CII member, will host the 15th Americas Conference on Wind Engineering (ACWE). The conference, scheduled for May 2025 in St. Louis, is anticipated to draw 400 participants. Dr. Yan extended a warm welcome to wind engineering researchers during this closing ceremony, inviting them to participate in the upcoming conference. Additionally, she offered conference attendees a captivating three-minute virtual tour of the Sinquefield Missouri Tornado Simulator Twins. This innovative initiative has the potential to significantly elevate the prominence of Missouri S&T in the realm of disaster resilience research, as highlighted by Dr. Yan. For more information about this conference, please visit https://15acwe.mst.edu.
Original Version Posted September 5, 2023 - Missouri S&T eConnection
INSPIRE NEWSLETTER 5
INSPECTING AND PRESERVING INFRASTRUCTURE THROUGH ROBOTIC EXPLORATION | inspire-utc.mst.edu
La wins Established Innovator Award for 2023 Computer Science & Engineering Associate Professor Hung (Jim) La, whose software developments have led to advances in the robotics and automation industry, has received the Foundation Innovation Established Innovator award from the University of Nevada, Reno Foundation. The award, which recognizes faculty whose recent work has actively contributed to innovation, commercialization and entrepreneurship, will be given at the May 9 Honor the Best ceremony. “Receiving the innovator award is a significant recognition of a researcher’s work and impact in their field,” La said. “I am honored to be acknowledged for my achievements and contributions to the field of robotics and automation. This award has the potential to bring greater visibility to my work and inspire others in the field. Moreover, this recognition can potentially help me attract more opportunities, and further advance my research and commercialization efforts.” One of La’s most recent achievements is the development of a software that monitors civil infrastructure, Highly Accurate Image Processing for Concrete Images. Licensed through the University of Nevada, Reno to Japanese firm Penta-Ocean Construction, the software detects defects in concrete structures and has the potential to help address the national issue of aging infrastructure, in addition to saving time and money. Computer Science & Engineering Chair Eelke Folmer, who nominated La for the Established Innovator award, also cited La’s three National Science Foundation (NSF) Innovation Corps (I-Corp) awards, his NSF Partnership for Innovation award, two pending patents and one software copyright. “In these four NSF innovation-funded projects, Jim has served as the principal investigator as well as the entrepreneur to find market fit for his research products,” Folmer wrote. “Jim’s passion and dedication to his work have inspired others in the industry and have earned him a reputation as a thought leader and established innovator.” La has an extensive history in research spanning over a decade. He is a senior member of the Institute of Electrical and Electronics Engineers (IEEE), an associate editor of several highly ranked journals and conferences such as the IEEE Transactions on Human-Machine Systems, the Frontiers in Robotics & AI, the Robotica journal, the IEEE International Conference on Robotics and Automation and the IEEE International Conference on Systems, Man and Cybernetics. La will be serving as the co-program chair for the 16th IEEE/SICE International Symposium on System Integration (SII), in January, 2024. “Jim is a visionary and innovative leader in the field of robotics and has made outstanding contributions to the industry through his innovative ideas and solutions,” Professor Eelke Folmer, chair of the Computer Science & Engineering department, said. “ Original Version Posted May 3, 2023 - Nevada Today
Missouri S&T drives workforce development with $1.3 million MoDOT funds For over two decades, Missouri S&T has administered the Missouri Local Technical Assistance Program (LTAP), and the university is set to remain in the driver’s seat moving forward thanks to a new agreement. The Missouri Department of Transportation recently awarded S&T a contract for almost $1.3 million to run the program, which the state agency funds in collaboration with the U.S. Department of Transportation’s Federal Highway Administration, for the next three years. “Our LTAP works with cities, counties and other districts throughout the state that are responsible for roads and bridges,” says Dr. Heath Pickerill, LTAP director and assistant teaching professor of civil, architectural and environmental engineering at S&T. “We are an amazing resource for training employees and helping them be as safe, knowledgeable, and effective as possible when on the job.” Original Version Posted July 11, 2023 -Missouri S&T eConnection 6 INSPIRE NEWSLETTER
INSPECTING AND PRESERVING INFRASTRUCTURE THROUGH ROBOTIC EXPLORATION | inspire-utc.mst.edu
CII opens door to European communities for international collaborations The Georg Nemetschek Institute (GNI) AI for the Built World at Technical University Munich, Germany, was established in 2020. The Founding Director of this new institute, Dr. Ian Smith, invited with confirmation Dr. Genda Chen, Director of the CII, to serve as a Member of the TUM GNI International Scientific Committee for three years, effective March 2023. The GNI is similar to the CII in many ways with synergistic activities in AI applications for data-driven, knowledge-based decision making throughout a life cycle of buildings and civil infrastructure systems. The GNI encourages, coordinates, and manages interdisciplinary research projects between engineers, architects, mathematicians, material scientists, and computer scientists. The GNI will lead international competitions and establish short-term visiting fellowships and postdoctoral fellowships. Dr. Christian Boller from Saarland University, Saarbrücken, Germany, recently invited 10 academic institutions to launch an international network to get SHM into Application! Structural Health Monitoring (SHM) is a multidisciplinary field that encompasses a significant breadth in engineering science. Although the research in SHM has made significant progresses over the past two decades, the SHM applications are moving at a relatively slow pace. To achieve and surpass the recently projected $4.0 billion SHM market by 2027 at a compound annual growth rate (CAGR) of 14.6%, knowledge integration of expertise from aerospace engineering, civil engineering, computer science, electrical engineering, and mechanical engineering is urgently needed. The SHM into Application goal can be achieved through more technology demonstrators with added economic and societal values. The progress of this demonstrator initiative will be presented at different scientific events, such as the SMART 2023 in Patras, Greece, in early July 2023, the 2023 IWSHM in Stanford, CA, United States in September of 2023, and the EWSHM 2024 in Potsdam near Berlin, Germany. Different demonstrators will be discussed and made available at different events. The current list of participated universities from East to West includes: •
Korea Advanced Institute of Science and Technology, Daejeon, South Korea with Prof. Hoon Sohn
•
University of Patras, Patras, Greece with Prof. Dimitris Saravanos
•
AGH, Cracow, Poland with Prof. Wieslaw Staszewski and Prof. Tadeusz Uhl
•
Federal Institute of Materials Research & Testing (BAM), Berlin, Germany with Dr. Ernst Niederleithinger and Dr. Jens Prager
•
Technical University Munich (TUM), Munich, Germany with Prof. Christian Grosse
•
Technical University Clausthal, Clausthal-Zellerfeld, Germany with Prof. Peter Wierach
•
Goethe University, Frankfurt am. Main, Germany with Dr. Jochen Moll
•
Saarland University, Saarbrücken, Germany with Prof. Christian Boller
•
Missouri University of Science and Technology, Rolla, the United States with Prof. Genda Chen
•
Stanford University, Stanford, the United States with Prof. Fu-Kuo Chang
INSPIRE NEWSLETTER 7
NEWS Researchers join CII & INSPIRE UTC at Missouri S&T Drew Wellen is a sophomore in Electrical Engineering. He is an INSPIRE UTC Undergraduate Research Assistant. With an impressive practical background, John has been an integral member of the Mars Rover Design Team in Rolla, MO since August 2022, contributing as an Electrical Design Member. In this role, he has designed and manufactured critical components, including printed circuit boards (PCBs), showcased innovation by designing a custom battery management system, and served as an electrical consultant for a custom fluorescence spectrometer. He coauthored and published a paper in the International Telemetry Conference Proceedings in 2023. With a strong skill set encompassing PCB design, schematic design, layout design, and project verification, Drew is poised for a successful career in electrical engineering.
Son Nguyen, Ph.D. is a Robotic Developer with a diverse academic background. He obtained his Bachelor's degree in mechatronics engineering from the Department of Aerospace and Engineering at the Military Technical Academy in Vietnam, where he actively participated in robotics competitions such as the ABU Robocon Contest. After graduating, he pursued a Master of Science degree in Control Engineering and Automation while working as a researcher and lecturer at the Ho Chi Minh City University of Transport. Dr. Nguyen successfully led various science projects related to robotics, auto control theories, and intelligent engineering systems, earning him the Best Young Faculty Award in 2015. Later, he earned his Ph.D. in computer science from the University of Nevada, Reno, where his research focused on developing novel generations of robots for steel bridge inspection. Dr. Nguyen has published several papers on top robotic conferences and journals, including ICRA, IROS, and JINT, with three of his papers receiving the distinction of Best Paper Award finalist. His research interest lies in the development of intelligent and multi-functional robotic systems, with a specific focus on advancing their architecture and autonomy for practical real-life applications.
New program/project coordinator joins INSPIRE Center Natalie Goeddertz joins the INSPIRE Center after service as a U.S. Army officer, and IT distribution, bringing vital leadership and adaptability to our team. Holding a Bachelor's degree in Criminology from Niagara University and actively pursuing certification as a Project Manager, Natalie is dedicated to addressing inefficiencies and proposing new solutions to existing problems in day-to-day operations. Her academic background has instilled in her a strong sense of justice, a commitment to ethical decision-making, and a sharp analytical mindset, which she leverages in her pursuit of optimizing project processes and enhancing efficiency. With an unwavering determination to improve systems and outcomes, Natalie seeks to merge her military leadership experience with her growing expertise in project/program management to facilitate positive change. Her passion for continuous learning and her willingness to embrace new challenges position her as a valuable asset in driving innovation and progress within the INSPIRE & CII team.
CII gains new member Dr. Weibing Gong is an Assistant Professor of Geological Engineering in the Department of Geosciences and Geological and Petroleum Engineering at Missouri University of Science and Technology. He obtained his Ph.D. in Geosystems Engineering from UC Berkeley in 2023. Prior to that, he earned a Master's degree in Geotechnical Engineering from Tongji University in 2018, and a Bachelor's degree in Civil Engineering from Central South University in 2015. Dr. Gong's research interests include climate change-related and seismic hazards, enhancing infrastructure resilience against natural hazards, applications of remote sensing and AI in geotechnical(geological) engineering, as well as carbon detection and capture.
8 INSPIRE NEWSLETTER
NEWS Chen delivers keynote at 14th International Workshop on Structural Health Monitoring (IWSHM) Dr. Genda Chen was invited to deliver a plenary keynote presentation at the 14th International Workshop on Structural Health Monitoring (IWSHM) in the picturesque setting of Stanford, California on September 13, 2024. Dr. Chen's presentation offered a captivating glimpse into a study that marked a significant milestone in the realm of Structural Health Monitoring (SHM). The research was centered around an original and pioneering attempt to equip a digital twin (DT) with computational capabilities, transforming it into an information-computation construct within the built environment. Intriguingly, this innovative endeavor explored the creation of a DT methodology and framework designed specifically for a university campus environment. The key components of this work included: Modulated Digital Twins: Dr. Chen and his team artfully defined modulated DTs and their interconnections, establishing a hierarchical architecture. These modulated twins worked in harmony to create a comprehensive representation of real-world construction within a university campus setting. Spatiotemporal Analysis: The study leveraged multi-modal data sourced from in-situ sensors, aerial nondestructive testing, and remote sensing. By integrating these sources, the research enabled spatiotemporal analysis at multiple scales. Cyber-Physical System: One of the most remarkable aspects of this research was the integration of computation, and information, and machine learning models into a holistic cyber-physical system. This system encompassed buildings, infrastructure, and the affected community. Dr. Chen's team strived for seamless decision-making that spanned from the design phase through construction to operation. Evaluating Structural Behaviors: As part of the study, the team evaluated structural behaviors under extreme loads. This provided insights into the campus's resilience and its capacity to withstand the most challenging conditions. The campus-scale Digital Twin offered a comprehensive understanding of various critical factors, including traffic flow, structural stability, building constructability, damage/cost scenarios for both existing and new structures, and the community's potential impacts in the aftermath of a postulated earthquake event. For more details, please read the research article published in this newsletter. INSPIRE UTC also demonstrated some technologies for teleinspecton of bridges at one exhibition booth at the IWSHM.
INSPIRE NEWSLETTER 9
RESEARCH ARTICLE Multidimensional digital twin in the built environment Background
New Thinking for Multidimensional DT
People live, learn, and work as a community in the built environment that is viewed collectively of manmade structures, features, and facilities. To support the healthy and resilient operation of the community, the built environment as a cyber-physical system provides various functions such as energy, food, health, internet, manufacture, transportation, and water services. Under a variety of natural hazards, such as extreme heat, droughtrelated wildfires, pluvial floods, and tropical storms, the built environment behaves in a complex manner and is sometime less inhabitable. The conditions of various functions are currently assessed individually in isolation or in partial integration by different disciplines.
The DT concept originated from the modeling of product lifecycle management (PLM) that handles a good as it moves through the stages of its product life. The life cycle of a product starts when a product is introduced to consumers into the market and ends when it is removed from the shelves. Due to the availability of commercial products in large quantity and short term at relatively low costs, the integration of multiple products into a new system product can be viewed as an intended physical prototype. The DT of the system is used to ensure all component products fit together before investing a new system product line in a physical factory. This is a valuable design attribute of DTs in the era of digital manufacturing in addition to real-time monitoring as envisioned originally.
To illustrate the above point, infrastructure assets have been traditionally managed using a database and recently with the aid of Building Information Modeling (BIM) for value engineering and as-built information. To enable spatiotemporal analysis and societal impact study, a digital twin (DT) is required as demonstrated by the 2007 Minneapolis Interstate 35W Bridge Collapse that killed 13 people and injured 145. This incident was due not only to the overlooked design information, which can be extracted from a BIM, but also to the insufficient capacity of bridge members, which cannot be evaluated from the BIM. The need for such an action becomes increasingly important as our nation’s infrastructure is aging and thus requires more frequent condition assessment and maintenance, particularly under accelerating climate changes and increasing natural disasters. The cybersecurity risk of infrastructure also increases as demonstrated from the Colonial Pipeline ransomware ($4.4 million) attack on May 7, 2021. Therefore, it is imperative to develop an open-source DT framework with both information and computation capabilities and security measures. In 2017, the United Kingdom (UK) National Infrastructure Commission launched a national DT initiative in their Data for the Public Good report. During the evolution of their DT initiative, the UK construction industry alone saved $1.1 billion in 2014 just by sharing information. Ever since then, the concept and development of DTs has been significantly advanced worldwide as demonstrated by an increase of publications (mentioned “digital twin” in their titles) to more than 1,200 since 2018. Most, if not all, of the current DT research has been focused on a single function of either information construct or computation model.
10 INSPIRE NEWSLETTER
On the other hand, asset lifecycle management (ALM) for large-scale buildings and infrastructure works differently. A set of strategies (e.g., maintenance, rehabilitation, and replacement) is organized and implemented with the intent of preserving and extending the service life of public infrastructure assets, such as roads, utility grids, bridges, and railways. Unlike commercial products, infrastructure assets are often unique for both esthetical and functional purposes and require capital investment over a long time. As such, the attractive attribute of DTs for product assembly in manufacturing may have no equivalence in infrastructure asset management. For buildings and infrastructure management, computational mechanics modeling is desirable as their physical and functional conditions affect the decision-making of asset management strategies. In addition, using sensing data alone to assess their conditions is costly due to their large scale or even impossible for hidden damage. Model updating with limited sensor data is one of the effective ways to provide the needed condition assessment capability. The above difference between PLM and ALM determines the way in which DTs are applied effectively in the built environment. The current DT in the literature differs from BIM in two distinctive aspects: (1) two-way digital threads between DT and its represented physical asset, and (2) focus on operation and maintenance instead of the entire lifecycle of an asset as BIM encompasses with an emphasis on design and construction. The BIM implementation for operation is also different from DT’s.
INSPECTING AND PRESERVING INFRASTRUCTURE THROUGH ROBOTIC EXPLORATION | inspire-utc.mst.edu
Multidimensional digital twin in the built environment Cont. While the DT supports the operation of built assets, BIM for facility management focuses compiling information of the delivered built asset to support inventory and space management, general upkeep, and building services maintenance, which does not result in an accurate replica of the condition and performance of the asset after initial construction. A multidimensional DT is defined as a multifunctional, modulated digital representation of an intended or actual real-world asset, system, or process - a physical twin in the built environment. Presented in the form of simulation, integration, testing, monitoring, and maintenance, the DT is intertwined and corroborated through two-way digital threads with a lifecycle of its represented physical infrastructure from planning through engineering and operating to decommissioning. In a physical-to-digital thread, the sensing data and information obtained from a physical twin can be used to update and improve its digital representation. In a digital-to-physical thread, the practice and optimization of intervening strategies on a digital twin enable scenario studies to understand the outcomes of multi-faceted decision-making before implementation. The modulated DTs of an autonomous region are organized from the region level to asset and system levels in a hierarchical structure as shown in Fig. 1. The overall structure is divided into two parts: (1) open-sourced for public buildings and regular infrastructure and (2) secured for information-sensitive buildings and critical infrastructure.
In doing so, public sectors can support the development of the open-sourced framework while private sectors will invest application-specific components that are set up with data security and privacy policies in place. The application components can be plugged into the open-sourced framework to run the overall model at the region level to understand potential impacts of new development on surrounding communities. Multitask learning is combined with a secure platform to limit the use of sensitive information and models to authorized users only. The platform sets specific roles and missions of the users while the learning engine identifies users before availing sensitive information and models by encrypting them with users-specific keys. In addition, the hierarchic asset and system structure will evolve and be updated as necessary in the process from planning through design, construction to operation phases as schematically illustrated in Fig. 1. When applied to similar assets, such as highway bridges with same configurations along an interstate highway, an application strategy for ALM is proposed to include both prognosis and diagnosis to meet the needs for both information and computation modeling in three steps: Creation, Option, and Evaluation. The DT Creation is the design and construction twin version with all its variants in similar infrastructure assets. The DT Option is the twin of each individual built infrastructure such as an actual concrete-girder, steel-girder, prestressedgirder, or box-girder bridge. It will provide insights through diagnosis and prognosis for the inspection,
Fig. 1 Hierarchy of modulated DTs
INSPIRE NEWSLETTER 11
RESEARCH ARTICLE Multidimensional digital twin in the built environment Cont. 2 Missouri S&T Campus DT – a Case Study The main Missouri S&T campus spans ten streets in the north-south direction and another ten streets in the eastwest direction. The campus has both existing buildings and new buildings under construction as well as one pedestrian concrete bridge. Its surrounding area has one steel-girder highway bridge and one steel truss bridge over the I-44 highway. Fig. 2 shows the main campus DT in the built environment. Campus data were collected biweekly (every other weekend to avoid flying drones over people) using RGB, infrared, and hyperspectral cameras as well as a Light Detection And Ranging (LiDAR) scanner. The RGB image gives general features of the campus. The thermal image shows the temperature distribution around various buildings that are related to energy use and efficiency in different buildings. The LiDAR image with three-dimensional (3D) coordinate and light reflection information allows a 3D construction of building elevation models as a base DT for the visualization and presentation of features of interest. The hyperspectral image sheds light on the health condition of campus landscapes and the types of construction materials. Informational, computational, and multitasking machine learning models of buildings and bridges are developed to realize the potential value of the campus-scale DT in understanding traffic flow, structural stability, constructability of partly erected buildings, damage assessment, cost analysis, and community impact in the wake of a postulated earthquake event.
The inset in Fig. 2 shows a detailed 3D reconstruction of a reinforced concrete column from a nearby highway bridge. It is produced by fusing RGB image to LIDAR point clouds. It provides the details of concrete patching and deterioration such as concrete spalling and steel rebar exposure.. Concluding Remarks This article extended the concept of DTs to enable information and computation modeling of buildings and infrastructure so that their condition assessment and impact on the supporting community can be studied during normal operations and emergency responses in the wake of a catastrophic event. The extended DTs can be applied into a wide spectrum of tasks in a lifecycle of assets from designing through constructing, operating to preserving buildings and infrastructure. The concept and model of multidimensional DTs are new. More and closer collaborations among academia, industry, government, and software sources are required to develop guidelines and identify societal needs, synergistic functions, and thus value for adoption in engineering and planning of an autonomous region. Reference Genda Chen, Ibrahim Alomari, Zhenhua Shi, Woubishet Z. Taffese, Tarutal G. Mondal, Joel Runji, Mohammad H. Afsharmovahed, and Son Nguyen. “Computation-enabled Digital Twin in the Built Environment,” Proceedings of the 14th International Workshop on Structural Health Monitoring, Stanford University, CA, September 12-14,
ABOUT THIS PROJECT Led by Dr. Genda Chen, Professor and Abbett Distinguished Chair in Civil Engineering at Missouri University of Science and Technology, this study was conducted using INSPIRE UTC facilities by personnel supported on INSPIRE UTC projects. For more information on this project, please contact Dr. Chen at inspire-utc@ mst.edu or (573) 341-6114.
Fig. 2 Campus-scale DT of the built environment
12 INSPIRE NEWSLETTER
INSPECTING AND PRESERVING INFRASTRUCTURE THROUGH ROBOTIC EXPLORATION | inspire-utc.mst.edu
CII seeks to fill two post-doctoral fellow positions Position: Post-Doctoral Fellows (2) Application Deadline: Posted Until Filled Job Type: Full-Time Location: Missouri University of Science and Technology Are you passionate about advancing the fields of grating- and scattering-based fiber optic sensing, artificial intelligence, machine learning, and robotics? The Center for Intelligent Infrastructure (CII) at Missouri University of Science and Technology is seeking two talented individuals to join our team and contribute to cutting-edge research and education initiatives.
Grating- and Scattering-based Fiber Optic Sensing in Civil Infrastructure Are you interested in measurement science and material characterization tests using advanced technologies? We are looking for candidates who can apply grating- and scattering-based measurement principles for innovative monitoring of civil infrastructure. If you have expertise in fiber optic sensing, this position may be a perfect fit for you.
Artificial Intelligence and Machine Learning If you have a strong background in image processing, computer science, machine learning, or engineering, and are excited about developing deep learning approaches to detect defects in civil infrastructure using drone-assisted technology, we want to hear from you. Join us in creating data-driven solutions for infrastructure condition assessment.
Robotics with Aerial Manipulation Do you have experience in robotics and system integration? We are looking for candidates to help develop robotic platforms for inspection and maintenance. If you're passionate about robotics, this is a unique opportunity to contribute to the advancement of infrastructure maintenance and evaluation.
Application Details Review of applications will begin as they are received and will continue until the position is filled. Interested candidates should electronically submit an application package consisting of: • Cover letter • Current curriculum vitae • Statement of research interests and goals • Complete contact information for three references Please apply through the Missouri S&T’s Human Resource Office using the following link: Apply Now. Ensure that all submitted application materials have the position reference number 00088774 or 00088773 for processing.
Minimum Qualifications •
Ph.D.
Preferred Qualifications •
Ph.D. in civil engineering, electrical engineering, mechanical engineering, computer science, or engineering.
Additional Information •
•
Final candidates will be required to provide copies of official transcript(s) for any college degree(s) listed in application materials. Job offers are contingent upon successful completion of a criminal background check. INSPIRE NEWSLETTER 13
INSPECTING AND PRESERVING INFRASTRUCTURE THROUGH ROBOTIC EXPLORATION | inspire-utc.mst.edu
INSPIRE WEBINARS UPCOMING WEBINARS
RECENT WEBINARS ROBOTIC INSPECTION OF INFRASTRUCTURE USING VISION, GPR, AND IMPACT-ECHO SENSORS Presented:September, 20 2023, 10:00 AM-11:00 AM (CST) Speaker: Dr. Jizhong Xiao Professor The City College of New York
MULTIDIMENSIONAL DIGITAL TWIN IN THE BUILT ENVIRONMNENT TO SUPPORT MULTIFUNCTIONAL MODELING FOR BROADER IMPACTS Present: December 04, 2023, 10:00 AM-11:00 AM (CST) Speaker: Dr. Genda Chen Professor Missouri University of Science and Technology Register: https://inspire-utc.mst.edu/webinars/ Digital twin (DT) has been developed for a single function in most of previous studies. This study aims to empower DT with a multilayered integration of multifunctional and multidisciplinary models in the built environment. It starts with the development of a framework of three hierarchical tiers of regional, asset, and system DT modules, defines a new concept of the degree of digital twinning (DODT) to a real world by the number of models enabled by a common DT platform, enables spatiotemporal analysis in multiple scales to couple nonstructural with structural building components and connect the built environment to planning constructions, enables an integrated computational and informational modeling, and demonstrates multiple values of the DT of a university campus in asset lifecycle management. A mechanical model is used to evaluate the structural and nonstructural behavior of buildings under earthquake loads, allowing damage/cost scenario studies for community resilience in the wake of an extreme event. A multitask machine learning model is used to detect the type and material of building roofs from videos, allowing infrastructure planning for existing buildings. An informational model allows master planning for green space development, environmental planning for flood zone susceptibility, security protocol development, and energy harvesting and utilization. The DODT allows the value-driven digital replication of a physical twin at different levels and thus the value proposition of structural health monitoring in broader architectural and engineering practices. The DODT of the campus is eight, indicating that the DT has broader impacts on campus’ asset lifecycle management.
14 INSPIRE NEWSLETTER
Aging U.S. infrastructure, including bridges, dams, highways, and tunnels, requires urgent maintenance and inspection for sustainability. Over 600,000 highway bridges in the National Bridge Inventory (NBI) are past their 50-year design life, with 42,951 rated as "structurally deficient." Traditional manual inspections using NDE instruments like GPR and impact-echo are costly, timeconsuming, and pose safety risks, often causing traffic disruptions. This presentation introduces climbing robots developed at CCNY Robotics Lab, integrating precise control, vision-based positioning, and NDE signal processing. These robots streamline inspections, automating data collection and enhancing safety. Additionally, machine learning algorithms are introduced for crack detection, IE data interpretation, and DNN-based GPR analysis for improved subsurface defect visualization.
ACCURATE AND EFFICIENT UPDATING OF BRIDGE RISK ASSESSMENTS BASED ON INSPECTION DATA Present: June 13, 2023, 12:00 PM-1:00 PM (CST) Speaker: Dr. Iris Tien Associate Professor Georgia Tech, Atlanta As structural inspection data increased, updating fragility functions based on these measurements provided a way to translate collected data into risk-based decision-making support. In this talk, Dr. Tien described new methodologies to efficiently and accurately update analytical fragility curves. The reduction in computational cost from both reducing the number of analyses required and simplifying the structural complexity was investigated. The method was applied to update calculations of seismic bridge fragilities, accounting for varying levels of measured corrosion. Results comparing updated fragility curves obtained from using the proposed approach versus using the full set of dynamic analyses showed that the proposed method achieved accurate, stable, and more quickly converging fragility calculations. In addition to this work on the impacts of corrosion on bridge risk, further work on integrating scour inspection data into updated assessments of bridge risk was also discussed.
15th Americas Conference on Wind Engineering Hosted by MIssouri University of Science and Technology in St. Louis, Missouri
The Americas Conference on Wind Engineering (ACWE) stands as a preeminent international gathering for the wind engineering community. With a great honor, the Center for Hazard Mitigation and Community Resilience (HMCR) at Missouri University of Science and Technology is proud to host the 15th ACWE in St. Louis, Missouri. Building on the success of previous conferences, we expand the agenda to promote advanced research and practice to better confront the grand challenges of wind hazards under changing climate, which includes the improvement of building codes for diverse wind conditions. The chair, Dr. Grace Yan, extends her heartfelt welcome to you all, to come to establish connections, exchange insights, and transform challenges into opportunities together, ultimately fostering the growth of the wind engineering community. Dr. Chen and CII Adminstrator, Ms. Natalie Goeddertz, are part of the conference organizing committee.
Conference Details Date: May 20-22, 2025 Location: St. Charles Convention Center Address: 1 Convention Center Blvd. St. Charles, MO 63303
Important Dates: Call for Abstract: July 1, 2024 Abstract Submission Close: September 15, 2024 Notification of Acceptance: November 1, 2024 Full Paper Submission Deadline: February 15, 2025 Early Registration Closes: March 15, 2025 https://15acwe.mst.edu/ INSPIRE NEWSLETTER 15
OUTREACH ACTIVITY The INSPIRE Center: A vital stop on Missouri S&T's Mi-STEM camp
The INSPIRE Center stands as a testament to Missouri S&T's commitment to nurturing a diverse and inclusive community of future STEM leaders. As the camp concluded, the university looks forward to building on its success, knowing that the INSPIRE Center will continue to play a significant role in the journey of aspiring young scientists and engineers.
As part of the Minority Introduction to STEM (Mi-STEM) camp at Missouri University of Science and Technology, a group of over 20 high school students, primarily from the St. Louis area, had the opportunity to visit the INSPIRE Center. The center played a pivotal role in enriching their STEM education journey by offering a diverse range of research activities and insights into the world of science, technology, engineering, and mathematics (STEM). Augmented reality (AR) played a central role in their visit, as they interacted with virtual bridges, gaining a unique perspective on engineering and design. The students delved into the exciting realm of additive manufacturing (3D-printing), witnessed the development of state-of-theart robots, and explored the intricacies of a cutting-edge driving simulator. Despite their intense schedule, the students were not limited to the confines of the center. They embarked on tours, including a visit to the Kummer Student Design Center, and were part of a Juneteenth celebration. They experienced the camaraderie of a residential hall and took a refreshing dip in the swimming pool located within the Gale Bullman Building. The INSPIRE Center's contribution to the Mi-STEM camp was invaluable. By offering a window into the possibilities of STEM education, the center inspired the students and broadened their horizons. The campers left with a profound understanding of STEM fields and the confidence that they too can excel in these areas. 16 INSPIRE NEWSLETTER
As part of its ongoing outreach efforts, the CII actively engages in various activities throughout the year. In the current reporting period, the CII hosted a total of eight events, welcoming students, teachers, and summer campers.
04/04/2023
Piloting Manufacturing Academy
04/11/2023
STEM Enrichment
05/11/2023
STEM’s SPACE THEMED EVENT
06/07/2023
Robotic Summer Camp
06/20/2023
Minority STEM Summer Camp
07/10 -11/2023 Cyber-Miner Camp 07/19/2023
Aerospace Camp
08/01/2023
Regional STEM Conference Tour
OUTREACH ACTIVITY Enlightening robotics summer camp captivates young minds at CII The Centre for Intelligent Infrastructure (CII) offered a summer camp on June 7, 2023 that left a profound impact on 54 young attendees. The program offered a comprehensive experience, commencing with an illuminating presentation on the CII's projects, followed by exclusive access to cutting-edge lab facilities. The day concluded with hands-on activities covering drone-assisted bridge inspections, augmented reality interactions with virtual bridges, 3D printing, and a sneak peek at state-of-the-art robots under development, along with a high-tech driving simulator. The campers exhibited boundless curiosity, eagerly probing into topics such as drone sensors, augmented reality (AR) and virtual reality (VR) distinctions, piloting drones, and the mechanics behind magnetic climbing robots. The trip of engaging demonstrations featuring Tello drones, Hololens 2, and the driving simulator left a lasting impression. The success of this robotics summer camp at Missouri S&T's CII underscores the pivotal role of such programs in fostering the curiosity and passion of tomorrow's innovators and researchers.
Unlocking the future of aerospace: Missouri S&T's CII Aerospace Summer Camp Missouri S&T's Centre for Intelligent Infrastructure (CII) opened its doors on July 19th, 2023, welcoming 72 enthusiastic campers to an aerospace summer camp like no other. The camp aimed to provide an intricate understanding of aerospace exploration, blending robotics and augmented reality. Divided into three sessions, each with 24 eager participants, the day featured an engaging mix of presentations, lab tours, and hands-on activities. Campers were introduced to the world of aerospace through an informative PowerPoint presentation, showcasing research ranging from droneassisted bridge inspections to augmented reality interactions with virtual bridges, additive manufacturing, advanced robotic technology, and a state-of-the-art driving simulator. Following the presentations, students embarked on lab tours to witness this cutting-edge technology in action. The highlight of the camp was the hands-on experience, including piloting drones, controlling climbing robots, and immersing themselves in augmented reality. The campers left with a newfound passion for aerospace technology, robotics, and augmented reality, thanks to the invaluable experience provided by the CII. INSPIRE NEWSLETTER 17
INSPIRE University Transportation Center Missouri University of Science and Technology 112 Engineering Research Laboratory, 500 W. 16th St. Rolla, MO 65409
Connect with INSPIRE UTC: • FACEBOOK: www.facebook.com/inspireutc • TWITTER: www.twitter.com/inspire_utc Connect with CII: • FACEBOOK: www.facebook.com/MSTCII • TWITTER: www.twitter.com/MST_CII
Newsletter Editors Genda Chen, INSPIRE UTC Director Natalie Goeddertz, INSPIRE UTC Program/Project Support Coordinator
Contact Us Phone: 573-341-6114 | Email: inspire-utc@mst.edu | Web: inspire-utc.mst.edu Visit our website to follow us on social media.
UPCOMING EVENTS December 4, 2023 Webinar: Digital Twin in the Built Environmnent https://inspire-utc.mst.edu/webinars
March 25-28, 2024 SPIE Smart Structures + NDE 2024 https://spie.org/conferences-and-exhibitions/smartstructures-nde
January 7 -11, 2024 103rd Annual Transportation Research Board (TRB) Meeting June 16 -18, 2024 https://www.trb.org/AnnualMeeting/AnnualMeeting.aspx 9th International Workshop on Structural Control and Monitoring (9IWSCM) March 24-28, 2024 https://9iwscm.ethz.ch/ ACI Concrete Convention www.concrete.org/events/conventions.aspx
inspire-uutc.m inspire-utc.mst.edu/events mst.eedu/events
18 INSPIRE NEWSLETTER