Monitoring the structural health of the nation鈥檚 aging buildings and bridges is vital to keeping people safe and helping prevent tragedies such as the Surfside condominium collapse in 2021.

That鈥檚 why 色中色视频 researchers have developed four new inventions that use artificial intelligence and virtual reality to improve the structural health monitoring of buildings, bridges, roads and other civil structures.

色中色视频 Professor Necati Catbas, Department of Civil, Environmental, and Construction Engineering (CECE). Catbas was awarded the Aftab Mufti medal in 2015 at the International Conference on Structural Health Monitoring of Intelligent Infrastructure.
色中色视频 Professor Necati Catbas, Department of Civil, Environmental, and Construction Engineering (CECE). Catbas was awarded the Aftab Mufti medal in 2015 at the International Conference on Structural Health Monitoring of Intelligent Infrastructure.

鈥淪tructural health monitoring is an area of need internationally,鈥 says Necati Catbas, a Lockheed Martin St. Laurent Professor in 色中色视频鈥檚 Department of Civil, Environmental and Construction Engineering. 鈥淚t’s almost like human health monitoring. As we get older, monitoring our health becomes very, very critical.鈥

Catbas, who lead the development of the structural health monitoring technologies, says civil infrastructure systems in developed countries are aging but these new technologies can help.

鈥淏y better understanding their conditions, we can anticipate risks and better prioritize infrastructure investments,鈥 he says.

Catbas says that traditional monitoring methods involve onsite visual inspection, which can be both time-consuming and costly with manual inspections and can create road and bridge traffic closures.

In addition to time and expense, sites with aging or damaged structures can pose dangers to those at the site, even if they wear personal protective equipment.

Catbas and his research team developed the technologies to help address these issues.

鈥淚 am very lucky to have collaborated with many people who have expertise in structural health monitoring over the years, and I have to acknowledge their contribution,鈥 he says. 鈥淚t’s not a one-person effort.鈥

Monitoring Structural Health Using Computer Vision and Augmented/Virtual Reality

One invention Catbas and his team developed employs computer vision, while another uses augmented reality (AR) and virtual reality (VR).

He says computer vision can complement sensors and visual inspection of structural health, and that it is very practical because it doesn鈥檛 require access structures such as bridges, buildings, or towers.

鈥淲e can use the camera, and by analyzing the images, we can extract meaningful information about these bridges and buildings,鈥 he says.

The technology, a , enables inspectors to safely view and accurately assess the load-worthiness and serviceability of structures without having to be onsite.

Catbas says that the 色中色视频 invention uses cameras stationed on and around a structure, like a bridge, to collect image and location data related to the structure鈥檚 use. In the bridge example, the data relates to vehicles crossing it. The data can include the vertical or horizontal displacement of girders caused by their movement, vibrational effects and velocity. While the cameras continually monitor the site, computer vision software processes and analyzes the collected data, providing system users with a safety assessment that includes information about structural changes and weaknesses, as well as immediate damage.

The second invention that the team developed is an that uses VR and AR to analyze structures via 鈥渧irtual visits.鈥 VR provides a completely computer-simulated environment, while AR generates or overlays content onto actual views of a real-world environment.

鈥淲ith this technology, you can virtually bring experts to disaster areas, such as buildings and bridges, like after a hurricane,鈥 Catbas says. 鈥淚 can virtually be on a damaged bridge in 色中色视频 discussing decisions with colleagues who might be in California.鈥

Like the first invention, the visualization system provides damage detection and load-carrying information about a structure using cameras and sensors. Additionally, it employs other tools such as robots, unmanned aerial vehicles (UAVs) or drones, LiDAR scanners and infrared thermography cameras. With its visualization platform, the technology provides the collected data and images via a user interface and sophisticated computer graphics. The result is a real-time view of a site and the ability to interact and communicate with people from different locations: onsite, across the country, and even globally.

Enhancing Inspections and Structural Damage Diagnostics Using Artificial Intelligence

Two other inventions developed by Catbas and his team incorporate AI. First, the blends human-centric AI with mixed reality to help fast-track inspection processes and keep costs down while ensuring accuracy. With this invention, an inspector standing outside a damaged building could wear a headset and/or use a hand-held device integrated with the technology.

Example depiction of a bridge inspection using an AI-powered mixed reality system.
Example depiction of a bridge inspection using an AI-powered mixed reality system.

The inspector uses the items to scan the damaged areas, which the system analyzes in real-time, saving the inspector from having to perform manual measurements. It then calculates or assesses the building鈥檚 condition, thus speeding the inspection process. During the assessment, the inspector interacts with the AI and can adjust its defect and detection boundaries. The system uses the inspector鈥檚 changes to retrain the AI model so that the AI’s accuracy improves over time. A major advantage of the invention is its ability to combine the professional judgment of an inspector/engineer with the AI鈥檚 analytical power.

The other invention, the , enables a more proactive approach to managing and maintaining the health and safety of structures. It uses AI to predict damage and minimize the need for data collection from many structures.

鈥淚nstead of putting sensors and devices on all structures, we can collect data from just a few of them,鈥 Catbas says.

He explained that collecting useful data from sensors about damaged structures is expensive and challenging.

鈥淭here is not enough data from damaged areas to train detection models,鈥 he says. 鈥淵et, machine learning (ML) and deep learning (DL) algorithms used with AI yield better, more accurate output using big data sets. As a solution to the data scarcity in civil structural health monitoring applications, the invention takes data collected from structures. It uses model variants of the GAN architecture to generate large, accurate synthetic data samples to train damage diagnostics systems.

“Then, by using AI, we can better understand what’s going on with other similar structures and more effectively decide how to respond,鈥 he says.

Shown are some members of the 色中色视频 CITRS lab with the autonomous Husky robot 鈥淐ypertor 鈥 the Cyber Inspector鈥 (left to right): Furkan L眉leci, Inad Alqurashi, Mahta Zakaria, Dr. Necati Catbas, Abdulrrahman Algadi.
Shown are some members of the 色中色视频 Civil Infrastructure Technologies for Resilience and Safety (CITRS) Initiative lab with the autonomous Husky robot 鈥淐ypertor 鈥 the Cyber Inspector鈥 (left to right): Graduate students Furkan L眉leci ’19MS, Inad Alqurashi, Mahta Zakaria, Lockheed Martin St. Laurent Professor Necati Catbas, Abdulrrahman Algadi.

The technology can predict the dynamic response of a structure change before damage conditions occur. It鈥檚 also possible to create potential future conditions of structures, such as generating data showing what a healthy bridge鈥檚 response would be after damage compared to the response of an unhealthy bridge.

Catbas says that the inventions can be used independently or together. For more information,

Upcoming Projects

Catbas says that his team鈥檚 future research plans include a framework for smart and resilient communities to withstand extreme events.

鈥淚t enhances community resilience by providing valuable insights for disaster preparedness, resource allocation and evacuation planning,鈥 he says. 鈥淭he framework improves emergency management by enabling informed decision-making during crises.鈥

They are also developing a 鈥渄igital twin鈥 of infrastructure assets, like the way NASA uses replicas of spacecraft components.

“They have those components on the ground, and if something happens, they work with these replicas,鈥 he says. 鈥淪o, this twin, in a sense, allows us to collect data simultaneously and work on different structure scenarios using predictive analysis.鈥

Researcher鈥檚 Credentials

Catbas holds a doctorate in structural engineering from the University of Cincinnati. After postdoctoral studies at Drexel University in Philadelphia, he joined 色中色视频鈥檚 College of Engineering and Computer Science in 2003 and is the founding director of the Civil Infrastructure Technologies for Resilience and Safety (CITRS) Initiative. His research covers various aspects of civil engineering, including analysis, design, and assessment of civil infrastructure systems, structural health monitoring, structural identification, and structural dynamics and earthquake engineering.

Technology Available for License

To learn more about Catbas鈥 work and additional potential licensing or sponsored research opportunities, contact Raju.Nagaiah (Raju.Nagaiah@ucf.edu) at (407)-882-0593.