google street view buildings (Google/Building Detective For Disaster Preparedness)

Turning pictures of buildings into better disaster preparedness

Scientists are using data from Google Maps and satellite images to power artificial intelligence applications that can automatically identify characteristics of city’s buildings that would be vulnerable in an earthquake, hurricane or tsunami.

Researchers from the National Science Foundation’s SimCenter, an engineering community focused on modeling the impact of natural hazards, built the Building Recognition using AI at Large-Scale suite of tools. BRAILS creates enhanced building databases for cities by running artificial intelligence-powered simulations on high-performance computers at the Texas Advanced Computing Center (TACC) at the University of Texas at Austin.

"We want to simulate the impact of hazards on all of the buildings in a region, but we don't have a description of the building attributes," said Charles Wang, a postdoctoral researcher at the University of California, Berkeley, and the lead developer of BRAILS told TACC News. "Using AI, we are able to get the needed information. We can train neural network models to infer building information from images and other sources of data."

The basic BRAILS framework uses computer vision to automatically pull building details – architectural features such as roofs, windows, and chimneys -- from satellite and ground-level images found in Google Maps and merges these with other datasets, such as Microsoft Footprint Data and OpenStreetMap. BRAILS users can also enhance the data with tax records, city surveys and other information to get more accurate assessments.

A crowdsourcing effort has contributed some of the data labeling. Volunteer with the SimCenter’s Building Detective for Disaster Preparedness project identified specific architectural features of structures, such as garages, roofs and adjacent buildings, that are then used to train additional machine learning modules. The citizen-science project was launched on March. Within a few weeks, a thousand volunteers had annotated 20,000 images, Wang said.

The researchers ran a series of testbeds to determine the accuracy of the AI-based models. Each generated an inventory of a city’s structures and simulated the impact of a hazard based on historical or plausible events. The team has created testbeds for earthquakes in San Francisco, and for hurricanes in Lake Charles, La., the Texas coast and Atlantic City, N.J.

To train the BRAILS modules and run the simulations, the researchers relied on TACC’s supercomputers -- notably Frontera, the fastest academic supercomputer in the world, and Maverick 2, a GPU-based system designed for deep learning.

"The hazard event simulations -- applying wind fields or ground shaking to thousands or millions of buildings to assess the impact of a hurricane or earthquake -- requires a lot of computing resources and time," Wang said. "For one city-wide simulation, depending on the size, it typically takes hours to run on TACC."

When asked about the performance of BRAILS, Wang touted the accuracy. "For some models, like occupancy, we are seeing the accuracy is close to 100%,” he said. “For other modules, like roof type, we're seeing 90% accuracy."

The researhers outlined the framework in the February 2021 issue of Automation in Construction and presented a testbed for Hurricane Laura the 2020 hurricane that made landfall in Louisiana at the 2021 Workshop on SHared Operational REsearch Logistics In the Nearshore Environment.

"Our objectives are two-fold," Wang said. "First, to mitigate the damage in the future by doing simulations and providing results to decision- and policy-makers. And second, to use this data to quickly simulate a real scenario – instantly following a new event, before the reconnaissance team is deployed. We hope near-real-time simulation results can help guide emergency response with greater accuracy."

About the Author

Susan Miller is executive editor at GCN.

Over a career spent in tech media, Miller has worked in editorial, print production and online, starting on the copy desk at IDG’s ComputerWorld, moving to print production for Federal Computer Week and later helping launch websites and email newsletter delivery for FCW. After a turn at Virginia’s Center for Innovative Technology, where she worked to promote technology-based economic development, she rejoined what was to become 1105 Media in 2004, eventually managing content and production for all the company's government-focused websites. Miller shifted back to editorial in 2012, when she began working with GCN.

Miller has a BA and MA from West Chester University and did Ph.D. work in English at the University of Delaware.

Connect with Susan at [email protected] or @sjaymiller.


  • Records management: Look beyond the NARA mandates

    Pandemic tests electronic records management

    Between the rush enable more virtual collaboration, stalled digitization of archived records and managing records that reside in datasets, records management executives are sorting through new challenges.

  • boy learning at home (Travelpixs/

    Tucson’s community wireless bridges the digital divide

    The city built cell sites at government-owned facilities such as fire departments and libraries that were already connected to Tucson’s existing fiber backbone.

Stay Connected