-
Granularity at Scale: Estimating Neighborhood Socioeconomic Indicators from High-Resolution Orthographic Imagery and Hybrid Learning
Authors:
Ethan Brewer,
Giovani Valdrighi,
Parikshit Solunke,
Joao Rulff,
Yurii Piadyk,
Zhonghui Lv,
Jorge Poco,
Claudio Silva
Abstract:
Many areas of the world are without basic information on the socioeconomic well-being of the residing population due to limitations in existing data collection methods. Overhead images obtained remotely, such as from satellite or aircraft, can help serve as windows into the state of life on the ground and help "fill in the gaps" where community information is sparse, with estimates at smaller geog…
▽ More
Many areas of the world are without basic information on the socioeconomic well-being of the residing population due to limitations in existing data collection methods. Overhead images obtained remotely, such as from satellite or aircraft, can help serve as windows into the state of life on the ground and help "fill in the gaps" where community information is sparse, with estimates at smaller geographic scales requiring higher resolution sensors. Concurrent with improved sensor resolutions, recent advancements in machine learning and computer vision have made it possible to quickly extract features from and detect patterns in image data, in the process correlating these features with other information. In this work, we explore how well two approaches, a supervised convolutional neural network and semi-supervised clustering based on bag-of-visual-words, estimate population density, median household income, and educational attainment of individual neighborhoods from publicly available high-resolution imagery of cities throughout the United States. Results and analyses indicate that features extracted from the imagery can accurately estimate the density (R$^2$ up to 0.81) of neighborhoods, with the supervised approach able to explain about half the variation in a population's income and education. In addition to the presented approaches serving as a basis for further geographic generalization, the novel semi-supervised approach provides a foundation for future work seeking to estimate fine-scale information from aerial imagery without the need for label data.
△ Less
Submitted 18 February, 2024; v1 submitted 28 September, 2023;
originally announced September 2023.
-
ARGUS: Visualization of AI-Assisted Task Guidance in AR
Authors:
Sonia Castelo,
Joao Rulff,
Erin McGowan,
Bea Steers,
Guande Wu,
Shaoyu Chen,
Iran Roman,
Roque Lopez,
Ethan Brewer,
Chen Zhao,
**g Qian,
Kyunghyun Cho,
He He,
Qi Sun,
Huy Vo,
Juan Bello,
Michael Krone,
Claudio Silva
Abstract:
The concept of augmented reality (AR) assistants has captured the human imagination for decades, becoming a staple of modern science fiction. To pursue this goal, it is necessary to develop artificial intelligence (AI)-based methods that simultaneously perceive the 3D environment, reason about physical tasks, and model the performer, all in real-time. Within this framework, a wide variety of senso…
▽ More
The concept of augmented reality (AR) assistants has captured the human imagination for decades, becoming a staple of modern science fiction. To pursue this goal, it is necessary to develop artificial intelligence (AI)-based methods that simultaneously perceive the 3D environment, reason about physical tasks, and model the performer, all in real-time. Within this framework, a wide variety of sensors are needed to generate data across different modalities, such as audio, video, depth, speech, and time-of-flight. The required sensors are typically part of the AR headset, providing performer sensing and interaction through visual, audio, and haptic feedback. AI assistants not only record the performer as they perform activities, but also require machine learning (ML) models to understand and assist the performer as they interact with the physical world. Therefore, develo** such assistants is a challenging task. We propose ARGUS, a visual analytics system to support the development of intelligent AR assistants. Our system was designed as part of a multi year-long collaboration between visualization researchers and ML and AR experts. This co-design process has led to advances in the visualization of ML in AR. Our system allows for online visualization of object, action, and step detection as well as offline analysis of previously recorded AR sessions. It visualizes not only the multimodal sensor data streams but also the output of the ML models. This allows developers to gain insights into the performer activities as well as the ML models, hel** them troubleshoot, improve, and fine tune the components of the AR assistant.
△ Less
Submitted 11 August, 2023;
originally announced August 2023.
-
Tracking the industrial growth of modern China with high-resolution panchromatic imagery: A sequential convolutional approach
Authors:
Ethan Brewer,
Zhonghui Lv,
Dan Runfola
Abstract:
Due to insufficient or difficult to obtain data on development in inaccessible regions, remote sensing data is an important tool for interested stakeholders to collect information on economic growth. To date, no studies have utilized deep learning to estimate industrial growth at the level of individual sites. In this study, we harness high-resolution panchromatic imagery to estimate development o…
▽ More
Due to insufficient or difficult to obtain data on development in inaccessible regions, remote sensing data is an important tool for interested stakeholders to collect information on economic growth. To date, no studies have utilized deep learning to estimate industrial growth at the level of individual sites. In this study, we harness high-resolution panchromatic imagery to estimate development over time at 419 industrial sites in the People's Republic of China using a multi-tier computer vision framework. We present two methods for approximating development: (1) structural area coverage estimated through a Mask R-CNN segmentation algorithm, and (2) imputing development directly with visible & infrared radiance from the Visible Infrared Imaging Radiometer Suite (VIIRS). Labels generated from these methods are comparatively evaluated and tested. On a dataset of 2,078 50 cm resolution images spanning 19 years, the results indicate that two dimensions of industrial development can be estimated using high-resolution daytime imagery, including (a) the total square meters of industrial development (average error of 0.021 $\textrm{km}^2$), and (b) the radiance of lights (average error of 9.8 $\mathrm{\frac{nW}{cm^{2}sr}}$). Trend analysis of the techniques reveal estimates from a Mask R-CNN-labeled CNN-LSTM track ground truth measurements most closely. The Mask R-CNN estimates positive growth at every site from the oldest image to the most recent, with an average change of 4,084 $\textrm{m}^2$.
△ Less
Submitted 17 May, 2024; v1 submitted 23 January, 2023;
originally announced January 2023.
-
Enabling Micro-level Demand-Side Grid Flexiblity in Resource Constrained Environments
Authors:
Diego Ponce de Leon Barido,
Javier Rosa,
Stephen Suffian,
Eric Brewer,
Daniel M. Kammen
Abstract:
The increased penetration of uncertain and variable renewable energy presents various resource and operational electric grid challenges. Micro-level (household and small commercial) demand-side grid flexibility could be a cost-effective strategy to integrate high penetrations of wind and solar energy, but literature and field deployments exploring the necessary information and communication techno…
▽ More
The increased penetration of uncertain and variable renewable energy presents various resource and operational electric grid challenges. Micro-level (household and small commercial) demand-side grid flexibility could be a cost-effective strategy to integrate high penetrations of wind and solar energy, but literature and field deployments exploring the necessary information and communication technologies (ICTs) are scant. This paper presents an exploratory framework for enabling information driven grid flexibility through the Internet of Things (IoT), and a proof-of-concept wireless sensor gateway (FlexBox) to collect the necessary parameters for adequately monitoring and actuating the micro-level demand-side. In the summer of 2015, thirty sensor gateways were deployed in the city of Managua (Nicaragua) to develop a baseline for a near future small-scale demand response pilot implementation. FlexBox field data has begun shedding light on relationships between ambient temperature and load energy consumption, load and building envelope energy efficiency challenges, latency communication network challenges, and opportunities to engage existing demand-side user behavioral patterns. Information driven grid flexibility strategies present great opportunity to develop new technologies, system architectures, and implementation approaches that can easily scale across regions, incomes, and levels of development.
△ Less
Submitted 28 April, 2016;
originally announced April 2016.
-
Higgs Boson Exchange Effects in $l^+l^-\to W^+W^-$ at High Energy
Authors:
U. Baur,
E. Brewer
Abstract:
We consider the prospects for detecting effects due to the Higgs exchange diagram in high energy mu^+ mu^-$, e^+ e^-, and tau^+ tau^- collisions producing a pair of W bosons. The processes l^+l^- -> W^+W^- (with l=mu,e,tau) are analyzed, analytically and via numerical simulations, to determine the center of mass energy, sqrt{s}_H, where the effects from Higgs exchange become relevant. The scalin…
▽ More
We consider the prospects for detecting effects due to the Higgs exchange diagram in high energy mu^+ mu^-$, e^+ e^-, and tau^+ tau^- collisions producing a pair of W bosons. The processes l^+l^- -> W^+W^- (with l=mu,e,tau) are analyzed, analytically and via numerical simulations, to determine the center of mass energy, sqrt{s}_H, where the effects from Higgs exchange become relevant. The scaling of sqrt{s}_H with the mass of the incoming leptons is also studied. Special consideration is given to the W^+W^- -> l^pm} nu_l jj final state after experimental acceptance cuts are imposed. Angular cuts are shown to be able to significantly lower sqrt{s}_H.
△ Less
Submitted 27 February, 2009;
originally announced March 2009.
