Showing 1–23 of 23 results for author: Ganguly, A R

Topological Determinants of Resilience in Urban Rail Networks Facing Multi-Hazard Disruptions

Authors: Ashis Kumar Pal, Auroop R. Ganguly

Abstract: This study examines the failure and recovery, two key components of resilience of nine major urban rail networks - Washington DC, Boston, Chicago, Delhi, Tokyo, Paris, Shanghai, London, and New York - against multi-hazard scenarios utilizing a quantitative approach focused on topological parameters to evaluate network resilience. Employing percolation-based network dismantling approach like Sequen… ▽ More This study examines the failure and recovery, two key components of resilience of nine major urban rail networks - Washington DC, Boston, Chicago, Delhi, Tokyo, Paris, Shanghai, London, and New York - against multi-hazard scenarios utilizing a quantitative approach focused on topological parameters to evaluate network resilience. Employing percolation-based network dismantling approach like Sequential Removal of Nodes and Giant Connected Component analysis, alongside random, centrality-based targeted attacks and flooding failure, findings reveal Domirank centrality's superior resilience in disruption and recovery phases. Kendall's tau coefficient's application further elucidates the relationships between network properties and resilience, underscoring larger networks' vulnerability yet faster recovery due to inherent redundancy and connectivity. Key attributes like average degree and path length consistently influence recovery effectiveness, while the clustering coefficient's positive correlation with recovery highlights the benefits of local interconnectivity. This analysis emphasizes the critical role of select nodes and the importance of balancing network design for enhanced resilience, offering insights for future urban rail system planning against multi-hazard threats. △ Less

Submitted 8 July, 2024; originally announced July 2024.

A Tri-Level Optimization Model for Interdependent Infrastructure Network Resilience Against Compound Hazard Events

Authors: Matthew R. Oster, Ilya Amburg, Samrat Chatterjee, Daniel A. Eisenberg, Dennis G. Thomas, Feng Pan, Auroop R. Ganguly

Abstract: Resilient operation of interdependent infrastructures against compound hazard events is essential for maintaining societal well-being. To address consequence assessment challenges in this problem space, we propose a novel tri-level optimization model applied to a proof-of-concept case study with fuel distribution and transportation networks -- encompassing one realistic network; one fictitious, ye… ▽ More Resilient operation of interdependent infrastructures against compound hazard events is essential for maintaining societal well-being. To address consequence assessment challenges in this problem space, we propose a novel tri-level optimization model applied to a proof-of-concept case study with fuel distribution and transportation networks -- encompassing one realistic network; one fictitious, yet realistic network; as well as networks drawn from three synthetic distributions. Mathematically, our approach takes the form of a defender-attacker-defender (DAD) model -- a multi-agent tri-level optimization, comprised of a defender, attacker, and an operator acting in sequence. Here, our notional operator may choose proxy actions to operate an interdependent system comprised of fuel terminals and gas stations (functioning as supplies) and a transportation network with traffic flow (functioning as demand) to minimize unmet demand at gas stations. A notional attacker aims to hypothetically disrupt normal operations by reducing supply at the supply terminals, and the notional defender aims to identify best proxy defense policy options which include hardening supply terminals or allowing alternative distribution methods such as trucking reserve supplies. We solve our DAD formulation at a metropolitan scale and present practical defense policy insights against hypothetical compound hazards. We demonstrate the generalizability of our framework by presenting results for a realistic network; a fictitious, yet realistic network; as well as for three networks drawn from synthetic distributions. Additionally, we demonstrate the scalability of the framework by investigating runtime performance as a function of the network size. Steps for future research are also discussed. △ Less

Submitted 16 October, 2023; originally announced October 2023.

CDA: Contrastive-adversarial Domain Adaptation

Authors: Nishant Yadav, Mahbubul Alam, Ahmed Farahat, Dipanjan Ghosh, Chetan Gupta, Auroop R. Ganguly

Abstract: Recent advances in domain adaptation reveal that adversarial learning on deep neural networks can learn domain invariant features to reduce the shift between source and target domains. While such adversarial approaches achieve domain-level alignment, they ignore the class (label) shift. When class-conditional data distributions are significantly different between the source and target domain, it c… ▽ More Recent advances in domain adaptation reveal that adversarial learning on deep neural networks can learn domain invariant features to reduce the shift between source and target domains. While such adversarial approaches achieve domain-level alignment, they ignore the class (label) shift. When class-conditional data distributions are significantly different between the source and target domain, it can generate ambiguous features near class boundaries that are more likely to be misclassified. In this work, we propose a two-stage model for domain adaptation called \textbf{C}ontrastive-adversarial \textbf{D}omain \textbf{A}daptation \textbf{(CDA)}. While the adversarial component facilitates domain-level alignment, two-stage contrastive learning exploits class information to achieve higher intra-class compactness across domains resulting in well-separated decision boundaries. Furthermore, the proposed contrastive framework is designed as a plug-and-play module that can be easily embedded with existing adversarial methods for domain adaptation. We conduct experiments on two widely used benchmark datasets for domain adaptation, namely, \textit{Office-31} and \textit{Digits-5}, and demonstrate that CDA achieves state-of-the-art results on both datasets. △ Less

Submitted 10 January, 2023; originally announced January 2023.

Robust Causality and False Attribution in Data-Driven Earth Science Discoveries

Authors: Elizabeth Eldhose, Tejasvi Chauhan, Vikram Chandel, Subimal Ghosh, Auroop R. Ganguly

Abstract: Causal and attribution studies are essential for earth scientific discoveries and critical for informing climate, ecology, and water policies. However, the current generation of methods needs to keep pace with the complexity of scientific and stakeholder challenges and data availability combined with the adequacy of data-driven methods. Unless carefully informed by physics, they run the risk of co… ▽ More Causal and attribution studies are essential for earth scientific discoveries and critical for informing climate, ecology, and water policies. However, the current generation of methods needs to keep pace with the complexity of scientific and stakeholder challenges and data availability combined with the adequacy of data-driven methods. Unless carefully informed by physics, they run the risk of conflating correlation with causation or getting overwhelmed by estimation inaccuracies. Given that natural experiments, controlled trials, interventions, and counterfactual examinations are often impractical, information-theoretic methods have been developed and are being continually refined in the earth sciences. Here we show that transfer entropy-based causal graphs, which have recently become popular in the earth sciences with high-profile discoveries, can be spurious even when augmented with statistical significance. We develop a subsample-based ensemble approach for robust causality analysis. Simulated data, and observations in climate and ecohydrology, suggest the robustness and consistency of this approach. △ Less

Submitted 26 September, 2022; originally announced September 2022.

Comments: 29 pages, 5 main figures, 7 Supplementary figures

Climate-mediated shifts in temperature fluctuations promote extinction risk

Authors: Kate Duffy, Tarik C. Gouhier, Auroop R. Ganguly

Abstract: Climate-mediated changes in the spatiotemporal distribution of thermal stress can destabilize animal populations and promote extinction risk. Using quantile, spectral, and wavelet analyses of temperature projections from the latest generation of earth system models, we show that significant regional differences are expected to arise in the way that temperatures will increase over time. When integr… ▽ More Climate-mediated changes in the spatiotemporal distribution of thermal stress can destabilize animal populations and promote extinction risk. Using quantile, spectral, and wavelet analyses of temperature projections from the latest generation of earth system models, we show that significant regional differences are expected to arise in the way that temperatures will increase over time. When integrated into empirically-parameterized mathematical models that simulate the dynamical and cumulative effects of thermal stress on the performance of 38 global ectotherm species, the projected spatiotemporal changes in temperature fluctuations are expected to give rise to complex regional changes in population abundance and stability over the course of the 21st century. However, despite their idiosyncratic effects on stability, projected temperatures universally increase extinction risk. These results show that population changes under future climate conditions may be more extensive and complex than the current literature suggests based on the statistical relationship between biological performance and average temperature. △ Less

Submitted 20 December, 2022; v1 submitted 23 February, 2022; originally announced February 2022.

Journal ref: Nat. Clim. Chang. 12, 1037-1044 (2022)

Deep Transfer Learning on Satellite Imagery Improves Air Quality Estimates in Develo** Nations

Authors: Nishant Yadav, Meytar Sorek-Hamer, Michael Von Pohle, Ata Akbari Asanjan, Adwait Sahasrabhojanee, Esra Suel, Raphael Arku, Violet Lingenfelter, Michael Brauer, Majid Ezzati, Nikunj Oza, Auroop R. Ganguly

Abstract: Urban air pollution is a public health challenge in low- and middle-income countries (LMICs). However, LMICs lack adequate air quality (AQ) monitoring infrastructure. A persistent challenge has been our inability to estimate AQ accurately in LMIC cities, which hinders emergency preparedness and risk mitigation. Deep learning-based models that map satellite imagery to AQ can be built for high-incom… ▽ More Urban air pollution is a public health challenge in low- and middle-income countries (LMICs). However, LMICs lack adequate air quality (AQ) monitoring infrastructure. A persistent challenge has been our inability to estimate AQ accurately in LMIC cities, which hinders emergency preparedness and risk mitigation. Deep learning-based models that map satellite imagery to AQ can be built for high-income countries (HICs) with adequate ground data. Here we demonstrate that a scalable approach that adapts deep transfer learning on satellite imagery for AQ can extract meaningful estimates and insights in LMIC cities based on spatiotemporal patterns learned in HIC cities. The approach is demonstrated for Accra in Ghana, Africa, with AQ patterns learned from two US cities, specifically Los Angeles and New York. △ Less

Submitted 17 February, 2022; originally announced February 2022.

Comments: Under review

Explainable deep learning for insights in El Niño and river flows

Authors: Yumin Liu, Kate Duffy, Jennifer G. Dy, Auroop R. Ganguly

Abstract: The El Niño Southern Oscillation (ENSO) is a semi-periodic fluctuation in sea surface temperature (SST) over the tropical central and eastern Pacific Ocean that influences interannual variability in regional hydrology across the world through long-range dependence or teleconnections. Recent research has demonstrated the value of Deep Learning (DL) methods for improving ENSO prediction as well as C… ▽ More The El Niño Southern Oscillation (ENSO) is a semi-periodic fluctuation in sea surface temperature (SST) over the tropical central and eastern Pacific Ocean that influences interannual variability in regional hydrology across the world through long-range dependence or teleconnections. Recent research has demonstrated the value of Deep Learning (DL) methods for improving ENSO prediction as well as Complex Networks (CN) for understanding teleconnections. However, gaps in predictive understanding of ENSO-driven river flows include the black box nature of DL, the use of simple ENSO indices to describe a complex phenomenon and translating DL-based ENSO predictions to river flow predictions. Here we show that eXplainable DL (XDL) methods, based on saliency maps, can extract interpretable predictive information contained in global SST and discover SST information regions and dependence structures relevant for river flows which, in tandem with climate network constructions, enable improved predictive understanding. Our results reveal additional information content in global SST beyond ENSO indices, develop understanding of how SSTs influence river flows, and generate improved river flow prediction, including uncertainty estimation. Observations, reanalysis data, and earth system model simulations are used to demonstrate the value of the XDL-CN based methods for future interannual and decadal scale climate projections. △ Less

Submitted 23 January, 2023; v1 submitted 7 January, 2022; originally announced January 2022.

Journal ref: Nat Commun 14, 339 (2023)

Bayesian Deep Learning Hyperparameter Search for Robust Function Map** to Polynomials with Noise

Authors: Nidhin Harilal, Udit Bhatia, Auroop R. Ganguly

Abstract: Advances in neural architecture search, as well as explainability and interpretability of connectionist architectures, have been reported in the recent literature. However, our understanding of how to design Bayesian Deep Learning (BDL) hyperparameters, specifically, the depth, width and ensemble size, for robust function map** with uncertainty quantification, is still emerging. This paper attem… ▽ More Advances in neural architecture search, as well as explainability and interpretability of connectionist architectures, have been reported in the recent literature. However, our understanding of how to design Bayesian Deep Learning (BDL) hyperparameters, specifically, the depth, width and ensemble size, for robust function map** with uncertainty quantification, is still emerging. This paper attempts to further our understanding by map** Bayesian connectionist representations to polynomials of different orders with varying noise types and ratios. We examine the noise-contaminated polynomials to search for the combination of hyperparameters that can extract the underlying polynomial signals while quantifying uncertainties based on the noise attributes. Specifically, we attempt to study the question that an appropriate neural architecture and ensemble configuration can be found to detect a signal of any n-th order polynomial contaminated with noise having different distributions and signal-to-noise (SNR) ratios and varying noise attributes. Our results suggest the possible existence of an optimal network depth as well as an optimal number of ensembles for prediction skills and uncertainty quantification, respectively. However, optimality is not discernible for width, even though the performance gain reduces with increasing width at high values of width. Our experiments and insights can be directional to understand theoretical properties of BDL representations and to design practical solutions. △ Less

Submitted 23 June, 2021; originally announced June 2021.

Mega Regional Heat Patterns in US Urban Corridors

Authors: Babak Jalalzadeh Fard, Udit Bhatia, Auroop R. Ganguly

Abstract: Current literature suggests that urban heat-islands and their consequences are intensifying under climate change and urbanization. Here we explore the relatively unexplored hypothesis that emerging urban corridors (UCs) spawn megaregions of intense heat which are evident from observations. A delineation of the eleven United States UCs relative to their underlying climatological regions (non-UCs) s… ▽ More Current literature suggests that urban heat-islands and their consequences are intensifying under climate change and urbanization. Here we explore the relatively unexplored hypothesis that emerging urban corridors (UCs) spawn megaregions of intense heat which are evident from observations. A delineation of the eleven United States UCs relative to their underlying climatological regions (non-UCs) suggest a surprisingly mixed trend. Medians and trends of winter temperatures over the last 60-years are generally higher in the UCs but no such general trends are observed in the summer. Heat wave metrics related to public health, energy demand and relative intensity do not exhibit significantly higher overall trends. Temperature and heat wave indices in the UCs exhibit high correlations with each other including across seasons. Spatiotemporal patterns in population, along with urbanization, agriculture and elevation, exhibit high (positive or negative) rank correlations with warming and heatwave intensification. The findings can inform climate adaptation in megalopolises. △ Less

Submitted 25 November, 2020; originally announced November 2020.

Comments: 18 pages, 5 figures, 4 tables

Machine Learning for Robust Identification of Complex Nonlinear Dynamical Systems: Applications to Earth Systems Modeling

Authors: Nishant Yadav, Sai Ravela, Auroop R. Ganguly

Abstract: Systems exhibiting nonlinear dynamics, including but not limited to chaos, are ubiquitous across Earth Sciences such as Meteorology, Hydrology, Climate and Ecology, as well as Biology such as neural and cardiac processes. However, System Identification remains a challenge. In climate and earth systems models, while governing equations follow from first principles and understanding of key processes… ▽ More Systems exhibiting nonlinear dynamics, including but not limited to chaos, are ubiquitous across Earth Sciences such as Meteorology, Hydrology, Climate and Ecology, as well as Biology such as neural and cardiac processes. However, System Identification remains a challenge. In climate and earth systems models, while governing equations follow from first principles and understanding of key processes has steadily improved, the largest uncertainties are often caused by parameterizations such as cloud physics, which in turn have witnessed limited improvements over the last several decades. Climate scientists have pointed to Machine Learning enhanced parameter estimation as a possible solution, with proof-of-concept methodological adaptations being examined on idealized systems. While climate science has been highlighted as a "Big Data" challenge owing to the volume and complexity of archived model-simulations and observations from remote and in-situ sensors, the parameter estimation process is often relatively a "small data" problem. A crucial question for data scientists in this context is the relevance of state-of-the-art data-driven approaches including those based on deep neural networks or kernel-based processes. Here we consider a chaotic system - two-level Lorenz-96 - used as a benchmark model in the climate science literature, adopt a methodology based on Gaussian Processes for parameter estimation and compare the gains in predictive understanding with a suite of Deep Learning and strawman Linear Regression methods. Our results show that adaptations of kernel-based Gaussian Processes can outperform other approaches under small data constraints along with uncertainty quantification; and needs to be considered as a viable approach in climate science and earth system modeling. △ Less

Submitted 12 August, 2020; originally announced August 2020.

Comments: 10 pages

Resilience of Urban Transport Network-of-Networks under Intense Flood Hazards Exacerbated by Targeted Attacks

Authors: Nishant Yadav, Samrat Chatterjee, Auroop R. Ganguly

Abstract: Natural hazards including floods can trigger catastrophic failures in interdependent urban transport network-of-networks (NoNs). Population growth has enhanced transportation demand while urbanization and climate change have intensified urban floods. However, despite the clear need to develop actionable insights for improving the resilience of critical urban lifelines, the theory and methods remai… ▽ More Natural hazards including floods can trigger catastrophic failures in interdependent urban transport network-of-networks (NoNs). Population growth has enhanced transportation demand while urbanization and climate change have intensified urban floods. However, despite the clear need to develop actionable insights for improving the resilience of critical urban lifelines, the theory and methods remain underdeveloped. Furthermore, as infrastructure systems become more intelligent, security experts point to the growing threat of targeted cyber-physical attacks during natural hazards. Here we develop a hypothesis-driven resilience framework for urban transport NoNs, which we demonstrate on the London Rail Network (LRN). We find that topological attributes designed for maximizing efficiency rather than robustness render the network more vulnerable to compound natural-targeted threats including cascading failures. Our results suggest that an organizing principle for post-disruption recovery may be developed with network science principles. Our findings and frameworks can generalize to urban lifelines and more generally to real-world spatial networks. △ Less

Submitted 11 December, 2019; v1 submitted 14 November, 2019; originally announced November 2019.

A framework for deep learning emulation of numerical models with a case study in satellite remote sensing

Authors: Kate Duffy, Thomas Vandal, Weile Wang, Ramakrishna Nemani, Auroop R. Ganguly

Abstract: Numerical models based on physics represent the state-of-the-art in earth system modeling and comprise our best tools for generating insights and predictions. Despite rapid growth in computational power, the perceived need for higher model resolutions overwhelms the latest-generation computers, reducing the ability of modelers to generate simulations for understanding parameter sensitivities and c… ▽ More Numerical models based on physics represent the state-of-the-art in earth system modeling and comprise our best tools for generating insights and predictions. Despite rapid growth in computational power, the perceived need for higher model resolutions overwhelms the latest-generation computers, reducing the ability of modelers to generate simulations for understanding parameter sensitivities and characterizing variability and uncertainty. Thus, surrogate models are often developed to capture the essential attributes of the full-blown numerical models. Recent successes of machine learning methods, especially deep learning, across many disciplines offer the possibility that complex nonlinear connectionist representations may be able to capture the underlying complex structures and nonlinear processes in earth systems. A difficult test for deep learning-based emulation, which refers to function approximation of numerical models, is to understand whether they can be comparable to traditional forms of surrogate models in terms of computational efficiency while simultaneously reproducing model results in a credible manner. A deep learning emulation that passes this test may be expected to perform even better than simple models with respect to capturing complex processes and spatiotemporal dependencies. Here we examine, with a case study in satellite-based remote sensing, the hypothesis that deep learning approaches can credibly represent the simulations from a surrogate model with comparable computational efficiency. Our results are encouraging in that the deep learning emulation reproduces the results with acceptable accuracy and often even faster performance. We discuss the broader implications of our results in light of the pace of improvements in high-performance implementations of deep learning as well as the growing desire for higher-resolution simulations in the earth sciences. △ Less

Submitted 7 January, 2022; v1 submitted 29 October, 2019; originally announced October 2019.

Comments: 6 pages, 8 figures, 4 tables

Universal and generalizable restoration strategies for degraded ecological networks

Authors: Udit Bhatia, Tarik Gouhier, Auroop Ratan Ganguly

Abstract: Humans are increasingly stressing ecosystems via habitat destruction, climate change and global population movements leading to the widespread loss of biodiversity and the disruption of key ecological services. Ecosystems characterized primarily by mutualistic relationships between species such as plant-pollinator interactions may be particularly vulnerable to such perturbations because the loss o… ▽ More Humans are increasingly stressing ecosystems via habitat destruction, climate change and global population movements leading to the widespread loss of biodiversity and the disruption of key ecological services. Ecosystems characterized primarily by mutualistic relationships between species such as plant-pollinator interactions may be particularly vulnerable to such perturbations because the loss of biodiversity can cause extinction cascades that can compromise the entire network. Here, we develop a general restoration strategy based on network-science for degraded ecosystems. Specifically, we show that network topology can be used to identify the optimal sequence of species reintroductions needed to maximize biodiversity gains following partial and full ecosystem collapse. This restoration strategy generalizes across topologically-disparate and geographically-distributed ecosystems. Additionally, we find that although higher connectance and diversity promote persistence in pristine ecosystems, these attributes reduce the effectiveness of restoration efforts in degraded networks. Hence, focusing on restoring the factors that promote persistence in pristine ecosystems may yield suboptimal recovery strategies for degraded ecosystems. Overall, our results have important insights for designing effective ecosystem restoration strategies to preserve biodiversity and ensure the delivery of critical natural services that fuel economic development, food security and human health around the globe △ Less

Submitted 13 November, 2018; originally announced November 2018.

Precipitation extremes and depth-duration-frequency under internal climate variability

Authors: Udit Bhatia, Auroop Ratan Ganguly

Abstract: Natural climate variability, captured through multiple initial condition ensembles, may be comparable to the variability caused by knowledge gaps in future emissions trajectories and in the physical science basis, especially at adaptation-relevant scales and projection horizons. The relations to chaos theory, including sensitivity to initial conditions, have caused the resulting variability in pro… ▽ More Natural climate variability, captured through multiple initial condition ensembles, may be comparable to the variability caused by knowledge gaps in future emissions trajectories and in the physical science basis, especially at adaptation-relevant scales and projection horizons. The relations to chaos theory, including sensitivity to initial conditions, have caused the resulting variability in projections to be viewed as the irreducible uncertainty component of climate. The multiplier effect of ensembles from emissions-trajectories, multiple-models and initial-conditions contribute to the challenge. We show that ignoring this variability results in underestimation of precipitation extremes return periods leading to maladaptation. However, we show that concatenating initial-condition ensembles results in reduction of hydroclimate uncertainty. We show how this reduced uncertainty in precipitation extremes percolates to adaptation-relevant-Depth-Duration Frequency curves. Hence, generation of additional initial condition ensembles therefore no longer needs to be viewed as an uncertainty explosion problem but as a solution that can lead to uncertainty reduction in assessment of extremes. △ Less

Submitted 21 June, 2019; v1 submitted 25 November, 2018; originally announced November 2018.

Generalized network recovery based on topology and optimization for real-world systems

Authors: Udit Bhatia, Lina Sela Perelman, Auroop Ratan Ganguly

Abstract: Designing effective recovery strategies for damaged networked systems is critical to the resilience of built, human and natural systems. However, progress has been limited by the inability to bring together distinct philosophies, such as complex network topology through centrality measures and network flow optimization through entropy measures. Network centrality-based metrics are relatively more… ▽ More Designing effective recovery strategies for damaged networked systems is critical to the resilience of built, human and natural systems. However, progress has been limited by the inability to bring together distinct philosophies, such as complex network topology through centrality measures and network flow optimization through entropy measures. Network centrality-based metrics are relatively more intuitive and computationally efficient while optimization-based approaches are more amenable to dynamic adjustments. Here we show, with case studies in real-world transportation systems, that the two distinct network philosophies can be blended to form a hybrid recovery strategy that is more effective than either, with the relative performance depending on aggregate network attributes. Direct applications include disaster management and climate adaptation sciences, where recovery of lifeline networks can save lives and economies. △ Less

Submitted 17 November, 2018; originally announced November 2018.

Quantifying Uncertainty in Discrete-Continuous and Skewed Data with Bayesian Deep Learning

Authors: Thomas Vandal, Evan Kodra, Jennifer Dy, Sangram Ganguly, Ramakrishna Nemani, Auroop R. Ganguly

Abstract: Deep Learning (DL) methods have been transforming computer vision with innovative adaptations to other domains including climate change. For DL to pervade Science and Engineering (S&E) applications where risk management is a core component, well-characterized uncertainty estimates must accompany predictions. However, S&E observations and model-simulations often follow heavily skewed distributions… ▽ More Deep Learning (DL) methods have been transforming computer vision with innovative adaptations to other domains including climate change. For DL to pervade Science and Engineering (S&E) applications where risk management is a core component, well-characterized uncertainty estimates must accompany predictions. However, S&E observations and model-simulations often follow heavily skewed distributions and are not well modeled with DL approaches, since they usually optimize a Gaussian, or Euclidean, likelihood loss. Recent developments in Bayesian Deep Learning (BDL), which attempts to capture uncertainties from noisy observations, aleatoric, and from unknown model parameters, epistemic, provide us a foundation. Here we present a discrete-continuous BDL model with Gaussian and lognormal likelihoods for uncertainty quantification (UQ). We demonstrate the approach by develo** UQ estimates on `DeepSD', a super-resolution based DL model for Statistical Downscaling (SD) in climate applied to precipitation, which follows an extremely skewed distribution. We find that the discrete-continuous models outperform a basic Gaussian distribution in terms of predictive accuracy and uncertainty calibration. Furthermore, we find that the lognormal distribution, which can handle skewed distributions, produces quality uncertainty estimates at the extremes. Such results may be important across S&E, as well as other domains such as finance and economics, where extremes are often of significant interest. Furthermore, to our knowledge, this is the first UQ model in SD where both aleatoric and epistemic uncertainties are characterized. △ Less

Submitted 24 May, 2018; v1 submitted 13 February, 2018; originally announced February 2018.

Comments: 10 Pages

Journal ref: The 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, August 19--23, 2018, London, United Kingdom

Physics-guided probabilistic modeling of extreme precipitation under climate change

Authors: Evan Kodra, Singdhansu Chatterjee, Stone Chen, Auroop R. Ganguly

Abstract: Earth System Models (ESMs) are the state of the art for projecting the effects of climate change. However, longstanding uncertainties in their ability to simulate regional and local precipitation extremes and related processes inhibit decision making. Stakeholders would be best supported by probabilistic projections of changes in extreme precipitation at relevant space-time scales. Here we propose… ▽ More Earth System Models (ESMs) are the state of the art for projecting the effects of climate change. However, longstanding uncertainties in their ability to simulate regional and local precipitation extremes and related processes inhibit decision making. Stakeholders would be best supported by probabilistic projections of changes in extreme precipitation at relevant space-time scales. Here we propose an empirical Bayesian model that extends an existing skill and consensus based weighting framework and test the hypothesis that nontrivial, physics-guided measures of ESM skill can help produce reliable probabilistic characterization of climate extremes. Specifically, the model leverages knowledge of physical relationships between temperature, atmospheric moisture capacity, and extreme precipitation intensity to iteratively weight and combine ESMs and estimate probability distributions of return levels. Out-of-sample validation shows evidence that the Bayesian model is a sound method for deriving reliable probabilistic projections. Beyond precipitation extremes, the framework may be a basis for a generic, physics-guided approach to modeling probability distributions of climate variables in general, extremes or otherwise. △ Less

Submitted 18 July, 2017; originally announced July 2017.

DeepSD: Generating High Resolution Climate Change Projections through Single Image Super-Resolution

Authors: Thomas Vandal, Evan Kodra, Sangram Ganguly, Andrew Michaelis, Ramakrishna Nemani, Auroop R Ganguly

Abstract: The impacts of climate change are felt by most critical systems, such as infrastructure, ecological systems, and power-plants. However, contemporary Earth System Models (ESM) are run at spatial resolutions too coarse for assessing effects this localized. Local scale projections can be obtained using statistical downscaling, a technique which uses historical climate observations to learn a low-reso… ▽ More The impacts of climate change are felt by most critical systems, such as infrastructure, ecological systems, and power-plants. However, contemporary Earth System Models (ESM) are run at spatial resolutions too coarse for assessing effects this localized. Local scale projections can be obtained using statistical downscaling, a technique which uses historical climate observations to learn a low-resolution to high-resolution map**. Depending on statistical modeling choices, downscaled projections have been shown to vary significantly terms of accuracy and reliability. The spatio-temporal nature of the climate system motivates the adaptation of super-resolution image processing techniques to statistical downscaling. In our work, we present DeepSD, a generalized stacked super resolution convolutional neural network (SRCNN) framework for statistical downscaling of climate variables. DeepSD augments SRCNN with multi-scale input channels to maximize predictability in statistical downscaling. We provide a comparison with Bias Correction Spatial Disaggregation as well as three Automated-Statistical Downscaling approaches in downscaling daily precipitation from 1 degree (~100km) to 1/8 degrees (~12.5km) over the Continental United States. Furthermore, a framework using the NASA Earth Exchange (NEX) platform is discussed for downscaling more than 20 ESM models with multiple emission scenarios. △ Less

Submitted 8 March, 2017; originally announced March 2017.

Comments: 9 pages, 5 Figures, 2 Tables

Intercomparison of Machine Learning Methods for Statistical Downscaling: The Case of Daily and Extreme Precipitation

Authors: Thomas Vandal, Evan Kodra, Auroop R Ganguly

Abstract: Statistical downscaling of global climate models (GCMs) allows researchers to study local climate change effects decades into the future. A wide range of statistical models have been applied to downscaling GCMs but recent advances in machine learning have not been explored. In this paper, we compare four fundamental statistical methods, Bias Correction Spatial Disaggregation (BCSD), Ordinary Least… ▽ More Statistical downscaling of global climate models (GCMs) allows researchers to study local climate change effects decades into the future. A wide range of statistical models have been applied to downscaling GCMs but recent advances in machine learning have not been explored. In this paper, we compare four fundamental statistical methods, Bias Correction Spatial Disaggregation (BCSD), Ordinary Least Squares, Elastic-Net, and Support Vector Machine, with three more advanced machine learning methods, Multi-task Sparse Structure Learning (MSSL), BCSD coupled with MSSL, and Convolutional Neural Networks to downscale daily precipitation in the Northeast United States. Metrics to evaluate of each method's ability to capture daily anomalies, large scale climate shifts, and extremes are analyzed. We find that linear methods, led by BCSD, consistently outperform non-linear approaches. The direct application of state-of-the-art machine learning methods to statistical downscaling does not provide improvements over simpler, longstanding approaches. △ Less

Submitted 13 February, 2017; originally announced February 2017.

Comments: 20 pages, 6 figures, 3 tables

Characterizing climate predictability and model response variability from multiple initial condition and multi-model ensembles

Authors: Devashish Kumar, Auroop R. Ganguly

Abstract: Climate models are thought to solve boundary value problems unlike numerical weather prediction, which is an initial value problem. However, climate internal variability (CIV) is thought to be relatively important at near-term (0-30 year) prediction horizons, especially at higher resolutions. The recent availability of significant numbers of multi-model (MME) and multi-initial condition (MICE) ens… ▽ More Climate models are thought to solve boundary value problems unlike numerical weather prediction, which is an initial value problem. However, climate internal variability (CIV) is thought to be relatively important at near-term (0-30 year) prediction horizons, especially at higher resolutions. The recent availability of significant numbers of multi-model (MME) and multi-initial condition (MICE) ensembles allows for the first time a direct sensitivity analysis of CIV versus model response variability (MRV). Understanding the relative agreement and variability of MME and MICE ensembles for multiple regions, resolutions, and projection horizons is critical for focusing model improvements, diagnostics, and prognosis, as well as impacts, adaptation, and vulnerability studies. Here we find that CIV (MICE agreement) is lower (higher) than MRV (MME agreement) across all spatial resolutions and projection time horizons for both temperature and precipitation. However, CIV dominates MRV over higher latitudes generally and in specific regions. Furthermore, CIV is considerably larger than MRV for precipitation compared to temperature across all horizontal and projection scales and seasons. Precipitation exhibits larger uncertainties, sharper decay of MICE agreement compared to MME, and relatively greater dominance of CIV over MRV at higher latitudes. The findings are crucial for climate predictability and adaptation strategies at stakeholder-relevant scales. △ Less

Submitted 18 January, 2016; originally announced January 2016.

Space-time Trends in U.S. Meteorological Droughts

Authors: Poulomi Ganguli, Auroop R. Ganguly

Abstract: Understanding droughts in a climate context remains a major challenge. Over the United States, different choices of observations and metrics have often produced diametrically opposite insights. This paper focuses on understanding and characterizing meteorological droughts from station measurements of precipitation. The Standardized Precipitation Index is computed and analyzed to obtain drought sev… ▽ More Understanding droughts in a climate context remains a major challenge. Over the United States, different choices of observations and metrics have often produced diametrically opposite insights. This paper focuses on understanding and characterizing meteorological droughts from station measurements of precipitation. The Standardized Precipitation Index is computed and analyzed to obtain drought severity, duration and frequency. Average drought severity trends are found to be uncertain and data-dependent. Furthermore, the mean and spatial variance do not show any discernible non-stationary behavior. However, the spatial coverage of extreme meteorological droughts in the United States exhibits an increasing trend over nearly all of the last century. Furthermore, the coverage over the last half decade exceeds that of the dust bowl era. Previous literature suggests that climate extremes do not necessarily follow the trends or uncertainties exhibited by the averages. While this possibility has been suggested for droughts, this paper for the first time clearly delineates and differentiates the trends in the mean, variability and extremes of meteorological droughts in the United States, and uncovers the trends in the spatial coverage of extremes. Multiple data sets, as well as years exhibiting large, and possibly anomalous, droughts are carefully examined to characterize trends and uncertainties. Nonlinear dependence among meteorological drought attributes necessitates the use of copula-based tools from probability theory. Severity-duration-frequency curves are generated to demonstrate how these insights may be translated to design and policy. △ Less

Submitted 23 December, 2015; originally announced December 2015.

Water Stress on U.S. Power Production at Decadal Time Horizons

Authors: Poulomi Ganguli, Devashish Kumar, Auroop R. Ganguly

Abstract: Thermoelectric power production at risk, owing to current and projected water scarcity and rising stream temperatures, is assessed for the contiguous United States at decadal scales. Regional water scarcity is driven by climate variability and change, as well as by multi-sector water demand. While a planning horizon of zero to about thirty years is occasionally prescribed by stakeholders, the chal… ▽ More Thermoelectric power production at risk, owing to current and projected water scarcity and rising stream temperatures, is assessed for the contiguous United States at decadal scales. Regional water scarcity is driven by climate variability and change, as well as by multi-sector water demand. While a planning horizon of zero to about thirty years is occasionally prescribed by stakeholders, the challenges to risk assessment at these scales include the difficulty in delineating decadal climate trends from intrinsic natural or multiple model variability. Current generation global climate or earth system models are not credible at the spatial resolutions of power plants, especially for surface water quantity and stream temperatures, which further exacerbates the assessment challenge. Population changes, which are difficult to project, cannot serve as adequate proxies for changes in the water demand across sectors. The hypothesis that robust assessments of power production at risk are possible, despite the uncertainties, has been examined as a proof of concept. An approach is presented for delineating water scarcity and temperature from climate models, observations and population storylines, as well as for assessing power production at risk by examining geospatial correlations of power plant locations within regions where the usable water supply for energy production happens to be scarcer and warmer. Our analyses showed that in the near term, more than 200 counties are likely to be exposed to water scarcity in the next three decades. Further, we noticed that stream gauges in more than five counties in the 2030s and ten counties in the 2040s showed a significant increase in water temperature, which exceeded the power plant effluent temperature threshold set by the EPA. Power plants in South Carolina, Louisiana, and Texas are likely to be vulnerable owing to climate-driven water stresses. △ Less

Submitted 26 November, 2015; originally announced November 2015.

Comments: Tech Report prepared for Advanced Research Projects Agency Energy, United States Department of Energy

Report number: DOE Purchase Order #DE-AR0000482

Network science based quantification of resilience demonstrated on the Indian Railways Network

Authors: Udit Bhatia, Devashish Kumar, Evan Kodra, Auroop R. Ganguly

Abstract: The structure, interdependence, and fragility of systems ranging from power grids and transportation to ecology, climate, biology and even human communities and the Internet, have been examined through network science. While the response to perturbations has been quantified, recovery strategies for perturbed networks have usually been either discussed conceptually or through anecdotal case studies… ▽ More The structure, interdependence, and fragility of systems ranging from power grids and transportation to ecology, climate, biology and even human communities and the Internet, have been examined through network science. While the response to perturbations has been quantified, recovery strategies for perturbed networks have usually been either discussed conceptually or through anecdotal case studies. Here we develop a network science-based quantitative methods framework for measuring, comparing and interpreting hazard responses and as well as recovery strategies. The framework, motivated by the recently proposed temporal resilience paradigm, is demonstrated with the Indian Railways Network. The methods are demonstrated through the resilience of the network to natural or human-induced hazards and electric grid failure. Simulations inspired by the 2004 Indian Ocean Tsunami and the 2012 North Indian blackout as well as a cyber-physical attack scenario. Multiple metrics are used to generate various recovery strategies, which are simply sequences in which system components should be recovered after a disruption. Quantitative evaluation of recovery strategies suggests that faster and more resource-effective recovery is possible through network centrality measures. Case studies based on two historical events, specifically the 2004 Indian Ocean tsunami and the 2012 North Indian blackout, and a simulated cyber-physical attack scenario, provides means for interpreting the relative performance of various recovery strategies. Quantitative evaluation of recovery strategies suggests that faster and more resource-effective restoration is possible through network centrality measures, even though the specific strategy may be different for sub-networks or for the partial recovery. △ Less

Submitted 15 October, 2015; v1 submitted 5 August, 2015; originally announced August 2015.