-
Enhancing ADHD Diagnosis with EEG: The Critical Role of Preprocessing and Key Features
Authors:
Sandra García-Ponsoda,
Alejandro Maté,
Juan Trujillo
Abstract:
Background: Attention-Deficit/Hyperactivity Disorder (ADHD) is a prevalent neurodevelopmental disorder that significantly impacts various key aspects of life, requiring accurate diagnostic methods. Electroencephalogram (EEG) signals are used in diagnosing ADHD, but proper preprocessing is crucial to avoid noise and artifacts that could lead to unreliable results.
Method: This study utilized a pu…
▽ More
Background: Attention-Deficit/Hyperactivity Disorder (ADHD) is a prevalent neurodevelopmental disorder that significantly impacts various key aspects of life, requiring accurate diagnostic methods. Electroencephalogram (EEG) signals are used in diagnosing ADHD, but proper preprocessing is crucial to avoid noise and artifacts that could lead to unreliable results.
Method: This study utilized a public EEG dataset from children diagnosed with ADHD and typically develo** (TD) children. Four preprocessing techniques were applied: no preprocessing (Raw), Finite Impulse Response (FIR) filtering, Artifact Subspace Reconstruction (ASR), and Independent Component Analysis (ICA). EEG recordings were segmented, and features were extracted and selected based on statistical significance. Classification was performed using Machine Learning models, as XGBoost, Support Vector Machine, and K-Nearest Neighbors.
Results: The absence of preprocessing leads to artificially high classification accuracy due to noise. In contrast, ASR and ICA preprocessing techniques significantly improved the reliability of results. Segmenting EEG recordings revealed that later segments provided better classification accuracy, likely due to the manifestation of ADHD symptoms over time. The most relevant EEG channels were P3, P4, and C3. The top features for classification included Kurtosis, Katz fractal dimension, and power spectral density of Delta, Theta, and Alpha bands.
Conclusions: Effective preprocessing is essential in EEG-based ADHD diagnosis to prevent noise-induced biases. This study identifies crucial EEG channels and features, providing a foundation for further research and improving ADHD diagnostic accuracy. Future work should focus on expanding datasets, refining preprocessing methods, and enhancing feature interpretability to improve diagnostic accuracy and model robustness for clinical use.
△ Less
Submitted 11 July, 2024;
originally announced July 2024.
-
Physics-Informed Heterogeneous Graph Neural Networks for DC Blocker Placement
Authors:
Hongwei **,
Prasanna Balaprakash,
Allen Zou,
Pieter Ghysels,
Aditi S. Krishnapriyan,
Adam Mate,
Arthur Barnes,
Russell Bent
Abstract:
The threat of geomagnetic disturbances (GMDs) to the reliable operation of the bulk energy system has spurred the development of effective strategies for mitigating their impacts. One such approach involves placing transformer neutral blocking devices, which interrupt the path of geomagnetically induced currents (GICs) to limit their impact. The high cost of these devices and the sparsity of trans…
▽ More
The threat of geomagnetic disturbances (GMDs) to the reliable operation of the bulk energy system has spurred the development of effective strategies for mitigating their impacts. One such approach involves placing transformer neutral blocking devices, which interrupt the path of geomagnetically induced currents (GICs) to limit their impact. The high cost of these devices and the sparsity of transformers that experience high GICs during GMD events, however, calls for a sparse placement strategy that involves high computational cost. To address this challenge, we developed a physics-informed heterogeneous graph neural network (PIHGNN) for solving the graph-based dc-blocker placement problem. Our approach combines a heterogeneous graph neural network (HGNN) with a physics-informed neural network (PINN) to capture the diverse types of nodes and edges in ac/dc networks and incorporates the physical laws of the power grid. We train the PIHGNN model using a surrogate power flow model and validate it using case studies. Results demonstrate that PIHGNN can effectively and efficiently support the deployment of GIC dc-current blockers, ensuring the continued supply of electricity to meet societal demands. Our approach has the potential to contribute to the development of more reliable and resilient power grids capable of withstanding the growing threat that GMDs pose.
△ Less
Submitted 16 May, 2024;
originally announced May 2024.
-
How does GPT-2 Predict Acronyms? Extracting and Understanding a Circuit via Mechanistic Interpretability
Authors:
Jorge García-Carrasco,
Alejandro Maté,
Juan Trujillo
Abstract:
Transformer-based language models are treated as black-boxes because of their large number of parameters and complex internal interactions, which is a serious safety concern. Mechanistic Interpretability (MI) intends to reverse-engineer neural network behaviors in terms of human-understandable components. In this work, we focus on understanding how GPT-2 Small performs the task of predicting three…
▽ More
Transformer-based language models are treated as black-boxes because of their large number of parameters and complex internal interactions, which is a serious safety concern. Mechanistic Interpretability (MI) intends to reverse-engineer neural network behaviors in terms of human-understandable components. In this work, we focus on understanding how GPT-2 Small performs the task of predicting three-letter acronyms. Previous works in the MI field have focused so far on tasks that predict a single token. To the best of our knowledge, this is the first work that tries to mechanistically understand a behavior involving the prediction of multiple consecutive tokens. We discover that the prediction is performed by a circuit composed of 8 attention heads (~5% of the total heads) which we classified in three groups according to their role. We also demonstrate that these heads concentrate the acronym prediction functionality. In addition, we mechanistically interpret the most relevant heads of the circuit and find out that they use positional information which is propagated via the causal mask mechanism. We expect this work to lay the foundation for understanding more complex behaviors involving multiple-token predictions.
△ Less
Submitted 7 May, 2024;
originally announced May 2024.
-
A resource-constrained stochastic scheduling algorithm for homeless street outreach and gleaning edible food
Authors:
Conor M. Artman,
Aditya Mate,
Ezinne Nwankwo,
Aliza Heching,
Tsuyoshi Idé,
Jiří Navrátil,
Karthikeyan Shanmugam,
Wei Sun,
Kush R. Varshney,
Lauri Goldkind,
Gidi Kroch,
Jaclyn Sawyer,
Ian Watson
Abstract:
We developed a common algorithmic solution addressing the problem of resource-constrained outreach encountered by social change organizations with different missions and operations: Breaking Ground -- an organization that helps individuals experiencing homelessness in New York transition to permanent housing and Leket -- the national food bank of Israel that rescues food from farms and elsewhere t…
▽ More
We developed a common algorithmic solution addressing the problem of resource-constrained outreach encountered by social change organizations with different missions and operations: Breaking Ground -- an organization that helps individuals experiencing homelessness in New York transition to permanent housing and Leket -- the national food bank of Israel that rescues food from farms and elsewhere to feed the hungry. Specifically, we developed an estimation and optimization approach for partially-observed episodic restless bandits under $k$-step transitions. The results show that our Thompson sampling with Markov chain recovery (via Stein variational gradient descent) algorithm significantly outperforms baselines for the problems of both organizations. We carried out this work in a prospective manner with the express goal of devising a flexible-enough but also useful-enough solution that can help overcome a lack of sustainable impact in data science for social good.
△ Less
Submitted 15 March, 2024;
originally announced March 2024.
-
Visualization Requirements for Business Intelligence Analytics: A Goal-Based, Iterative Framework
Authors:
Ana Lavalle,
Alejandro Maté,
Juan Trujillo,
Stefano Rizzi
Abstract:
Information visualization plays a key role in business intelligence analytics. With ever larger amounts of data that need to be interpreted, using the right visualizations is crucial in order to understand the underlying patterns and results obtained by analysis algorithms. Despite its importance, defining the right visualization is still a challenging task. Business users are rarely experts in in…
▽ More
Information visualization plays a key role in business intelligence analytics. With ever larger amounts of data that need to be interpreted, using the right visualizations is crucial in order to understand the underlying patterns and results obtained by analysis algorithms. Despite its importance, defining the right visualization is still a challenging task. Business users are rarely experts in information visualization, and they may not exactly know the most adequate visualization tools or patterns for their goals. Consequently, misinterpreted graphs and wrong results can be obtained, leading to missed opportunities and significant losses for companies. The main problem underneath is a lack of tools and methodologies that allow non-expert users to define their visualization and data analysis goals in business terms. In order to tackle this problem, we present an iterative goal-oriented approach based on the i* language for the automatic derivation of data visualizations. Our approach links non-expert user requirements to the data to be analyzed, choosing the most suited visualization techniques in a semi-automatic way. The great advantage of our proposal is that we provide non-expert users with the best suited visualizations according to their information needs and their data with little effort and without requiring expertise in information visualization.
△ Less
Submitted 14 February, 2024;
originally announced February 2024.
-
Requirements-Driven Visualizations for Big Data Analytics: a Model-Driven approach
Authors:
Ana Lavalle,
Alejandro Maté,
Juan Trujillo
Abstract:
Choosing the right Visualization techniques is critical in Big Data Analytics. However, decision makers are not experts on visualization and they face up with enormous difficulties in doing so. There are currently many different (i) Big Data sources and also (ii) many different visual analytics to be chosen. Every visualization technique is not valid for every Big Data source and is not adequate f…
▽ More
Choosing the right Visualization techniques is critical in Big Data Analytics. However, decision makers are not experts on visualization and they face up with enormous difficulties in doing so. There are currently many different (i) Big Data sources and also (ii) many different visual analytics to be chosen. Every visualization technique is not valid for every Big Data source and is not adequate for every context. In order to tackle this problem, we propose an approach, based on the Model Driven Architecture (MDA) to facilitate the selection of the right visual analytics to non-expert users. The approach is based on three different models: (i) a requirements model based on goal-oriented modeling for representing information requirements, (ii) a data representation model for representing data which will be connected to visualizations and, (iii) a visualization model for representing visualization details regardless of their implementation technology. Together with these models, a set of transformations allow us to semi-automatically obtain the corresponding implementation avoiding the intervention of the non-expert users. In this way, the great advantage of our proposal is that users no longer need to focus on the characteristics of the visualization, but rather, they focus on their information requirements and obtain the visualization that is better suited for their needs. We show the applicability of our proposal through a case study focused on a tax collection organization from a real project developed by the Spin-off company Lucentia Lab.
△ Less
Submitted 30 January, 2024;
originally announced February 2024.
-
A Review of the GIC Blocker Placement Problem
Authors:
Arthur K. Barnes,
Adam Mate,
Russell Bent
Abstract:
Space weather poses a tremendous threat to power systems: geomagnetic disturbances could result in widespread disruptions and long-duration blackouts, including severe damage to system components. To mitigate their impacts, a handful of strategies exist, with the most promising being the deployment of transformer neutral blocking devices. The high cost of these devices, however, precludes their in…
▽ More
Space weather poses a tremendous threat to power systems: geomagnetic disturbances could result in widespread disruptions and long-duration blackouts, including severe damage to system components. To mitigate their impacts, a handful of strategies exist, with the most promising being the deployment of transformer neutral blocking devices. The high cost of these devices, however, precludes their installation at all substations; this motivates the development of effective solutions for the cost-effective placement of such devices. While the current state-of-the-art in blocker placement methods is insufficient to be applied to real-sized power grids, ongoing research continues to increase the size of networks for which the placement problem remains tractable. Along these lines, the contributions of this paper are two fold: first, a comprehensive overview of the current state-of-the-art in blocker placement methods is provided; and second, a complete optimization formulation - implemented and benchmarked in an open-source software - for the blocker placement problem is presented.
△ Less
Submitted 11 February, 2024;
originally announced February 2024.
-
Heuristic Algorithms for Placing Geomagnetically Induced Current Blocking Devices
Authors:
Minseok Ryu,
Ahmed Attia,
Arthur Barnes,
Russell Bent,
Sven Leyffer,
Adam Mate
Abstract:
We propose a new heuristic approach for solving the challenge of determining optimal placements for geomagnetically induced current blocking devices on electrical grids. Traditionally, these determinations are approached by formulating the problem as mixed-integer nonlinear programming models and solving them using optimization solvers based on the spatial branch-and-bound algorithm.However, compu…
▽ More
We propose a new heuristic approach for solving the challenge of determining optimal placements for geomagnetically induced current blocking devices on electrical grids. Traditionally, these determinations are approached by formulating the problem as mixed-integer nonlinear programming models and solving them using optimization solvers based on the spatial branch-and-bound algorithm.However, computing an optimal solution using the solvers often demands substantial computational time due to their inability to leverage the inherent problem structure. Therefore, in this work we propose a new heuristic approach based on a three-block alternating direction method of multipliers algorithm, and we compare it with an existing stochastic learning algorithm. Both heuristics exploit the structure of the problem of interest. We test these heuristic approaches through extensive numerical experiments conducted on the EPRI-21 and UIUC-150 test systems. The outcomes showcase the superior performance of our methodologies in terms of both solution quality and computational speed when compared with conventional solvers.
△ Less
Submitted 13 October, 2023;
originally announced October 2023.
-
Develo** Optimization-Based Inverter Models for Short Circuit Studies
Authors:
Thabiso R. Mabote,
Jose E. Tabarez,
Arthur K. Barnes,
Adam Mate,
Russell W. Bent,
Eduardo Cotilla-Sanchez
Abstract:
As inverter-based generation becomes more common in distribution networks, it is important to create models for use in optimization-based problems that accurately represent their non-linear behavior when saturated. This work presents models for grid-following and grid-forming inverters, and demonstrates their use in optimization-based fault studies. The developed models are shown to provide result…
▽ More
As inverter-based generation becomes more common in distribution networks, it is important to create models for use in optimization-based problems that accurately represent their non-linear behavior when saturated. This work presents models for grid-following and grid-forming inverters, and demonstrates their use in optimization-based fault studies. The developed models are shown to provide results in line with experimental tests from literature; however, grid-forming inverter models fail to provide feasible solutions for certain fault types even when currents, voltages, and powers from the models seem reasonable. This work lays down the foundation for the development of relaxed models for both grid-following and grid-forming inverter models for use in optimization problems.
△ Less
Submitted 6 August, 2023; v1 submitted 1 May, 2023;
originally announced May 2023.
-
Real-Time Implementation of Dynamic State Estimation for Microgrid Load Bus Protection
Authors:
Sarbajit Basu,
Arthur K. Barnes,
Adam Mate,
Olga Lavrova
Abstract:
Inverter-interfaced microgrids, owing to the lack of fault current, cannot be protected using traditional over-current protections, while admittance or differential relaying protection schemes are not practical to be implemented. Dynamic state estimation can track and predict power system transients and has been extensively investigated for setting-less protection. A novel real-time application of…
▽ More
Inverter-interfaced microgrids, owing to the lack of fault current, cannot be protected using traditional over-current protections, while admittance or differential relaying protection schemes are not practical to be implemented. Dynamic state estimation can track and predict power system transients and has been extensively investigated for setting-less protection. A novel real-time application of dynamic state estimation for protection is proposed in this paper, wherein parameter estimation and parallel processing is used to identify the state of the system. The implementation scheme has low process complexity and employs a data acquisition device and estimator that run on a general-purpose computer. This proposed implementation extends the state-of-the-art, under short-circuit conditions, to a real-time implementation with a lumped-load radial microgrid and a grid-forming inverter with current-limiting behavior.
△ Less
Submitted 21 April, 2023;
originally announced April 2023.
-
Improved Policy Evaluation for Randomized Trials of Algorithmic Resource Allocation
Authors:
Aditya Mate,
Bryan Wilder,
Aparna Taneja,
Milind Tambe
Abstract:
We consider the task of evaluating policies of algorithmic resource allocation through randomized controlled trials (RCTs). Such policies are tasked with optimizing the utilization of limited intervention resources, with the goal of maximizing the benefits derived. Evaluation of such allocation policies through RCTs proves difficult, notwithstanding the scale of the trial, because the individuals'…
▽ More
We consider the task of evaluating policies of algorithmic resource allocation through randomized controlled trials (RCTs). Such policies are tasked with optimizing the utilization of limited intervention resources, with the goal of maximizing the benefits derived. Evaluation of such allocation policies through RCTs proves difficult, notwithstanding the scale of the trial, because the individuals' outcomes are inextricably interlinked through resource constraints controlling the policy decisions. Our key contribution is to present a new estimator leveraging our proposed novel concept, that involves retrospective reshuffling of participants across experimental arms at the end of an RCT. We identify conditions under which such reassignments are permissible and can be leveraged to construct counterfactual trials, whose outcomes can be accurately ascertained, for free. We prove theoretically that such an estimator is more accurate than common estimators based on sample means -- we show that it returns an unbiased estimate and simultaneously reduces variance. We demonstrate the value of our approach through empirical experiments on synthetic, semi-synthetic as well as real case study data and show improved estimation accuracy across the board.
△ Less
Submitted 6 February, 2023;
originally announced February 2023.
-
Measuring and Analyzing Effects of HEMP Simulation on Synthetic Power Grids
Authors:
Carson L. May,
Arthur K. Barnes,
Jose E. Tabarez,
Adam Mate,
Eric M. Nelson,
Ross Guttromson
Abstract:
There is significant uncertainty about the potential effects of a high-altitude electromagnetic pulse (HEMP) detonation on the bulk electric system. This study attempts to account for such uncertainty, in using Monte-Carlo methods to account for speculated range of effect of HEMP contingency. Through task parallelism and asynchronous processing techniques implemented throughout simulation, this st…
▽ More
There is significant uncertainty about the potential effects of a high-altitude electromagnetic pulse (HEMP) detonation on the bulk electric system. This study attempts to account for such uncertainty, in using Monte-Carlo methods to account for speculated range of effect of HEMP contingency. Through task parallelism and asynchronous processing techniques implemented throughout simulation, this study measure the effects of 700 large-scale HEMP simulations on a 7173 bus synthetic power grid. Analysis explores how contingency severity varies, depending on initial contingency parameters. Severity indices were captured throughout simulation to measure and quantify the cascading nature of an HEMP event. Further development of HEMP simulation modeling is explored as well, which could augment forecasts of potential contingency events as well.
△ Less
Submitted 21 April, 2023; v1 submitted 30 January, 2023;
originally announced January 2023.
-
Decision-Focused Evaluation: Analyzing Performance of Deployed Restless Multi-Arm Bandits
Authors:
Paritosh Verma,
Shresth Verma,
Aditya Mate,
Aparna Taneja,
Milind Tambe
Abstract:
Restless multi-arm bandits (RMABs) is a popular decision-theoretic framework that has been used to model real-world sequential decision making problems in public health, wildlife conservation, communication systems, and beyond. Deployed RMAB systems typically operate in two stages: the first predicts the unknown parameters defining the RMAB instance, and the second employs an optimization algorith…
▽ More
Restless multi-arm bandits (RMABs) is a popular decision-theoretic framework that has been used to model real-world sequential decision making problems in public health, wildlife conservation, communication systems, and beyond. Deployed RMAB systems typically operate in two stages: the first predicts the unknown parameters defining the RMAB instance, and the second employs an optimization algorithm to solve the constructed RMAB instance.
In this work we provide and analyze the results from a first-of-its-kind deployment of an RMAB system in public health domain, aimed at improving maternal and child health. Our analysis is focused towards understanding the relationship between prediction accuracy and overall performance of deployed RMAB systems. This is crucial for determining the value of investing in improving predictive accuracy towards improving the final system performance, and is useful for diagnosing, monitoring deployed RMAB systems.
Using real-world data from our deployed RMAB system, we demonstrate that an improvement in overall prediction accuracy may even be accompanied by a degradation in the performance of RMAB system -- a broad investment of resources to improve overall prediction accuracy may not yield expected results. Following this, we develop decision-focused evaluation metrics to evaluate the predictive component and show that it is better at explaining (both empirically and theoretically) the overall performance of a deployed RMAB system.
△ Less
Submitted 18 January, 2023;
originally announced January 2023.
-
Fault Current-Constrained Optimal Power Flow on Unbalanced Distribution Networks
Authors:
Jose E. Tabarez,
Arthur K. Barnes,
Adam Mate,
Russell W. Bent
Abstract:
With the proliferation of distributed generation into distribution networks, the need to consider fault currents in the dispatch problem becomes increasingly relevant. This paper introduces a method for adding fault current constraints into optimal power flow in order to reduce fault currents while minimizing generation cost. The optimal power flow problem is formulated as a single optimization pr…
▽ More
With the proliferation of distributed generation into distribution networks, the need to consider fault currents in the dispatch problem becomes increasingly relevant. This paper introduces a method for adding fault current constraints into optimal power flow in order to reduce fault currents while minimizing generation cost. The optimal power flow problem is formulated as a single optimization problem with sub-networks representing the faults of interest. Having a single optimization problem allows the decision variables to be coupled across the optimal power flow and the fault current studies without having to iterate over possible solutions. The proposed method is applicable to unbalanced distribution networks, including those with transformers that introduce phase-shifts.
△ Less
Submitted 30 January, 2023; v1 submitted 22 August, 2022;
originally announced August 2022.
-
Dynamic State Estimation-Based Protection for Induction Motor Loads
Authors:
Arthur K. Barnes,
Sarbajit Basu,
Adam Mate
Abstract:
Ensuring protective device coordination is critical to maintain the resilience and improve the reliability of large microgrids. Inverter-interfaced generation, however, poses significant challenges when designing protection systems. Traditional time-overcurrent protective devices are unsuitable on account of the lack of fault current. Present industry practice is to force all inverters to shut dow…
▽ More
Ensuring protective device coordination is critical to maintain the resilience and improve the reliability of large microgrids. Inverter-interfaced generation, however, poses significant challenges when designing protection systems. Traditional time-overcurrent protective devices are unsuitable on account of the lack of fault current. Present industry practice is to force all inverters to shut down during faults, which prevents large microgrids from operating in a resilient and reliable manner. Dynamic state estimation (DSE) has been proposed for line protection, and more recently for the protection of load buses or downstream radial portions of microgrids. However, only passive loads with series resistive-inductive loads have been tested with DSE, even though the behavior of dynamic loads -- such as induction motors or power electronics -- may differ significantly during faults. This paper considers the case of applying DSE to protecting a load bus serving a three-phase induction motor.
△ Less
Submitted 30 January, 2023; v1 submitted 18 August, 2022;
originally announced August 2022.
-
Dynamic State Estimation for Load Bus Protection on Inverter-Interfaced Microgrids
Authors:
Arthur K. Barnes,
Adam Mate,
Jean Marie V. Bikorimana,
Ricardo J. Castillo
Abstract:
Inverter-interfaced microgrids results in challenges when designing protection systems. Traditional time-overcurrent, admittance, and differential protection methods are unsuitable on account of lack of fault current, excessively short lines, or a prohibitive number of protective devices needing to be installed. Current practice is to force all inverters to shut down during fault conditions, weake…
▽ More
Inverter-interfaced microgrids results in challenges when designing protection systems. Traditional time-overcurrent, admittance, and differential protection methods are unsuitable on account of lack of fault current, excessively short lines, or a prohibitive number of protective devices needing to be installed. Current practice is to force all inverters to shut down during fault conditions, weakening resilience and reducing reliability. Dynamic state estimation (DSE), which has been explored for both line protection and load bus protection before, is a potential solution to these challenges to create widely utilizable, highly reliable protection systems. However, it has only been tested for load protection with ideal voltage sources, which do not capture the short-circuit behavior of inverter-interfaced generation, notably low fault current and unbalanced output voltage. This paper aims to extend the state-of-the-art on DSE load protection: the performance of DSE during short-circuit conditions with a grid-forming inverter with current-limiting behavior during fault conditions is investigated.
△ Less
Submitted 8 October, 2022; v1 submitted 13 July, 2022;
originally announced July 2022.
-
Scalable Decision-Focused Learning in Restless Multi-Armed Bandits with Application to Maternal and Child Health
Authors:
Kai Wang,
Shresth Verma,
Aditya Mate,
Sanket Shah,
Aparna Taneja,
Neha Madhiwalla,
Aparna Hegde,
Milind Tambe
Abstract:
This paper studies restless multi-armed bandit (RMAB) problems with unknown arm transition dynamics but with known correlated arm features. The goal is to learn a model to predict transition dynamics given features, where the Whittle index policy solves the RMAB problems using predicted transitions. However, prior works often learn the model by maximizing the predictive accuracy instead of final R…
▽ More
This paper studies restless multi-armed bandit (RMAB) problems with unknown arm transition dynamics but with known correlated arm features. The goal is to learn a model to predict transition dynamics given features, where the Whittle index policy solves the RMAB problems using predicted transitions. However, prior works often learn the model by maximizing the predictive accuracy instead of final RMAB solution quality, causing a mismatch between training and evaluation objectives. To address this shortcoming, we propose a novel approach for decision-focused learning in RMAB that directly trains the predictive model to maximize the Whittle index solution quality. We present three key contributions: (i) we establish differentiability of the Whittle index policy to support decision-focused learning; (ii) we significantly improve the scalability of decision-focused learning approaches in sequential problems, specifically RMAB problems; (iii) we apply our algorithm to a previously collected dataset of maternal and child health to demonstrate its performance. Indeed, our algorithm is the first for decision-focused learning in RMAB that scales to real-world problem sizes.
△ Less
Submitted 13 August, 2023; v1 submitted 2 February, 2022;
originally announced February 2022.
-
Field Study in Deploying Restless Multi-Armed Bandits: Assisting Non-Profits in Improving Maternal and Child Health
Authors:
Aditya Mate,
Lovish Madaan,
Aparna Taneja,
Neha Madhiwalla,
Shresth Verma,
Gargi Singh,
Aparna Hegde,
Pradeep Varakantham,
Milind Tambe
Abstract:
The widespread availability of cell phones has enabled non-profits to deliver critical health information to their beneficiaries in a timely manner. This paper describes our work to assist non-profits that employ automated messaging programs to deliver timely preventive care information to beneficiaries (new and expecting mothers) during pregnancy and after delivery. Unfortunately, a key challenge…
▽ More
The widespread availability of cell phones has enabled non-profits to deliver critical health information to their beneficiaries in a timely manner. This paper describes our work to assist non-profits that employ automated messaging programs to deliver timely preventive care information to beneficiaries (new and expecting mothers) during pregnancy and after delivery. Unfortunately, a key challenge in such information delivery programs is that a significant fraction of beneficiaries drop out of the program. Yet, non-profits often have limited health-worker resources (time) to place crucial service calls for live interaction with beneficiaries to prevent such engagement drops. To assist non-profits in optimizing this limited resource, we developed a Restless Multi-Armed Bandits (RMABs) system. One key technical contribution in this system is a novel clustering method of offline historical data to infer unknown RMAB parameters. Our second major contribution is evaluation of our RMAB system in collaboration with an NGO, via a real-world service quality improvement study. The study compared strategies for optimizing service calls to 23003 participants over a period of 7 weeks to reduce engagement drops. We show that the RMAB group provides statistically significant improvement over other comparison groups, reducing ~ 30% engagement drops. To the best of our knowledge, this is the first study demonstrating the utility of RMABs in real world public health settings. We are transitioning our RMAB system to the NGO for real-world use.
△ Less
Submitted 27 October, 2021; v1 submitted 16 September, 2021;
originally announced September 2021.
-
Relaxation Based Modeling of GMD Induced Cascading Failures in PowerModelsGMD.jl
Authors:
Adam Mate,
Arthur K. Barnes,
Steven K. Morley,
Jacob A. Friz-Trillo,
Eduardo Cotilla-Sanchez,
Sean P. Blake
Abstract:
A major risk of geomagnetic disturbances (GMDs) is cascading failure of electrical grids. The modeling of GMD events and cascading outages in power systems is difficult, both independently and jointly, because of the many different mechanisms and physics involved. This paper introduces a relaxation based modeling of GMD-induced cascading failures:~the dc approximation-based DCSIMSEP solver was ada…
▽ More
A major risk of geomagnetic disturbances (GMDs) is cascading failure of electrical grids. The modeling of GMD events and cascading outages in power systems is difficult, both independently and jointly, because of the many different mechanisms and physics involved. This paper introduces a relaxation based modeling of GMD-induced cascading failures:~the dc approximation-based DCSIMSEP solver was adapted to simulate cascading as a result of GMDs, the full set of ac power flow equations were relaxed to guarantee optimality, and the reactive power losses were modeled while kee** the problem convex. The developed algorithm was implemented in PowerModelsGMD.jl - an open-source software specifically designed to model and analyze geomagnetic hazards - and demonstrated to work on the RTS-GMLC-GIC-EAST synthetic test network.
△ Less
Submitted 30 December, 2021; v1 submitted 14 August, 2021;
originally announced August 2021.
-
The Risk of Hidden Failures to the United States Electrical Grid and Potential for Mitigation
Authors:
Arthur K. Barnes,
Adam Mate,
Jose E. Tabarez
Abstract:
Hidden failures present a noticeable impact to the reliability of the United States electrical grid. These hazards are responsible for protective device misoperations and can cause multiple-element contingencies across nearby components, greatly increasing the likelihood of cascading events. This paper provides an in-depth overview of the causes and risks of hidden failures and discusses methods f…
▽ More
Hidden failures present a noticeable impact to the reliability of the United States electrical grid. These hazards are responsible for protective device misoperations and can cause multiple-element contingencies across nearby components, greatly increasing the likelihood of cascading events. This paper provides an in-depth overview of the causes and risks of hidden failures and discusses methods for identifying critical locations where hidden failures could pose a risk of cascading failure, with the ultimate goal being to identify efficient mitigation methods that can prevent their occurrence in protective relays.
△ Less
Submitted 30 December, 2021; v1 submitted 7 July, 2021;
originally announced July 2021.
-
Solving Structured Hierarchical Games Using Differential Backward Induction
Authors:
Zun Li,
Feiran Jia,
Aditya Mate,
Shahin Jabbari,
Mithun Chakraborty,
Milind Tambe,
Yevgeniy Vorobeychik
Abstract:
From large-scale organizations to decentralized political systems, hierarchical strategic decision making is commonplace. We introduce a novel class of structured hierarchical games (SHGs) that formally capture such hierarchical strategic interactions. In an SHG, each player is a node in a tree, and strategic choices of players are sequenced from root to leaves, with root moving first, followed by…
▽ More
From large-scale organizations to decentralized political systems, hierarchical strategic decision making is commonplace. We introduce a novel class of structured hierarchical games (SHGs) that formally capture such hierarchical strategic interactions. In an SHG, each player is a node in a tree, and strategic choices of players are sequenced from root to leaves, with root moving first, followed by its children, then followed by their children, and so on until the leaves. A player's utility in an SHG depends on its own decision, and on the choices of its parent and all the tree leaves. SHGs thus generalize simultaneous-move games, as well as Stackelberg games with many followers. We leverage the structure of both the sequence of player moves as well as payoff dependence to develop a gradient-based back propagation-style algorithm, which we call Differential Backward Induction (DBI), for approximating equilibria of SHGs. We provide a sufficient condition for convergence of DBI and demonstrate its efficacy in finding approximate equilibrium solutions to several SHG models of hierarchical policy-making problems.
△ Less
Submitted 27 June, 2022; v1 submitted 8 June, 2021;
originally announced June 2021.
-
Selective Intervention Planning using Restless Multi-Armed Bandits to Improve Maternal and Child Health Outcomes
Authors:
Siddharth Nishtala,
Lovish Madaan,
Aditya Mate,
Harshavardhan Kamarthi,
Anirudh Grama,
Divy Thakkar,
Dhyanesh Narayanan,
Suresh Chaudhary,
Neha Madhiwalla,
Ramesh Padmanabhan,
Aparna Hegde,
Pradeep Varakantham,
Balaraman Ravindran,
Milind Tambe
Abstract:
India has a maternal mortality ratio of 113 and child mortality ratio of 2830 per 100,000 live births. Lack of access to preventive care information is a major contributing factor for these deaths, especially in low resource households. We partner with ARMMAN, a non-profit based in India employing a call-based information program to disseminate health-related information to pregnant women and wome…
▽ More
India has a maternal mortality ratio of 113 and child mortality ratio of 2830 per 100,000 live births. Lack of access to preventive care information is a major contributing factor for these deaths, especially in low resource households. We partner with ARMMAN, a non-profit based in India employing a call-based information program to disseminate health-related information to pregnant women and women with recent child deliveries. We analyze call records of over 300,000 women registered in the program created by ARMMAN and try to identify women who might not engage with these call programs that are proven to result in positive health outcomes. We built machine learning based models to predict the long term engagement pattern from call logs and beneficiaries' demographic information, and discuss the applicability of this method in the real world through a pilot validation. Through a pilot service quality improvement study, we show that using our model's predictions to make interventions boosts engagement metrics by 61.37%. We then formulate the intervention planning problem as restless multi-armed bandits (RMABs), and present preliminary results using this approach.
△ Less
Submitted 18 October, 2021; v1 submitted 7 March, 2021;
originally announced March 2021.
-
Efficient Algorithms for Finite Horizon and Streaming Restless Multi-Armed Bandit Problems
Authors:
Aditya Mate,
Arpita Biswas,
Christoph Siebenbrunner,
Susobhan Ghosh,
Milind Tambe
Abstract:
We propose Streaming Bandits, a Restless Multi Armed Bandit (RMAB) framework in which heterogeneous arms may arrive and leave the system after staying on for a finite lifetime. Streaming Bandits naturally capture the health intervention planning problem, where health workers must manage the health outcomes of a patient cohort while new patients join and existing patients leave the cohort each day.…
▽ More
We propose Streaming Bandits, a Restless Multi Armed Bandit (RMAB) framework in which heterogeneous arms may arrive and leave the system after staying on for a finite lifetime. Streaming Bandits naturally capture the health intervention planning problem, where health workers must manage the health outcomes of a patient cohort while new patients join and existing patients leave the cohort each day. Our contributions are as follows: (1) We derive conditions under which our problem satisfies indexability, a precondition that guarantees the existence and asymptotic optimality of the Whittle Index solution for RMABs. We establish the conditions using a polytime reduction of the Streaming Bandit setup to regular RMABs. (2) We further prove a phenomenon that we call index decay, whereby the Whittle index values are low for short residual lifetimes driving the intuition underpinning our algorithm. (3) We propose a novel and efficient algorithm to compute the index-based solution for Streaming Bandits. Unlike previous methods, our algorithm does not rely on solving the costly finite horizon problem on each arm of the RMAB, thereby lowering the computational complexity compared to existing methods. (4) Finally, we evaluate our approach via simulations run on realworld data sets from a tuberculosis patient monitoring task and an intervention planning task for improving maternal healthcare, in addition to other synthetic domains. Across the board, our algorithm achieves a 2-orders-of-magnitude speed-up over existing methods while maintaining the same solution quality.
△ Less
Submitted 15 February, 2022; v1 submitted 8 March, 2021;
originally announced March 2021.
-
A Game-Theoretic Approach for Hierarchical Epidemic Control
Authors:
Feiran Jia,
Aditya Mate,
Zun Li,
Shahin Jabbari,
Mithun Chakraborty,
Milind Tambe,
Michael Wellman,
Yevgeniy Vorobeychik
Abstract:
We design and analyze a multi-level game-theoretic model of hierarchical policy interventions for epidemic control, such as those in response to the COVID-19 pandemic. Our model captures the potentially mismatched priorities among a hierarchy of policy-makers (e.g., federal, state, and local governments) with respect to two cost components that have opposite dependence on the policy strength -- po…
▽ More
We design and analyze a multi-level game-theoretic model of hierarchical policy interventions for epidemic control, such as those in response to the COVID-19 pandemic. Our model captures the potentially mismatched priorities among a hierarchy of policy-makers (e.g., federal, state, and local governments) with respect to two cost components that have opposite dependence on the policy strength -- post-intervention infection rates and the socio-economic cost of policy implementation. Additionally, our model includes a crucial third factor in decisions: a cost of non-compliance with the policy-maker immediately above in the hierarchy, such as non-compliance of counties with state-level policies. We propose two novel algorithms for approximating solutions to such games. The first is based on best response dynamics (BRD), and exploits the tree structure of the game. The second combines quadratic integer programming (QIP), which enables us to collapse the two lowest levels of the game, with best response dynamics. Through extensive experiments, we show that our QIP-based approach significantly outperforms the BRD algorithm both in running time and the quality of equilibrium solutions. Finally, we apply the QIP-based algorithm to experiments based on both synthetic and real-world data under various parameter configurations and analyze the resulting (approximate) equilibria to gain insight into the impact of decentralization on overall welfare (measured as the negative sum of costs) as well as emergent properties like free-riding and fairness in cost distribution among policy-makers.
△ Less
Submitted 3 August, 2022; v1 submitted 21 February, 2021;
originally announced February 2021.
-
Impacts of Earthquakes on Electrical Grid Resilience
Authors:
Adam Mate,
Travis Hagan,
Eduardo Cotilla-Sanchez,
Ted K. A. Brekken,
Annette Von Jouanne
Abstract:
One of the most complex and devastating disaster scenarios that the U.S.~Pacific Northwest region and the state of Oregon faces is a large magnitude Cascadia Subduction Zone earthquake event. The region's electrical grid lacks in resilience against the destruction of a megathrust earthquake, a powerful tsunami, hundreds of aftershocks and increased volcanic activity, all of which are highly probab…
▽ More
One of the most complex and devastating disaster scenarios that the U.S.~Pacific Northwest region and the state of Oregon faces is a large magnitude Cascadia Subduction Zone earthquake event. The region's electrical grid lacks in resilience against the destruction of a megathrust earthquake, a powerful tsunami, hundreds of aftershocks and increased volcanic activity, all of which are highly probable components of this hazard. This research seeks to catalyze further understanding and improvement of resilience. By systematizing power system related experiences of historical earthquakes, and collecting practical and innovative ideas from other regions on how to enhance network design, construction, and operation, important steps are being taken toward a more resilient, earthquake-resistant grid. This paper presents relevant findings in an effort to be an overview and a useful guideline for those who are also working towards greater electrical grid resilience.
△ Less
Submitted 27 December, 2022; v1 submitted 19 January, 2021;
originally announced January 2021.
-
Implementing Admittance Relaying for Microgrid Protection
Authors:
Arthur K. Barnes,
Adam Mate
Abstract:
The rapid increase of distributed energy resources has led to the widespread deployment of microgrids. These flexible and efficient local energy grids are able to operate in both grid-connected mode and islanded mode; they are interfaced to the main power system by a fast semiconductor switch and commonly make use of inverter-interfaced generation. This paper focuses on inverter interfaced microgr…
▽ More
The rapid increase of distributed energy resources has led to the widespread deployment of microgrids. These flexible and efficient local energy grids are able to operate in both grid-connected mode and islanded mode; they are interfaced to the main power system by a fast semiconductor switch and commonly make use of inverter-interfaced generation. This paper focuses on inverter interfaced microgrids, which present a challenge for protection as they do not provide the high short-circuit current necessary for conventional time-overcurrent protection. The application of admittance relaying for the protection of inverter-interfaced microgrids is investigated as a potential solution. The comparison of analytical and simulated results of performed four experiments prove the suitability of admittance relaying for microgrids protection.
△ Less
Submitted 27 December, 2022; v1 submitted 19 January, 2021;
originally announced January 2021.
-
Dynamic State Estimation for Radial Microgrid Protection
Authors:
Arthur K. Barnes,
Adam Mate
Abstract:
Microgrids are localized electrical grids with control capability that are able to disconnect from the traditional grid to operate autonomously. They strengthen grid resilience, help mitigate grid disturbances, and support a flexible grid by enabling the integration of distributed energy resources. Given the likely presence of critical loads, the proper protection of microgrids is of vital importa…
▽ More
Microgrids are localized electrical grids with control capability that are able to disconnect from the traditional grid to operate autonomously. They strengthen grid resilience, help mitigate grid disturbances, and support a flexible grid by enabling the integration of distributed energy resources. Given the likely presence of critical loads, the proper protection of microgrids is of vital importance; however, this is complicated in the case of inverter-interfaced microgrids where low fault currents preclude the use of conventional time-overcurrent protection. This paper introduces and investigates the application of dynamic state estimation, a generalization of differential protection, for the protection of radial portions of microgrids (or distribution networks); both phasor-based and dynamic approaches are investigated for protection. It is demonstrated through experiments on three case-study systems that dynamic state estimation is capable of correctly identifying model parameters for both normal and faulted operation.
△ Less
Submitted 30 December, 2022; v1 submitted 19 January, 2021;
originally announced January 2021.
-
Rapid Method for Generation Prioritization during System Restoration with Renewable Resources
Authors:
Adam Mate,
Eduardo Cotilla-Sanchez
Abstract:
Quick and reliable power system restoration is critically important after natural disasters or other sudden threats, such as cyber-attacks. Leveraging renewable resources in system restoration shortens recovery times, resulting in prevented life-loss and avoided economic-loss, and improves the resilience of the entire grid. However, it is not a common practice today; the inherent variability of th…
▽ More
Quick and reliable power system restoration is critically important after natural disasters or other sudden threats, such as cyber-attacks. Leveraging renewable resources in system restoration shortens recovery times, resulting in prevented life-loss and avoided economic-loss, and improves the resilience of the entire grid. However, it is not a common practice today; the inherent variability of these resources represents a challenge for a streamlined restoration process. This paper presents a prioritized method - starting with renewable generator units then lowering priority to conventional units - to plan the operational schedule of a power system during the restoration process. The goal is to achieve a well balanced system in the presence of significant renewable penetration. Validation and benchmarking experiments were performed on a customized version of the RTS-GMLC test system using six months out of year-long data, tested through hourly simulations. After evaluating the performance and computational costs, this method proved faster than common approaches: a MILP Unit Commitment algorithm, widely used today, and an "enable-and-try" algorithm. In summary, herein a more convenient method is provided to be utilized during time-sensitive restoration, as an online operation-planning aid.
△ Less
Submitted 15 January, 2021;
originally announced January 2021.
-
Analyzing and Mitigating the Impacts of GMD and EMP Events on the Electrical Grid with PowerModelsGMD.jl
Authors:
Adam Mate,
Arthur K. Barnes,
Russell W. Bent,
Eduardo Cotilla-Sanchez
Abstract:
Geomagnetic disturbances and E3 high-altitude electromagnetic pulse events pose a substantial threat to the electrical grid by adversely impacting and damaging high-voltage transmission networks and equipment. To evaluate the risks and mitigate the potential effects of these hazards, this work proposes PowerModelsGMD.jl (abbr. PMsGMD). PMsGMD is an open-source Julia package that solves for quasi-d…
▽ More
Geomagnetic disturbances and E3 high-altitude electromagnetic pulse events pose a substantial threat to the electrical grid by adversely impacting and damaging high-voltage transmission networks and equipment. To evaluate the risks and mitigate the potential effects of these hazards, this work proposes PowerModelsGMD.jl (abbr. PMsGMD). PMsGMD is an open-source Julia package that solves for quasi-dc line flow and ac power flow problems in a system subjected to geomagnetically induced currents. Unlike commercially available software solutions, it is extensible and applicable to a variety of problems. The flexibility of this framework is demonstrated by applying it to the problem of identifying mitigation strategies via line switching for a time-extended transformer heating problem. An overview of PMsGMD is presented in this paper: introduction to its design, validation of its implementation, demonstration of its performance and effectiveness, and a description of how it may be applied to aid system-operation decisions.
△ Less
Submitted 7 April, 2021; v1 submitted 13 January, 2021;
originally announced January 2021.
-
Collapsing Bandits and Their Application to Public Health Interventions
Authors:
Aditya Mate,
Jackson A. Killian,
Haifeng Xu,
Andrew Perrault,
Milind Tambe
Abstract:
We propose and study Collpasing Bandits, a new restless multi-armed bandit (RMAB) setting in which each arm follows a binary-state Markovian process with a special structure: when an arm is played, the state is fully observed, thus "collapsing" any uncertainty, but when an arm is passive, no observation is made, thus allowing uncertainty to evolve. The goal is to keep as many arms in the "good" st…
▽ More
We propose and study Collpasing Bandits, a new restless multi-armed bandit (RMAB) setting in which each arm follows a binary-state Markovian process with a special structure: when an arm is played, the state is fully observed, thus "collapsing" any uncertainty, but when an arm is passive, no observation is made, thus allowing uncertainty to evolve. The goal is to keep as many arms in the "good" state as possible by planning a limited budget of actions per round. Such Collapsing Bandits are natural models for many healthcare domains in which workers must simultaneously monitor patients and deliver interventions in a way that maximizes the health of their patient cohort. Our main contributions are as follows: (i) Building on the Whittle index technique for RMABs, we derive conditions under which the Collapsing Bandits problem is indexable. Our derivation hinges on novel conditions that characterize when the optimal policies may take the form of either "forward" or "reverse" threshold policies. (ii) We exploit the optimality of threshold policies to build fast algorithms for computing the Whittle index, including a closed-form. (iii) We evaluate our algorithm on several data distributions including data from a real-world healthcare task in which a worker must monitor and deliver interventions to maximize their patients' adherence to tuberculosis medication. Our algorithm achieves a 3-order-of-magnitude speedup compared to state-of-the-art RMAB techniques while achieving similar performance.
△ Less
Submitted 4 July, 2020;
originally announced July 2020.
-
End-to-End Game-Focused Learning of Adversary Behavior in Security Games
Authors:
Andrew Perrault,
Bryan Wilder,
Eric Ewing,
Aditya Mate,
Bistra Dilkina,
Milind Tambe
Abstract:
Stackelberg security games are a critical tool for maximizing the utility of limited defense resources to protect important targets from an intelligent adversary. Motivated by green security, where the defender may only observe an adversary's response to defense on a limited set of targets, we study the problem of learning a defense that generalizes well to a new set of targets with novel feature…
▽ More
Stackelberg security games are a critical tool for maximizing the utility of limited defense resources to protect important targets from an intelligent adversary. Motivated by green security, where the defender may only observe an adversary's response to defense on a limited set of targets, we study the problem of learning a defense that generalizes well to a new set of targets with novel feature values and combinations. Traditionally, this problem has been addressed via a two-stage approach where an adversary model is trained to maximize predictive accuracy without considering the defender's optimization problem. We develop an end-to-end game-focused approach, where the adversary model is trained to maximize a surrogate for the defender's expected utility. We show both in theory and experimental results that our game-focused approach achieves higher defender expected utility than the two-stage alternative when there is limited data.
△ Less
Submitted 22 June, 2020; v1 submitted 3 March, 2019;
originally announced March 2019.
-
Magneto-elastic oscillations modulating the emission of magnetars
Authors:
Michael Gabler,
Pablo Cerdá-Durán,
Alexei Mate,
Nikolaos Stergioulas,
José A. Font,
Ewald Müller
Abstract:
Magneto-elastic oscillations of neutron stars are believed to explain observed quasi-periodic oscillations (QPOs) in the decaying tail of the giant flares of highly magnetized neutron stars (magnetars). Strong efforts of the theoretical modelling from different groups have increased our understanding of this phenomenon significantly. Here, we discuss some constraints on the matter in neutron stars…
▽ More
Magneto-elastic oscillations of neutron stars are believed to explain observed quasi-periodic oscillations (QPOs) in the decaying tail of the giant flares of highly magnetized neutron stars (magnetars). Strong efforts of the theoretical modelling from different groups have increased our understanding of this phenomenon significantly. Here, we discuss some constraints on the matter in neutron stars that arise if the interpretation of the observations in terms of superfluid, magneto-elastic oscillations is correct. To explain the observed modulation of the light curve of the giant flare, we describe a model that allows the QPOs to couple to the stellar exterior through the magnetic field. In this magnetosphere, the shaking magnetic field induces currents that provide scattering targets for resonant cyclotron scattering of photons, which is calculated with a Monte-Carlo approach and coupled to a code that calculates the momentum distribution of the charge carriers as a one-dimensional accelerator problem. We show first results of a simplified, but self-consistent momentum distribution, i.e. a waterbag distribution, and of the corresponding spectra.
△ Less
Submitted 20 September, 2017;
originally announced September 2017.