-
Label Noise Robustness for Domain-Agnostic Fair Corrections via Nearest Neighbors Label Spreading
Authors:
Nathan Stromberg,
Rohan Ayyagari,
Sanmi Koyejo,
Richard Nock,
Lalitha Sankar
Abstract:
Last-layer retraining methods have emerged as an efficient framework for correcting existing base models. Within this framework, several methods have been proposed to deal with correcting models for subgroup fairness with and without group membership information. Importantly, prior work has demonstrated that many methods are susceptible to noisy labels. To this end, we propose a drop-in correction…
▽ More
Last-layer retraining methods have emerged as an efficient framework for correcting existing base models. Within this framework, several methods have been proposed to deal with correcting models for subgroup fairness with and without group membership information. Importantly, prior work has demonstrated that many methods are susceptible to noisy labels. To this end, we propose a drop-in correction for label noise in last-layer retraining, and demonstrate that it achieves state-of-the-art worst-group accuracy for a broad range of symmetric label noise and across a wide variety of datasets exhibiting spurious correlations. Our proposed approach uses label spreading on a latent nearest neighbors graph and has minimal computational overhead compared to existing methods.
△ Less
Submitted 13 June, 2024;
originally announced June 2024.
-
Robustness to Subpopulation Shift with Domain Label Noise via Regularized Annotation of Domains
Authors:
Nathan Stromberg,
Rohan Ayyagari,
Monica Welfert,
Sanmi Koyejo,
Richard Nock,
Lalitha Sankar
Abstract:
Existing methods for last layer retraining that aim to optimize worst-group accuracy (WGA) rely heavily on well-annotated groups in the training data. We show, both in theory and practice, that annotation-based data augmentations using either downsampling or upweighting for WGA are susceptible to domain annotation noise, and in high-noise regimes approach the WGA of a model trained with vanilla em…
▽ More
Existing methods for last layer retraining that aim to optimize worst-group accuracy (WGA) rely heavily on well-annotated groups in the training data. We show, both in theory and practice, that annotation-based data augmentations using either downsampling or upweighting for WGA are susceptible to domain annotation noise, and in high-noise regimes approach the WGA of a model trained with vanilla empirical risk minimization. We introduce Regularized Annotation of Domains (RAD) in order to train robust last layer classifiers without the need for explicit domain annotations. Our results show that RAD is competitive with other recently proposed domain annotation-free techniques. Most importantly, RAD outperforms state-of-the-art annotation-reliant methods even with only 5% noise in the training data for several publicly available datasets.
△ Less
Submitted 26 June, 2024; v1 submitted 16 February, 2024;
originally announced February 2024.
-
Markov Decision Process with an External Temporal Process
Authors:
Ranga Shaarad Ayyagari,
Ambedkar Dukkipati
Abstract:
Most reinforcement learning algorithms treat the context under which they operate as a stationary, isolated and undisturbed environment. However, in the real world, the environment is constantly changing due to a variety of external influences. To address this problem, we study Markov Decision Processes (MDP) under the influence of an external temporal process. We formalize this notion and discuss…
▽ More
Most reinforcement learning algorithms treat the context under which they operate as a stationary, isolated and undisturbed environment. However, in the real world, the environment is constantly changing due to a variety of external influences. To address this problem, we study Markov Decision Processes (MDP) under the influence of an external temporal process. We formalize this notion and discuss conditions under which the problem becomes tractable with suitable solutions. We propose a policy iteration algorithm to solve this problem and theoretically analyze its performance.
△ Less
Submitted 25 May, 2023;
originally announced May 2023.
-
Learning Skills to Navigate without a Master: A Sequential Multi-Policy Reinforcement Learning Algorithm
Authors:
Ambedkar Dukkipati,
Rajarshi Banerjee,
Ranga Shaarad Ayyagari,
Dhaval Parmar Udaybhai
Abstract:
Solving complex problems using reinforcement learning necessitates breaking down the problem into manageable tasks and learning policies to solve these tasks. These policies, in turn, have to be controlled by a master policy that takes high-level decisions. Hence learning policies involves hierarchical decision structures. However, training such methods in practice may lead to poor generalization,…
▽ More
Solving complex problems using reinforcement learning necessitates breaking down the problem into manageable tasks and learning policies to solve these tasks. These policies, in turn, have to be controlled by a master policy that takes high-level decisions. Hence learning policies involves hierarchical decision structures. However, training such methods in practice may lead to poor generalization, with either sub-policies executing actions for too few time steps or devolving into a single policy altogether. In our work, we introduce an alternative approach to learn such skills sequentially without using an overarching hierarchical policy. We propose this method in the context of environments where a major component of the objective of a learning agent is to prolong the episode for as long as possible. We refer to our proposed method as Sequential Soft Option Critic. We demonstrate the utility of our approach on navigation and goal-based tasks in a flexible simulated 3D navigation environment that we have developed. We also show that our method outperforms prior methods such as Soft Actor-Critic and Soft Option Critic on various environments, including the Atari River Raid environment and the Gym-Duckietown self-driving car simulator.
△ Less
Submitted 7 August, 2022; v1 submitted 30 January, 2021;
originally announced February 2021.
-
Hot Electron Dynamics in Ultrafast Multilayer Epsilon-Near-Zero Metamaterial
Authors:
Alireza R. Rashed,
Bilge Can Yildiz,
Surya R. Ayyagari,
Humeyra Caglayan
Abstract:
Realizing remarkable tunability in optical properties without sacrificing speed is critical to obtain all optical ultrafast devices. In this work, we investigate the ultrafast temporal behavior of optically tunable epsilon-near-zero (ENZ) metamaterials, operating in the visible spectral range. To perform this the ultrafast dynamics of the hot electrons is acquired by femtosecond pump-probe spectro…
▽ More
Realizing remarkable tunability in optical properties without sacrificing speed is critical to obtain all optical ultrafast devices. In this work, we investigate the ultrafast temporal behavior of optically tunable epsilon-near-zero (ENZ) metamaterials, operating in the visible spectral range. To perform this the ultrafast dynamics of the hot electrons is acquired by femtosecond pump-probe spectroscopy and studied based on two-temperature model (2TM). We show that pum** with femtosecond pulses changes the effective permittivity of the metamaterial more than 400 %. This significant modulation is more pronounced in ENZ region and we confirm this by the 2TM. The realized ultrafast modulation in effective permittivity, along with the ultrashort relaxation time of 3.3 ps, opens a new avenue towards ultrafast photonic applications.
△ Less
Submitted 10 March, 2020;
originally announced March 2020.
-
Decentralized Cooperative Merging of Platoons of Connected and Automated Vehicles at Highway On-Ramps
Authors:
Sharmila Devi Kumaravel,
Andreas A. Malikopoulos,
Ramakalyan Ayyagari
Abstract:
In this paper, we propose an optimization framework for cooperative merging of platoons of connected and automated vehicles at highway on-ramps. The framework includes (1) an optimal scheduling algorithm, through which, each platoon derives the sequence and time to enter the highway safely, and (2) an optimal control algorithm that allows each platoon to derive its optimal control input (accelerat…
▽ More
In this paper, we propose an optimization framework for cooperative merging of platoons of connected and automated vehicles at highway on-ramps. The framework includes (1) an optimal scheduling algorithm, through which, each platoon derives the sequence and time to enter the highway safely, and (2) an optimal control algorithm that allows each platoon to derive its optimal control input (acceleration/deceleration) in terms of fuel consumption. We evaluate the efficacy of the proposed optimization framework through VISSIM-MATLAB simulation environment. The proposed framework significantly reduces the crossing time and fuel consumption of platoons at the highway on-ramps.
△ Less
Submitted 21 February, 2021; v1 submitted 12 February, 2020;
originally announced February 2020.
-
Optimal Coordination of Platoons of Connected and Automated Vehicles at Signal-Free Intersections
Authors:
Sharmila Devi Kumaravel,
Andreas A. Malikopoulos,
Ramakalyan Ayyagari
Abstract:
In this paper, we address the problem of coordinating platoons of connected and automated vehicles at signal-free intersections. We present a decentralized, two-level optimal framework to coordinate the platoons with the objective to minimize travel delay and fuel consumption of every platoon crossing the intersection. In the upper-level, each platoon derives an optimal schedule to enter the inter…
▽ More
In this paper, we address the problem of coordinating platoons of connected and automated vehicles at signal-free intersections. We present a decentralized, two-level optimal framework to coordinate the platoons with the objective to minimize travel delay and fuel consumption of every platoon crossing the intersection. In the upper-level, each platoon derives an optimal schedule to enter the intersection. In the low-level, the platoons derive their optimal control input (acceleration/deceleration) for the optimal schedule derived in the upper-level. We validate the effectiveness of the proposed framework in simulation and show significant improvements both in travel delay and fuel consumption compared to the baseline scenario with fixed time traffic signals at the intersection.
△ Less
Submitted 11 July, 2021; v1 submitted 14 January, 2020;
originally announced January 2020.
-
The Statistical Performance of Matching-Adjusted Indirect Comparisons
Authors:
David Cheng,
Rajeev Ayyagari,
James Signorovitch
Abstract:
Indirect comparisons of treatment-specific outcomes across separate studies often inform decision-making in the absence of head-to-head randomized comparisons. Differences in baseline characteristics between study populations may introduce confounding bias in such comparisons. Matching-adjusted indirect comparison (MAIC) (Signorovitch et al., 2010) has been used to adjust for differences in observ…
▽ More
Indirect comparisons of treatment-specific outcomes across separate studies often inform decision-making in the absence of head-to-head randomized comparisons. Differences in baseline characteristics between study populations may introduce confounding bias in such comparisons. Matching-adjusted indirect comparison (MAIC) (Signorovitch et al., 2010) has been used to adjust for differences in observed baseline covariates when the individual patient-level data (IPD) are available for only one study and aggregate data (AGD) are available for the other study. The approach weights outcomes from the IPD using estimates of trial selection odds that balance baseline covariates between the IPD and AGD. With the increasing use of MAIC, there is a need for formal assessments of its statistical properties. In this paper we formulate identification assumptions for causal estimands that justify MAIC estimators. We then examine large sample properties and evaluate strategies for estimating standard errors without the full IPD from both studies. The finite-sample bias of MAIC and the performance of confidence intervals based on different standard error estimators are evaluated through simulations. The method is illustrated through an example comparing placebo arm and natural history outcomes in Duchenne muscular dystrophy.
△ Less
Submitted 8 April, 2020; v1 submitted 14 October, 2019;
originally announced October 2019.
-
Cache Contention on Multicore Systems: An Ontology-based Approach
Authors:
Maruthi Rohit Ayyagari
Abstract:
Multicore processors have proved to be the right choice for both desktop and server systems because it can support high performance with an acceptable budget expenditure. In this work, we have compared several works in cache contention and found that such works have identified several techniques for cache contention other than cache size including FSB, Memory Controller and prefetching hardware. W…
▽ More
Multicore processors have proved to be the right choice for both desktop and server systems because it can support high performance with an acceptable budget expenditure. In this work, we have compared several works in cache contention and found that such works have identified several techniques for cache contention other than cache size including FSB, Memory Controller and prefetching hardware. We found that Distributed Intensity Online (DIO) is a very promising cache contention algorithm since it can achieve up to 2% from the optimal technique. Moreover, we propose a new framework for cache contention based on resource ontologies. In which ontologies instances will be used for communication between diverse processes instead of gras** schedules based on hardware.
△ Less
Submitted 3 June, 2019;
originally announced June 2019.
-
Integrating Association Rules with Decision Trees in Object-Relational Databases
Authors:
Maruthi Rohit Ayyagari
Abstract:
Research has provided evidence that associative classification produces more accurate results compared to other classification models. The Classification Based on Association (CBA) is one of the famous Associative Classification algorithms that generates accurate classifiers. However, current association classification algorithms reside external to databases, which reduces the flexibility of enter…
▽ More
Research has provided evidence that associative classification produces more accurate results compared to other classification models. The Classification Based on Association (CBA) is one of the famous Associative Classification algorithms that generates accurate classifiers. However, current association classification algorithms reside external to databases, which reduces the flexibility of enterprise analytics systems. This paper implements the CBA in Oracle database using two variant models: hardcoding the CBA in Oracle Data Mining (ODM) package and Integrating Oracle Apriori model with the Oracle Decision tree model. We compared the proposed model performance with Naive Bayes, Support Vector Machine, Random Forests, and Decision Tree over 18 datasets from UCI. Results showed that our models outperformed the original CBA model with 1 percent and is competitive to chosen classification models over benchmark datasets.
△ Less
Submitted 21 April, 2019;
originally announced April 2019.
-
A new NS3 Implementation of CCNx 1.0 Protocol
Authors:
Marc Mosko,
Ramesh Ayyagari,
Priti Goel,
Eric Holmberg,
Mark Konezny
Abstract:
The ccns3Sim project is an open source implementation of the CCNx 1.0 protocols for the NS3 simulator. We describe the implementation and several important features including modularity and process delay simulation. The ccns3Sim implementation is a fresh NS3-specific implementation. Like NS3 itself, it uses C++98 standard, NS3 code style, NS3 smart pointers, NS3 xUnit, and integrates with the NS3…
▽ More
The ccns3Sim project is an open source implementation of the CCNx 1.0 protocols for the NS3 simulator. We describe the implementation and several important features including modularity and process delay simulation. The ccns3Sim implementation is a fresh NS3-specific implementation. Like NS3 itself, it uses C++98 standard, NS3 code style, NS3 smart pointers, NS3 xUnit, and integrates with the NS3 documentation and manual. A user or developer does not need to learn two systems. If one knows NS3, one should be able to get started with the CCNx code right away. A developer can easily use their own implementation of the layer 3 protocol, layer 4 protocol, forwarder, routing protocol, Pending Interest Table (PIT) or Forwarding Information Base (FIB) or Content Store (CS). A user may configure or specify a new implementation for any of these features at runtime in the simulation script. In this paper, we describe the software architecture and give examples of using the simulator. We evaluate the implementation with several example experiments on ICN caching.
△ Less
Submitted 15 July, 2017;
originally announced July 2017.
-
Formation Control in Multi-Agent Systems Over Packet Drop** Links
Authors:
Seshadhri Srinivasan,
R. Ayyagari
Abstract:
One major challenge in implementation of formation control problems stems from the packet loss that occur in these shared communication channel. In the presence of packet loss the coordination information among agents is lost. Moreover, there is a move to use wireless channels in formation control applications. It has been found in practice that packet losses are more pronounced in wireless channe…
▽ More
One major challenge in implementation of formation control problems stems from the packet loss that occur in these shared communication channel. In the presence of packet loss the coordination information among agents is lost. Moreover, there is a move to use wireless channels in formation control applications. It has been found in practice that packet losses are more pronounced in wireless channels, than their wired counterparts. In our analysis, we first show that packet loss may result in loss of rigidity. In turn this causes the entire formation to fail. Later, we present an estimation based formation control algorithm that is robust to packet loss among agents. The proposed estimation algorithm employs minimal spanning tree algorithm to compute the estimate of the node variables (coordination variables). Consequently, this reduces the communication overhead required for information exchange. Later, using simulation, we verify the data that is to be transmitted for optimal estimation of these variables in the event of a packet loss. Finally, the effectiveness of the proposed algorithm is illustrated using suitable simulation example.
△ Less
Submitted 26 June, 2015;
originally announced June 2015.
-
An analytical framework for analysis and design of networked control systems with random delays and packet losses
Authors:
M. Vallabhan,
S. Seshadhri,
S. Ashok,
S. Ramaswmay,
R. Ayyagari
Abstract:
Delays and data losses are undesirable from a control system perspective as they tend to adversely affect performance Networked Control Systems (NCSs) are a class of control systems wherein control components exchange information using a shared communication channel. Delays and packet losses in the communication channels are usually random, thereby making the analysis and design of control loops m…
▽ More
Delays and data losses are undesirable from a control system perspective as they tend to adversely affect performance Networked Control Systems (NCSs) are a class of control systems wherein control components exchange information using a shared communication channel. Delays and packet losses in the communication channels are usually random, thereby making the analysis and design of control loops more complex. The usual assumptions in classical control theory, such as delay free sensing and synchronous actuation, assume lesser significance when it comes to NCSs. Hence, this necessitates a reformulation/relook into the existing models used for NCS control loop analysis and design. In this paper, we study and present the reformulations required for NCSs to include random delays and packet loss in the channel. This paper thereby gives a complete overview of what has been accomplished thus far in NCS research and puts forth a unified framework for analyzing a host of problems that can be captured as NCSs subjected to random delays and packet losses.
△ Less
Submitted 20 June, 2015;
originally announced June 2015.
-
On Chiral Symmetry Restoration at Finite Density in Large N_c QCD
Authors:
Thomas D. Cohen,
Prabal Adhikari,
Mark C. Strother,
Raja R. M. Ayyagari
Abstract:
At large N_c, cold nuclear matter is expected to form a crystal and thus spontaneously break translational symmetry. The description of chiral symmetry breaking and translational symmetry breaking can become intertwined. Here, the focus is on aspects of chiral symmetry breaking and its possible restoration that are by construction independent of the nature of translational symmetry breaking---name…
▽ More
At large N_c, cold nuclear matter is expected to form a crystal and thus spontaneously break translational symmetry. The description of chiral symmetry breaking and translational symmetry breaking can become intertwined. Here, the focus is on aspects of chiral symmetry breaking and its possible restoration that are by construction independent of the nature of translational symmetry breaking---namely spatial averages of chiral order parameters. A system will be considered to be chirally restored provided all spatially-averaged chiral order parameters are zero. A critical question is whether chiral restoration in this sense is possible for phases in which chiral order parameters are locally non-zero but whose spatial averages all vanish. We show that this is not possible unless all chirally-invariant observables are spatially uniform. This result is first derived for Skyrme-type models, which are based on a nonlinear sigma model and by construction break chiral symmetry on a point-by-point basis. A no-go theorem for chiral restoration (in the average sense) for all models of this type is obtained by showing that in these models there exist chirally symmetric order parameters which cannot be spatially uniform. Next we show that the no-go theorem applies to large N_c QCD in any phase which has a non-zero but spatially varying chiral condensate. The theorem is demonstrated by showing that in a putative chirally-restored phase, the field configuration can be reduced to that of a nonlinear sigma model.
△ Less
Submitted 12 April, 2011;
originally announced April 2011.
