-
Adversarially Robust Prototypical Few-shot Segmentation with Neural-ODEs
Authors:
Prashant Pandey,
Aleti Vardhan,
Mustafa Chasmai,
Tanuj Sur,
Brejesh Lall
Abstract:
Few-shot Learning (FSL) methods are being adopted in settings where data is not abundantly available. This is especially seen in medical domains where the annotations are expensive to obtain. Deep Neural Networks have been shown to be vulnerable to adversarial attacks. This is even more severe in the case of FSL due to the lack of a large number of training examples. In this paper, we provide a fr…
▽ More
Few-shot Learning (FSL) methods are being adopted in settings where data is not abundantly available. This is especially seen in medical domains where the annotations are expensive to obtain. Deep Neural Networks have been shown to be vulnerable to adversarial attacks. This is even more severe in the case of FSL due to the lack of a large number of training examples. In this paper, we provide a framework to make few-shot segmentation models adversarially robust in the medical domain where such attacks can severely impact the decisions made by clinicians who use them. We propose a novel robust few-shot segmentation framework, Prototypical Neural Ordinary Differential Equation (PNODE), that provides defense against gradient-based adversarial attacks. We show that our framework is more robust compared to traditional adversarial defense mechanisms such as adversarial training. Adversarial training involves increased training time and shows robustness to limited types of attacks depending on the type of adversarial examples seen during training. Our proposed framework generalises well to common adversarial attacks like FGSM, PGD and SMIA while having the model parameters comparable to the existing few-shot segmentation models. We show the effectiveness of our proposed approach on three publicly available multi-organ segmentation datasets in both in-domain and cross-domain settings by attacking the support and query sets without the need for ad-hoc adversarial training.
△ Less
Submitted 7 October, 2022;
originally announced October 2022.
-
Gliders in shape-changing active matter
Authors:
Akash Vardhan,
Ram Avinery,
Hridesh Kedia,
Shengkai Li,
Kurt Wiesenfeld,
Daniel I. Goldman
Abstract:
We report in experiment and simulation the spontaneous formation of dynamically bound pairs of shape changing smarticle robots undergoing locally repulsive collisions. Borrowing terminology from Conway's simulated Game of Life, these physical `gliders' robustly emerge from an ensemble of individually undulating three-link two-motor smarticles and can remain bound for hundreds of undulations and tr…
▽ More
We report in experiment and simulation the spontaneous formation of dynamically bound pairs of shape changing smarticle robots undergoing locally repulsive collisions. Borrowing terminology from Conway's simulated Game of Life, these physical `gliders' robustly emerge from an ensemble of individually undulating three-link two-motor smarticles and can remain bound for hundreds of undulations and travel for multiple robot dimensions. Gliders occur in two distinct binding symmetries and form over a wide range of angular flap** extent. This parameter sets the maximal concavity which influences formation probability and translation characteristics. Analysis of dynamics in simulation reveals the mechanism of effective dynamical attraction -- a result of the emergent interplay of appropriately oriented and timed repulsive interactions.
△ Less
Submitted 9 June, 2022;
originally announced June 2022.
-
ExCode-Mixed: Explainable Approaches towards Sentiment Analysis on Code-Mixed Data using BERT models
Authors:
Aman Priyanshu,
Aleti Vardhan,
Sudarshan Sivakumar,
Supriti Vijay,
Nipuna Chhabra
Abstract:
The increasing use of social media sites in countries like India has given rise to large volumes of code-mixed data. Sentiment analysis of this data can provide integral insights into people's perspectives and opinions. Develo** robust explainability techniques which explain why models make their predictions becomes essential. In this paper, we propose an adequate methodology to integrate explai…
▽ More
The increasing use of social media sites in countries like India has given rise to large volumes of code-mixed data. Sentiment analysis of this data can provide integral insights into people's perspectives and opinions. Develo** robust explainability techniques which explain why models make their predictions becomes essential. In this paper, we propose an adequate methodology to integrate explainable approaches into code-mixed sentiment analysis.
△ Less
Submitted 25 September, 2021; v1 submitted 7 September, 2021;
originally announced September 2021.
-
Towards Quantifying the Carbon Emissions of Differentially Private Machine Learning
Authors:
Rakshit Naidu,
Harshita Diddee,
A**kya Mulay,
Aleti Vardhan,
Krithika Ramesh,
Ahmed Zamzam
Abstract:
In recent years, machine learning techniques utilizing large-scale datasets have achieved remarkable performance. Differential privacy, by means of adding noise, provides strong privacy guarantees for such learning algorithms. The cost of differential privacy is often a reduced model accuracy and a lowered convergence speed. This paper investigates the impact of differential privacy on learning al…
▽ More
In recent years, machine learning techniques utilizing large-scale datasets have achieved remarkable performance. Differential privacy, by means of adding noise, provides strong privacy guarantees for such learning algorithms. The cost of differential privacy is often a reduced model accuracy and a lowered convergence speed. This paper investigates the impact of differential privacy on learning algorithms in terms of their carbon footprint due to either longer run-times or failed experiments. Through extensive experiments, further guidance is provided on choosing the noise levels which can strike a balance between desired privacy levels and reduced carbon emissions.
△ Less
Submitted 14 July, 2021;
originally announced July 2021.
-
Low rattling: A predictive principle for self-organization in active collectives
Authors:
Pavel Chvykov,
Thomas A. Berrueta,
Akash Vardhan,
William Savoie,
Alexander Samland,
Todd D. Murphey,
Kurt Wiesenfeld,
Daniel I. Goldman,
Jeremy L. England
Abstract:
Self-organization is frequently observed in active collectives, from ant rafts to molecular motor assemblies. General principles describing self-organization away from equilibrium have been challenging to identify. We offer a unifying framework that models the behavior of complex systems as largely random, while capturing their configuration-dependent response to external forcing. This allows deri…
▽ More
Self-organization is frequently observed in active collectives, from ant rafts to molecular motor assemblies. General principles describing self-organization away from equilibrium have been challenging to identify. We offer a unifying framework that models the behavior of complex systems as largely random, while capturing their configuration-dependent response to external forcing. This allows derivation of a Boltzmann-like principle for understanding and manipulating driven self-organization. We validate our predictions experimentally in shape-changing robotic active matter, and outline a methodology for controlling collective behavior. Our findings highlight how emergent order depends sensitively on the matching between external patterns of forcing and internal dynamical response properties, pointing towards future approaches for design and control of active particle mixtures and metamaterials.
△ Less
Submitted 3 January, 2021;
originally announced January 2021.