Skip to main content

Showing 1–18 of 18 results for author: Anderson, B G

.
  1. arXiv:2406.19529  [pdf, other

    math.OC

    Approximately Gaussian Replicator Flows: Nonconvex Optimization as a Nash-Convergent Evolutionary Game

    Authors: Brendon G. Anderson, Samuel Pfrommer, Somayeh Sojoudi

    Abstract: This work leverages tools from evolutionary game theory to solve unconstrained nonconvex optimization problems. Specifically, we lift such a problem to an optimization over probability measures, whose minimizers exactly correspond to the Nash equilibria of a particular population game. To algorithmically solve for such Nash equilibria, we introduce approximately Gaussian replicator flows (AGRFs) a… ▽ More

    Submitted 27 June, 2024; originally announced June 2024.

  2. arXiv:2405.16763  [pdf, other

    cs.LG

    Transport of Algebraic Structure to Latent Embeddings

    Authors: Samuel Pfrommer, Brendon G. Anderson, Somayeh Sojoudi

    Abstract: Machine learning often aims to produce latent embeddings of inputs which lie in a larger, abstract mathematical space. For example, in the field of 3D modeling, subsets of Euclidean space can be embedded as vectors using implicit neural representations. Such subsets also have a natural algebraic structure including operations (e.g., union) and corresponding laws (e.g., associativity). How can we l… ▽ More

    Submitted 26 May, 2024; originally announced May 2024.

    Comments: Proceedings of the 41st International Conference on Machine Learning (2024)

  3. arXiv:2312.08286  [pdf, other

    math.DS cs.GT eess.SY math.OC

    Evolutionary Games on Infinite Strategy Sets: Convergence to Nash Equilibria via Dissipativity

    Authors: Brendon G. Anderson, Somayeh Sojoudi, Murat Arcak

    Abstract: We consider evolutionary dynamics for population games in which players have a continuum of strategies at their disposal. Models in this setting amount to infinite-dimensional differential equations evolving on the manifold of probability measures. We generalize dissipativity theory for evolutionary games from finite to infinite strategy sets that are compact metric spaces, and derive sufficient c… ▽ More

    Submitted 22 December, 2023; v1 submitted 13 December, 2023; originally announced December 2023.

  4. arXiv:2311.15165  [pdf, other

    cs.LG cs.CV

    Mixing Classifiers to Alleviate the Accuracy-Robustness Trade-Off

    Authors: Yatong Bai, Brendon G. Anderson, Somayeh Sojoudi

    Abstract: Deep neural classifiers have recently found tremendous success in data-driven control systems. However, existing models suffer from a trade-off between accuracy and adversarial robustness. This limitation must be overcome in the control of safety-critical systems that require both high performance and rigorous robustness guarantees. In this work, we develop classifiers that simultaneously inherit… ▽ More

    Submitted 3 June, 2024; v1 submitted 25 November, 2023; originally announced November 2023.

    Comments: arXiv admin note: text overlap with arXiv:2301.12554

    MSC Class: 68T07

  5. arXiv:2310.04916  [pdf, other

    math.OC cs.LG

    Tight Certified Robustness via Min-Max Representations of ReLU Neural Networks

    Authors: Brendon G. Anderson, Samuel Pfrommer, Somayeh Sojoudi

    Abstract: The reliable deployment of neural networks in control systems requires rigorous robustness guarantees. In this paper, we obtain tight robustness certificates over convex attack sets for min-max representations of ReLU neural networks by develo** a convex reformulation of the nonconvex certification problem. This is done by "lifting" the problem to an infinite-dimensional optimization over probab… ▽ More

    Submitted 7 October, 2023; originally announced October 2023.

    Comments: IEEE Conference on Decision and Control, 2023

  6. arXiv:2309.13794  [pdf, other

    cs.LG

    Projected Randomized Smoothing for Certified Adversarial Robustness

    Authors: Samuel Pfrommer, Brendon G. Anderson, Somayeh Sojoudi

    Abstract: Randomized smoothing is the current state-of-the-art method for producing provably robust classifiers. While randomized smoothing typically yields robust $\ell_2$-ball certificates, recent research has generalized provable robustness to different norm balls as well as anisotropic regions. This work considers a classifier architecture that first projects onto a low-dimensional approximation of the… ▽ More

    Submitted 24 September, 2023; originally announced September 2023.

    Comments: Transactions on Machine Learning Research (TMLR) 2023

  7. arXiv:2302.01961  [pdf, other

    cs.LG

    Asymmetric Certified Robustness via Feature-Convex Neural Networks

    Authors: Samuel Pfrommer, Brendon G. Anderson, Julien Piet, Somayeh Sojoudi

    Abstract: Recent works have introduced input-convex neural networks (ICNNs) as learning models with advantageous training, inference, and generalization properties linked to their convex structure. In this paper, we propose a novel feature-convex neural network architecture as the composition of an ICNN with a Lipschitz feature map in order to achieve adversarial robustness. We consider the asymmetric binar… ▽ More

    Submitted 10 October, 2023; v1 submitted 3 February, 2023; originally announced February 2023.

    Comments: 37th Conference on Neural Information Processing Systems (NeurIPS 2023)

  8. arXiv:2301.12554  [pdf, other

    cs.LG cs.CR cs.CV

    Improving the Accuracy-Robustness Trade-Off of Classifiers via Adaptive Smoothing

    Authors: Yatong Bai, Brendon G. Anderson, Aerin Kim, Somayeh Sojoudi

    Abstract: While prior research has proposed a plethora of methods that build neural classifiers robust against adversarial robustness, practitioners are still reluctant to adopt them due to their unacceptably severe clean accuracy penalties. This paper significantly alleviates this accuracy-robustness trade-off by mixing the output probabilities of a standard classifier and a robust classifier, where the st… ▽ More

    Submitted 8 April, 2024; v1 submitted 29 January, 2023; originally announced January 2023.

    MSC Class: 68T07

  9. arXiv:2208.07464  [pdf, other

    cs.LG math.OC stat.ML

    An Overview and Prospective Outlook on Robust Training and Certification of Machine Learning Models

    Authors: Brendon G. Anderson, Tanmay Gautam, Somayeh Sojoudi

    Abstract: In this discussion paper, we survey recent research surrounding robustness of machine learning models. As learning algorithms become increasingly more popular in data-driven control systems, their robustness to data uncertainty must be ensured in order to maintain reliable safety-critical operations. We begin by reviewing common formalisms for such robustness, and then move on to discuss popular a… ▽ More

    Submitted 27 September, 2022; v1 submitted 15 August, 2022; originally announced August 2022.

  10. arXiv:2106.00089  [pdf, other

    cs.LG eess.SP

    Node-Variant Graph Filters in Graph Neural Networks

    Authors: Fernando Gama, Brendon G. Anderson, Somayeh Sojoudi

    Abstract: Graph neural networks (GNNs) have been successfully employed in a myriad of applications involving graph signals. Theoretical findings establish that GNNs use nonlinear activation functions to create low-eigenvalue frequency content that can be processed in a stable manner by subsequent graph convolutional filters. However, the exact shape of the frequency content created by nonlinear functions is… ▽ More

    Submitted 4 March, 2022; v1 submitted 31 May, 2021; originally announced June 2021.

  11. arXiv:2101.09306  [pdf, other

    cs.LG math.OC

    Towards Optimal Branching of Linear and Semidefinite Relaxations for Neural Network Robustness Certification

    Authors: Brendon G. Anderson, Ziye Ma, **gqi Li, Somayeh Sojoudi

    Abstract: In this paper, we study certifying the robustness of ReLU neural networks against adversarial input perturbations. To diminish the relaxation error suffered by the popular linear programming (LP) and semidefinite programming (SDP) certification methods, we take a branch-and-bound approach to propose partitioning the input uncertainty set and solving the relaxations on each part separately. We show… ▽ More

    Submitted 2 February, 2023; v1 submitted 22 January, 2021; originally announced January 2021.

    Comments: This is an extension of our IEEE CDC 2020 conference paper arXiv:2004.00570

  12. arXiv:2010.07532   

    cs.LG math.OC stat.ML

    Certifying Neural Network Robustness to Random Input Noise from Samples

    Authors: Brendon G. Anderson, Somayeh Sojoudi

    Abstract: Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial input uncertainty, but researchers have recently shown a need for methods that consider random uncertainty. In this paper, we propose a novel robustness certification method that upper bounds the p… ▽ More

    Submitted 25 January, 2023; v1 submitted 15 October, 2020; originally announced October 2020.

    Comments: This paper has been superseded by arXiv:2010.01171 (merged from arXiv:2010.01171v1 and arXiv:2010.07532)

  13. arXiv:2010.01171  [pdf, other

    cs.LG math.OC stat.ML

    Data-Driven Certification of Neural Networks with Random Input Noise

    Authors: Brendon G. Anderson, Somayeh Sojoudi

    Abstract: Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial or worst-case inputs, but researchers have recently shown a need for methods that consider random input noise. In this paper, we examine the setting where inputs are subject to random noise coming… ▽ More

    Submitted 25 January, 2023; v1 submitted 2 October, 2020; originally announced October 2020.

    Comments: IEEE Transactions on Control of Network Systems, 2022. This work is a merge of arXiv:2010.01171v1 and arXiv:2010.07532

  14. arXiv:2004.00570  [pdf, ps, other

    cs.LG math.OC stat.ML

    Tightened Convex Relaxations for Neural Network Robustness Certification

    Authors: Brendon G. Anderson, Ziye Ma, **gqi Li, Somayeh Sojoudi

    Abstract: In this paper, we consider the problem of certifying the robustness of neural networks to perturbed and adversarial input data. Such certification is imperative for the application of neural networks in safety-critical decision-making and control systems. Certification techniques using convex optimization have been proposed, but they often suffer from relaxation errors that void the certificate. O… ▽ More

    Submitted 17 September, 2020; v1 submitted 1 April, 2020; originally announced April 2020.

    Comments: Proceedings of the 59th IEEE Conference on Decision and Control, 2020

  15. arXiv:1907.04409  [pdf, other

    cs.LG cs.CV math.OC stat.ML

    Global Optimality Guarantees for Nonconvex Unsupervised Video Segmentation

    Authors: Brendon G. Anderson, Somayeh Sojoudi

    Abstract: In this paper, we consider the problem of unsupervised video object segmentation via background subtraction. Specifically, we pose the nonsemantic extraction of a video's moving objects as a nonconvex optimization problem via a sum of sparse and low-rank matrices. The resulting formulation, a nonnegative variant of robust principal component analysis, is more computationally tractable than its com… ▽ More

    Submitted 22 February, 2020; v1 submitted 9 July, 2019; originally announced July 2019.

    Comments: Proceedings of the 57th Annual Allerton Conference on Communication, Control, and Computing, 2019; added funding source information and notation definitions

    Journal ref: Proceedings of the 57th Annual Allerton Conference on Communication, Control, and Computing, pp. 965--972, 2019

  16. arXiv:1905.07655  [pdf, other

    eess.SY

    Quantifying Robotic Swarm Coverage

    Authors: Brendon G. Anderson, Eva Loeser, Marissa Gee, Fei Ren, Swagata Biswas, Olga Turanova, Matt Haberland, Andrea L. Bertozzi

    Abstract: In the field of swarm robotics, the design and implementation of spatial density control laws has received much attention, with less emphasis being placed on performance evaluation. This work fills that gap by introducing an error metric that provides a quantitative measure of coverage for use with any control scheme. The proposed error metric is continuously sensitive to changes in the swarm dist… ▽ More

    Submitted 18 May, 2019; originally announced May 2019.

    Comments: To appear in Springer series Lecture Notes in Electrical Engineering (LNEE). This book contribution is an extension of our ICINCO 2018 conference paper arXiv:1806.02488. 27 pages, 8 figures, 2 tables

  17. Quantitative Assessment of Robotic Swarm Coverage

    Authors: Brendon G. Anderson, Eva Loeser, Marissa Gee, Fei Ren, Swagata Biswas, Olga Turanova, Matt Haberland, Andrea L. Bertozzi

    Abstract: This paper studies a generally applicable, sensitive, and intuitive error metric for the assessment of robotic swarm density controller performance. Inspired by vortex blob numerical methods, it overcomes the shortcomings of a common strategy based on discretization, and unifies other continuous notions of coverage. We present two benchmarks against which to compare the error metric value of a giv… ▽ More

    Submitted 6 June, 2018; originally announced June 2018.

    Comments: Proceedings of the 15th International Conference on Informatics in Control, Automation and Robotics (ICINCO), Porto, Portugal, 29--31 July 2018. 11 pages, 4 figures

    Journal ref: Proceedings of the 15th International Conference on Informatics in Control, Automation and Robotics (ICINCO)---Volume 2, 2018, pp. 91--101

  18. A far UV study of interstellar gas towards HD34078: high excitation H2 and small scale structure - Based on observations performed by the FUSE mission and at the CFHT telescope

    Authors: P. Boisse, F. Le Petit, E. Rollinde, E. Roueff, G. Pineau des Forets, B. G. Anderson, C. Gry, P. Felenbok

    Abstract: To investigate the presence of small scale structure in the spatial distribution of H2 molecules we have undertaken repeated FUSE UV observations of the runaway O9.5V star, HD34078. In this paper we present five spectra obtained between January 2000 and October 2002. These observations reveal an unexpectedly large amount of highly excited H2. Column densities for H2 levels from (v = 0, J = 0) up… ▽ More

    Submitted 3 August, 2004; originally announced August 2004.

    Journal ref: Astron.Astrophys. 429 (2005) 509-523