Showing 1–24 of 24 results for author: Thorpe, A

Act Natural! Projecting Autonomous System Trajectories Into Naturalistic Behavior Sets

Authors: Hamzah I. Khan, Adam J. Thorpe, David Fridovich-Keil

Abstract: Autonomous agents operating around human actors must consider how their behaviors might affect those humans, even when not directly interacting with them. To this end, it is often beneficial to be predictable and appear naturalistic. Existing methods to address this problem use human actor intent modeling or imitation learning techniques, but these approaches rarely capture all possible motivation… ▽ More Autonomous agents operating around human actors must consider how their behaviors might affect those humans, even when not directly interacting with them. To this end, it is often beneficial to be predictable and appear naturalistic. Existing methods to address this problem use human actor intent modeling or imitation learning techniques, but these approaches rarely capture all possible motivations for human behavior or require significant amounts of data. In contrast, we propose a technique for modeling naturalistic behavior as a set of convex hulls computed over a relatively small dataset of human behavior. Given this set, we design an optimization-based filter which projects arbitrary trajectories into it to make them more naturalistic for autonomous agents to execute while also satisfying dynamics constraints. We demonstrate our methods on real-world human driving data from the inD intersection dataset (Bock et al., 2020). △ Less

Submitted 29 May, 2024; originally announced May 2024.

Zero-Shot Transfer of Neural ODEs

Authors: Tyler Ingebrand, Adam J. Thorpe, Ufuk Topcu

Abstract: Autonomous systems often encounter environments and scenarios beyond the scope of their training data, which underscores a critical challenge: the need to generalize and adapt to unseen scenarios in real time. This challenge necessitates new mathematical and algorithmic tools that enable adaptation and zero-shot transfer. To this end, we leverage the theory of function encoders, which enables zero… ▽ More Autonomous systems often encounter environments and scenarios beyond the scope of their training data, which underscores a critical challenge: the need to generalize and adapt to unseen scenarios in real time. This challenge necessitates new mathematical and algorithmic tools that enable adaptation and zero-shot transfer. To this end, we leverage the theory of function encoders, which enables zero-shot transfer by combining the flexibility of neural networks with the mathematical principles of Hilbert spaces. Using this theory, we first present a method for learning a space of dynamics spanned by a set of neural ODE basis functions. After training, the proposed approach can rapidly identify dynamics in the learned space using an efficient inner product calculation. Critically, this calculation requires no gradient calculations or retraining during the online phase. This method enables zero-shot transfer for autonomous systems at runtime and opens the door for a new class of adaptable control algorithms. We demonstrate state-of-the-art system modeling accuracy for two MuJoCo robot environments and show that the learned models can be used for more efficient MPC control of a quadrotor. △ Less

Submitted 14 May, 2024; originally announced May 2024.

Sensing Resource Allocation Against Data-Poisoning Attacks in Traffic Routing

Authors: Yue Yu, Adam J. Thorpe, Jesse Milzman, David Fridovich-Keil, Ufuk Topcu

Abstract: Data-poisoning attacks can disrupt the efficient operations of transportation systems by misdirecting traffic flows via falsified data. One challenge in countering these attacks is to reduce the uncertainties on the types of attacks, such as the distribution of their targets and intensities. We introduce a resource allocation method in transportation networks to detect and distinguish different ty… ▽ More Data-poisoning attacks can disrupt the efficient operations of transportation systems by misdirecting traffic flows via falsified data. One challenge in countering these attacks is to reduce the uncertainties on the types of attacks, such as the distribution of their targets and intensities. We introduce a resource allocation method in transportation networks to detect and distinguish different types of attacks and facilitate efficient traffic routing. The idea is to first cluster different types of attacks based on the corresponding optimal routing strategies, then allocate sensing resources to a subset of network links to distinguish attacks from different clusters via lexicographical mixed-integer programming. We illustrate the application of the proposed method using the Anaheim network, a benchmark model in traffic routing that contains more than 400 nodes and 900 links. △ Less

Submitted 3 April, 2024; originally announced April 2024.

Active Learning of Dynamics Using Prior Domain Knowledge in the Sampling Process

Authors: Kevin S. Miller, Adam J. Thorpe, Ufuk Topcu

Abstract: We present an active learning algorithm for learning dynamics that leverages side information by explicitly incorporating prior domain knowledge into the sampling process. Our proposed algorithm guides the exploration toward regions that demonstrate high empirical discrepancy between the observed data and an imperfect prior model of the dynamics derived from side information. Through numerical exp… ▽ More We present an active learning algorithm for learning dynamics that leverages side information by explicitly incorporating prior domain knowledge into the sampling process. Our proposed algorithm guides the exploration toward regions that demonstrate high empirical discrepancy between the observed data and an imperfect prior model of the dynamics derived from side information. Through numerical experiments, we demonstrate that this strategy explores regions of high discrepancy and accelerates learning while simultaneously reducing model uncertainty. We rigorously prove that our active learning algorithm yields a consistent estimate of the underlying dynamics by providing an explicit rate of convergence for the maximum predictive variance. We demonstrate the efficacy of our approach on an under-actuated pendulum system and on the half-cheetah MuJoCo environment. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Symbolic Regression on Sparse and Noisy Data with Gaussian Processes

Authors: Junette Hsin, Shubhankar Agarwal, Adam Thorpe, Luis Sentis, David Fridovich-Keil

Abstract: In this paper, we address the challenge of deriving dynamical models from sparse and noisy data. High-quality data is crucial for symbolic regression algorithms; limited and noisy data can present modeling challenges. To overcome this, we combine Gaussian process regression with a sparse identification of nonlinear dynamics (SINDy) method to denoise the data and identify nonlinear dynamical equati… ▽ More In this paper, we address the challenge of deriving dynamical models from sparse and noisy data. High-quality data is crucial for symbolic regression algorithms; limited and noisy data can present modeling challenges. To overcome this, we combine Gaussian process regression with a sparse identification of nonlinear dynamics (SINDy) method to denoise the data and identify nonlinear dynamical equations. Our simple approach offers improved robustness with sparse, noisy data compared to SINDy alone. We demonstrate its effectiveness on a Lotka-Volterra model, a unicycle dynamic model in simulation, and hardware data from an NVIDIA JetRacer system. We show superior performance over baselines including 20.78% improvement over SINDy and 61.92% improvement over SSR in predicting future trajectories from discovered dynamics. △ Less

Submitted 27 March, 2024; v1 submitted 20 September, 2023; originally announced September 2023.

Comments: Submitted to CDC 2024

Cosmic Ray Anisotropy with 11 Years of IceCube Data

Authors: Frank McNally, Rasha Abbasi, Paolo Desiati, Juan Carlos Díaz Vélez, Christina Cochling, Katherine Gruchot, William Hayes, Andrew Moy, Emily Schmidt, Andrew Thorpe

Abstract: The IceCube Observatory provides our highest-statistics picture of the cosmic-ray arrival directions in the Southern Hemisphere, with over 700 billion cosmic-ray-induced muon events collected between May 2011 and May 2022. Using the larger data volume, we find an improved significance of the PeV cosmic ray anisotropy down to scales of $6^\circ$. In addition, we observe a variation in the angular p… ▽ More The IceCube Observatory provides our highest-statistics picture of the cosmic-ray arrival directions in the Southern Hemisphere, with over 700 billion cosmic-ray-induced muon events collected between May 2011 and May 2022. Using the larger data volume, we find an improved significance of the PeV cosmic ray anisotropy down to scales of $6^\circ$. In addition, we observe a variation in the angular power spectrum as a function of energy, hinting at a relative decrease in large-scale features above 100 TeV. The data-taking period covers a complete solar cycle, providing new insight into the time variability of the signal. We present preliminary results using this up-to-date event sample. △ Less

Submitted 4 August, 2023; originally announced August 2023.

Comments: Presented at the 38th International Cosmic Ray Conference (ICRC2023). See arXiv:2307.13047 for all IceCube contributions

Report number: PoS-ICRC2023-360

Refining Human-Centered Autonomy Using Side Information

Authors: Adam J. Thorpe

Abstract: Data-driven algorithms for human-centered autonomy use observed data to compute models of human behavior in order to ensure safety, correctness, and to avoid potential errors that arise at runtime. However, such algorithms often neglect useful a priori knowledge, known as side information, that can improve the quality of data-driven models. We identify several key challenges in human-centered auto… ▽ More Data-driven algorithms for human-centered autonomy use observed data to compute models of human behavior in order to ensure safety, correctness, and to avoid potential errors that arise at runtime. However, such algorithms often neglect useful a priori knowledge, known as side information, that can improve the quality of data-driven models. We identify several key challenges in human-centered autonomy, and identify possible approaches to incorporate side information in data-driven models of human behavior. △ Less

Submitted 9 May, 2023; originally announced May 2023.

Journal ref: HCPS 2023 Workshop on Humans in Cyber-Physical Systems (HCPS 2023), part of CPS-IoT Week

Physics-Informed Kernel Embeddings: Integrating Prior System Knowledge with Data-Driven Control

Authors: Adam J. Thorpe, Cyrus Neary, Franck Djeumou, Meeko M. K. Oishi, Ufuk Topcu

Abstract: Data-driven control algorithms use observations of system dynamics to construct an implicit model for the purpose of control. However, in practice, data-driven techniques often require excessive sample sizes, which may be infeasible in real-world scenarios where only limited observations of the system are available. Furthermore, purely data-driven methods often neglect useful a priori knowledge, s… ▽ More Data-driven control algorithms use observations of system dynamics to construct an implicit model for the purpose of control. However, in practice, data-driven techniques often require excessive sample sizes, which may be infeasible in real-world scenarios where only limited observations of the system are available. Furthermore, purely data-driven methods often neglect useful a priori knowledge, such as approximate models of the system dynamics. We present a method to incorporate such prior knowledge into data-driven control algorithms using kernel embeddings, a nonparametric machine learning technique based in the theory of reproducing kernel Hilbert spaces. Our proposed approach incorporates prior knowledge of the system dynamics as a bias term in the kernel learning problem. We formulate the biased learning problem as a least-squares problem with a regularization term that is informed by the dynamics, that has an efficiently computable, closed-form solution. Through numerical experiments, we empirically demonstrate the improved sample efficiency and out-of-sample generalization of our approach over a purely data-driven baseline. We demonstrate an application of our method to control through a target tracking problem with nonholonomic dynamics, and on spring-mass-damper and F-16 aircraft state prediction tasks. △ Less

Submitted 9 January, 2023; originally announced January 2023.

Data-Driven Stochastic Optimal Control Using Kernel Gradients

Authors: Adam J. Thorpe, Jake A. Gonzales, Meeko M. K. Oishi

Abstract: We present an empirical, gradient-based method for solving data-driven stochastic optimal control problems using the theory of kernel embeddings of distributions. By embedding the integral operator of a stochastic kernel in a reproducing kernel Hilbert space, we can compute an empirical approximation of stochastic optimal control problems, which can then be solved efficiently using the properties… ▽ More We present an empirical, gradient-based method for solving data-driven stochastic optimal control problems using the theory of kernel embeddings of distributions. By embedding the integral operator of a stochastic kernel in a reproducing kernel Hilbert space, we can compute an empirical approximation of stochastic optimal control problems, which can then be solved efficiently using the properties of the RKHS. Existing approaches typically rely upon finite control spaces or optimize over policies with finite support to enable optimization. In contrast, our approach uses kernel-based gradients computed using observed data to approximate the cost surface of the optimal control problem, which can then be optimized using gradient descent. We apply our technique to the area of data-driven stochastic optimal control, and demonstrate our proposed approach on a linear regulation problem for comparison and on a nonlinear target tracking problem. △ Less

Submitted 19 September, 2022; originally announced September 2022.

Characterizing Within-Driver Variability in Driving Dynamics During Obstacle Avoidance Maneuvers

Authors: Kendric R. Ortiz, Adam J. Thorpe, AnaMaria Perez, Maya Luster, Brandon J. Pitts, Meeko Oishi

Abstract: Variability in human response creates non-trivial challenges for modeling and control of human-automation systems. As autonomy becomes pervasive, methods that can accommodate human variability will become paramount, to ensure efficiency, safety, and high levels of performance. We propose an easily computable modeling framework which takes advantage of a metric to assess variability in individual h… ▽ More Variability in human response creates non-trivial challenges for modeling and control of human-automation systems. As autonomy becomes pervasive, methods that can accommodate human variability will become paramount, to ensure efficiency, safety, and high levels of performance. We propose an easily computable modeling framework which takes advantage of a metric to assess variability in individual human response in a dynamic task that subjects repeat over several trials. Our approach is based in a transformation of observed trajectories to a reproducing kernel Hilbert space, which captures variability in human response as a distribution embedded within the Hilbert space. We evaluate the similarity across responses via the maximum mean discrepancy, which measures the distance between distributions within the Hilbert space. We apply this metric to a difficult driving task designed to elucidate differences across subjects. We conducted a pilot study with 6 subjects in an advanced driving simulator, in which subjects were tasked with collision avoidance of an obstacle in the middle of the road, around a blind corner, in a nighttime scenario, while steering only with the non-dominant hand. △ Less

Submitted 2 June, 2022; originally announced June 2022.

Comments: 7 pages, 2 titles due to IFAC submission requirements, 7 figures

Mechanisms of high harmonic generation in solids

Authors: A. Thorpe, N. Boroumand, A. M. Parks, E. Goulielmakis, T. Brabec

Abstract: The long standing issue of separating resonant from non-resonant processes in extreme nonlinear optics is resolved. The theoretical formalism is applied to high harmonic generation (HHG) in solids and reveals a deeper view into the dominant laser and material dependent mechanisms. Mid-infrared driven HHG in semiconductors is dominated by the resonant interband current. As a result of the dynamic S… ▽ More The long standing issue of separating resonant from non-resonant processes in extreme nonlinear optics is resolved. The theoretical formalism is applied to high harmonic generation (HHG) in solids and reveals a deeper view into the dominant laser and material dependent mechanisms. Mid-infrared driven HHG in semiconductors is dominated by the resonant interband current. As a result of the dynamic Stark shift, virtual processes gain in importance in near-infrared driven HHG in dielectrics. Finally, our analysis identifies limitations of microscopic one-electron-hole theories. △ Less

Submitted 2 June, 2022; originally announced June 2022.

SOCKS: A Stochastic Optimal Control and Reachability Toolbox Using Kernel Methods

Authors: Adam J. Thorpe, Meeko M. K. Oishi

Abstract: We present SOCKS, a data-driven stochastic optimal control toolbox based in kernel methods. SOCKS is a collection of data-driven algorithms that compute approximate solutions to stochastic optimal control problems with arbitrary cost and constraint functions, including stochastic reachability, which seeks to determine the likelihood that a system will reach a desired target set while respecting a… ▽ More We present SOCKS, a data-driven stochastic optimal control toolbox based in kernel methods. SOCKS is a collection of data-driven algorithms that compute approximate solutions to stochastic optimal control problems with arbitrary cost and constraint functions, including stochastic reachability, which seeks to determine the likelihood that a system will reach a desired target set while respecting a set of pre-defined safety constraints. Our approach relies upon a class of machine learning algorithms based in kernel methods, a nonparametric technique which can be used to represent probability distributions in a high-dimensional space of functions known as a reproducing kernel Hilbert space. As a nonparametric technique, kernel methods are inherently data-driven, meaning that they do not place prior assumptions on the system dynamics or the structure of the uncertainty. This makes the toolbox amenable to a wide variety of systems, including those with nonlinear dynamics, black-box elements, and poorly characterized stochastic disturbances. We present the main features of SOCKS and demonstrate its capabilities on several benchmarks. △ Less

Submitted 11 March, 2022; originally announced March 2022.

Data-Driven Chance Constrained Control using Kernel Distribution Embeddings

Authors: Adam J. Thorpe, Thomas Lew, Meeko M. K. Oishi, Marco Pavone

Abstract: We present a data-driven algorithm for efficiently computing stochastic control policies for general joint chance constrained optimal control problems. Our approach leverages the theory of kernel distribution embeddings, which allows representing expectation operators as inner products in a reproducing kernel Hilbert space. This framework enables approximately reformulating the original problem us… ▽ More We present a data-driven algorithm for efficiently computing stochastic control policies for general joint chance constrained optimal control problems. Our approach leverages the theory of kernel distribution embeddings, which allows representing expectation operators as inner products in a reproducing kernel Hilbert space. This framework enables approximately reformulating the original problem using a dataset of observed trajectories from the system without imposing prior assumptions on the parameterization of the system dynamics or the structure of the uncertainty. By optimizing over a finite subset of stochastic open-loop control trajectories, we relax the original problem to a linear program over the control parameters that can be efficiently solved using standard convex optimization techniques. We demonstrate our proposed approach in simulation on a system with nonlinear non-Markovian dynamics navigating in a cluttered environment. △ Less

Submitted 8 February, 2022; originally announced February 2022.

Comments: Submitted to 4th Annual Learning for Dynamics & Control Conference (L4DC) 2022

Observation of Cosmic Ray Anisotropy with Nine Years of IceCube Data

Authors: Frank McNally, Rasha Abbasi, Paolo Desiati, Juan Carlos Díaz Vélez, Timothy Aguado, Katherine Gruchot, Andrew Moy, Alexander Simmons, Andrew Thorpe, Hannah Woodward

Abstract: The IceCube Observatory has collected over 577 billion cosmic-ray induced muon events in its final configuration from May 2011 to May 2020. We used this data set to provide an unprecedented statistically accurate map of the cosmic ray arrival direction distribution in the TeV-PeV energy range scale in the Southern Hemisphere. Such an increase in event statistics makes it possible to extend the sen… ▽ More The IceCube Observatory has collected over 577 billion cosmic-ray induced muon events in its final configuration from May 2011 to May 2020. We used this data set to provide an unprecedented statistically accurate map of the cosmic ray arrival direction distribution in the TeV-PeV energy range scale in the Southern Hemisphere. Such an increase in event statistics makes it possible to extend the sensitivity to anisotropies at higher cosmic ray energies and smaller angular scales. It will also facilitate a more detailed assessment of the observatory stability over both short- and long-time scales. This will enable us to study the time variability of the cosmic ray anisotropy on a yearly-base and over the entire data sample period covering most of the solar cycle 24. We present the preliminary results from the study with the extended event sample. △ Less

Submitted 23 July, 2021; originally announced July 2021.

Comments: Presented at the 37th International Cosmic Ray Conference (ICRC 2021). See arXiv:2107.06966 for all IceCube contributions

Report number: PoS-ICRC2021-320

Impact of Scene-Specific Enhancement Spectra on Matched Filter Greenhouse Gas Retrievals from Imaging Spectroscopy

Authors: Markus D. Foote, Philip E. Dennison, Patrick R. Sullivan, Kelly B. O'Neill, Andrew K. Thorpe, David R. Thompson, Daniel H. Cusworth, Riley Duren, Sarang C. Joshi

Abstract: Matched filter (MF) techniques have been widely used for retrieval of greenhouse gas enhancements (enh.) from imaging spectroscopy datasets. While multiple algorithmic techniques and refinements have been proposed, the greenhouse gas target spectrum used for concentration enh. estimation has remained largely unaltered since the introduction of quantitative MF retrievals. The magnitude of retrieved… ▽ More Matched filter (MF) techniques have been widely used for retrieval of greenhouse gas enhancements (enh.) from imaging spectroscopy datasets. While multiple algorithmic techniques and refinements have been proposed, the greenhouse gas target spectrum used for concentration enh. estimation has remained largely unaltered since the introduction of quantitative MF retrievals. The magnitude of retrieved methane and carbon dioxide enh., and thereby integrated mass enh. (IME) and estimated flux of point-source emitters, is heavily dependent on this target spectrum. Current standard use of molecular absorption coefficients to create unit enh. target spectra does not account for absorption by background concentrations of greenhouse gases, solar and sensor geometry, or atmospheric water vapor absorption. We introduce geometric and atmospheric parameters into the generation of scene-specific (SS) unit enh. spectra to provide target spectra that are compatible with all greenhouse gas retrieval MF techniques. For methane plumes, IME resulting from use of standard, generic enh. spectra varied from -22 to +28.7% compared to SS enh. spectra. Due to differences in spectral shape between the generic and SS enh. spectra, differences in methane plume IME were linked to surface spectral characteristics in addition to geometric and atmospheric parameters. IME differences for carbon dioxide plumes, with generic enh. spectra producing integrated mass enh. -76.1 to -48.1% compared to SS enh. spectra. Fluxes calculated from these integrated enh. would vary by the same %s, assuming equivalent wind conditions. Methane and carbon dioxide IME were most sensitive to changes in solar zenith angle and ground elevation. SS target spectra can improve confidence in greenhouse gas retrievals and flux estimates across collections of scenes with diverse geometric and atmospheric conditions. △ Less

Submitted 10 August, 2021; v1 submitted 25 June, 2021; originally announced July 2021.

Comments: 13 pages, 5 figures, 3 tables

Journal ref: Remote Sensing of Environment, Volume 264, October 2021, 112574

Stochastic Optimal Control via Hilbert Space Embeddings of Distributions

Authors: Adam J. Thorpe, Meeko M. K. Oishi

Abstract: Kernel embeddings of distributions have recently gained significant attention in the machine learning community as a data-driven technique for representing probability distributions. Broadly, these techniques enable efficient computation of expectations by representing integral operators as elements in a reproducing kernel Hilbert space. We apply these techniques to the area of stochastic optimal… ▽ More Kernel embeddings of distributions have recently gained significant attention in the machine learning community as a data-driven technique for representing probability distributions. Broadly, these techniques enable efficient computation of expectations by representing integral operators as elements in a reproducing kernel Hilbert space. We apply these techniques to the area of stochastic optimal control theory and present a method to compute approximately optimal policies for stochastic systems with arbitrary disturbances. Our approach reduces the optimization problem to a linear program, which can easily be solved via the Lagrangian dual, without resorting to gradient-based optimization algorithms. We focus on discrete-time dynamic programming, and demonstrate our proposed approach on a linear regulation problem, and on a nonlinear target tracking problem. This approach is broadly applicable to a wide variety of optimal control problems, and provides a means of working with stochastic systems in a data-driven setting. △ Less

Submitted 23 March, 2021; originally announced March 2021.

SReachTools Kernel Module: Data-Driven Stochastic Reachability Using Hilbert Space Embeddings of Distributions

Authors: Adam J. Thorpe, Kendric R. Ortiz, Meeko M. K. Oishi

Abstract: We present algorithms for performing data-driven stochastic reachability as an addition to SReachTools, an open-source stochastic reachability toolbox. Our method leverages a class of machine learning techniques known as kernel embeddings of distributions to approximate the safety probabilities for a wide variety of stochastic reachability problems. By representing the probability distributions of… ▽ More We present algorithms for performing data-driven stochastic reachability as an addition to SReachTools, an open-source stochastic reachability toolbox. Our method leverages a class of machine learning techniques known as kernel embeddings of distributions to approximate the safety probabilities for a wide variety of stochastic reachability problems. By representing the probability distributions of the system state as elements in a reproducing kernel Hilbert space, we can learn the "best fit" distribution via a simple regularized least-squares problem, and then compute the stochastic reachability safety probabilities as simple linear operations. This technique admits finite sample bounds and has known convergence in probability. We implement these methods as part of SReachTools, and demonstrate their use on a double integrator system, on a million-dimensional repeated planar quadrotor system, and a cart-pole system with a black-box neural network controller. △ Less

Submitted 22 March, 2021; v1 submitted 20 November, 2020; originally announced November 2020.

Learning Approximate Forward Reachable Sets Using Separating Kernels

Authors: Adam J. Thorpe, Kendric R. Ortiz, Meeko M. K. Oishi

Abstract: We present a data-driven method for computing approximate forward reachable sets using separating kernels in a reproducing kernel Hilbert space. We frame the problem as a support estimation problem, and learn a classifier of the support as an element in a reproducing kernel Hilbert space using a data-driven approach. Kernel methods provide a computationally efficient representation for the classif… ▽ More We present a data-driven method for computing approximate forward reachable sets using separating kernels in a reproducing kernel Hilbert space. We frame the problem as a support estimation problem, and learn a classifier of the support as an element in a reproducing kernel Hilbert space using a data-driven approach. Kernel methods provide a computationally efficient representation for the classifier that is the solution to a regularized least squares problem. The solution converges almost surely as the sample size increases, and admits known finite sample bounds. This approach is applicable to stochastic systems with arbitrary disturbances and neural network verification problems by treating the network as a dynamical system, or by considering neural network controllers as part of a closed-loop system. We present our technique on several examples, including a spacecraft rendezvous and docking problem, and two nonlinear system benchmarks with neural network controllers. △ Less

Submitted 19 November, 2020; originally announced November 2020.

State-Based Confidence Bounds for Data-Driven Stochastic Reachability Using Hilbert Space Embeddings

Authors: Adam J. Thorpe, Kendric R. Ortiz, Meeko M. K. Oishi

Abstract: In this paper, we compute finite sample bounds for data-driven approximations of the solution to stochastic reachability problems. Our approach uses a nonparametric technique known as kernel distribution embeddings, and provides probabilistic assurances of safety for stochastic systems in a model-free manner. By implicitly embedding the stochastic kernel of a Markov control process in a reproducin… ▽ More In this paper, we compute finite sample bounds for data-driven approximations of the solution to stochastic reachability problems. Our approach uses a nonparametric technique known as kernel distribution embeddings, and provides probabilistic assurances of safety for stochastic systems in a model-free manner. By implicitly embedding the stochastic kernel of a Markov control process in a reproducing kernel Hilbert space, we can approximate the safety probabilities for stochastic systems with arbitrary stochastic disturbances as simple matrix operations and inner products. We present finite sample bounds for point-based approximations of the safety probabilities through construction of probabilistic confidence bounds that are state- and input-dependent. One advantage of this approach is that the bounds are responsive to non-uniformly sampled data, meaning that tighter bounds are feasible in regions of the state- and input-space with more observations. We numerically evaluate the approach, and demonstrate its efficacy on a neural network-controlled pendulum system. △ Less

Submitted 7 December, 2021; v1 submitted 15 October, 2020; originally announced October 2020.

Wannier quasi-classical approach to high harmonic generation in semiconductors

Authors: Andrew M. Parks, Guilmot Ernotte, Adam Thorpe, Chris R. McDonald, Paul B. Corkum, Marco Taucer, Thomas Brabec

Abstract: We develop a quasi-classical theory of high harmonic generation in semiconductors based on an interband current that has been transformed from Bloch to Wannier basis. The Wannier quasi-classical approach reveals a complete picture of the mechanisms sha** high harmonic generation, such that quantitative agreement with full quantum calculations is obtained. The intuitive picture revealed by quasi-… ▽ More We develop a quasi-classical theory of high harmonic generation in semiconductors based on an interband current that has been transformed from Bloch to Wannier basis. The Wannier quasi-classical approach reveals a complete picture of the mechanisms sha** high harmonic generation, such that quantitative agreement with full quantum calculations is obtained. The intuitive picture revealed by quasi-classical wavepacket propagation will be helpful in the interpretation and design of high harmonic and attosecond experiments. Beyond that, the capacity to quantitatively model quantum dynamics with classical trajectories should prove useful for a wider spectrum of condensed matter research, including coherent control, transport theory, and strong field physics. △ Less

Submitted 17 June, 2020; originally announced June 2020.

Comments: 9 pages; 5 figures; 2 appendices

Trust-based user-interface design for human-automation systems

Authors: Abraham P. Vinod, Adam J. Thorpe, Philip A. Olaniyi, Tyler H. Summers, Meeko M. K. Oishi

Abstract: We present a method for dynamics-driven, user-interface design for a human-automation system via sensor selection. We define the user-interface to be the output of a MIMO LTI system, and formulate the design problem as one of selecting an output matrix from a given set of candidate output matrices. Sufficient conditions for situation awareness are captured as additional constraints on the selectio… ▽ More We present a method for dynamics-driven, user-interface design for a human-automation system via sensor selection. We define the user-interface to be the output of a MIMO LTI system, and formulate the design problem as one of selecting an output matrix from a given set of candidate output matrices. Sufficient conditions for situation awareness are captured as additional constraints on the selection of the output matrix. These constraints depend upon the level of trust the human has in the automation. We show that the resulting user-interface design problem is a combinatorial, set-cardinality minimization problem with set function constraints. We propose tractable algorithms to compute optimal or sub-optimal solutions with suboptimality bounds. Our approaches exploit monotonicity and submodularity present in the design problem, and rely on constraint programming and submodular maximization. We apply this method to the IEEE 118-bus, to construct correct-by-design interfaces under various operating scenarios. △ Less

Submitted 15 April, 2020; originally announced April 2020.

Comments: 20 pages, 8 figures, 4 tables

Fast and Accurate Retrieval of Methane Concentration from Imaging Spectrometer Data Using Sparsity Prior

Authors: Markus D. Foote, Philip E. Dennison, Andrew K. Thorpe, David R. Thompson, Siraput Jongaramrungruang, Christian Frankenberg, Sarang C. Joshi

Abstract: The strong radiative forcing by atmospheric methane has stimulated interest in identifying natural and anthropogenic sources of this potent greenhouse gas. Point sources are important targets for quantification, and anthropogenic targets have potential for emissions reduction. Methane point source plume detection and concentration retrieval have been previously demonstrated using data from the Air… ▽ More The strong radiative forcing by atmospheric methane has stimulated interest in identifying natural and anthropogenic sources of this potent greenhouse gas. Point sources are important targets for quantification, and anthropogenic targets have potential for emissions reduction. Methane point source plume detection and concentration retrieval have been previously demonstrated using data from the Airborne Visible InfraRed Imaging Spectrometer Next Generation (AVIRIS-NG). Current quantitative methods have tradeoffs between computational requirements and retrieval accuracy, creating obstacles for processing real-time data or large datasets from flight campaigns. We present a new computationally efficient algorithm that applies sparsity and an albedo correction to matched filter retrieval of trace gas concentration-pathlength. The new algorithm was tested using AVIRIS-NG data acquired over several point source plumes in Ahmedabad, India. The algorithm was validated using simulated AVIRIS-NG data including synthetic plumes of known methane concentration. Sparsity and albedo correction together reduced the root mean squared error of retrieved methane concentration-pathlength enhancement by 60.7% compared with a previous robust matched filter method. Background noise was reduced by a factor of 2.64. The new algorithm was able to process the entire 300 flightline 2016 AVIRIS-NG India campaign in just over 8 hours on a desktop computer with GPU acceleration. △ Less

Submitted 5 March, 2020; originally announced March 2020.

Comments: 13 pages, 11 figures

Journal ref: IEEE Transactions on Geoscience and Remote Sensing, 2020, pp. 1-13

Approximate Stochastic Reachability for High Dimensional Systems

Authors: Adam J. Thorpe, Vignesh Sivaramakrishnan, Meeko M. K. Oishi

Abstract: We present a method to compute the stochastic reachability safety probabilities for high-dimensional stochastic dynamical systems. Our approach takes advantage of a nonparametric learning technique known as conditional distribution embeddings to model the stochastic kernel using a data-driven approach. By embedding the dynamics and uncertainty within a reproducing kernel Hilbert space, it becomes… ▽ More We present a method to compute the stochastic reachability safety probabilities for high-dimensional stochastic dynamical systems. Our approach takes advantage of a nonparametric learning technique known as conditional distribution embeddings to model the stochastic kernel using a data-driven approach. By embedding the dynamics and uncertainty within a reproducing kernel Hilbert space, it becomes possible to compute the safety probabilities for stochastic reachability problems as simple matrix operations and inner products. We employ a convergent approximation technique, random Fourier features, in order to alleviate the increased computational requirements for high-dimensional systems. This technique avoids the curse of dimensionality, and enables the computation of safety probabilities for high-dimensional systems without prior knowledge of the structure of the dynamics or uncertainty. We validate this approach on a double integrator system, and demonstrate its capabilities on a million-dimensional, nonlinear, non-Gaussian, repeated planar quadrotor system. △ Less

Submitted 15 October, 2020; v1 submitted 23 October, 2019; originally announced October 2019.

Model-Free Stochastic Reachability Using Kernel Distribution Embeddings

Authors: Adam J. Thorpe, Meeko M. K. Oishi

Abstract: We present a solution to the terminal-hitting stochastic reach-avoid problem for a Markov control process. This solution takes advantage of a nonparametric representation of the stochastic kernel as a conditional distribution embedding within a reproducing kernel Hilbert space (RKHS). Because the disturbance is modeled as a data-driven stochastic process, this representation avoids intractable int… ▽ More We present a solution to the terminal-hitting stochastic reach-avoid problem for a Markov control process. This solution takes advantage of a nonparametric representation of the stochastic kernel as a conditional distribution embedding within a reproducing kernel Hilbert space (RKHS). Because the disturbance is modeled as a data-driven stochastic process, this representation avoids intractable integrals in the dynamic recursion of the reach-avoid problem since the expectations can be calculated as an inner product within the RKHS. We demonstrate this approach on a high-dimensional chain of integrators and on Clohessy-Wiltshire-Hill dynamics. △ Less

Submitted 22 February, 2020; v1 submitted 2 August, 2019; originally announced August 2019.

Journal ref: in IEEE Control Systems Letters, vol. 4, no. 2, pp. 512-517, April 2020