Showing 1–42 of 42 results for author: Halder, A

Schrödinger Bridge with Quadratic State Cost is Exactly Solvable

Authors: Alexis M. H. Teter, Wenqing Wang, Abhishek Halder

Abstract: Schrödinger bridge is a diffusion process that steers a given distribution to another in a prescribed time while minimizing the effort to do so. It can be seen as the stochastic dynamical version of the optimal mass transport, and has growing applications in generative diffusion models and stochastic optimal control. In this work, we propose a regularized variant of the Schrödinger bridge with a q… ▽ More Schrödinger bridge is a diffusion process that steers a given distribution to another in a prescribed time while minimizing the effort to do so. It can be seen as the stochastic dynamical version of the optimal mass transport, and has growing applications in generative diffusion models and stochastic optimal control. In this work, we propose a regularized variant of the Schrödinger bridge with a quadratic state cost-to-go that incentivizes the optimal sample paths to stay close to a nominal level. Unlike the conventional Schrödinger bridge, the regularization induces a state-dependent rate of killing and creation of probability mass, and its solution requires determining the Markov kernel of a reaction-diffusion partial differential equation. We derive this Markov kernel in closed form. Our solution recovers the heat kernel in the vanishing regularization (i.e., diffusion without reaction) limit, thereby recovering the solution of the conventional Schrödinger bridge. Our results enable the use of dynamic Sinkhorn recursion for computing the Schrödinger bridge with a quadratic state cost-to-go, which would otherwise be challenging to use in this setting. We deduce properties of the new kernel and explain its connections with certain exactly solvable models in quantum mechanics. △ Less

Submitted 16 June, 2024; v1 submitted 1 June, 2024; originally announced June 2024.

Stochastic Learning of Computational Resource Usage as Graph Structured Multimarginal Schrödinger Bridge

Authors: Georgiy A. Bondar, Robert Gifford, Linh Thi Xuan Phan, Abhishek Halder

Abstract: We propose to learn the time-varying stochastic computational resource usage of software as a graph structured Schrödinger bridge problem. In general, learning the computational resource usage from data is challenging because resources such as the number of CPU instructions and the number of last level cache requests are both time-varying and statistically correlated. Our proposed method enables l… ▽ More We propose to learn the time-varying stochastic computational resource usage of software as a graph structured Schrödinger bridge problem. In general, learning the computational resource usage from data is challenging because resources such as the number of CPU instructions and the number of last level cache requests are both time-varying and statistically correlated. Our proposed method enables learning the joint time-varying stochasticity in computational resource usage from the measured profile snapshots in a nonparametric manner. The method can be used to predict the most-likely time-varying distribution of computational resource availability at a desired time. We provide detailed algorithms for stochastic learning in both single and multi-core cases, discuss the convergence guarantees, computational complexities, and demonstrate their practical use in two case studies: a single-core nonlinear model predictive controller, and a synthetic multi-core software. △ Less

Submitted 20 May, 2024; originally announced May 2024.

Solution of the Probabilistic Lambert's Problem: Optimal Transport Approach

Authors: Alexis M. H. Teter, Iman Nodozi, Abhishek Halder

Abstract: The deterministic variant of the Lambert's problem was posed by Lambert in the 18th century and its solution for conic trajectory has been derived by many, including Euler, Lambert, Lagrange, Laplace, Gauss and Legendre. The solution amounts to designing velocity control for steering a spacecraft from a given initial to a given terminal position subject to gravitational potential and flight time c… ▽ More The deterministic variant of the Lambert's problem was posed by Lambert in the 18th century and its solution for conic trajectory has been derived by many, including Euler, Lambert, Lagrange, Laplace, Gauss and Legendre. The solution amounts to designing velocity control for steering a spacecraft from a given initial to a given terminal position subject to gravitational potential and flight time constraints. In recent years, a probabilistic variant of the Lambert's problem has received attention in the aerospace community where the endpoint position constraints are softened to endpoint joint probability distributions over the respective positions. Such probabilistic specifications account for the estimation errors, modeling uncertainties, etc. Building on a deterministic optimal control reformulation via analytical mechanics, we show that the probabilistic Lambert's problem is a generalized dynamic optimal mass transport problem where the gravitational potential plays the role of an additive state cost. This allows us to rigorously prove the existence-uniqueness of the solution for the probabilistic Lambert problem both with and without process noise. In the latter case, the problem and its solution correspond to a generalized Schrödinger bridge, much like how classical Schrodinger bridge can be seen as stochastic regularization of the optimal mass transport. We deduce the large deviation principle enjoyed by the Lambertian Schrödinger bridge. Leveraging these newfound connections, we design a computational algorithm to illustrate the nonparametric numerical solution of the probabilistic Lambert's problem. △ Less

Submitted 2 February, 2024; originally announced February 2024.

Solution of the Probabilistic Lambert Problem: Connections with Optimal Mass Transport, Schrödinger Bridge and Reaction-Diffusion PDEs

Authors: Alexis M. H. Teter, Iman Nodozi, Abhishek Halder

Abstract: Lambert's problem concerns with transferring a spacecraft from a given initial to a given terminal position within prescribed flight time via velocity control subject to a gravitational force field. We consider a probabilistic variant of the Lambert problem where the knowledge of the endpoint constraints in position vectors are replaced by the knowledge of their respective joint probability densit… ▽ More Lambert's problem concerns with transferring a spacecraft from a given initial to a given terminal position within prescribed flight time via velocity control subject to a gravitational force field. We consider a probabilistic variant of the Lambert problem where the knowledge of the endpoint constraints in position vectors are replaced by the knowledge of their respective joint probability density functions. We show that the Lambert problem with endpoint joint probability density constraints is a generalized optimal mass transport (OMT) problem, thereby connecting this classical astrodynamics problem with a burgeoning area of research in modern stochastic control and stochastic machine learning. This newfound connection allows us to rigorously establish the existence and uniqueness of solution for the probabilistic Lambert problem. The same connection also helps to numerically solve the probabilistic Lambert problem via diffusion regularization, i.e., by leveraging further connection of the OMT with the Schrödinger bridge problem (SBP). This also shows that the probabilistic Lambert problem with additive dynamic process noise is in fact a generalized SBP, and can be solved numerically using the so-called Schrödinger factors, as we do in this work. We explain how the resulting analysis leads to solving a boundary-coupled system of reaction-diffusion PDEs where the nonlinear gravitational potential appears as the reaction rate. We propose novel algorithms for the same, and present illustrative numerical results. Our analysis and the algorithmic framework are nonparametric, i.e., we make neither statistical (e.g., Gaussian, first few moments, mixture or exponential family, finite dimensionality of the sufficient statistic) nor dynamical (e.g., Taylor series) approximations. △ Less

Submitted 18 March, 2024; v1 submitted 15 January, 2024; originally announced January 2024.

Path Structured Multimarginal Schrödinger Bridge for Probabilistic Learning of Hardware Resource Usage by Control Software

Authors: Georgiy A. Bondar, Robert Gifford, Linh Thi Xuan Phan, Abhishek Halder

Abstract: The solution of the path structured multimarginal Schrödinger bridge problem (MSBP) is the most-likely measure-valued trajectory consistent with a sequence of observed probability measures or distributional snapshots. We leverage recent algorithmic advances in solving such structured MSBPs for learning stochastic hardware resource usage by control software. The solution enables predicting the time… ▽ More The solution of the path structured multimarginal Schrödinger bridge problem (MSBP) is the most-likely measure-valued trajectory consistent with a sequence of observed probability measures or distributional snapshots. We leverage recent algorithmic advances in solving such structured MSBPs for learning stochastic hardware resource usage by control software. The solution enables predicting the time-varying distribution of hardware resource availability at a desired time with guaranteed linear convergence. We demonstrate the efficacy of our probabilistic learning approach in a model predictive control software execution case study. The method exhibits rapid convergence to an accurate prediction of hardware resource utilization of the controller. The method can be broadly applied to any software to predict cyber-physical context-dependent performance at arbitrary time. △ Less

Submitted 3 October, 2023; v1 submitted 1 October, 2023; originally announced October 2023.

Comments: 8 pages, 6 figures. Submitted to American Control Conference (ACC) 2024

Exact Computation of LTI Reach Set from Integrator Reach Set with Bounded Input

Authors: Shadi Haddad, Pansie Khodary, Abhishek Halder

Abstract: We present a semi-analytical method for exact computation of the boundary of the reach set of a single-input controllable linear time invariant (LTI) system with given bounds on its input range. In doing so, we deduce a parametric formula for the boundary of the reach set of an integrator linear system with time-varying bounded input. This formula generalizes recent results on the geometry of an i… ▽ More We present a semi-analytical method for exact computation of the boundary of the reach set of a single-input controllable linear time invariant (LTI) system with given bounds on its input range. In doing so, we deduce a parametric formula for the boundary of the reach set of an integrator linear system with time-varying bounded input. This formula generalizes recent results on the geometry of an integrator reach set with time-invariant bounded input. We show that the same ideas allow for computing the volume of the LTI reach set. △ Less

Submitted 3 January, 2024; v1 submitted 15 September, 2023; originally announced September 2023.

On the Contraction Coefficient of the Schrödinger Bridge for Stochastic Linear Systems

Authors: Alexis M. H. Teter, Yongxin Chen, Abhishek Halder

Abstract: Schrödinger bridge is a stochastic optimal control problem to steer a given initial state density to another, subject to controlled diffusion and deadline constraints. A popular method to numerically solve the Schrödinger bridge problems, in both classical and in the linear system settings, is via contractive fixed point recursions. These recursions can be seen as dynamic versions of the well-know… ▽ More Schrödinger bridge is a stochastic optimal control problem to steer a given initial state density to another, subject to controlled diffusion and deadline constraints. A popular method to numerically solve the Schrödinger bridge problems, in both classical and in the linear system settings, is via contractive fixed point recursions. These recursions can be seen as dynamic versions of the well-known Sinkhorn iterations, and under mild assumptions, they solve the so-called Schrödinger systems with guaranteed linear convergence. In this work, we study a priori estimates for the contraction coefficients associated with the convergence of respective Schrödinger systems. We provide new geometric and control-theoretic interpretations for the same. Building on these newfound interpretations, we point out the possibility of improved computation for the worst-case contraction coefficients of linear SBPs by preconditioning the endpoint support sets. △ Less

Submitted 12 September, 2023; originally announced September 2023.

Neural Schrödinger Bridge with Sinkhorn Losses: Application to Data-driven Minimum Effort Control of Colloidal Self-assembly

Authors: Iman Nodozi, Charlie Yan, Mira Khare, Abhishek Halder, Ali Mesbah

Abstract: We show that the minimum effort control of colloidal self-assembly can be naturally formulated in the order-parameter space as a generalized Schrödinger bridge problem -- a class of fixed-horizon stochastic optimal control problems that originated in the works of Erwin Schrödinger in the early 1930s. In recent years, this class of problems has seen a resurgence of research activities in the contro… ▽ More We show that the minimum effort control of colloidal self-assembly can be naturally formulated in the order-parameter space as a generalized Schrödinger bridge problem -- a class of fixed-horizon stochastic optimal control problems that originated in the works of Erwin Schrödinger in the early 1930s. In recent years, this class of problems has seen a resurgence of research activities in the control and machine learning communities. Different from the existing literature on the theory and computation for such problems, the controlled drift and diffusion coefficients for colloidal self-assembly are typically nonaffine in control, and are difficult to obtain from physics-based modeling. We deduce the conditions of optimality for such generalized problems, and show that the resulting system of equations is structurally very different from the existing results in a way that standard computational approaches no longer apply. Thus motivated, we propose a data-driven learning and control framework, named `neural Schrödinger bridge', to solve such generalized Schrödinger bridge problems by innovating on recent advances in neural networks. We illustrate the effectiveness of the proposed framework using a numerical case study of colloidal self-assembly. We learn the controlled drift and diffusion coefficients as two neural networks using molecular dynamics simulation data, and then use these two to train a third network with Sinkhorn losses designed for distributional endpoint constraints, specific for this class of control problems. △ Less

Submitted 13 October, 2023; v1 submitted 26 July, 2023; originally announced July 2023.

Optimal Mass Transport over the Euler Equation

Authors: Charlie Yan, Iman Nodozi, Abhishek Halder

Abstract: We consider the finite horizon optimal steering of the joint state probability distribution subject to the angular velocity dynamics governed by the Euler equation. The problem and its solution amounts to controlling the spin of a rigid body via feedback, and is of practical importance, for example, in angular stabilization of a spacecraft with stochastic initial and terminal states. We clarify ho… ▽ More We consider the finite horizon optimal steering of the joint state probability distribution subject to the angular velocity dynamics governed by the Euler equation. The problem and its solution amounts to controlling the spin of a rigid body via feedback, and is of practical importance, for example, in angular stabilization of a spacecraft with stochastic initial and terminal states. We clarify how this problem is an instance of the optimal mass transport (OMT) problem with bilinear prior drift. We deduce both static and dynamic versions of the Eulerian OMT, and provide analytical and numerical results for the synthesis of the optimal controller. △ Less

Submitted 2 April, 2023; originally announced April 2023.

A Controlled Mean Field Model for Chiplet Population Dynamics

Authors: Iman Nodozi, Abhishek Halder, Ion Matei

Abstract: In micro-assembly applications, ensemble of chiplets immersed in a dielectric fluid are steered using dielectrophoretic forces induced by an array of electrode population. Generalizing the finite population deterministic models proposed in prior works for individual chiplet position dynamics, we derive a controlled mean field model for a continuum of chiplet population in the form of a nonlocal, n… ▽ More In micro-assembly applications, ensemble of chiplets immersed in a dielectric fluid are steered using dielectrophoretic forces induced by an array of electrode population. Generalizing the finite population deterministic models proposed in prior works for individual chiplet position dynamics, we derive a controlled mean field model for a continuum of chiplet population in the form of a nonlocal, nonlinear partial differential equation. The proposed model accounts for the stochastic forces as well as two different types of nonlocal interactions, viz. chiplet-to-chiplet and chiplet-to-electrode interactions. Both of these interactions are nonlinear functions of the electrode voltage input. We prove that the deduced mean field evolution can be expressed as the Wasserstein gradient flow of a Lyapunov-like energy functional. With respect to this functional, the resulting dynamics is a gradient descent on the manifold of joint population density functions with finite second moments that are supported on the position coordinates. △ Less

Submitted 16 May, 2023; v1 submitted 19 March, 2023; originally announced March 2023.

Convex and Nonconvex Sublinear Regression with Application to Data-driven Learning of Reach Sets

Authors: Shadi Haddad, Abhishek Halder

Abstract: We consider estimating a compact set from finite data by approximating the support function of that set via sublinear regression. Support functions uniquely characterize a compact set up to closure of convexification, and are sublinear (convex as well as positive homogeneous of degree one). Conversely, any sublinear function is the support function of a compact set. We leverage this property to tr… ▽ More We consider estimating a compact set from finite data by approximating the support function of that set via sublinear regression. Support functions uniquely characterize a compact set up to closure of convexification, and are sublinear (convex as well as positive homogeneous of degree one). Conversely, any sublinear function is the support function of a compact set. We leverage this property to transcribe the task of learning a compact set to that of learning its support function. We propose two algorithms to perform the sublinear regression, one via convex and another via nonconvex programming. The convex programming approach involves solving a quadratic program (QP). The nonconvex programming approach involves training a input sublinear neural network. We illustrate the proposed methods via numerical examples on learning the reach sets of controlled dynamics subject to set-valued input uncertainties from trajectory data. △ Less

Submitted 23 March, 2023; v1 submitted 4 October, 2022; originally announced October 2022.

A Physics-informed Deep Learning Approach for Minimum Effort Stochastic Control of Colloidal Self-Assembly

Authors: Iman Nodozi, Jared O'Leary, Ali Mesbah, Abhishek Halder

Abstract: We propose formulating the finite-horizon stochastic optimal control problem for colloidal self-assembly in the space of probability density functions (PDFs) of the underlying state variables (namely, order parameters). The control objective is formulated in terms of steering the state PDFs from a prescribed initial probability measure towards a prescribed terminal probability measure with minimum… ▽ More We propose formulating the finite-horizon stochastic optimal control problem for colloidal self-assembly in the space of probability density functions (PDFs) of the underlying state variables (namely, order parameters). The control objective is formulated in terms of steering the state PDFs from a prescribed initial probability measure towards a prescribed terminal probability measure with minimum control effort. For specificity, we use a univariate stochastic state model from the literature. Both the analysis and the computational steps for control synthesis as developed in this paper generalize for multivariate stochastic state dynamics given by generic nonlinear in state and non-affine in control models. We derive the conditions of optimality for the associated optimal control problem. This derivation yields a system of three coupled partial differential equations together with the boundary conditions at the initial and terminal times. The resulting system is a generalized instance of the so-called Schrödinger bridge problem. We then determine the optimal control policy by training a physics-informed deep neural network, where the "physics" are the derived conditions of optimality. The performance of the proposed solution is demonstrated via numerical simulations on a benchmark colloidal self-assembly problem. △ Less

Submitted 6 September, 2022; v1 submitted 19 August, 2022; originally announced August 2022.

A Note on the Hausdorff Distance between Norm Balls and their Linear Maps

Authors: Shadi Haddad, Abhishek Halder

Abstract: We consider the problem of computing the (two-sided) Hausdorff distance between the unit $\ell_{p_{1}}$ and $\ell_{p_{2}}$ norm balls in finite dimensional Euclidean space for $1 \leq p_1 < p_2 \leq \infty$, and derive a closed-form formula for the same. We also derive a closed-form formula for the Hausdorff distance between the $k_1$ and $k_2$ unit $D$-norm balls, which are certain polyhedral nor… ▽ More We consider the problem of computing the (two-sided) Hausdorff distance between the unit $\ell_{p_{1}}$ and $\ell_{p_{2}}$ norm balls in finite dimensional Euclidean space for $1 \leq p_1 < p_2 \leq \infty$, and derive a closed-form formula for the same. We also derive a closed-form formula for the Hausdorff distance between the $k_1$ and $k_2$ unit $D$-norm balls, which are certain polyhedral norm balls in $d$ dimensions for $1 \leq k_1 < k_2 \leq d$. When two different $\ell_p$ norm balls are transformed via a common linear map, we obtain several estimates for the Hausdorff distance between the resulting convex sets. These estimates upper bound the Hausdorff distance or its expectation, depending on whether the linear map is arbitrary or random. We then generalize the developments for the Hausdorff distance between two set-valued integrals obtained by applying a parametric family of linear maps to different $\ell_p$ unit norm balls, and then taking the Minkowski sums of the resulting sets in a limiting sense. To illustrate an application, we show that the problem of computing the Hausdorff distance between the reach sets of a linear dynamical system with different unit norm ball-valued input uncertainties, reduces to this set-valued integral setting. △ Less

Submitted 27 July, 2023; v1 submitted 23 June, 2022; originally announced June 2022.

Certifying the Intersection of Reach Sets of Integrator Agents with Set-valued Input Uncertainties

Authors: Shadi Haddad, Abhishek Halder

Abstract: We consider the problem of verifying safety for a pair of identical integrator agents in continuous time with compact set-valued input uncertainties. We encode this verification problem as that of certifying or falsifying the intersection of their reach sets. We transcribe the same into a variational problem, namely that of minimizing the support function of the difference of the two reach sets ov… ▽ More We consider the problem of verifying safety for a pair of identical integrator agents in continuous time with compact set-valued input uncertainties. We encode this verification problem as that of certifying or falsifying the intersection of their reach sets. We transcribe the same into a variational problem, namely that of minimizing the support function of the difference of the two reach sets over the unit sphere. We illustrate the computational tractability of the proposed formulation by develo** two cases in detail, viz. when the inputs have time-varying norm-bounded and generic hyperrectangular uncertainties. We show that the latter case allows distributed certification via second order cone programming. △ Less

Submitted 17 May, 2022; v1 submitted 22 March, 2022; originally announced March 2022.

Schrödinger Meets Kuramoto via Feynman-Kac: Minimum Effort Distribution Steering for Noisy Nonuniform Kuramoto Oscillators

Authors: Iman Nodozi, Abhishek Halder

Abstract: We formulate and solve the problem of finite horizon minimum control effort steering of the state probability distribution between prescribed endpoint joints for a finite population of networked noisy nonuniform Kuramoto oscillators. We consider both the first and second order stochastic Kuramoto models. For numerical solution of the associated stochastic optimal control, we propose combining cert… ▽ More We formulate and solve the problem of finite horizon minimum control effort steering of the state probability distribution between prescribed endpoint joints for a finite population of networked noisy nonuniform Kuramoto oscillators. We consider both the first and second order stochastic Kuramoto models. For numerical solution of the associated stochastic optimal control, we propose combining certain measure-valued proximal recursions and the Feynman-Kac path integral computation. We illustrate the proposed framework via numerical examples. △ Less

Submitted 6 September, 2022; v1 submitted 20 February, 2022; originally announced February 2022.

A Distributed Algorithm for Measure-valued Optimization with Additive Objective

Authors: Iman Nodozi, Abhishek Halder

Abstract: We propose a distributed nonparametric algorithm for solving measure-valued optimization problems with additive objectives. Such problems arise in several contexts in stochastic learning and control including Langevin sampling from an unnormalized prior, mean field neural network learning and Wasserstein gradient flows. The proposed algorithm comprises a two-layer alternating direction method of m… ▽ More We propose a distributed nonparametric algorithm for solving measure-valued optimization problems with additive objectives. Such problems arise in several contexts in stochastic learning and control including Langevin sampling from an unnormalized prior, mean field neural network learning and Wasserstein gradient flows. The proposed algorithm comprises a two-layer alternating direction method of multipliers (ADMM). The outer-layer ADMM generalizes the Euclidean consensus ADMM to the Wasserstein consensus ADMM, and to its entropy-regularized version Sinkhorn consensus ADMM. The inner-layer ADMM turns out to be a specific instance of the standard Euclidean ADMM. The overall algorithm realizes operator splitting for gradient flows in the manifold of probability measures. △ Less

Submitted 17 February, 2022; originally announced February 2022.

Boundary and Taxonomy of Integrator Reach Sets

Authors: Shadi Haddad, Abhishek Halder

Abstract: Over-approximating the forward reach sets of controlled dynamical systems subject to set-valued uncertainties is a common practice in systems-control engineering for the purpose of performance verification. However, specific algebraic and topological results for the geometry of such sets are rather uncommon even for simple linear systems such as the integrators. This work explores the geometry of… ▽ More Over-approximating the forward reach sets of controlled dynamical systems subject to set-valued uncertainties is a common practice in systems-control engineering for the purpose of performance verification. However, specific algebraic and topological results for the geometry of such sets are rather uncommon even for simple linear systems such as the integrators. This work explores the geometry of the forward reach set of the integrator dynamics subject to box-valued uncertainties in its control inputs. Our contribution includes derivation of a closed-form formula for the support functions of these sets. This result, then enables us to deduce the parametric as well as the implicit equations describing the exact boundaries of these reach sets. Specifically, the implicit equations for the bounding hypersurfaces are shown to be given by vanishing of certain Hankel determinants. Finally, it is established that these sets are semialgebraic as well as translated zonoids. Such results should be useful to benchmark existing reach set over-approximation algorithms, and to help design new algorithms for the same. △ Less

Submitted 14 February, 2022; v1 submitted 1 September, 2021; originally announced September 2021.

Comments: arXiv admin note: text overlap with arXiv:2102.11423

Stochastic Uncertainty Propagation in Power System Dynamics using Measure-valued Proximal Recursions

Authors: Abhishek Halder, Kenneth F. Caluya, Pegah Ojaghi, Xinbo Geng

Abstract: We present a proximal algorithm that performs a variational recursion on the space of joint probability measures to propagate the stochastic uncertainties in power system dynamics over high dimensional state space. The proposed algorithm takes advantage of the exact nonlinearity structures in the trajectory-level dynamics of the networked power systems, and is nonparametric. Lifting the dynamics t… ▽ More We present a proximal algorithm that performs a variational recursion on the space of joint probability measures to propagate the stochastic uncertainties in power system dynamics over high dimensional state space. The proposed algorithm takes advantage of the exact nonlinearity structures in the trajectory-level dynamics of the networked power systems, and is nonparametric. Lifting the dynamics to the space of probability measures allows us to design a scalable algorithm that obviates gridding the underlying high dimensional state space which is computationally prohibitive. The proximal recursion implements a generalized infinite dimensional gradient flow, and evolves probability-weighted scattered point clouds. We clarify the theoretical nuances and algorithmic details specific to the power system nonlinearities, and provide illustrative numerical examples. △ Less

Submitted 24 August, 2022; v1 submitted 30 August, 2021; originally announced August 2021.

On the Convexity of Discrete Time Covariance Steering in Stochastic Linear Systems with Wasserstein Terminal Cost

Authors: Isin M. Balci, Abhishek Halder, Efstathios Bakolas

Abstract: In this work, we analyze the properties of the solution to the covariance steering problem for discrete time Gaussian linear systems with a squared Wasserstein distance terminal cost. In our previous work, we have shown that by utilizing the state feedback control policy parametrization, this stochastic optimal control problem can be associated with a difference of convex functions program. Here,… ▽ More In this work, we analyze the properties of the solution to the covariance steering problem for discrete time Gaussian linear systems with a squared Wasserstein distance terminal cost. In our previous work, we have shown that by utilizing the state feedback control policy parametrization, this stochastic optimal control problem can be associated with a difference of convex functions program. Here, we revisit the same covariance control problem but this time we focus on the analysis of the problem. Specifically, we establish the existence of solutions to the optimization problem and derive the first and second order conditions for optimality. We provide analytic expressions for the gradient and the Hessian of the performance index by utilizing specialized tools from matrix calculus. Subsequently, we prove that the optimization problem always admits a global minimizer, and finally, we provide a sufficient condition for the performance index to be a strictly convex function (under the latter condition, the problem admits a unique global minimizer). In particular, we show that when the terminal state covariance is upper bounded, with respect to the Löwner partial order, by the covariance matrix of the desired terminal normal distribution, then our problem admits a unique global minimizing state feedback gain. The results of this paper set the stage for the development of specialized control design tools that exploit the structure of the solution to the covariance steering problem with a squared Wasserstein distance terminal cost. △ Less

Submitted 24 March, 2021; originally announced March 2021.

Anytime Ellipsoidal Over-approximation of Forward Reach Sets of Uncertain Linear Systems

Authors: Shadi Haddad, Abhishek Halder

Abstract: Computing tight over-approximation of reach sets of a controlled uncertain dynamical system is a common practice in verification of safety-critical cyber-physical systems (CPS). While several algorithms are available for this purpose, they tend to be computationally demanding in CPS applications since here, the computational resources such as processor availability tend to be scarce, time-varying… ▽ More Computing tight over-approximation of reach sets of a controlled uncertain dynamical system is a common practice in verification of safety-critical cyber-physical systems (CPS). While several algorithms are available for this purpose, they tend to be computationally demanding in CPS applications since here, the computational resources such as processor availability tend to be scarce, time-varying and difficult to model. A natural idea then is to design "computation-aware" algorithms that can dynamically adapt with respect to the processor availability in a provably safe manner. Even though this idea should be applicable in broader context, here we focus on ellipsoidal over-approximations. We demonstrate that the algorithms for ellipsoidal over-approximation of reach sets of uncertain linear systems, are well-suited for anytime implementation in the sense the quality of the over-approximation can be dynamically traded off depending on the computational time available, all the while guaranteeing safety. We give a numerical example to illustrate the idea, and point out possible future directions. △ Less

Submitted 14 March, 2021; v1 submitted 7 March, 2021; originally announced March 2021.

The Curious Case of Integrator Reach Sets, Part I: Basic Theory

Authors: Shadi Haddad, Abhishek Halder

Abstract: This is the first of a two part paper investigating the geometry of the integrator reach sets, and the applications thereof. In this Part I, assuming box-valued input uncertainties, we establish that this compact convex reach set is semialgebraic, translated zonoid, and not a spectrahedron. We derive the parametric as well as the implicit representation of the boundary of this reach set. We also d… ▽ More This is the first of a two part paper investigating the geometry of the integrator reach sets, and the applications thereof. In this Part I, assuming box-valued input uncertainties, we establish that this compact convex reach set is semialgebraic, translated zonoid, and not a spectrahedron. We derive the parametric as well as the implicit representation of the boundary of this reach set. We also deduce the closed form formula for the volume and diameter of this set, and discuss their scaling with state dimension and time. We point out that these results may be utilized in benchmarking the performance of the reach set over-approximation algorithms. △ Less

Submitted 6 December, 2022; v1 submitted 22 February, 2021; originally announced February 2021.

Prediction and Optimal Feedback Steering of Probability Density Functions for Safe Automated Driving

Authors: Shadi Haddad, Kenneth F. Caluya, Abhishek Halder, Baljeet Singh

Abstract: We propose a stochastic prediction-control framework to promote safety in automated driving by directly controlling the joint state probability density functions (PDFs) subject to the vehicle dynamics via trajectory-level state feedback. To illustrate the main ideas, we focus on a multi-lane highway driving scenario although the proposed framework can be adapted to other contexts. The computationa… ▽ More We propose a stochastic prediction-control framework to promote safety in automated driving by directly controlling the joint state probability density functions (PDFs) subject to the vehicle dynamics via trajectory-level state feedback. To illustrate the main ideas, we focus on a multi-lane highway driving scenario although the proposed framework can be adapted to other contexts. The computational pipeline consists of a PDF prediction layer, followed by a PDF control layer. The prediction layer performs moving horizon nonparametric forecasts for the ego and the non-ego vehicles' stochastic states, and thereby derives safe target PDF for the ego. The latter is based on the forecasted collision probabilities, and promotes the probabilistic safety for the ego. The PDF control layer designs a feedback that optimally steers the joint state PDF subject to the controlled ego dynamics while satisfying the endpoint PDF constraints. Our computation for the PDF prediction layer leverages the structure of the controlled Liouville PDE to evolve the joint PDF values, as opposed to empirically approximating the PDFs. Our computation for the PDF control layer leverages the differential flatness structure in vehicle dynamics. We harness recent theoretical and algorithmic advances in optimal mass transport, and the Schrödinger bridge. The numerical simulations illustrate the efficacy of the proposed framework. △ Less

Submitted 7 November, 2020; v1 submitted 18 September, 2020; originally announced September 2020.

Density-based Stochastic Reachability Computation for Occupancy Prediction in Automated Driving

Authors: Shadi Haddad, Abhishek Halder, Baljeet Singh

Abstract: We propose a stochastic reachability computation framework for occupancy prediction in automated driving by directly solving the underlying transport partial differential equation governing the advection of the closed-loop joint density functions. The resulting nonparametric gridless computation is based on integration along the characteristic curves, and allows online computation of the time-vary… ▽ More We propose a stochastic reachability computation framework for occupancy prediction in automated driving by directly solving the underlying transport partial differential equation governing the advection of the closed-loop joint density functions. The resulting nonparametric gridless computation is based on integration along the characteristic curves, and allows online computation of the time-varying collision probabilities. Numerical simulations highlight the scope the proposed method. △ Less

Submitted 2 November, 2020; v1 submitted 22 June, 2020; originally announced June 2020.

Reflected Schrödinger Bridge: Density Control with Path Constraints

Authors: Kenneth F. Caluya, Abhishek Halder

Abstract: How to steer a given joint state probability density function to another over finite horizon subject to a controlled stochastic dynamics with hard state (sample path) constraints? In applications, state constraints may encode safety requirements such as obstacle avoidance. In this paper, we perform the feedback synthesis for minimum control effort density steering (a.k.a. Schrödinger bridge) probl… ▽ More How to steer a given joint state probability density function to another over finite horizon subject to a controlled stochastic dynamics with hard state (sample path) constraints? In applications, state constraints may encode safety requirements such as obstacle avoidance. In this paper, we perform the feedback synthesis for minimum control effort density steering (a.k.a. Schrödinger bridge) problem subject to state constraints. We extend the theory of Schrödinger bridges to account the reflecting boundary conditions for the sample paths, and provide a computational framework building on our previous work on proximal recursions, to solve the same. △ Less

Submitted 4 April, 2020; v1 submitted 30 March, 2020; originally announced March 2020.

Wasserstein Proximal Algorithms for the Schrödinger Bridge Problem: Density Control with Nonlinear Drift

Authors: Kenneth F. Caluya, Abhishek Halder

Abstract: We study the Schrödinger bridge problem (SBP) with nonlinear prior dynamics. In control-theoretic language, this is a problem of minimum effort steering of a given joint state probability density function (PDF) to another over a finite time horizon, subject to a controlled stochastic differential evolution of the state vector. For generic nonlinear drift, we reduce the SBP to solving a system of f… ▽ More We study the Schrödinger bridge problem (SBP) with nonlinear prior dynamics. In control-theoretic language, this is a problem of minimum effort steering of a given joint state probability density function (PDF) to another over a finite time horizon, subject to a controlled stochastic differential evolution of the state vector. For generic nonlinear drift, we reduce the SBP to solving a system of forward and backward Kolmogorov partial differential equations (PDEs) that are coupled through the boundary conditions, with unknowns being the "Schrödinger factors" -- so named since their product at any time yields the optimal controlled joint state PDF at that time. We show that if the drift is a gradient vector field, or is of mixed conservative-dissipative nature, then it is possible to transform these PDEs into a pair of initial value problems (IVPs) involving the same forward Kolmogorov operator. Combined with a recently proposed fixed point recursion that is contractive in the Hilbert metric, this opens up the possibility to numerically solve the SBPs in these cases by computing the Schrödinger factors via a single IVP solver for the corresponding (uncontrolled) forward Kolmogorov PDE. The flows generated by such forward Kolmogorov PDEs, for the two aforementioned types of drift, in turn, enjoy gradient descent structures on the manifold of joint PDFs with respect to suitable distance functionals. We employ a proximal algorithm developed in our prior work, that exploits this geometric viewpoint, to solve these IVPs and compute the Schrödinger factors via weighted scattered point cloud evolution in the state space. We provide the algorithmic details and illustrate the proposed framework of solving the SBPs with nonlinear prior dynamics by numerical examples. △ Less

Submitted 15 March, 2021; v1 submitted 3 December, 2019; originally announced December 2019.

Finite Horizon Density Steering for Multi-input State Feedback Linearizable Systems

Authors: Kenneth F. Caluya, Abhishek Halder

Abstract: In this paper, we study the feedback synthesis problem for steering the joint state density or ensemble subject to multi-input state feedback linearizable dynamics. This problem is of interest to many practical applications including that of dynamically sha** a robotic swarm. Our results here show that it is possible to exploit the structural nonlinearities to derive the feedback controllers ste… ▽ More In this paper, we study the feedback synthesis problem for steering the joint state density or ensemble subject to multi-input state feedback linearizable dynamics. This problem is of interest to many practical applications including that of dynamically sha** a robotic swarm. Our results here show that it is possible to exploit the structural nonlinearities to derive the feedback controllers steering the joint density from a prescribed shape to another while minimizing the expected control effort to do so. The developments herein build on our previous work, and extend the theory of the Schrödinger bridge problem subject to feedback linearizable dynamics. △ Less

Submitted 29 September, 2019; v1 submitted 27 September, 2019; originally announced September 2019.

Proximal Recursion for the Wonham Filter

Authors: Abhishek Halder, Tryphon T. Georgiou

Abstract: This paper contributes to the emerging viewpoint that governing equations for dynamic state estimation, conditioned on the history of noisy measurements, can be viewed as gradient flow on the manifold of joint probability density functions with respect to suitable metrics. Herein, we focus on the Wonham filter where the prior dynamics is given by a continuous time Markov chain on a finite state sp… ▽ More This paper contributes to the emerging viewpoint that governing equations for dynamic state estimation, conditioned on the history of noisy measurements, can be viewed as gradient flow on the manifold of joint probability density functions with respect to suitable metrics. Herein, we focus on the Wonham filter where the prior dynamics is given by a continuous time Markov chain on a finite state space; the measurement model includes noisy observation of the (possibly nonlinear function of) state. We establish that the posterior flow given by the Wonham filter can be viewed as the small time-step limit of proximal recursions of certain functionals on the probability simplex. The results of this paper extend our earlier work where similar proximal recursions were derived for the Kalman-Bucy filter. △ Less

Submitted 12 September, 2019; originally announced September 2019.

Gradient Flow Algorithms for Density Propagation in Stochastic Systems

Authors: Kenneth F. Caluya, Abhishek Halder

Abstract: We develop a new computational framework to solve the partial differential equations (PDEs) governing the flow of the joint probability density functions (PDFs) in continuous-time stochastic nonlinear systems. The need for computing the transient joint PDFs subject to prior dynamics arises in uncertainty propagation, nonlinear filtering and stochastic control. Our methodology breaks away from the… ▽ More We develop a new computational framework to solve the partial differential equations (PDEs) governing the flow of the joint probability density functions (PDFs) in continuous-time stochastic nonlinear systems. The need for computing the transient joint PDFs subject to prior dynamics arises in uncertainty propagation, nonlinear filtering and stochastic control. Our methodology breaks away from the traditional approach of spatial discretization or function approximation -- both of which, in general, suffer from the "curse-of-dimensionality". In the proposed framework, we discretize time but not the state space. We solve infinite dimensional proximal recursions in the manifold of joint PDFs, which in the small time-step limit, is theoretically equivalent to solving the underlying transport PDEs. The resulting computation has the geometric interpretation of gradient flow of certain free energy functional with respect to the Wasserstein metric arising from the theory of optimal mass transport. We show that dualization along with an entropic regularization, leads to a cone-preserving fixed point recursion that is proved to be contractive in Thompson metric. A block co-ordinate iteration scheme is proposed to solve the resulting nonlinear recursions with guaranteed convergence. This approach enables remarkably fast computation for non-parametric transient joint PDF propagation. Numerical examples and various extensions are provided to illustrate the scope and efficacy of the proposed approach. △ Less

Submitted 6 August, 2019; v1 submitted 1 August, 2019; originally announced August 2019.

Comments: arXiv admin note: substantial text overlap with arXiv:1809.10844

Finite Horizon Density Control for Static State Feedback Linearizable Systems

Authors: Kenneth F. Caluya, Abhishek Halder

Abstract: We consider the problem of steering the joint state probability density function of a static feedback linearizable control system over finite time horizon. Potential applications include controlling neuronal populations, swarm guidance, and probabilistic motion planning. Our theoretical developments reveal the structure of the minimum energy controller for the same, and can be viewed as a generali… ▽ More We consider the problem of steering the joint state probability density function of a static feedback linearizable control system over finite time horizon. Potential applications include controlling neuronal populations, swarm guidance, and probabilistic motion planning. Our theoretical developments reveal the structure of the minimum energy controller for the same, and can be viewed as a generalization of the Benamou-Brenier theory for dynamic optimal transport. Further analytical results are derived for solving the feasibility problem, i.e., for finding feedback that steers a given joint density function to another in fixed time, subject to the controlled nonlinear dynamics. An algorithm based on the Schrödinger bridge is proposed to approximate a feasible controller; a numerical example is worked out to illustrate the same. △ Less

Submitted 29 April, 2020; v1 submitted 3 April, 2019; originally announced April 2019.

DeGroot-Friedkin Map in Opinion Dynamics is Mirror Descent

Authors: Abhishek Halder

Abstract: We provide a variational interpretation of the DeGroot-Friedkin map in opinion dynamics. Specifically, we show that the nonlinear dynamics for the DeGroot-Friedkin map can be viewed as mirror descent on the standard simplex with the associated Bregman divergence being equal to the generalized Kullback-Leibler divergence, i.e., an entropic mirror descent. Our results reveal that the DeGroot-Friedki… ▽ More We provide a variational interpretation of the DeGroot-Friedkin map in opinion dynamics. Specifically, we show that the nonlinear dynamics for the DeGroot-Friedkin map can be viewed as mirror descent on the standard simplex with the associated Bregman divergence being equal to the generalized Kullback-Leibler divergence, i.e., an entropic mirror descent. Our results reveal that the DeGroot-Friedkin map elicits an individual's social power to be close to her social influence while minimizing the so called "extropy" -- the entropy of the complimentary opinion. △ Less

Submitted 17 February, 2019; v1 submitted 29 December, 2018; originally announced December 2018.

Smallest Ellipsoid Containing $p$-Sum of Ellipsoids with Application to Reachability Analysis

Authors: Abhishek Halder

Abstract: We study the problem of ellipsoidal bounding of convex set-valued data, where the convex set is obtained by the $p$-sum of finitely many ellipsoids, for any real $p\geq 1$. The notion of $p$-sum appears in the Brunn-Minkowski-Firey theory in convex analysis, and generalizes several well-known set-valued operations such as the Minkowski sum of the summand convex sets (here, ellipsoids). We derive a… ▽ More We study the problem of ellipsoidal bounding of convex set-valued data, where the convex set is obtained by the $p$-sum of finitely many ellipsoids, for any real $p\geq 1$. The notion of $p$-sum appears in the Brunn-Minkowski-Firey theory in convex analysis, and generalizes several well-known set-valued operations such as the Minkowski sum of the summand convex sets (here, ellipsoids). We derive an outer ellipsoidal parameterization for the $p$-sum of a given set of ellipsoids, and compute the tightest such parameterization for two optimality criteria: minimum trace and minimum volume. For such optimal parameterizations, several known results in the system-control literature are recovered as special cases of our general formula. For the minimum volume criterion, our analysis leads to a fixed point recursion over a scalar that parameterizes the shape matrix of the outer ellipsoid. This recursion is proved to be contractive, and found to converge fast in practice. We apply these results to compute the forward reach sets for a linear control system subject to different convex set-valued uncertainty models for the initial condition and control, generated by varying $p\in[1,\infty]$. Our numerical results show that the proposed fixed point algorithm offers more than two orders of magnitude speed-up in computational time for $p=1$, compared to the existing semidefinite programming approach without significant effect on the numerical accuracy. For $p>1$, the reach set computation results reported here are novel. Our results are expected to be useful in real-time safety critical applications such as decision making for collision avoidance of autonomous vehicles, where the computational time-scale for reach set calculation needs to be much smaller than the vehicular dynamics time-scale. △ Less

Submitted 10 July, 2020; v1 submitted 20 June, 2018; originally announced June 2018.

On the Parameterized Computation of Minimum Volume Outer Ellipsoid of Minkowski Sum of Ellipsoids

Authors: Abhishek Halder

Abstract: We consider the problem of computing certain parameterized minimum volume outer ellipsoidal (MVOE) approximation of the Minkowski sum of a finite number of ellipsoids. We clarify connections among several parameterizations available in the literature, obtain novel analysis results regarding the conditions of optimality, and based on the same, propose two new algorithms for computing the parameteri… ▽ More We consider the problem of computing certain parameterized minimum volume outer ellipsoidal (MVOE) approximation of the Minkowski sum of a finite number of ellipsoids. We clarify connections among several parameterizations available in the literature, obtain novel analysis results regarding the conditions of optimality, and based on the same, propose two new algorithms for computing the parameterized MVOE. Numerical results reveal faster runtime for the proposed algorithms than the state-of-the-art semidefinite programming approach of computing the same. △ Less

Submitted 22 June, 2018; v1 submitted 21 March, 2018; originally announced March 2018.

Gradient Flows in Filtering and Fisher-Rao Geometry

Authors: Abhishek Halder, Tryphon T. Georgiou

Abstract: Uncertainty propagation and filtering can be interpreted as gradient flows with respect to suitable metrics in the infinite dimensional manifold of probability density functions. Such a viewpoint has been put forth in recent literature, and a systematic way to formulate and solve the same for linear Gaussian systems has appeared in our previous work where the gradient flows were realized via proxi… ▽ More Uncertainty propagation and filtering can be interpreted as gradient flows with respect to suitable metrics in the infinite dimensional manifold of probability density functions. Such a viewpoint has been put forth in recent literature, and a systematic way to formulate and solve the same for linear Gaussian systems has appeared in our previous work where the gradient flows were realized via proximal operators with respect to Wasserstein metric arising in optimal mass transport. In this paper, we derive the evolution equations as proximal operators with respect to Fisher-Rao metric arising in information geometry. We develop the linear Gaussian case in detail and show that a template two step optimization procedure proposed earlier by the authors still applies. Our objective is to provide new geometric interpretations of known equations in filtering, and to clarify the implication of different choices of metric. △ Less

Submitted 29 October, 2017; v1 submitted 29 September, 2017; originally announced October 2017.

Stability Theory of Stochastic Models in Opinion Dynamics

Authors: Zahra Askarzadeh, Rui Fu, Abhishek Halder, Yongxin Chen, Tryphon T. Georgiou

Abstract: We consider a certain class of nonlinear maps that preserve the probability simplex, i.e., stochastic maps, that are inspired by the DeGroot-Friedkin model of belief/opinion propagation over influence networks. The corresponding dynamical models describe the evolution of the probability distribution of interacting species. Such models where the probability transition mechanism depends nonlinearly… ▽ More We consider a certain class of nonlinear maps that preserve the probability simplex, i.e., stochastic maps, that are inspired by the DeGroot-Friedkin model of belief/opinion propagation over influence networks. The corresponding dynamical models describe the evolution of the probability distribution of interacting species. Such models where the probability transition mechanism depends nonlinearly on the current state are often referred to as {\em nonlinear Markov chains}. In this paper we develop stability results and study the behavior of representative opinion models. The stability certificates are based on the contractivity of the nonlinear evolution in the $\ell_1$-metric. We apply the theory to two types of opinion models where the adaptation of the transition probabilities to the current state is exponential and linear, respectively--both of these can display a wide range of behaviors. We discuss continuous-time and other generalizations. △ Less

Submitted 10 October, 2018; v1 submitted 9 June, 2017; originally announced June 2017.

Comments: 11 pages, 6 figures

MSC Class: 93E03; 60J10; 60J20; 65C40; 68Q87

Gradient Flows in Uncertainty Propagation and Filtering of Linear Gaussian Systems

Authors: Abhishek Halder, Tryphon T. Georgiou

Abstract: The purpose of this work is mostly expository and aims to elucidate the Jordan-Kinderlehrer-Otto (JKO) scheme for uncertainty propagation, and a variant, the Laugesen-Mehta-Meyn-Raginsky (LMMR) scheme for filtering. We point out that these variational schemes can be understood as proximal operators in the space of density functions, realizing gradient flows. These schemes hold the promise of leadi… ▽ More The purpose of this work is mostly expository and aims to elucidate the Jordan-Kinderlehrer-Otto (JKO) scheme for uncertainty propagation, and a variant, the Laugesen-Mehta-Meyn-Raginsky (LMMR) scheme for filtering. We point out that these variational schemes can be understood as proximal operators in the space of density functions, realizing gradient flows. These schemes hold the promise of leading to efficient ways for solving the Fokker-Planck equation as well as the equations of non-linear filtering. Our aim in this paper is to develop in detail the underlying ideas in the setting of linear stochastic systems with Gaussian noise and recover known results. △ Less

Submitted 29 September, 2017; v1 submitted 31 March, 2017; originally announced April 2017.

Comments: 8 pages

Architecture and Algorithms for Privacy Preserving Thermal Inertial Load Management by A Load Serving Entity

Authors: Abhishek Halder, Xinbo Geng, P. R. Kumar, Le Xie

Abstract: Motivated by the growing importance of demand response in modern power system's operations, we propose an architecture and supporting algorithms for privacy preserving thermal inertial load management as a service provided by the load serving entity (LSE). We focus on an LSE managing a population of its customers' air conditioners, and propose a contractual model where the LSE guarantees quality o… ▽ More Motivated by the growing importance of demand response in modern power system's operations, we propose an architecture and supporting algorithms for privacy preserving thermal inertial load management as a service provided by the load serving entity (LSE). We focus on an LSE managing a population of its customers' air conditioners, and propose a contractual model where the LSE guarantees quality of service to each customer in terms of kee** their indoor temperature trajectories within respective bands around the desired individual comfort temperatures. We show how the LSE can price the contracts differentiated by the flexibility embodied by the width of the specified bands. We address architectural questions of (i) how the LSE can strategize its energy procurement based on price and ambient temperature forecasts, (ii) how an LSE can close the real time control loop at the aggregate level while providing individual comfort guarantees to loads, without ever measuring the states of an air conditioner for privacy reasons. Control algorithms to enable our proposed architecture are given, and their efficacy is demonstrated on real data. △ Less

Submitted 29 November, 2016; v1 submitted 30 June, 2016; originally announced June 2016.

Mean Square Stability for Stochastic Jump Linear Systems via Optimal Transport

Authors: Kooktae Lee, Abhishek Halder, Raktim Bhattacharya

Abstract: In this note, we provide a unified framework for the mean square stability of stochastic jump linear systems via optimal transport. The Wasserstein metric known as an optimal transport, that assesses the distance between probability density functions enables the stability analysis. Without any assumption on the underlying jump process, this Wasserstein distance guarantees the mean square stability… ▽ More In this note, we provide a unified framework for the mean square stability of stochastic jump linear systems via optimal transport. The Wasserstein metric known as an optimal transport, that assesses the distance between probability density functions enables the stability analysis. Without any assumption on the underlying jump process, this Wasserstein distance guarantees the mean square stability for general stochastic jump linear systems, not necessarily for Markovian jump. The validity of the proposed methods are proved by recovering already-known stability conditions under this framework. △ Less

Submitted 10 March, 2014; originally announced March 2014.

Comments: 6 pages, no figures, IEEE TAC

Probabilistic Robustness Analysis of Stochastic Jump Linear Systems

Authors: Kooktae Lee, Abhishek Halder, Raktim Bhattacharya

Abstract: In this paper, we propose a new method to measure the probabilistic robustness of stochastic jump linear system with respect to both the initial state uncertainties and the randomness in switching. Wasserstein distance which defines a metric on the manifold of probability density functions is used as tool for the performance and the stability measures. Starting with Gaussian distribution to repres… ▽ More In this paper, we propose a new method to measure the probabilistic robustness of stochastic jump linear system with respect to both the initial state uncertainties and the randomness in switching. Wasserstein distance which defines a metric on the manifold of probability density functions is used as tool for the performance and the stability measures. Starting with Gaussian distribution to represent the initial state uncertainties, the probability density function of the system state evolves into mixture of Gaussian, where the number of Gaussian components grows exponentially. To cope with computational complexity caused by mixture of Gaussian, we prove that there exists an alternative probability density function that preserves exact information in the Wasserstein level. The usefulness and the efficiency of the proposed methods are demonstrated by example. △ Less

Submitted 10 March, 2014; originally announced March 2014.

Comments: 2014 ACC(American Control Conference) paper

Performance and Robustness Analysis of Stochastic Jump Linear Systems using Wasserstein metric

Authors: Kooktae Lee, Abhishek Halder, Raktim Bhattacharya

Abstract: This paper focuses on the performance and the robustness analysis of stochastic jump linear systems. The state trajectory under stochastic jump process becomes random variables, which brings forth the probability distributions in the system state. Therefore, we need to adopt a proper metric to measure the system performance with respect to stochastic switching. In this perspective, Wasserstein met… ▽ More This paper focuses on the performance and the robustness analysis of stochastic jump linear systems. The state trajectory under stochastic jump process becomes random variables, which brings forth the probability distributions in the system state. Therefore, we need to adopt a proper metric to measure the system performance with respect to stochastic switching. In this perspective, Wasserstein metric that assesses the distance between probability density functions is applied to provide the performance and the robustness analysis. Both the transient and steady-state performance of the systems with given initial state uncertainties can be measured in this framework. Also, we prove that the convergence of this metric implies the mean square stability. Overall, this study provides a unifying framework for the performance and the robustness analysis of general stochastic jump linear systems, but not necessarily Markovian jump process that is commonly used for stochastic switching. The practical usefulness and efficiency of the proposed method are verified through numerical examples. △ Less

Submitted 25 May, 2014; v1 submitted 8 March, 2014; originally announced March 2014.

Geodesic Density Tracking with Applications to Data Driven Modeling

Authors: Abhishek Halder, Raktim Bhattacharya

Abstract: Many problems in dynamic data driven modeling deals with distributed rather than lumped observations. In this paper, we show that the Monge-Kantorovich optimal transport theory provides a unifying framework to tackle such problems in the systems-control parlance. Specifically, given distributional measurements at arbitrary instances of measurement availability, we show how to derive dynamical syst… ▽ More Many problems in dynamic data driven modeling deals with distributed rather than lumped observations. In this paper, we show that the Monge-Kantorovich optimal transport theory provides a unifying framework to tackle such problems in the systems-control parlance. Specifically, given distributional measurements at arbitrary instances of measurement availability, we show how to derive dynamical systems that interpolate the observed distributions along the geodesics. We demonstrate the framework in the context of three specific problems: (i) \emph{finding a feedback control} to track observed ensembles over finite-horizon, (ii) \emph{finding a model} whose prediction matches the observed distributional data, and (iii) \emph{refining a baseline model} that results a distribution-level prediction-observation mismatch. We emphasize how the three problems can be posed as variants of the optimal transport problem, but lead to different types of numerical methods depending on the problem context. Several examples are given to elucidate the ideas. △ Less

Submitted 7 February, 2014; originally announced February 2014.

Comments: 8 pages, 7 figures

A Probabilistic Method for Nonlinear Robustness Analysis of F-16 Controllers

Authors: Abhishek Halder, Kooktae Lee, Raktim Bhattacharya

Abstract: This paper presents a new framework for controller robustness verification with respect to F-16 aircraft's closed-loop performance in longitudinal flight. We compare the state regulation performance of a linear quadratic regulator (LQR) and a gain-scheduled linear quadratic regulator (gsLQR), applied to nonlinear open-loop dynamics of F-16, in presence of stochastic initial condition and parametri… ▽ More This paper presents a new framework for controller robustness verification with respect to F-16 aircraft's closed-loop performance in longitudinal flight. We compare the state regulation performance of a linear quadratic regulator (LQR) and a gain-scheduled linear quadratic regulator (gsLQR), applied to nonlinear open-loop dynamics of F-16, in presence of stochastic initial condition and parametric uncertainties, as well as actuator disturbance. We show that, in presence of initial condition uncertainties alone, both LQR and gsLQR have comparable immediate and asymptotic performances, but the gsLQR exhibits better transient performance at intermediate times. This remains true in the presence of additional actuator disturbance. Also, gsLQR is shown to be more robust than LQR, against parametric uncertainties. The probabilistic framework proposed here, leverages transfer operator based density computation in exact arithmetic and introduces optimal transport theoretic performance validation and verification (V&V) for nonlinear dynamical systems. Numerical results from our proposed method, are in unison with Monte Carlo simulations. △ Less

Submitted 1 February, 2014; originally announced February 2014.

Comments: 27 pages, 17 figures

Probabilistic Model Validation for Uncertain Nonlinear Systems

Authors: Abhishek Halder, Raktim Bhattacharya

Abstract: This paper presents a probabilistic model validation methodology for nonlinear systems in time-domain. The proposed formulation is simple, intuitive, and accounts both deterministic and stochastic nonlinear systems with parametric and nonparametric uncertainties. Instead of hard invalidation methods available in the literature, a relaxed notion of validation in probability is introduced. To guaran… ▽ More This paper presents a probabilistic model validation methodology for nonlinear systems in time-domain. The proposed formulation is simple, intuitive, and accounts both deterministic and stochastic nonlinear systems with parametric and nonparametric uncertainties. Instead of hard invalidation methods available in the literature, a relaxed notion of validation in probability is introduced. To guarantee provably correct inference, algorithm for constructing probabilistically robust validation certificate is given along with computational complexities. Several examples are worked out to illustrate its use. △ Less

Submitted 1 February, 2014; originally announced February 2014.

Comments: 24 pages, 14 figures