-
Optimal State Estimation in the Presence of Non-Gaussian Uncertainty via Wasserstein Distance Minimization
Authors:
Himanshu Prabhat,
Raktim Bhattacharya
Abstract:
This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally reaches the Dirac delta distribution with minimal effort. The Wasserstein metric is used to quantify the effort of transporting from one distribution to another.…
▽ More
This paper presents a novel distribution-agnostic Wasserstein distance-based estimation framework. The goal is to determine an optimal map combining prior estimate with measurement likelihood such that posterior estimation error optimally reaches the Dirac delta distribution with minimal effort. The Wasserstein metric is used to quantify the effort of transporting from one distribution to another. We hypothesize that minimizing the Wasserstein distance between the posterior error and the Dirac delta distribution results in optimal information fusion and posterior state uncertainty. Framework validation is demonstrated by the successful recovery of the classical Kalman filter for linear systems with Gaussian uncertainties. Notably, the proposed Wasserstein filter does not rely on particle representation of uncertainty. Furthermore, the classical result for the Gaussian Sum Filter (GSF) is retrieved from the Wasserstein framework. This approach analytically exhibits the suboptimality of GSF and enables the use of nonlinear optimization techniques to enhance the accuracy of the Gaussian sum estimator.
△ Less
Submitted 6 March, 2024;
originally announced March 2024.
-
A Convex Optimization Framework for Computing Robustness Margins of Kalman Filters
Authors:
Himanshu Prabhat,
Raktim Bhattacharya
Abstract:
This paper proposes a novel convex optimization framework for designing robust Kalman filters that guarantee a user-specified steady-state error while maximizing process and sensor noise. The proposed framework simultaneously determines the Kalman gain and the robustness margin in terms of the process and sensor noise. This is the first paper to present such a joint formulation for Kalman filterin…
▽ More
This paper proposes a novel convex optimization framework for designing robust Kalman filters that guarantee a user-specified steady-state error while maximizing process and sensor noise. The proposed framework simultaneously determines the Kalman gain and the robustness margin in terms of the process and sensor noise. This is the first paper to present such a joint formulation for Kalman filtering. The proposed methodology is validated through two distinct examples: the Clohessy-Wiltshire-Hill equations for a chaser spacecraft in an elliptical orbit and the longitudinal motion model of an F-16 aircraft.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
Quantifying Maximum Actuator Degradation for a Given $H_2/H_{\infty}$ Performance with Full-State Feedback Control
Authors:
Hrishav Das,
Eliot Nychka,
Raktim Bhattacharya
Abstract:
In this paper, we address the issue of quantifying maximum actuator degradation in linear time-invariant dynamical systems. We present a new unified framework for computing the state-feedback controller gain that meets a user-defined closed-loop performance criterion while also maximizing actuator degradation. This degradation is modeled as a first-order filter with additive noise. Our approach in…
▽ More
In this paper, we address the issue of quantifying maximum actuator degradation in linear time-invariant dynamical systems. We present a new unified framework for computing the state-feedback controller gain that meets a user-defined closed-loop performance criterion while also maximizing actuator degradation. This degradation is modeled as a first-order filter with additive noise. Our approach involves two novel convex optimization formulations that concurrently determine the controller gain, maximize actuator degradation, and maintain the desired closed-loop performance in both the $H_2$ and $H_{\infty}$ system norms. The results are limited to open-loop stable systems. We demonstrate the application of our results through the design of a full-state feedback controller for a model representing the longitudinal motion of the F-16 aircraft.
△ Less
Submitted 2 March, 2024;
originally announced March 2024.
-
Explicit Constraints on the Geometric Rate of Convergence of Random Walk Metropolis-Hastings
Authors:
Riddhiman Bhattacharya,
Galin L. Jones
Abstract:
Convergence rate analyses of random walk Metropolis-Hastings Markov chains on general state spaces have largely focused on establishing sufficient conditions for geometric ergodicity or on analysis of mixing times. Geometric ergodicity is a key sufficient condition for the Markov chain Central Limit Theorem and allows rigorous approaches to assessing Monte Carlo error. The sufficient conditions fo…
▽ More
Convergence rate analyses of random walk Metropolis-Hastings Markov chains on general state spaces have largely focused on establishing sufficient conditions for geometric ergodicity or on analysis of mixing times. Geometric ergodicity is a key sufficient condition for the Markov chain Central Limit Theorem and allows rigorous approaches to assessing Monte Carlo error. The sufficient conditions for geometric ergodicity of the random walk Metropolis-Hastings Markov chain are refined and extended, which allows the analysis of previously inaccessible settings such as Bayesian Poisson regression.
The key technical innovation is the development of explicit drift and minorization conditions for random walk Metropolis-Hastings, which allows explicit upper and lower bounds on the geometric rate of convergence. Further, lower bounds on the geometric rate of convergence are also developed using spectral theory. The existing sufficient conditions for geometric ergodicity, to date, have not provided explicit constraints on the rate of geometric rate of convergence because the method used only implies the existence of drift and minorization conditions.
The theoretical results are applied to random walk Metropolis-Hastings algorithms for a class of exponential families and generalized linear models that address Bayesian Regression problems.
△ Less
Submitted 21 July, 2023;
originally announced July 2023.
-
Non-Asymptotic Analysis of Online Multiplicative Stochastic Gradient Descent
Authors:
Riddhiman Bhattacharya,
Tiefeng Jiang
Abstract:
Past research has indicated that the covariance of the Stochastic Gradient Descent (SGD) error done via minibatching plays a critical role in determining its regularization and escape from low potential points. Motivated by some new research in this area, we prove universality results by showing that noise classes that have the same mean and covariance structure of SGD via minibatching have simila…
▽ More
Past research has indicated that the covariance of the Stochastic Gradient Descent (SGD) error done via minibatching plays a critical role in determining its regularization and escape from low potential points. Motivated by some new research in this area, we prove universality results by showing that noise classes that have the same mean and covariance structure of SGD via minibatching have similar properties. We mainly consider the Multiplicative Stochastic Gradient Descent (M-SGD) algorithm as introduced in previous work, which has a much more general noise class than the SGD algorithm done via minibatching. We establish non asymptotic bounds for the M-SGD algorithm in the Wasserstein distance. We also show that the M-SGD error is approximately a scaled Gaussian distribution with mean $0$ at any fixed point of the M-SGD algorithm.
△ Less
Submitted 1 March, 2023; v1 submitted 13 December, 2021;
originally announced December 2021.
-
Simultaneous best linear invariant prediction of future order statistics for location-scale and scale families and associated optimality properties
Authors:
Narayanaswamy Balakrishnan,
Ritwik Bhattacharya
Abstract:
In this article, we first derive an explicit expression for the marginal best linear invariant predictor (BLIP) of an unobserved future order statistic based on a set of early observed ordered statistics. We then derive the joint BLIPs of two future order statistics and prove that the joint predictors are trace-efficient as well as determinant-efficient linear invariant predictors. More generally,…
▽ More
In this article, we first derive an explicit expression for the marginal best linear invariant predictor (BLIP) of an unobserved future order statistic based on a set of early observed ordered statistics. We then derive the joint BLIPs of two future order statistics and prove that the joint predictors are trace-efficient as well as determinant-efficient linear invariant predictors. More generally, the BLIPs are shown to possess complete mean squared predictive error matrix dominance property in the class of all linear invariant predictors of two future unobserved order statistics. Finally, these results are extended to the case of simultaneous BLIPs of any $\ell$ future order statistics. Both scale and location-scale families of distributions are considered as the parent distribution for the development of results.
△ Less
Submitted 25 November, 2021;
originally announced November 2021.
-
Optimal Sensor Precision for Multi-Rate Sensing for Bounded Estimation Error
Authors:
Niladri Das,
Raktim Bhattacharya
Abstract:
We address the problem of determining optimal sensor precisions for estimating the states of linear time-varying discrete-time stochastic dynamical systems, with guaranteed bounds on the estimation errors. This is performed in the Kalman filtering framework, where the sensor precisions are treated as variables. They are determined by solving a constrained convex optimization problem, which guarant…
▽ More
We address the problem of determining optimal sensor precisions for estimating the states of linear time-varying discrete-time stochastic dynamical systems, with guaranteed bounds on the estimation errors. This is performed in the Kalman filtering framework, where the sensor precisions are treated as variables. They are determined by solving a constrained convex optimization problem, which guarantees the specified upper bound on the posterior error variance. Optimal sensor precisions are determined by minimizing the l1 norm, which promotes sparseness in the solution and indirectly addresses the sensor selection problem. The theory is applied to realistic flight mechanics and astrodynamics problems to highlight its engineering value. These examples demonstrate the application of the presented theory to a) determine redundant sensing architectures for linear time invariant systems, b) accurately estimate states with low-cost sensors, and c) optimally schedule sensors for linear time-varying systems.
△ Less
Submitted 12 June, 2021;
originally announced June 2021.
-
Sensor Selection and Optimal Precision in $\mathcal{H}_2/\mathcal{H}_{\infty}$ Estimation Framework: Theory and Algorithms
Authors:
Vedang M. Deshpande,
Raktim Bhattacharya
Abstract:
We consider the problem of sensor selection for designing observer and filter for continuous linear time invariant systems such that the sensor precisions are minimized, and the estimation errors are bounded by the prescribed $\mathcal{H}_2/\mathcal{H}_{\infty}$ performance criteria. The proposed integrated framework formulates the precision minimization as a convex optimization problem subject to…
▽ More
We consider the problem of sensor selection for designing observer and filter for continuous linear time invariant systems such that the sensor precisions are minimized, and the estimation errors are bounded by the prescribed $\mathcal{H}_2/\mathcal{H}_{\infty}$ performance criteria. The proposed integrated framework formulates the precision minimization as a convex optimization problem subject to linear matrix inequalities, and it is solved using an algorithm based on the alternating direction method of multipliers (ADMM). We also present a greedy approach for sensor selection and demonstrate the performance of the proposed algorithms using numerical simulations.
△ Less
Submitted 6 April, 2021; v1 submitted 28 February, 2021;
originally announced March 2021.
-
Sparse Sensing and Optimal Precision: Robust $\mathcal{H}_{\infty}$ Optimal Observer Design with Model Uncertainty
Authors:
Vedang M. Deshpande,
Raktim Bhattacharya
Abstract:
We present a framework which incorporates three aspects of the estimation problem, namely, sparse sensor configuration, optimal precision, and robustness in the presence of model uncertainty. The problem is formulated in the $\mathcal{H}_{\infty}$ optimal observer design framework. We consider two types of uncertainties in the system, i.e. structured affine and unstructured uncertainties. The obje…
▽ More
We present a framework which incorporates three aspects of the estimation problem, namely, sparse sensor configuration, optimal precision, and robustness in the presence of model uncertainty. The problem is formulated in the $\mathcal{H}_{\infty}$ optimal observer design framework. We consider two types of uncertainties in the system, i.e. structured affine and unstructured uncertainties. The objective is to design an observer with a given $\mathcal{H}_{\infty}$ performance index with minimal number of sensors and minimal precision values, while guaranteeing the performance for all admissible uncertainties. The problem is posed as a convex optimization problem subject to linear matrix inequalities. Numerical simulations demonstrate the application of the theoretical results presented in this work.
△ Less
Submitted 3 September, 2020;
originally announced September 2020.
-
Modeling and Optimal Control of Hybrid UAVs with Wind Disturbance
Authors:
Sunsoo Kim,
Niladri Das,
Raktim Bhattacharya
Abstract:
This paper addresses modeling and control of a six-degree-of-freedom unmanned aerial vehicle capable of vertical take-off and landing in the presence of wind disturbances. We design a hybrid vehicle that combines the benefits of both the fixed-wing and the rotary-wing UAVs. A non-linear model for the hybrid vehicle is rapidly built, combining rigid body dynamics, aerodynamics of wing, and dynamics…
▽ More
This paper addresses modeling and control of a six-degree-of-freedom unmanned aerial vehicle capable of vertical take-off and landing in the presence of wind disturbances. We design a hybrid vehicle that combines the benefits of both the fixed-wing and the rotary-wing UAVs. A non-linear model for the hybrid vehicle is rapidly built, combining rigid body dynamics, aerodynamics of wing, and dynamics of the motor and propeller. Further, we design an H2 optimal controller to make the UAV robust to wind disturbances. We compare its results against that of PID and LQR-based control. Our proposed controller results in better performance in terms of root mean squared errors and time responses during two scenarios: hover and level-flight.
△ Less
Submitted 19 June, 2020;
originally announced June 2020.
-
Utility and Privacy in Object Tracking from Video Stream using Kalman Filter
Authors:
Niladri Das,
Raktim Bhattacharya
Abstract:
Tracking objects in Computer Vision is a hard problem. Privacy and utility concerns adds an extra layer of complexity over this problem. In this work we consider the problem of maintaining privacy and utility while tracking an object in a video stream using Kalman filtering. Our first proposed method ensures that the localization accuracy of this object will not improve beyond a certain level. Our…
▽ More
Tracking objects in Computer Vision is a hard problem. Privacy and utility concerns adds an extra layer of complexity over this problem. In this work we consider the problem of maintaining privacy and utility while tracking an object in a video stream using Kalman filtering. Our first proposed method ensures that the localization accuracy of this object will not improve beyond a certain level. Our second method ensures that the localization accuracy of the same object will always remain under a certain threshold.
△ Less
Submitted 14 June, 2020;
originally announced June 2020.
-
Statistical inference and Bayesian optimal life-testing plans under Type-II unified hybrid censoring scheme
Authors:
Tanmay Sen,
Ritwik Bhattacharya,
Biswabrata Pradhan,
Yogesh Mani Tripathi
Abstract:
This article describes the inferential procedures and Bayesian optimal life-testing issues under Type-II unified hybrid censoring scheme. First, the explicit expressions of expected number of failures, expected duration of testing and Fisher information matrix for the unknown parameters of the underlying lifetime model are derived. Then, using these quantities, the Bayesian optimal life-testing pl…
▽ More
This article describes the inferential procedures and Bayesian optimal life-testing issues under Type-II unified hybrid censoring scheme. First, the explicit expressions of expected number of failures, expected duration of testing and Fisher information matrix for the unknown parameters of the underlying lifetime model are derived. Then, using these quantities, the Bayesian optimal life-testing plans are computed in subsequent section. A cost constraint D-optimal optimization problem has been formulated and the corresponding solution algorithm is provided to obtain optimal plans. Computational procedures are illustrated through numerical examples.
△ Less
Submitted 11 April, 2020;
originally announced April 2020.
-
Data-driven Solution of Stochastic Differential Equations Using Maximum Entropy Basis Functions
Authors:
Vedang M. Deshpande,
Raktim Bhattacharya
Abstract:
In this paper we present a data-driven approach for uncertainty propagation. In particular, we consider stochastic differential equations with parametric uncertainty. Solution of the differential equation is approximated using maximum entropy (maxent) basis functions similar to polynomial chaos expansions. Maxent basis functions are derived from available data by maximization of information-theore…
▽ More
In this paper we present a data-driven approach for uncertainty propagation. In particular, we consider stochastic differential equations with parametric uncertainty. Solution of the differential equation is approximated using maximum entropy (maxent) basis functions similar to polynomial chaos expansions. Maxent basis functions are derived from available data by maximization of information-theoretic entropy, therefore, there is no need to specify basis functions beforehand. We compare the proposed maxent based approach with existing methods.
△ Less
Submitted 3 April, 2020;
originally announced April 2020.
-
Robust LQR for Uncertain Discrete-Time Systems using Polynomial Chaos
Authors:
Vaishnav Tadiparthi,
Raktim Bhattacharya
Abstract:
In this paper, a polynomial chaos based framework for designing controllers for discrete time linear systems with probabilistic parameters is presented. Conditions for exponential-mean-square stability for such systems are derived and algorithms for synthesizing optimal quadratically stabilizing controllers are proposed in a convex optimization formulation. The solution presented is demonstrated o…
▽ More
In this paper, a polynomial chaos based framework for designing controllers for discrete time linear systems with probabilistic parameters is presented. Conditions for exponential-mean-square stability for such systems are derived and algorithms for synthesizing optimal quadratically stabilizing controllers are proposed in a convex optimization formulation. The solution presented is demonstrated on the derived discrete-time models of a nonlinear F-16 aircraft model trimmed at a set of chosen points.
△ Less
Submitted 3 April, 2020;
originally announced April 2020.
-
Nonlinear Attitude Estimation for Small UAVs with Low Power Microprocessors
Authors:
Sunsoo Kim,
Vaishnav Tadiparthi,
Raktim Bhattacharya
Abstract:
Among algorithms used for sensor fusion for attitude estimation in unmanned aerial vehicles, the Extended Kalman Filter (EKF) is the most commonly used for estimation. In this paper, we propose a new version of H2 estimation called extended H2 estimation that can overcome the limitations of the extended Kalman Filter, specifically with respect to computational speed, memory usage, and root mean sq…
▽ More
Among algorithms used for sensor fusion for attitude estimation in unmanned aerial vehicles, the Extended Kalman Filter (EKF) is the most commonly used for estimation. In this paper, we propose a new version of H2 estimation called extended H2 estimation that can overcome the limitations of the extended Kalman Filter, specifically with respect to computational speed, memory usage, and root mean squared error. We formulate a new attitude-estimation algorithm, where the filter gain is designed offline about a nominal operating point, but the filter dynamics is implemented using the nonlinear system dynamics. We refer to this implementation of the H2 optimal estimator as the extended H2 estimator. The solution presented is tested on two cases, corresponding to slow and rapid motions, and compared against the EKF in the performance metrics mentioned above.
△ Less
Submitted 30 March, 2020;
originally announced March 2020.
-
Sparse Sensing and Optimal Precision: An Integrated Framework for $\mathcal{H}_2/\mathcal{H}_{\infty}$ Optimal Observer Design
Authors:
Vedang M. Deshpande,
Raktim Bhattacharya
Abstract:
In this paper, we simultaneously determine the optimal sensor precision and the observer gain, which achieves the specified accuracy in the state estimates. Along with the unknown observer gain, the formulation parameterizes the scaling of the exogenous inputs that correspond to the sensor noise. Reciprocal of this scaling is defined as the sensor precision, and sparseness is achieved by minimizin…
▽ More
In this paper, we simultaneously determine the optimal sensor precision and the observer gain, which achieves the specified accuracy in the state estimates. Along with the unknown observer gain, the formulation parameterizes the scaling of the exogenous inputs that correspond to the sensor noise. Reciprocal of this scaling is defined as the sensor precision, and sparseness is achieved by minimizing the $l_1$ norm of the precision vector. The optimization is performed with constraints guaranteeing specified accuracy in state estimates, which are defined in terms of $\mathcal{H}_2$ or $\mathcal{H}_{\infty}$ norms of the error dynamics. The results presented in this paper are applied to the linearized longitudinal model of an F-16 aircraft.
△ Less
Submitted 20 June, 2020; v1 submitted 24 March, 2020;
originally announced March 2020.
-
Eigen Value Analysis in Lower Bounding Uncertainty of Kalman Filter Estimates
Authors:
Niladri Das,
Raktim Bhattacharya
Abstract:
In this paper we are concerned with the error-covariance lower-bounding problem in Kalman filtering: a sensor releases a set of measurements to the data fusion/estimation center, which has a perfect knowledge of the dynamic model, to allow it to estimate the states, while preventing it to estimate the states beyond a given accuracy. We propose a measurement noise manipulation scheme to ensure lowe…
▽ More
In this paper we are concerned with the error-covariance lower-bounding problem in Kalman filtering: a sensor releases a set of measurements to the data fusion/estimation center, which has a perfect knowledge of the dynamic model, to allow it to estimate the states, while preventing it to estimate the states beyond a given accuracy. We propose a measurement noise manipulation scheme to ensure lower-bound on the estimation accuracy of states. Our proposed method ensures lower-bound on the steady state estimation error of Kalman filter, using mathematical tools from eigen value analysis.
△ Less
Submitted 14 June, 2020; v1 submitted 12 March, 2020;
originally announced March 2020.
-
Optimal Transport Based Filtering with Nonlinear State Equality Constraints
Authors:
Niladri Das,
Raktim Bhattacharya
Abstract:
In this work we propose a framework to address the issue of state dependent nonlinear equality-constrained state estimation using Bayesian filtering. This framework is constructed specifically for a linear approximation of Bayesian filtering that uses the theory of Optimal Transport. As a part of this framework, we present three traditionally-used nonlinear equality constraint-preserving algorithm…
▽ More
In this work we propose a framework to address the issue of state dependent nonlinear equality-constrained state estimation using Bayesian filtering. This framework is constructed specifically for a linear approximation of Bayesian filtering that uses the theory of Optimal Transport. As a part of this framework, we present three traditionally-used nonlinear equality constraint-preserving algorithms coupled with the Optimal Transport based filter: the equality-constrained Optimal Transport filter, the projected Optimal Transport filter, and the measurement-augmented Optimal Transport filter. In cases where the nonlinear equality-constraints represent an arbitrary convex manifold, we show that the re-sampling step of Optimal Transport filter, can generate initial samples for filtering, from any probability distribution function defined on this manifold. We show numerical results using our proposed framework.
△ Less
Submitted 12 March, 2020;
originally announced March 2020.
-
Optimal Sensing Precision in Ensemble and Unscented Kalman Filtering
Authors:
Niladri Das,
Raktim Bhattacharya
Abstract:
We consider the problem of selecting an optimal set of sensor precisions to estimate the states of a non-linear dynamical system using an Ensemble Kalman filter and an Unscented Kalman filter, which uses random and deterministic ensembles respectively. Specifically, the goal is to choose at run-time, a sparse set of sensor precisions for active-sensing that satisfies certain constraints on the est…
▽ More
We consider the problem of selecting an optimal set of sensor precisions to estimate the states of a non-linear dynamical system using an Ensemble Kalman filter and an Unscented Kalman filter, which uses random and deterministic ensembles respectively. Specifically, the goal is to choose at run-time, a sparse set of sensor precisions for active-sensing that satisfies certain constraints on the estimated state covariance. In this paper, we show that this sensor precision selection problem is a semidefinite programming problem when we use l1 norm over precision vector as the surrogate measure to induce sparsity. We formulate a sensor selection scheme over multiple time steps, for certain constraints on the terminal estimated state covariance.
△ Less
Submitted 12 March, 2020;
originally announced March 2020.
-
A unified framework to generate optimized compact finite difference schemes
Authors:
Vedang M. Deshpande,
Raktim Bhattacharya,
Diego A. Donzis
Abstract:
A unified framework to derive optimized compact schemes for a uniform grid is presented. The optimal scheme coefficients are determined analytically by solving an optimization problem to minimize the spectral error subject to equality constraints that ensure specified order of accuracy. A rigorous stability analysis for the optimized schemes is also presented. We analytically prove the relation be…
▽ More
A unified framework to derive optimized compact schemes for a uniform grid is presented. The optimal scheme coefficients are determined analytically by solving an optimization problem to minimize the spectral error subject to equality constraints that ensure specified order of accuracy. A rigorous stability analysis for the optimized schemes is also presented. We analytically prove the relation between order of a derivative and symmetry or skew-symmetry of the optimal coefficients approximating it. We also show that other types of schemes e.g., spatially explicit, and biased finite differences, can be generated as special cases of the framework.
△ Less
Submitted 12 December, 2019;
originally announced December 2019.
-
Privacy and Utility Aware Data Sharing for Space Situational Awareness from Ensemble and Unscented Kalman Filtering Perspective
Authors:
Niladri Das,
Raktim Bhattacharya
Abstract:
In this paper, we present an optimization-based formulation for privacy-utility tradeoff in the Ensemble and Unscented Kalman filtering framework, with a focus on space situational awareness. Privacy and utility are defined in terms of a lower and an upper bound on the state estimation error covariance, respectively. Synthetic sensor noise is used to satisfy these bounds and is determined by solvi…
▽ More
In this paper, we present an optimization-based formulation for privacy-utility tradeoff in the Ensemble and Unscented Kalman filtering framework, with a focus on space situational awareness. Privacy and utility are defined in terms of a lower and an upper bound on the state estimation error covariance, respectively. Synthetic sensor noise is used to satisfy these bounds and is determined by solving an optimization problem. Given privacy and utility bounds, we present optimization problem formulations to determine a) the maximum noise for which utility is satisfied or the estimation errors are upper-bounded, b) the minimum noise for which privacy is satisfied or the estimation errors are lower-bounded, c) the optimal noise that satisfies utility constraints and maximizes privacy, and d) the optimal noise that satisfies privacy constraints and maximizes utility. We demonstrate application of these formulations to the tracking of the International Space Station, and highlight the optimal privacy vs utility tradeoff for this dynamical system.
△ Less
Submitted 8 December, 2019;
originally announced December 2019.
-
Surrogate Modeling of Dynamics From Sparse Data Using Maximum Entropy Basis Functions
Authors:
Vedang M. Deshpande,
Raktim Bhattacharya
Abstract:
In this paper we present a data driven approach for approximating dynamical systems. A dynamics is approximated using basis functions, which are derived from maximization of the information-theoretic entropy, and can be generated directly from the data provided. This approach has advantages over other methods, where a dictionary of basis functions have to be provided by the user, which is non triv…
▽ More
In this paper we present a data driven approach for approximating dynamical systems. A dynamics is approximated using basis functions, which are derived from maximization of the information-theoretic entropy, and can be generated directly from the data provided. This approach has advantages over other methods, where a dictionary of basis functions have to be provided by the user, which is non trivial in some applications. We compare the accuracy of the proposed data-driven modeling approach to existing methods in the literature, and demonstrate that for some applications the maximum entropy basis functions provide significantly more accurate models.
△ Less
Submitted 7 November, 2019;
originally announced November 2019.
-
Superiority of Bayes estimators over the MLE in high dimensional multinomial models and its implication for nonparametric Bayes theory
Authors:
Rabi Bhattacharya,
Rachel Oliver
Abstract:
This article focuses on the performance of Bayes estimators, in comparison with the MLE, in multinomial models with a relatively large number of cells. The prior for the Bayes estimator is taken to be the conjugate Dirichlet, i.e., the multivariate Beta, with exchangeable distributions over the coordinates, including the non-informative uniform distribution. The choice of the multinomial is motiva…
▽ More
This article focuses on the performance of Bayes estimators, in comparison with the MLE, in multinomial models with a relatively large number of cells. The prior for the Bayes estimator is taken to be the conjugate Dirichlet, i.e., the multivariate Beta, with exchangeable distributions over the coordinates, including the non-informative uniform distribution. The choice of the multinomial is motivated by its many applications in business and industry, but also by its use in providing a simple nonparametric estimator of an unknown distribution. It is striking that the Bayes procedure outperforms the asymptotically efficient MLE over most of the parameter spaces for even moderately large dimensional parameter space and rather large sample sizes.
△ Less
Submitted 5 October, 2019;
originally announced October 2019.
-
On Improved Statistical Accuracy of Low-Order Polynomial Chaos Approximations
Authors:
Vedang M. Deshpande,
Raktim Bhattacharya
Abstract:
Polynomial chaos expansion is a popular way to develop surrogate models for stochastic systems with arbitrary random variables. Standard techniques such as Galerkin projection, stochastic collocation, and least squares approximation, are applied to determine polynomial chaos coefficients, which define the surrogate model. Since the surrogate models are developed from a function approximation persp…
▽ More
Polynomial chaos expansion is a popular way to develop surrogate models for stochastic systems with arbitrary random variables. Standard techniques such as Galerkin projection, stochastic collocation, and least squares approximation, are applied to determine polynomial chaos coefficients, which define the surrogate model. Since the surrogate models are developed from a function approximation perspective, there is no reason to expect accuracy of statistics from these models. The statistical moments estimated from the surrogate model may significantly differ from the true moments, especially for lower order approximations. Often arbitrary high orders are required to recover, for example, the second moment. In this paper, we present modifications of standard techniques and determine polynomial chaos coefficients by solving a constrained optimization problem. We present this new approach for algebraic functions and differential equations with random parameters, and demonstrate that the surrogate models from the new approach are able to recover the first two moments exactly.
△ Less
Submitted 8 September, 2019;
originally announced September 2019.
-
Differential Geometry for Model Independent Analysis of Images and Other Non-Euclidean Data: Recent Developments
Authors:
Rabi Bhattacharya,
Lizhen Lin
Abstract:
This article provides an exposition of recent methodologies for nonparametric analysis of digital observations on images and other non-Euclidean objects. Fréchet means of distributions on metric spaces, such as manifolds and stratified spaces, have played an important role in this endeavor. Apart from theoretical issues of uniqueness of the Fréchet minimizer and the asymptotic distribution of the…
▽ More
This article provides an exposition of recent methodologies for nonparametric analysis of digital observations on images and other non-Euclidean objects. Fréchet means of distributions on metric spaces, such as manifolds and stratified spaces, have played an important role in this endeavor. Apart from theoretical issues of uniqueness of the Fréchet minimizer and the asymptotic distribution of the sample Fréchet mean under uniqueness, applications to image analysis are highlighted. In addition, nonparametric Bayes theory is brought to bear on the problems of density estimation and classification on manifolds.
△ Less
Submitted 3 January, 2018;
originally announced January 2018.
-
Design of Linear Parameter Varying Quadratic Regulator in Polynomial Chaos Framework
Authors:
Shao-Chen Hsu,
Raktim Bhattacharya
Abstract:
We present a new theoretical framework for designing linear parameter varying controllers in the polynomial chaos framework. We assume the scheduling variable to be random and apply polynomial chaos approach to synthesize the controller for the resulting linear stochastic dynamical system. Two algorithms are presented that minimize the performance objective with respect to the stochastic system. T…
▽ More
We present a new theoretical framework for designing linear parameter varying controllers in the polynomial chaos framework. We assume the scheduling variable to be random and apply polynomial chaos approach to synthesize the controller for the resulting linear stochastic dynamical system. Two algorithms are presented that minimize the performance objective with respect to the stochastic system. The first algorithm is based on Galerkin projection and the second algorithm is based on stochastic collocation. LPV controllers from both the algorithms are shown to outperform classical LPV designs with respect to regulator design for nonlinear missile system.
△ Less
Submitted 7 November, 2017;
originally announced November 2017.
-
Sustainability in the Stochastic Ramsey Model
Authors:
Rabi Bhattacharya,
Hyeonju Kim,
Mukul Majumdar
Abstract:
In this paper we provide a self-contained exposition of the problem of sustaining a constant consumption level in a Ramsey model. Our focus is on the case in which the output capital-ratio is random. After a brief review of the known results on the probabilities of sustaining a target consumption from an initial stock, we present some new results on estimating the probabilities by using Chebyshev…
▽ More
In this paper we provide a self-contained exposition of the problem of sustaining a constant consumption level in a Ramsey model. Our focus is on the case in which the output capital-ratio is random. After a brief review of the known results on the probabilities of sustaining a target consumption from an initial stock, we present some new results on estimating the probabilities by using Chebyshev inequalities. Some numerical calculations for these estimates are also provided.
△ Less
Submitted 23 November, 2015;
originally announced November 2015.
-
On the Convergence Analysis of Asynchronous Distributed Quadratic Programming via Dual Decomposition
Authors:
Kooktae Lee,
Raktim Bhattacharya
Abstract:
In this paper, we analyze the convergence as well as the rate of convergence of asynchronous distributed quadratic programming (QP) with dual decomposition technique. In general, distributed optimization requires synchronization of data at each iteration step due to the interdependency of data. This synchronization latency may incur a large amount of waiting time caused by an idle process during c…
▽ More
In this paper, we analyze the convergence as well as the rate of convergence of asynchronous distributed quadratic programming (QP) with dual decomposition technique. In general, distributed optimization requires synchronization of data at each iteration step due to the interdependency of data. This synchronization latency may incur a large amount of waiting time caused by an idle process during computation. We aim to attack this synchronization penalty in distributed QP problems by implementing asynchronous update of dual variable. The price to pay for adopting asynchronous computing algorithms is unpredictability of the solution, resulting in a tradeoff between speedup and accuracy. Thus, the convergence to an optimal solution is not guaranteed owing to the stochastic behavior of asynchrony. In this paper, we employ the switched system framework as an analysis tool to investigate the convergence of asynchronous distributed QP. This switched system will facilitate analysis on asynchronous distributed QP with dual decomposition, providing necessary and sufficient conditions for the mean square convergence. Also, we provide an analytic expression for the rate of convergence through the switched system, which enables performance analysis of asynchronous algorithms as compared with synchronous case. To verify the validity of the proposed methods, numerical examples are presented with an implementation of asynchronous parallel QP using OpenMP.
△ Less
Submitted 18 June, 2015; v1 submitted 17 June, 2015;
originally announced June 2015.
-
A Switched Dynamical System Framework for Analysis of Massively Parallel Asynchronous Numerical Algorithms
Authors:
Kooktae Lee,
Raktim Bhattacharya,
Vijay Gupta
Abstract:
In the near future, massively parallel computing systems will be necessary to solve computation intensive applications. The key bottleneck in massively parallel implementation of numerical algorithms is the synchronization of data across processing elements (PEs) after each iteration, which results in significant idle time. Thus, there is a trend towards relaxing the synchronization and adopting a…
▽ More
In the near future, massively parallel computing systems will be necessary to solve computation intensive applications. The key bottleneck in massively parallel implementation of numerical algorithms is the synchronization of data across processing elements (PEs) after each iteration, which results in significant idle time. Thus, there is a trend towards relaxing the synchronization and adopting an asynchronous model of computation to reduce idle time. However, it is not clear what is the effect of this relaxation on the stability and accuracy of the numerical algorithm. In this paper we present a new framework to analyze such algorithms. We treat the computation in each PE as a dynamical system and model the asynchrony as stochastic switching. The overall system is then analyzed as a switched dynamical system. However, modeling of massively parallel numerical algorithms as switched dynamical systems results in a very large number of modes, which makes current analysis tools available for such systems computationally intractable. We develop new techniques that circumvent this scalability issue. The framework is presented on a one-dimensional heat equation as a case study and the proposed analysis framework is verified by solving the partial differential equation (PDE) in a $\mathtt{nVIDIA\: Tesla^{\scriptsize{TM}}}$ GPU machine, with asynchronous communication between cores.
△ Less
Submitted 13 March, 2015;
originally announced March 2015.
-
Stability Analysis of Large-Scale Distributed Networked Control Systems with Random Communication Delays: A Switched System Approach
Authors:
Kooktae Lee,
Raktim Bhattacharya
Abstract:
In this paper, we consider the stability analysis of large-scale distributed networked control systems with random communication delays between linearly interconnected subsystems. The stability analysis is performed in the Markov jump linear system framework. There have been considerable researches on stability analysis of Markov jump systems, however, these methods are not applicable to large-sca…
▽ More
In this paper, we consider the stability analysis of large-scale distributed networked control systems with random communication delays between linearly interconnected subsystems. The stability analysis is performed in the Markov jump linear system framework. There have been considerable researches on stability analysis of Markov jump systems, however, these methods are not applicable to large-scale systems because large numbers of subsystems result in an extremely large number of the switching modes. To avoid this scalability issue, we propose a new reduced mode model for stability analysis, which is computationally efficient. We also consider the case in which the transition probabilities for the Markov jump process contain uncertainties. We provide a new method that estimates bounds for uncertain Markov transition probability matrix to guarantee the system stability. The efficiency and the usefulness of the proposed methods are verified through examples.
△ Less
Submitted 10 March, 2015;
originally announced March 2015.
-
Optimal Switching Synthesis for Jump Linear Systems with Gaussian initial state uncertainty
Authors:
Kooktae Lee,
Raktim Bhattacharya
Abstract:
This paper provides a method to design an optimal switching sequence for jump linear systems with given Gaussian initial state uncertainty. In the practical perspective, the initial state contains some uncertainties that come from measurement errors or sensor inaccuracies and we assume that the type of this uncertainty has the form of Gaussian distribution. In order to cope with Gaussian initial s…
▽ More
This paper provides a method to design an optimal switching sequence for jump linear systems with given Gaussian initial state uncertainty. In the practical perspective, the initial state contains some uncertainties that come from measurement errors or sensor inaccuracies and we assume that the type of this uncertainty has the form of Gaussian distribution. In order to cope with Gaussian initial state uncertainty and to measure the system performance, Wasserstein metric that defines the distance between probability density functions is used. Combining with the receding horizon framework, an optimal switching sequence for jump linear systems can be obtained by minimizing the objective function that is expressed in terms of Wasserstein distance. The proposed optimal switching synthesis also guarantees the mean square stability for jump linear systems. The validations of the proposed methods are verified by examples.
△ Less
Submitted 20 August, 2014;
originally announced August 2014.
-
Mean Square Stability for Stochastic Jump Linear Systems via Optimal Transport
Authors:
Kooktae Lee,
Abhishek Halder,
Raktim Bhattacharya
Abstract:
In this note, we provide a unified framework for the mean square stability of stochastic jump linear systems via optimal transport. The Wasserstein metric known as an optimal transport, that assesses the distance between probability density functions enables the stability analysis. Without any assumption on the underlying jump process, this Wasserstein distance guarantees the mean square stability…
▽ More
In this note, we provide a unified framework for the mean square stability of stochastic jump linear systems via optimal transport. The Wasserstein metric known as an optimal transport, that assesses the distance between probability density functions enables the stability analysis. Without any assumption on the underlying jump process, this Wasserstein distance guarantees the mean square stability for general stochastic jump linear systems, not necessarily for Markovian jump. The validity of the proposed methods are proved by recovering already-known stability conditions under this framework.
△ Less
Submitted 10 March, 2014;
originally announced March 2014.
-
Probabilistic Robustness Analysis of Stochastic Jump Linear Systems
Authors:
Kooktae Lee,
Abhishek Halder,
Raktim Bhattacharya
Abstract:
In this paper, we propose a new method to measure the probabilistic robustness of stochastic jump linear system with respect to both the initial state uncertainties and the randomness in switching. Wasserstein distance which defines a metric on the manifold of probability density functions is used as tool for the performance and the stability measures. Starting with Gaussian distribution to repres…
▽ More
In this paper, we propose a new method to measure the probabilistic robustness of stochastic jump linear system with respect to both the initial state uncertainties and the randomness in switching. Wasserstein distance which defines a metric on the manifold of probability density functions is used as tool for the performance and the stability measures. Starting with Gaussian distribution to represent the initial state uncertainties, the probability density function of the system state evolves into mixture of Gaussian, where the number of Gaussian components grows exponentially. To cope with computational complexity caused by mixture of Gaussian, we prove that there exists an alternative probability density function that preserves exact information in the Wasserstein level. The usefulness and the efficiency of the proposed methods are demonstrated by example.
△ Less
Submitted 10 March, 2014;
originally announced March 2014.
-
Performance and Robustness Analysis of Stochastic Jump Linear Systems using Wasserstein metric
Authors:
Kooktae Lee,
Abhishek Halder,
Raktim Bhattacharya
Abstract:
This paper focuses on the performance and the robustness analysis of stochastic jump linear systems. The state trajectory under stochastic jump process becomes random variables, which brings forth the probability distributions in the system state. Therefore, we need to adopt a proper metric to measure the system performance with respect to stochastic switching. In this perspective, Wasserstein met…
▽ More
This paper focuses on the performance and the robustness analysis of stochastic jump linear systems. The state trajectory under stochastic jump process becomes random variables, which brings forth the probability distributions in the system state. Therefore, we need to adopt a proper metric to measure the system performance with respect to stochastic switching. In this perspective, Wasserstein metric that assesses the distance between probability density functions is applied to provide the performance and the robustness analysis. Both the transient and steady-state performance of the systems with given initial state uncertainties can be measured in this framework. Also, we prove that the convergence of this metric implies the mean square stability. Overall, this study provides a unifying framework for the performance and the robustness analysis of general stochastic jump linear systems, but not necessarily Markovian jump process that is commonly used for stochastic switching. The practical usefulness and efficiency of the proposed method are verified through numerical examples.
△ Less
Submitted 25 May, 2014; v1 submitted 8 March, 2014;
originally announced March 2014.
-
Linear Receding Horizon Control with Probabilistic System Parameters
Authors:
Raktim Bhattacharya,
James Fisher
Abstract:
In this paper we address the problem of designing receding horizon control algorithms for linear discrete-time systems with parametric uncertainty. We do not consider presence of stochastic forcing or process noise in the system. It is assumed that the parametric uncertainty is probabilistic in nature with known probability density functions. We use generalized polynomial chaos theory to design th…
▽ More
In this paper we address the problem of designing receding horizon control algorithms for linear discrete-time systems with parametric uncertainty. We do not consider presence of stochastic forcing or process noise in the system. It is assumed that the parametric uncertainty is probabilistic in nature with known probability density functions. We use generalized polynomial chaos theory to design the proposed stochastic receding horizon control algorithms. In this framework, the stochastic problem is converted to a deterministic problem in higher dimensional space. The performance of the proposed receding horizon control algorithms is assessed using a linear model with two states.
△ Less
Submitted 19 February, 2014;
originally announced February 2014.
-
Geodesic Density Tracking with Applications to Data Driven Modeling
Authors:
Abhishek Halder,
Raktim Bhattacharya
Abstract:
Many problems in dynamic data driven modeling deals with distributed rather than lumped observations. In this paper, we show that the Monge-Kantorovich optimal transport theory provides a unifying framework to tackle such problems in the systems-control parlance. Specifically, given distributional measurements at arbitrary instances of measurement availability, we show how to derive dynamical syst…
▽ More
Many problems in dynamic data driven modeling deals with distributed rather than lumped observations. In this paper, we show that the Monge-Kantorovich optimal transport theory provides a unifying framework to tackle such problems in the systems-control parlance. Specifically, given distributional measurements at arbitrary instances of measurement availability, we show how to derive dynamical systems that interpolate the observed distributions along the geodesics. We demonstrate the framework in the context of three specific problems: (i) \emph{finding a feedback control} to track observed ensembles over finite-horizon, (ii) \emph{finding a model} whose prediction matches the observed distributional data, and (iii) \emph{refining a baseline model} that results a distribution-level prediction-observation mismatch. We emphasize how the three problems can be posed as variants of the optimal transport problem, but lead to different types of numerical methods depending on the problem context. Several examples are given to elucidate the ideas.
△ Less
Submitted 7 February, 2014;
originally announced February 2014.
-
A Probabilistic Method for Nonlinear Robustness Analysis of F-16 Controllers
Authors:
Abhishek Halder,
Kooktae Lee,
Raktim Bhattacharya
Abstract:
This paper presents a new framework for controller robustness verification with respect to F-16 aircraft's closed-loop performance in longitudinal flight. We compare the state regulation performance of a linear quadratic regulator (LQR) and a gain-scheduled linear quadratic regulator (gsLQR), applied to nonlinear open-loop dynamics of F-16, in presence of stochastic initial condition and parametri…
▽ More
This paper presents a new framework for controller robustness verification with respect to F-16 aircraft's closed-loop performance in longitudinal flight. We compare the state regulation performance of a linear quadratic regulator (LQR) and a gain-scheduled linear quadratic regulator (gsLQR), applied to nonlinear open-loop dynamics of F-16, in presence of stochastic initial condition and parametric uncertainties, as well as actuator disturbance. We show that, in presence of initial condition uncertainties alone, both LQR and gsLQR have comparable immediate and asymptotic performances, but the gsLQR exhibits better transient performance at intermediate times. This remains true in the presence of additional actuator disturbance. Also, gsLQR is shown to be more robust than LQR, against parametric uncertainties. The probabilistic framework proposed here, leverages transfer operator based density computation in exact arithmetic and introduces optimal transport theoretic performance validation and verification (V&V) for nonlinear dynamical systems. Numerical results from our proposed method, are in unison with Monte Carlo simulations.
△ Less
Submitted 1 February, 2014;
originally announced February 2014.
-
Probabilistic Model Validation for Uncertain Nonlinear Systems
Authors:
Abhishek Halder,
Raktim Bhattacharya
Abstract:
This paper presents a probabilistic model validation methodology for nonlinear systems in time-domain. The proposed formulation is simple, intuitive, and accounts both deterministic and stochastic nonlinear systems with parametric and nonparametric uncertainties. Instead of hard invalidation methods available in the literature, a relaxed notion of validation in probability is introduced. To guaran…
▽ More
This paper presents a probabilistic model validation methodology for nonlinear systems in time-domain. The proposed formulation is simple, intuitive, and accounts both deterministic and stochastic nonlinear systems with parametric and nonparametric uncertainties. Instead of hard invalidation methods available in the literature, a relaxed notion of validation in probability is introduced. To guarantee provably correct inference, algorithm for constructing probabilistically robust validation certificate is given along with computational complexities. Several examples are worked out to illustrate its use.
△ Less
Submitted 1 February, 2014;
originally announced February 2014.
-
Omnibus CLTs for Fréchet means and nonparametric inference on non-Euclidean spaces
Authors:
Rabi Bhattacharya,
Lizhen Lin
Abstract:
Two central limit theorems for sample Fréchet means are derived, both significant for nonparametric inference on non-Euclidean spaces. The first one, Theorem 2.2, encompasses and improves upon most earlier CLTs on Fréchet means and broadens the scope of the methodology beyond manifolds to diverse new non-Euclidean data including those on certain stratified spaces which are important in the study o…
▽ More
Two central limit theorems for sample Fréchet means are derived, both significant for nonparametric inference on non-Euclidean spaces. The first one, Theorem 2.2, encompasses and improves upon most earlier CLTs on Fréchet means and broadens the scope of the methodology beyond manifolds to diverse new non-Euclidean data including those on certain stratified spaces which are important in the study of phylogenetic trees. It does not require that the underlying distribution $Q$ have a density, and applies to both intrinsic and extrinsic analysis. The second theorem, Theorem 3.3, focuses on intrinsic means on Riemannian manifolds of dimensions $d>2$ and breaks new ground by providing a broad CLT without any of the earlier restrictive support assumptions. It makes the statistically reasonable assumption of a somewhat smooth density of $Q$. The excluded case of dimension $d=2$ proves to be an enigma, although the first theorem does provide a CLT in this case as well under a support restriction. Theorem 3.3 immediately applies to spheres $S^d$, $d>2$, which are also of considerable importance in applications to axial spaces and to landmarks based image analysis, as these spaces are quotients of spheres under a Lie group $\mathcal G $ of isometries of $S^d$.
△ Less
Submitted 27 March, 2016; v1 submitted 24 June, 2013;
originally announced June 2013.
-
An Exposition of Götze's Estimation of the Rate of Convergence in the Multivariate Central Limit Theorem
Authors:
Rabi Bhattacharya,
Susan Holmes
Abstract:
We provide an explanation of the main ideas underlying Götze's main result in using Stein's method. We also provide detailed derivations of various intermediate estimates. Curiously, we are led to a different dimensional dependence of the constant than that given Götze's paper. We would like to dedicate this to Charles Stein on the occasion of his 90th birthday.
We provide an explanation of the main ideas underlying Götze's main result in using Stein's method. We also provide detailed derivations of various intermediate estimates. Curiously, we are led to a different dimensional dependence of the constant than that given Götze's paper. We would like to dedicate this to Charles Stein on the occasion of his 90th birthday.
△ Less
Submitted 22 March, 2010;
originally announced March 2010.
-
Nonparametric statistics on manifolds with applications to shape spaces
Authors:
Abhishek Bhattacharya,
Rabi Bhattacharya
Abstract:
This article presents certain recent methodologies and some new results for the statistical analysis of probability distributions on manifolds. An important example considered in some detail here is the 2-D shape space of k-ads, comprising all configurations of $k$ planar landmarks ($k>2$)-modulo translation, scaling and rotation.
This article presents certain recent methodologies and some new results for the statistical analysis of probability distributions on manifolds. An important example considered in some detail here is the 2-D shape space of k-ads, comprising all configurations of $k$ planar landmarks ($k>2$)-modulo translation, scaling and rotation.
△ Less
Submitted 21 May, 2008;
originally announced May 2008.
-
Large sample theory of intrinsic and extrinsic sample means on manifolds--II
Authors:
Rabi Bhattacharya,
Vic Patrangenaru
Abstract:
This article develops nonparametric inference procedures for estimation and testing problems for means on manifolds. A central limit theorem for Frechet sample means is derived leading to an asymptotic distribution theory of intrinsic sample means on Riemannian manifolds. Central limit theorems are also obtained for extrinsic sample means w.r.t. an arbitrary embedding of a differentiable manifol…
▽ More
This article develops nonparametric inference procedures for estimation and testing problems for means on manifolds. A central limit theorem for Frechet sample means is derived leading to an asymptotic distribution theory of intrinsic sample means on Riemannian manifolds. Central limit theorems are also obtained for extrinsic sample means w.r.t. an arbitrary embedding of a differentiable manifold in a Euclidean space. Bootstrap methods particularly suitable for these problems are presented. Applications are given to distributions on the sphere S^d (directional spaces), real projective space RP^{N-1} (axial spaces), complex projective space CP^{k-2} (planar shape spaces) w.r.t. Veronese-Whitney embeddings and a three-dimensional shape space Σ_3^4.
△ Less
Submitted 21 July, 2005;
originally announced July 2005.
-
Stability in Distribution of Randomly Perturbed Quadratic Maps as Markov Processes
Authors:
Rabi Bhattacharya,
Mukul Majumdar
Abstract:
Iteration of randomly chosen quadratic maps defines a Markov process: X_{n+1}=ε_{n+1}X_n(1-X_n), where ε_n are i.i.d. with values in the parameter space [0,4] of quadratic maps F_θ(x)=θx(1-x). Its study is of significance as an important Markov model, with applications to problems of optimization under uncertainty arising in economics. In this article a broad criterion is established for positiv…
▽ More
Iteration of randomly chosen quadratic maps defines a Markov process: X_{n+1}=ε_{n+1}X_n(1-X_n), where ε_n are i.i.d. with values in the parameter space [0,4] of quadratic maps F_θ(x)=θx(1-x). Its study is of significance as an important Markov model, with applications to problems of optimization under uncertainty arising in economics. In this article a broad criterion is established for positive Harris recurrence of X_n.
△ Less
Submitted 24 March, 2005;
originally announced March 2005.