Showing 1–31 of 31 results for author: Vaidya, U

Synthesizing Controller for Safe Navigation using Control Density Function

Authors: Joseph Moyalan, Sriram S. K. S Narayanan, Andrew Zheng, Umesh Vaidya

Abstract: We consider the problem of navigating a nonlinear dynamical system from some initial set to some target set while avoiding collision with an unsafe set. We extend the concept of density function to control density function (CDF) for solving navigation problems with safety constraints. The occupancy-based interpretation of the measure associated with the density function is instrumental in imposing… ▽ More We consider the problem of navigating a nonlinear dynamical system from some initial set to some target set while avoiding collision with an unsafe set. We extend the concept of density function to control density function (CDF) for solving navigation problems with safety constraints. The occupancy-based interpretation of the measure associated with the density function is instrumental in imposing the safety constraints. The navigation problem with safety constraints is formulated as a quadratic program (QP) using CDF. The existing approach using the control barrier function (CBF) also formulates the navigation problem with safety constraints as QP. One of the main advantages of the proposed QP using CDF compared to QP formulated using CBF is that both the convergence/stability and safety can be combined and imposed using the CDF. Simulation results involving the Duffing oscillator and safe navigation of Dubin car models are provided to verify the main findings of the paper. △ Less

Submitted 21 March, 2024; originally announced March 2024.

Spectral Koopman Method for Identifying Stability Boundary

Authors: Bhagyashree Umathe, Umesh Vaidya

Abstract: The paper is about characterizing the stability boundary of an autonomous dynamical system using the Koopman spectrum. For a dynamical system with an asymptotically stable equilibrium point, the domain of attraction constitutes a region consisting of all initial conditions attracted to the equilibrium point. The stability boundary is a separatrix region that separates the domain of attraction from… ▽ More The paper is about characterizing the stability boundary of an autonomous dynamical system using the Koopman spectrum. For a dynamical system with an asymptotically stable equilibrium point, the domain of attraction constitutes a region consisting of all initial conditions attracted to the equilibrium point. The stability boundary is a separatrix region that separates the domain of attraction from the rest of the state space. For a large class of dynamical systems, this stability boundary consists of the union of stable manifolds of all the unstable equilibrium points on the stability boundary. We characterize the stable manifold in terms of the zero-level curve of the Koopman eigenfunction. A path-integral formula is proposed to compute the Koopman eigenfunction for a saddle-type equilibrium point on the stability boundary. The algorithm for identifying stability boundary based on the Koopman eigenfunction is attractive as it does not involve explicit knowledge of system dynamics. We present simulation results to verify the main results of the paper. △ Less

Submitted 11 December, 2023; originally announced December 2023.

Data-driven optimal control under safety constraints using sparse Koopman approximation

Authors: Hongzhe Yu, Joseph Moyalan, Umesh Vaidya, Yongxin Chen

Abstract: In this work we approach the dual optimal reach-safe control problem using sparse approximations of Koopman operator. Matrix approximation of Koopman operator needs to solve a least-squares (LS) problem in the lifted function space, which is computationally intractable for fine discretizations and high dimensions. The state transitional physical meaning of the Koopman operator leads to a sparse LS… ▽ More In this work we approach the dual optimal reach-safe control problem using sparse approximations of Koopman operator. Matrix approximation of Koopman operator needs to solve a least-squares (LS) problem in the lifted function space, which is computationally intractable for fine discretizations and high dimensions. The state transitional physical meaning of the Koopman operator leads to a sparse LS problem in this space. Leveraging this sparsity, we propose an efficient method to solve the sparse LS problem where we reduce the problem dimension dramatically by formulating the problem using only the non-zero elements in the approximation matrix with known sparsity pattern. The obtained matrix approximation of the operators is then used in a dual optimal reach-safe problem formulation where a linear program with sparse linear constraints naturally appears. We validate our proposed method on various dynamical systems and show that the computation time for operator approximation is greatly reduced with high precision in the solutions. △ Less

Submitted 1 June, 2023; originally announced June 2023.

Off-Road Navigation of Legged Robots Using Linear Transfer Operators

Authors: Joseph Moyalan, Andrew Zheng, Sriram S. K. S Narayanan, Umesh Vaidya

Abstract: This paper presents the implementation of off-road navigation on legged robots using convex optimization through linear transfer operators. Given a traversability measure that captures the off-road environment, we lift the navigation problem into the density space using the Perron-Frobenius (P-F) operator. This allows the problem formulation to be represented as a convex optimization. Due to the o… ▽ More This paper presents the implementation of off-road navigation on legged robots using convex optimization through linear transfer operators. Given a traversability measure that captures the off-road environment, we lift the navigation problem into the density space using the Perron-Frobenius (P-F) operator. This allows the problem formulation to be represented as a convex optimization. Due to the operator acting on an infinite-dimensional density space, we use data collected from the terrain to get a finite-dimension approximation of the convex optimization. Results of the optimal trajectory for off-road navigation are compared with a standard iterative planner, where we show how our convex optimization generates a more traversable path for the legged robot compared to the suboptimal iterative planner. △ Less

Submitted 4 May, 2023; originally announced May 2023.

Data-Driven Convex Approach to Off-road Navigation via Linear Transfer Operators

Authors: Joseph Moyalan, Yongxin Chen, Umesh Vaidya

Abstract: We consider the problem of optimal navigation control design for navigation on off-road terrain. We use traversability measure to characterize the degree of difficulty of navigation on the off-road terrain. The traversability measure captures the property of terrain essential for navigation, such as elevation map, terrain roughness, slope, and terrain texture. The terrain with the presence or abse… ▽ More We consider the problem of optimal navigation control design for navigation on off-road terrain. We use traversability measure to characterize the degree of difficulty of navigation on the off-road terrain. The traversability measure captures the property of terrain essential for navigation, such as elevation map, terrain roughness, slope, and terrain texture. The terrain with the presence or absence of obstacles becomes a particular case of the proposed traversability measure. We provide a convex formulation to the off-road navigation problem by lifting the problem to the density space using the linear Perron-Frobenius (P-F) operator. The convex formulation leads to an infinite-dimensional optimal navigation problem for control synthesis. The finite-dimensional approximation of the infinite-dimensional convex problem is constructed using data. We use a computational framework involving the Koopman operator and the duality between the Koopman and P-F operator for the data-driven approximation. This makes our proposed approach data-driven and can be applied in cases where an explicit system model is unavailable. Finally, we demonstrate the application of the developed framework for the navigation of vehicle dynamics with Dubin's car model. △ Less

Submitted 1 May, 2023; v1 submitted 3 October, 2022; originally announced October 2022.

Reciprocity of Algorithms Solving Distributed Consensus-Based Optimization and Distributed Resource Allocation

Authors: Seyyed Shaho Alaviani, Atul Gajanan Kelkar, Umesh Vaidya

Abstract: This paper aims at proposing a procedure to derive distributed algorithms for distributed consensus-based optimization by using distributed algorithms for network resource allocation and vice versa over switching networks with/without synchronous protocol. It is shown that first-order gradient distributed consensus-based optimization algorithms can be used for finding an optimal solution of distri… ▽ More This paper aims at proposing a procedure to derive distributed algorithms for distributed consensus-based optimization by using distributed algorithms for network resource allocation and vice versa over switching networks with/without synchronous protocol. It is shown that first-order gradient distributed consensus-based optimization algorithms can be used for finding an optimal solution of distributed resource allocation with synchronous protocol under weaker assumptions than those given in the literature for non-switching (static) networks. It is shown that first-order gradient distributed resource allocation algorithms can be utilized for finding an optimal solution of distributed consensus-based optimization. The results presented here can be applied to time-varying and random directed networks with or without synchronous protocol with arbitrary initialization. As a result, several algorithms can now be used to derive distributed algorithms for both consensus-based optimization and resource allocation, that can overcome limitations of the existing results. While the focus of this paper is on the first-order gradient algorithms, it is to be noted that the results also work with second-order gradient algorithms. △ Less

Submitted 2 August, 2022; originally announced August 2022.

Comments: 8 pages

Koopman-based Policy Iteration for Robust Optimal Control

Authors: Alexander Krolicki, Sarang Sutavani, Umesh Vaidya

Abstract: Classically, the optimal control problem in the presence of an adversary is formulated as a two-player zero-sum differential game or an $H_\infty$ control problem. The solution to these problems can be obtained by solving the Hamilton-Jacobi-Issac equation (HJIE). We provide a novel Koopman-based expression of the HJIE, where the solutions can be obtained through the approximation of the Koopman o… ▽ More Classically, the optimal control problem in the presence of an adversary is formulated as a two-player zero-sum differential game or an $H_\infty$ control problem. The solution to these problems can be obtained by solving the Hamilton-Jacobi-Issac equation (HJIE). We provide a novel Koopman-based expression of the HJIE, where the solutions can be obtained through the approximation of the Koopman operator itself. In particular, we developed a data-driven and model based policy iteration algorithm for approximating the optimal value function using a finite-dimensional approximation of the Koopman operator and generator. △ Less

Submitted 23 April, 2022; originally announced April 2022.

Data-Driven Optimal Control via Linear Transfer Operators: A Convex Approach

Authors: Joseph Moyalan, Hyung** Choi, Yongxin Chen, Umesh Vaidya

Abstract: This paper is concerned with data-driven optimal control of nonlinear systems. We present a convex formulation to the optimal control problem (OCP) with a discounted cost function. We consider OCP with both positive and negative discount factor. The convex approach relies on lifting nonlinear system dynamics in the space of densities using the linear Perron-Frobenius (P-F) operator. This lifting l… ▽ More This paper is concerned with data-driven optimal control of nonlinear systems. We present a convex formulation to the optimal control problem (OCP) with a discounted cost function. We consider OCP with both positive and negative discount factor. The convex approach relies on lifting nonlinear system dynamics in the space of densities using the linear Perron-Frobenius (P-F) operator. This lifting leads to an infinite-dimensional convex optimization formulation of the optimal control problem. The data-driven approximation of the optimization problem relies on the approximation of the Koopman operator using the polynomial basis function. We write the approximate finite-dimensional optimization problem as a polynomial optimization which is then solved efficiently using a sum-of-squares-based optimization framework. Simulation results are presented to demonstrate the efficacy of the developed data-driven optimal control framework. △ Less

Submitted 3 February, 2022; originally announced February 2022.

Data-Driven Stochastic Optimal Control using Linear Transfer Operators

Authors: Umesh Vaidya, Duvan Tellez-Castro

Abstract: We provide a data-driven framework for optimal control of a continuous-time stochastic dynamical system. The proposed framework relies on the linear operator theory involving linear Perron-Frobenius (P-F) and Koopman operators. Our first results involving the P-F operator provide a convex formulation to the optimal control problem in the dual space of densities. This convex formulation of the stoc… ▽ More We provide a data-driven framework for optimal control of a continuous-time stochastic dynamical system. The proposed framework relies on the linear operator theory involving linear Perron-Frobenius (P-F) and Koopman operators. Our first results involving the P-F operator provide a convex formulation to the optimal control problem in the dual space of densities. This convex formulation of the stochastic optimal control problem leads to an infinite-dimensional convex program. The finite-dimensional approximation of the convex program is obtained using a data-driven approximation of the P-F operator. Our second results demonstrate the use of the Koopman operator, which is dual to the P-F operator, for the stochastic optimal control design. We show that the Hamilton Jacobi Bellman (HJB) equation can be expressed using the Koopman operator. We provide an iterative procedure along the lines of a popular policy iteration algorithm based on the data-driven approximation of the Koopman operator for solving the HJB equation. The two formulations, namely the convex formulation involving P-F operator and Koopman based formulation using HJB equation, can be viewed as dual to each other where the duality follows due to the dual nature of P-F and Koopman operators. Finally, we present several numerical examples to demonstrate the efficacy of the developed framework. △ Less

Submitted 2 February, 2022; originally announced February 2022.

Comments: 14 pages

Information-Theoretic Approach for Model Reduction Over Finite Time Horizon

Authors: Punit Tulpule, Umesh Vaidya

Abstract: This paper presents an information-theoretic approach for model reduction for finite time simulation. Although system models are typically used for simulation over a finite time, most of the metrics (and pseudo-metrics) used for model accuracy assessment consider asymptotic behavior e.g., Hankel singular values and Kullback-Leibler(KL) rate metric. These metrics could further be used for model ord… ▽ More This paper presents an information-theoretic approach for model reduction for finite time simulation. Although system models are typically used for simulation over a finite time, most of the metrics (and pseudo-metrics) used for model accuracy assessment consider asymptotic behavior e.g., Hankel singular values and Kullback-Leibler(KL) rate metric. These metrics could further be used for model order reduction. Hence, in this paper, we propose a generalization of KL divergence-based metric called n-step KL rate metric, which could be used to compare models over a finite time horizon. We then demonstrate that the asymptotic metrics for comparing dynamical systems may not accurately assess the model prediction uncertainties over a finite time horizon. Motivated by this finite time analysis, we propose a new pragmatic approach to compute the influence of a subset of states on a combination of states called information transfer (IT). Model reduction typically involves the removal or truncation of states. IT combines the concepts from the n-step KL rate metric and model reduction. Finally, we demonstrate the application of information transfer for model reduction. Although the analysis and definitions presented in this paper assume linear systems, they can be extended for nonlinear systems. △ Less

Submitted 24 November, 2021; originally announced November 2021.

Data-driven Identification of Nonlinear Power System Dynamics Using Output-only Measurements

Authors: Pranav Sharma, Venkataramana Ajjarapu, Umesh Vaidya

Abstract: In this paper, we propose a novel approach for the data-driven characterization of power system dynamics. The developed method of Extended Subspace Identification (ESI) is suitable for systems with output measurements when all the dynamics states are not observable. It is particularly applicable for power systems dynamic identification using Phasor Measurement Units (PMUs) measurements. As in the… ▽ More In this paper, we propose a novel approach for the data-driven characterization of power system dynamics. The developed method of Extended Subspace Identification (ESI) is suitable for systems with output measurements when all the dynamics states are not observable. It is particularly applicable for power systems dynamic identification using Phasor Measurement Units (PMUs) measurements. As in the case of power systems, it is often expensive or impossible to measure all the internal dynamic states of system components such as generators, controllers and loads. PMU measurements capture voltages, currents, power injection and frequencies, which can be considered as the outputs of system dynamics. The ESI method is suitable for system identification, capturing nonlinear modes, computing participation factor of output measurements in system modes and identifying system parameters such as system inertia. The proposed method is suitable for measurements with a noise similar to realistic system measurements. The developed method addresses some of the known deficiencies of existing data-driven dynamic system characterization methods. The approach is validated for multiple network models and dynamic event scenarios with synthetic PMU measurements. △ Less

Submitted 4 October, 2021; originally announced October 2021.

Comments: 11 Pages, 10 figures, under review in IEEE transactions on Power Systems

Sparse Control Synthesis for Uncertain Responsive Loads with Stochastic Stability Guarantees

Authors: Sai Pushpak Nandanoori, Soumya Kundu, Jianming Lian, Umesh Vaidya, Draguna Vrabie, Karanjit Kalsi

Abstract: Recent studies have demonstrated the potential of flexible loads in providing frequency response services. However, uncertainty and variability in various weather-related and end-use behavioral factors often affect the demand-side control performance. This work addresses this problem with the design of a demand-side control to achieve frequency response under load uncertainties. Our approach invol… ▽ More Recent studies have demonstrated the potential of flexible loads in providing frequency response services. However, uncertainty and variability in various weather-related and end-use behavioral factors often affect the demand-side control performance. This work addresses this problem with the design of a demand-side control to achieve frequency response under load uncertainties. Our approach involves modeling the load uncertainties via stochastic processes that appear as both multiplicative and additive to the system states in closed-loop power system dynamics. Extending the recently developed mean square exponential stability (MSES) results for stochastic systems, we formulate multi-objective linear matrix inequality (LMI)-based optimal control synthesis problems to not only guarantee stochastic stability, but also promote sparsity, enhance closed-loop transient performance, and maximize allowable uncertainties. The fundamental trade-off between the maximum allowable (\textit{critical}) uncertainty levels and the optimal stochastic stabilizing control efforts is established. Moreover, the sparse control synthesis problem is generalized to the realistic power systems scenario in which only partial-state measurements are available. Detailed numerical studies are carried out on IEEE 39-bus system to demonstrate the closed-loop stochastic stabilizing performance of the sparse controllers in enhancing frequency response under load uncertainties; as well as illustrate the fundamental trade-off between the allowable uncertainties and optimal control efforts. △ Less

Submitted 27 June, 2021; originally announced June 2021.

Comments: accepted for publication at the IEEE Transactions on Power Sysems

Report number: PNNL-SA-156076

Deep Learning of Koopman Representation for Control

Authors: Yiqiang Han, Wenjian Hao, Umesh Vaidya

Abstract: We develop a data-driven, model-free approach for the optimal control of the dynamical system. The proposed approach relies on the Deep Neural Network (DNN) based learning of Koopman operator for the purpose of control. In particular, DNN is employed for the data-driven identification of basis function used in the linear lifting of nonlinear control system dynamics. The controller synthesis is pur… ▽ More We develop a data-driven, model-free approach for the optimal control of the dynamical system. The proposed approach relies on the Deep Neural Network (DNN) based learning of Koopman operator for the purpose of control. In particular, DNN is employed for the data-driven identification of basis function used in the linear lifting of nonlinear control system dynamics. The controller synthesis is purely data-driven and does not rely on a priori domain knowledge. The OpenAI Gym environment, employed for Reinforcement Learning-based control design, is used for data generation and learning of Koopman operator in control setting. The method is applied to two classic dynamical systems on OpenAI Gym environment to demonstrate the capability. △ Less

Submitted 15 October, 2020; originally announced October 2020.

Comments: 6 pages, 8 figures

A Convex Approach to Data-driven Optimal Control via Perron-Frobenius and Koopman Operators

Authors: Bowen Huang, Umesh Vaidya

Abstract: The paper is about the data-driven computation of optimal control for a class of control affine deterministic nonlinear systems. We assume that the control dynamical system model is not available, and the only information about the system dynamics is available in the form of time-series data. We provide a convex formulation for the optimal control problem of the nonlinear system. The convex formul… ▽ More The paper is about the data-driven computation of optimal control for a class of control affine deterministic nonlinear systems. We assume that the control dynamical system model is not available, and the only information about the system dynamics is available in the form of time-series data. We provide a convex formulation for the optimal control problem of the nonlinear system. The convex formulation relies on the duality result in the dynamical system's stability theory involving density function and Perron-Frobenius operator. We formulate the optimal control problem as an infinite-dimensional convex optimization program. The finite-dimensional approximation of the optimization problem relies on the recent advances made in the Koopman operator's data-driven computation, which is dual to the Perron-Frobenius operator. Simulation results are presented to demonstrate the application of the developed framework. △ Less

Submitted 12 April, 2021; v1 submitted 4 October, 2020; originally announced October 2020.

A convex data-driven approach for nonlinear control synthesis

Authors: Hyung** Choi, Umesh Vaidya, Yongxin Chen

Abstract: We consider a class of nonlinear control synthesis problems where the underlying mathematical models are not explicitly known. We propose a data-driven approach to stabilize the systems when only sample trajectories of the dynamics are accessible. Our method is founded on the density function based almost everywhere stability certificate that is dual to the Lyapunov function for dynamic systems. U… ▽ More We consider a class of nonlinear control synthesis problems where the underlying mathematical models are not explicitly known. We propose a data-driven approach to stabilize the systems when only sample trajectories of the dynamics are accessible. Our method is founded on the density function based almost everywhere stability certificate that is dual to the Lyapunov function for dynamic systems. Unlike Lyapunov based methods, density functions lead to a convex formulation for a joint search of the control strategy and the stability certificate. This type of convex problem can be solved efficiently by invoking the machinery of the sum of squares (SOS). For the data-driven part, we exploit the fact that the duality results in the stability theory of the dynamical system can be understood using linear Perron-Frobenius and Koopman operators. This connection allows us to use data-driven methods developed to approximate these operators combined with the SOS techniques for the convex formulation of control synthesis. The efficacy of the proposed approach is demonstrated through several examples. △ Less

Submitted 27 June, 2020; originally announced June 2020.

Comments: 6 pages, 5 figures

MSC Class: 93C10; 12D15; 93D20; 93B30; 47J10

Data-Driven Approach for Uncertainty Propagation and Reachability Analysis in Dynamical Systems

Authors: Amarsagar Reddy Ramapuram Matavalam, Umesh Vaidya, Venkataramana Ajjarapu

Abstract: In this paper, we propose a data-driven approach for uncertainty propagation and reachability analysis in a dynamical system. The proposed approach relies on the linear lifting of a nonlinear system using linear Perron-Frobenius (P-F) and Koopman operators. The uncertainty can be characterized in terms of the moments of a probability density function. We demonstrate how the P-F and Koopman operato… ▽ More In this paper, we propose a data-driven approach for uncertainty propagation and reachability analysis in a dynamical system. The proposed approach relies on the linear lifting of a nonlinear system using linear Perron-Frobenius (P-F) and Koopman operators. The uncertainty can be characterized in terms of the moments of a probability density function. We demonstrate how the P-F and Koopman operators are used for propagating the moments. Time-series data is used for the finite-dimensional approximation of the linear operators, thereby enabling data-driven approach for moment propagation. Simulation results are presented to demonstrate the effectiveness of the proposed method. △ Less

Submitted 21 January, 2020; originally announced January 2020.

Comments: Accepted in the 2020 American Control Conference, to be held in Denver, CO, USA on July 1-3, 2020

Information Based Data-Driven Characterization of Stability and Influence in Power Systems

Authors: Subhrajit Sinha, Pranav Sharma, Venkataramana Ajjarapu, Umesh Vaidya

Abstract: Stability analysis of a power network and its characterization (voltage or angle) is an important problem in the power system community. However, these problems are mostly studied using linearized models and participation factor analysis. In this paper, we provide a purely data-driven technique for small-signal stability classification (voltage or angle stability) and influence characterization fo… ▽ More Stability analysis of a power network and its characterization (voltage or angle) is an important problem in the power system community. However, these problems are mostly studied using linearized models and participation factor analysis. In this paper, we provide a purely data-driven technique for small-signal stability classification (voltage or angle stability) and influence characterization for a power network. In particular, we use Koopman operator framework for data-driven discovery of the underlying power system dynamics and then leverage the newly developed concept of information transfer for discovering the causal structure. We further use it to not only identify the influential states (subspaces) in a power network, but also to clearly characterize and classify angle and voltage instabilities. We demonstrate the efficacy of the proposed framework on two different systems, namely the 3-bus system, where we reproduce the already known results regarding the types of instabilities, and the IEEE 9-bus system where we identify the influential generators and also the generator (and its states) which contribute to the system instability, thus identifying the type of instability. △ Less

Submitted 13 October, 2021; v1 submitted 24 October, 2019; originally announced October 2019.

Information Transfer in Dynamical Systems and Optimal Placement of Actuators and Sensors for Control of Non-equilibrium Dynamics

Authors: Subhrajit Sinha, Umesh Vaidya, Enoch Yeung

Abstract: In this paper we develop the concept of information transfer between the Borel-measurable sets for a dynamical system described by a measurable space and a non-singular transformation. The concept is based on how Shannon entropy is transferred between the measurable sets, as the dynamical system evolves. We show that the proposed definition of information transfer satisfies the usual notions of in… ▽ More In this paper we develop the concept of information transfer between the Borel-measurable sets for a dynamical system described by a measurable space and a non-singular transformation. The concept is based on how Shannon entropy is transferred between the measurable sets, as the dynamical system evolves. We show that the proposed definition of information transfer satisfies the usual notions of information transfer and causality, namely, zero transfer and transfer asymmetry. Furthermore, we show how the information transfer measure can be used to classify ergodicity and mixing. We also develop the computational methods for information transfer computation and apply the framework for optimal placements of actuators and sensors for control of non-equilibrium dynamics. △ Less

Submitted 29 September, 2019; originally announced September 2019.

Data-driven Identification and Prediction of Power System Dynamics Using Linear Operators

Authors: Pranav Sharma, Bowen Huang, Umesh Vaidya, Venkatramana Ajjarapu

Abstract: In this paper, we propose linear operator theoretic framework involving Koopman operator for the data-driven identification of power system dynamics. We explicitly account for noise in the time series measurement data and propose robust approach for data-driven approximation of Koopman operator for the identification of nonlinear power system dynamics. The identified model is used for the predicti… ▽ More In this paper, we propose linear operator theoretic framework involving Koopman operator for the data-driven identification of power system dynamics. We explicitly account for noise in the time series measurement data and propose robust approach for data-driven approximation of Koopman operator for the identification of nonlinear power system dynamics. The identified model is used for the prediction of state trajectories in the power system. The application of the framework is illustrated using an IEEE nine bus test system. △ Less

Submitted 15 March, 2019; originally announced March 2019.

Comments: Accepted for publication in IEEE Power and Energy System General Meeting 2019

A Transfer Operator Methodology for Optimal Sensor Placement Accounting for Uncertainty

Authors: Himanshu Sharma, Umesh Vaidya, Baskar Ganapathysubramanian

Abstract: Sensors in buildings are used for a wide variety of applications such as monitoring air quality, contaminants, indoor temperature, and relative humidity. These are used for accessing and ensuring indoor air quality, and also for ensuring safety in the event of chemical and biological attacks. It follows that optimal placement of sensors become important to accurately monitor contaminant levels in… ▽ More Sensors in buildings are used for a wide variety of applications such as monitoring air quality, contaminants, indoor temperature, and relative humidity. These are used for accessing and ensuring indoor air quality, and also for ensuring safety in the event of chemical and biological attacks. It follows that optimal placement of sensors become important to accurately monitor contaminant levels in the indoor environment. However, contaminant transport inside the indoor environment is governed by the indoor flow conditions which are affected by various uncertainties associated with the building systems including occupancy and boundary fluxes. Therefore, it is important to account for all associated uncertainties while designing the sensor layout. The transfer operator based framework provides an effective way to identify optimal placement of sensors. Previous work has been limited to sensor placements under deterministic scenarios. In this work we extend the transfer operator based approach for optimal sensor placement while accounting for building systems uncertainties. The methodology provides a probabilistic metric to gauge coverage under uncertain conditions. We illustrate the capabilities of the framework with examples exhibiting boundary flux uncertainty. △ Less

Submitted 26 December, 2018; originally announced December 2018.

Journal ref: Building and Environment, 155,2019,334--349

On Information Transfer Based Characterization of Power System Stability

Authors: Subhrajit Sinha, Pranav Sharma, Umesh Vaidya, Venkataramana Ajjarapu

Abstract: In this paper, we present a novel approach to identify the generators and states responsible for the small-signal stability of power networks. To this end, the newly developed notion of information transfer between the states of a dynamical system is used. In particular, using the concept of information transfer, which characterizes influence between the various states and a linear combination of… ▽ More In this paper, we present a novel approach to identify the generators and states responsible for the small-signal stability of power networks. To this end, the newly developed notion of information transfer between the states of a dynamical system is used. In particular, using the concept of information transfer, which characterizes influence between the various states and a linear combination of states of a dynamical system, we identify the generators and states which are responsible for causing instability of the power network. While characterizing influence from state to state, information transfer can also describe influence from state to modes thereby generalizing the well-known notion of participation factor while at the same time overcoming some of the limitations of the participation factor. The developed framework is applied to study the three bus system identifying various cause of instabilities in the system. The simulation study is extended to IEEE 39 bus system. △ Less

Submitted 18 September, 2018; originally announced September 2018.

Transfer Operator Theoretic Framework for Monitoring Building Indoor Environment in Uncertain Operating Conditions

Authors: Himanshu Sharma, Anthony D. Fontanini, Umesh Vaidya, Baskar Ganapathysubramanian

Abstract: Dynamical system-based linear transfer Perron- Frobenius (P-F) operator framework is developed to address analysis and design problems in the building system. In particular, the problems of fast contaminant propagation and optimal placement of sensors in uncertain operating conditions of indoor building environment are addressed. The linear nature of transfer P-F operator is exploited to develop a… ▽ More Dynamical system-based linear transfer Perron- Frobenius (P-F) operator framework is developed to address analysis and design problems in the building system. In particular, the problems of fast contaminant propagation and optimal placement of sensors in uncertain operating conditions of indoor building environment are addressed. The linear nature of transfer P-F operator is exploited to develop a computationally efficient numerical scheme based on the finite dimensional approximation of P-F operator for fast propagation of contaminants. The proposed scheme is an order of magnitude faster than existing methods that rely on simulation of an advection-diffusion partial differential equation for contami- nant transport. Furthermore, the system-theoretic notion of observability gramian is generalized to nonlinear flow fields using the transfer P-F operator. This developed notion of observability gramian for nonlinear flow field combined with the finite dimensional approximation of P-F operator is used to provide a systematic procedure for optimal placement of sensors under uncertain operating conditions. Simulation results are presented to demonstrate the applicability of the developed framework on the IEA-annex 2D benchmark problem. △ Less

Submitted 12 July, 2018; originally announced July 2018.

Data-Driven Optimal Control Using Perron-Frobenius Operator

Authors: Apurba Kumar Das, Bowen Huang, Umesh Vaidya

Abstract: In this paper, we propose a data-driven approach for control of nonlinear dynamical systems. The proposed data-driven approach relies on transfer Koopman and Perron-Frobenius (P-F) operators for linear representation and control of such systems. Systematic model-based frameworks involving linear transfer P-F operator were proposed for almost everywhere stability analysis and control design of a no… ▽ More In this paper, we propose a data-driven approach for control of nonlinear dynamical systems. The proposed data-driven approach relies on transfer Koopman and Perron-Frobenius (P-F) operators for linear representation and control of such systems. Systematic model-based frameworks involving linear transfer P-F operator were proposed for almost everywhere stability analysis and control design of a nonlinear dynamical system in previous works [1-3]. Lyapunov measure can be used as a tool to provide linear programming-based computational framework for stability analysis and almost everywhere stabilizing control design of a nonlinear system. In this paper, we show that those frameworks can be extended to a data-driven setting, where the finite dimensional approximation of linear transfer P-F operator and stabilizing feedback controller can be obtained from time-series data. We exploit the positivity and Markov property of these operators and their finite-dimensional approximation to provide {\it linear programming} based approach for designing an optimally stabilizing feedback controller. △ Less

Submitted 10 June, 2018; originally announced June 2018.

Comments: arXiv admin note: text overlap with arXiv:1408.6917

Transfer Operator Based Approach for Optimal Stabilization of Stochastic System

Authors: Apurba Kumar Das, Arvind Raghunathan, Umesh Vaidya

Abstract: In this paper we develop linear transfer Perron Frobenius operator-based approach for optimal stabilization of stochastic nonlinear system. One of the main highlight of the proposed transfer operator based approach is that both the theory and computational framework developed for the optimal stabilization of deterministic dynamical system in [1] carries over to the stochastic case with little chan… ▽ More In this paper we develop linear transfer Perron Frobenius operator-based approach for optimal stabilization of stochastic nonlinear system. One of the main highlight of the proposed transfer operator based approach is that both the theory and computational framework developed for the optimal stabilization of deterministic dynamical system in [1] carries over to the stochastic case with little change. The optimal stabilization problem is formulated as an infinite dimensional linear program. Set oriented numerical methods are proposed for the finite dimensional approximation of the transfer operator and the controller. Simulation results are presented to verify the developed framework. △ Less

Submitted 14 February, 2017; v1 submitted 11 February, 2017; originally announced February 2017.

Comments: arXiv admin note: substantial text overlap with arXiv:1408.6917

Fragility of Decentralized Load-Side Frequency Control in Stochastic Environment

Authors: Sai Pushpak, Umesh Vaidya

Abstract: In this paper, we demonstrate the fragility of decentralized load-side frequency algorithms proposed in [1] against stochastic parametric uncertainty in power network model. The stochastic parametric uncertainty is motivated through the presence of renewable energy resources in power system model. We show that relatively small variance value of the parametric uncertainty affecting the system bus v… ▽ More In this paper, we demonstrate the fragility of decentralized load-side frequency algorithms proposed in [1] against stochastic parametric uncertainty in power network model. The stochastic parametric uncertainty is motivated through the presence of renewable energy resources in power system model. We show that relatively small variance value of the parametric uncertainty affecting the system bus voltages cause the decentralized load-side frequency regulation algorithm to become stochastically unstable. The critical variance value of the stochastic bus voltages above which the decentralized control algorithm become mean square unstable is computed using an analytical framework developed in [2], [3]. Furthermore, the critical variance value is shown to decrease with the increase in the cost of the controllable loads and with the increase in penetration of renewable energy resources. Finally, simulation results on IEEE 68 bus system are presented to verify the main findings of the paper. △ Less

Submitted 11 February, 2017; originally announced February 2017.

Mean Square Stability Analysis of Stochastic Continuous-time Linear Networked Systems

Authors: Sai Pushpak, Amit Diwadkar, Umesh Vaidya

Abstract: In this technical note, we study the mean square stability-based analysis of stochastic continuous-time linear networked systems. The stochastic uncertainty is assumed to enter multiplicatively in system dynamics through input and output channels of the plant. Necessary and sufficient conditions for mean square exponential stability are expressed in terms of the input-output property of determinis… ▽ More In this technical note, we study the mean square stability-based analysis of stochastic continuous-time linear networked systems. The stochastic uncertainty is assumed to enter multiplicatively in system dynamics through input and output channels of the plant. Necessary and sufficient conditions for mean square exponential stability are expressed in terms of the input-output property of deterministic or nominal system dynamics captured by the {\it mean square} system norm and variance of channel uncertainty. The stability results can also be interpreted as a small gain theorem for continuous-time stochastic systems. Linear Matrix Inequalities (LMI)-based optimization formulation is provided for the computation of mean square system norm for stability analysis. For a special case of single input channel uncertainty, we also prove a fundamental limitation result that arises in the mean square exponential stabilization of the continuous-time linear system. Overall, the contributions in this work generalize the existing results on stability analysis from discrete-time linear systems to continuous-time linear systems with multiplicative uncertainty. Simulation results are presented for WSCC $9$ bus power system to demonstrate the application of the developed framework. △ Less

Submitted 7 February, 2018; v1 submitted 8 February, 2016; originally announced February 2016.

Stochastic Stability Analysis of Discrete Time System Using Lyapunov Measure

Authors: Umesh Vaidya

Abstract: In this paper, we study the stability problem of a stochastic, nonlinear, discrete-time system. We introduce a linear transfer operator-based Lyapunov measure as a new tool for stability verification of stochastic systems. Weaker set-theoretic notion of almost everywhere stochastic stability is introduced and verified, using Lyapunov measure-based stochastic stability theorems. Furthermore, connec… ▽ More In this paper, we study the stability problem of a stochastic, nonlinear, discrete-time system. We introduce a linear transfer operator-based Lyapunov measure as a new tool for stability verification of stochastic systems. Weaker set-theoretic notion of almost everywhere stochastic stability is introduced and verified, using Lyapunov measure-based stochastic stability theorems. Furthermore, connection between Lyapunov functions, a popular tool for stochastic stability verification, and Lyapunov measures is established. Using the duality property between the linear transfer Perron-Frobenius and Koopman operators, we show the Lyapunov measure and Lyapunov function used for the verification of stochastic stability are dual to each other. Set-oriented numerical methods are proposed for the finite dimensional approximation of the Perron-Frobenius operator; hence, Lyapunov measure is proposed. Stability results in finite dimensional approximation space are also presented. Finite dimensional approximation is shown to introduce further weaker notion of stability referred to as coarse stochastic stability. The results in this paper extend our earlier work on the use of Lyapunov measures for almost everywhere stability verification of deterministic dynamical systems ("Lyapunov Measure for Almost Everywhere Stability", {\it IEEE Trans. on Automatic Control}, Vol. 53, No. 1, Feb. 2008). △ Less

Submitted 8 March, 2016; v1 submitted 15 March, 2015; originally announced March 2015.

Comments: Proceedings of American Control Conference, Chicago IL, 2015

Limitations and tradeoffs in synchronization of large-scale networks with uncertain links

Authors: Amit Diwadkar, Umesh Vaidya

Abstract: We study synchronization in scalar nonlinear systems connected over a linear network with stochastic uncertainty in their interactions. We provide a sufficient condition for the synchronization of such network systems expressed in terms of the parameters of the nonlinear scalar dynamics, the second and largest eigenvalues of the mean interconnection Laplacian, and the variance of the stochastic un… ▽ More We study synchronization in scalar nonlinear systems connected over a linear network with stochastic uncertainty in their interactions. We provide a sufficient condition for the synchronization of such network systems expressed in terms of the parameters of the nonlinear scalar dynamics, the second and largest eigenvalues of the mean interconnection Laplacian, and the variance of the stochastic uncertainty. The sufficient condition is independent of network size thereby making it attractive for verification of synchronization in a large size network. The main contribution of this paper is to provide analytical characterization for the interplay of roles played by the internal dynamics of the nonlinear system, network topology, and uncertainty statistics in network synchronization. We show there exist important tradeoffs between these various network parameters necessary to achieve synchronization. We show for nearest neighbor networks with stochastic uncertainty in interactions there exists an optimal number of neighbors with maximum margin for synchronization. This proves in the presence of interaction uncertainty, too many connections among network components is just as harmful for synchronization as the lack of connection. We provide an analytical formula for the optimal gain required to achieve maximum synchronization margin thereby allowing us to compare various complex network topology for their synchronization property. △ Less

Submitted 21 May, 2015; v1 submitted 10 September, 2014; originally announced September 2014.

Optimal Stabilization using Lyapunov Measures

Authors: Arvind Raghunathan, Umesh Vaidya

Abstract: Numerical solutions for the optimal feedback stabilization of discrete time dynamical systems is the focus of this paper. Set-theoretic notion of almost everywhere stability introduced by the Lyapunov measure, weaker than conventional Lyapunov function-based stabilization methods, is used for optimal stabilization. The linear Perron-Frobenius transfer operator is used to pose the optimal stabiliza… ▽ More Numerical solutions for the optimal feedback stabilization of discrete time dynamical systems is the focus of this paper. Set-theoretic notion of almost everywhere stability introduced by the Lyapunov measure, weaker than conventional Lyapunov function-based stabilization methods, is used for optimal stabilization. The linear Perron-Frobenius transfer operator is used to pose the optimal stabilization problem as an infinite dimensional linear program. Set-oriented numerical methods are used to obtain the finite dimensional approximation of the linear program. We provide conditions for the existence of stabilizing feedback controls and show the optimal stabilizing feedback control can be obtained as a solution of a finite dimensional linear program. The approach is demonstrated on stabilization of period two orbit in a controlled standard map. △ Less

Submitted 28 August, 2014; originally announced August 2014.

Journal ref: IEEE Transactions on Automatic Control, Vol 59, No. 5, pg. 1316-1321, 2014

Control of systems in Lure form over erasure channel

Authors: Amit Diwadkar, Sambarta Dasgupta, Umesh Vaidya

Abstract: In this paper, we study the problem of control of discrete-time nonlinear systems in Lure form over erasure channels at the input and output. The input and output channel uncertainties are modeled as Bernoulli random variables. The main results of this paper provide sufficient condition for the mean square exponential stability of the closed loop system expressed in terms of statistics of channel… ▽ More In this paper, we study the problem of control of discrete-time nonlinear systems in Lure form over erasure channels at the input and output. The input and output channel uncertainties are modeled as Bernoulli random variables. The main results of this paper provide sufficient condition for the mean square exponential stability of the closed loop system expressed in terms of statistics of channel uncertainty and plant characteristics. We also provide synthesis method for the design of observer-based controller that is robust to channel uncertainty. To prove the main results of this paper, we discover a stochastic variant of the well known Positive Real Lemma and principle of separation for stochastic nonlinear system. Application of the results for the stabilization of system in Lure form over packet-drop network is discussed. Finally a result for state feedback control of a Lure system with a general multiplicative uncertainty at actuation is discussed. △ Less

Submitted 28 August, 2014; originally announced August 2014.

Limitations for nonlinear observation over erasure channel

Authors: Amit Diwadkar, Umesh Vaidya

Abstract: In this paper, we study the problem of state observation of nonlinear systems over an erasure channel. The notion of mean square exponential stability is used to analyze the stability property of observer error dynamics. The main results of this paper prove, fundamental limitation arises for mean square exponential stabilization of the observer error dynamics, expressed in terms of probability of… ▽ More In this paper, we study the problem of state observation of nonlinear systems over an erasure channel. The notion of mean square exponential stability is used to analyze the stability property of observer error dynamics. The main results of this paper prove, fundamental limitation arises for mean square exponential stabilization of the observer error dynamics, expressed in terms of probability of erasure, and positive Lyapunov exponents of the system. Positive Lyapunov exponents are a measure of average expansion of nearby trajectories on an attractor set for nonlinear systems. Hence, the dependence of limitation results on the Lyapunov exponents highlights the important role played by non-equilibrium dynamics in observation over an erasure channel. The limitation on observation is also related to measure-theoretic entropy of the system, which is another measure of dynamical complexity. The limitation result for the observation of linear systems is obtained as a special case, where Lyapunov exponents are shown to emerge as the natural generalization of eigenvalues from linear systems to nonlinear systems. △ Less

Submitted 28 August, 2014; originally announced August 2014.

Journal ref: IEEE Transactions on Automatic Control, Vol. 58, Issue 6, Pages 454-459, 2013