-
Online Optimization and Learning in Uncertain Dynamical Environments with Performance Guarantees
Authors:
Dan Li,
Dariush Fooladivanda,
Sonia Martinez
Abstract:
We propose a new framework to solve online optimization and learning problems in unknown and uncertain dynamical environments. This framework enables us to simultaneously learn the uncertain dynamical environment while making online decisions in a quantifiably robust manner. The main technical approach relies on the theory of distributional robust optimization that leverages adaptive probabilistic…
▽ More
We propose a new framework to solve online optimization and learning problems in unknown and uncertain dynamical environments. This framework enables us to simultaneously learn the uncertain dynamical environment while making online decisions in a quantifiably robust manner. The main technical approach relies on the theory of distributional robust optimization that leverages adaptive probabilistic ambiguity sets. However, as defined, the ambiguity set usually leads to online intractable problems, and the first part of our work is directed to find reformulations in the form of online convex problems for two sub-classes of objective functions. To solve the resulting problems in the proposed framework, we further introduce an online version of the Nesterov accelerated-gradient algorithm. We determine how the proposed solution system achieves a probabilistic regret bound under certain conditions. Two applications illustrate the applicability of the proposed framework.
△ Less
Submitted 17 February, 2021;
originally announced February 2021.
-
Online Learning of Parameterized Uncertain Dynamical Environments with Finite-sample Guarantees
Authors:
Dan Li,
Dariush Fooladivanda,
Sonia Martinez
Abstract:
We present a novel online learning algorithm for a class of unknown and uncertain dynamical environments that are fully observable. First, we obtain a novel probabilistic characterization of systems whose mean behavior is known but which are subject to additive, unknown subGaussian disturbances. This characterization relies on recent concentration of measure results and is given in terms of ambigu…
▽ More
We present a novel online learning algorithm for a class of unknown and uncertain dynamical environments that are fully observable. First, we obtain a novel probabilistic characterization of systems whose mean behavior is known but which are subject to additive, unknown subGaussian disturbances. This characterization relies on recent concentration of measure results and is given in terms of ambiguity sets. Second, we extend the results to environments whose mean behavior is also unknown but described by a parameterized class of possible mean behaviors. Our algorithm adapts the ambiguity set dynamically by learning the parametric dependence online, and retaining similar probabilistic guarantees with respect to the additive, unknown disturbance. We illustrate the results on a differential-drive robot subject to environmental uncertainty.
△ Less
Submitted 4 September, 2020;
originally announced September 2020.
-
Data-driven Predictive Control for a Class of Uncertain Control-Affine Systems
Authors:
Dan Li,
Dariush Fooladivanda,
Sonia Martinez
Abstract:
This paper studies a data-driven predictive control for a class of control-affine systems which is subject to uncertainty. With the accessibility to finite sample measurements of the uncertain variables, we aim to find controls which are feasible and provide superior performance guarantees with high probability. This results into the formulation of a stochastic optimization problem (P), which is i…
▽ More
This paper studies a data-driven predictive control for a class of control-affine systems which is subject to uncertainty. With the accessibility to finite sample measurements of the uncertain variables, we aim to find controls which are feasible and provide superior performance guarantees with high probability. This results into the formulation of a stochastic optimization problem (P), which is intractable due to the unknown distribution of the uncertainty variables. By develo** a distributionally robust optimization framework, we present an equivalent and yet tractable reformulation of (P). Further, we propose an efficient algorithm that provides online suboptimal data-driven solutions and guarantees performance with high probability. To illustrate the effectiveness of the proposed approach, we consider a highway speed-limit control problem. We then develop a set of data-driven speed controls that allow us to prevent traffic congestion with high probability. Finally, we employ the resulting control method on a traffic simulator to illustrate the effectiveness of this approach numerically.
△ Less
Submitted 29 April, 2021; v1 submitted 22 November, 2019;
originally announced November 2019.
-
Secure State Estimation and Control for Cyber Security of AC Microgrids
Authors:
Dariush Fooladivanda,
Qie Hu,
Young Hwan Chang,
Peter Sauer
Abstract:
A timely, accurate, and secure dynamic state estimation is needed for reliable monitoring and efficient control of microgrids. The synchrophasor technology enables us to obtain synchronized measurements in real-time and to develop dynamic state estimators for real-time monitoring and control of microgrids. In this study, we consider an AC microgrid comprising several synchronous generators and inv…
▽ More
A timely, accurate, and secure dynamic state estimation is needed for reliable monitoring and efficient control of microgrids. The synchrophasor technology enables us to obtain synchronized measurements in real-time and to develop dynamic state estimators for real-time monitoring and control of microgrids. In this study, we consider an AC microgrid comprising several synchronous generators and inverter-interface power supplies, and focus on securely estimating the dynamic states of the microgrid from a set of corrupted data. We propose a dynamic state estimator which enables the microgrid operator to reconstruct the dynamic states of the microgrid from a set of corrupted data. Finally, we consider an AC microgrid with the same topology as the IEEE 33-bus distribution system, and numerically show that the proposed secure estimation algorithm can accurately reconstruct the attack signals.
△ Less
Submitted 16 August, 2019;
originally announced August 2019.
-
Data-driven Variable Speed Limit Design for Highways via Distributionally Robust Optimization
Authors:
Dan Li,
Dariush Fooladivanda,
Sonia Martinez
Abstract:
This paper introduces an optimization problem (P) and a solution strategy to design variable-speed-limit controls for a highway that is subject to traffic congestion and uncertain vehicle arrival and departure. By employing a finite data-set of samples of the uncertain variables, we aim to find a data-driven solution that has a guaranteed out-of-sample performance. In principle, such formulation l…
▽ More
This paper introduces an optimization problem (P) and a solution strategy to design variable-speed-limit controls for a highway that is subject to traffic congestion and uncertain vehicle arrival and departure. By employing a finite data-set of samples of the uncertain variables, we aim to find a data-driven solution that has a guaranteed out-of-sample performance. In principle, such formulation leads to an intractable problem (P) as the distribution of the uncertainty variable is unknown. By adopting a distributionally robust optimization approach, this work presents a tractable reformulation of (P) and an efficient algorithm that provides a suboptimal solution that retains the out-of-sample performance guarantee. A simulation illustrates the effectiveness of this method.
△ Less
Submitted 26 October, 2018;
originally announced October 2018.
-
Utilization of Water Supply Networks for Harvesting Renewable Energy
Authors:
Dariush Fooladivanda,
Alejandro D. Domínguez-García,
Peter W. Sauer
Abstract:
Renewable surplus power is increasing due to the increasing penetration of these intermittent resources. In practice, electric grid operators either curtail the surplus energy resulting from renewable-based generations or utilize energy storage resources to absorb it. In this paper, we propose a framework for utilizing water pumps and tanks in water supply networks to absorb the surplus electrical…
▽ More
Renewable surplus power is increasing due to the increasing penetration of these intermittent resources. In practice, electric grid operators either curtail the surplus energy resulting from renewable-based generations or utilize energy storage resources to absorb it. In this paper, we propose a framework for utilizing water pumps and tanks in water supply networks to absorb the surplus electrical energy resulting from renewable-based electricity generation resources in the electrical grid. We model water supply networks analytically, and propose a two-step procedure that utilizes the water tanks in the water supply network to harvest the surplus energy from an electrical grid. In each step, the water network operator needs to solve an optimization problem that is non-convex. To compute optimal pump schedules and water flows, we develop a second-order cone relaxation and an approximation technique that enable us to transform the proposed problems into mixed-integer second-order cone programs. We then provide the conditions under which the proposed relaxation is exact, and present an algorithm for constructing an exact solution to the original problem from a solution to the relaxed problem. We demonstrate the effectiveness of the proposed framework via numerical simulations.
△ Less
Submitted 15 August, 2018;
originally announced August 2018.
-
Secure State Estimation for Nonlinear Power Systems under Cyber Attacks
Authors:
Qie Hu,
Dariush Fooladivanda,
Young Hwan Chang,
Claire J. Tomlin
Abstract:
This paper focuses on securely estimating the state of a nonlinear dynamical system from a set of corrupted measurements. In particular, we consider two broad classes of nonlinear systems, and propose a technique which enables us to perform secure state estimation for such nonlinear systems. We then provide guarantees on the achievable state estimation error against arbitrary corruptions, and anal…
▽ More
This paper focuses on securely estimating the state of a nonlinear dynamical system from a set of corrupted measurements. In particular, we consider two broad classes of nonlinear systems, and propose a technique which enables us to perform secure state estimation for such nonlinear systems. We then provide guarantees on the achievable state estimation error against arbitrary corruptions, and analytically characterize the number of errors that can be perfectly corrected by a decoder. To illustrate how the proposed nonlinear estimation approach can be applied to practical systems, we focus on secure estimation for the wide area control of an interconnected power system under cyber-physical attacks and communication failures, and propose a secure estimator for the power system. Finally, we numerically show that the proposed secure estimation algorithm enables us to reconstruct the attack signals accurately.
△ Less
Submitted 22 March, 2016;
originally announced March 2016.
-
State of Charge Evolution Equations for Flywheels
Authors:
D. Fooladivanda,
G. Mancini,
S. Garg,
C. Rosenberg
Abstract:
A mathematical state-of-charge evolution equation is present for Flywheel Energy Storage Systems.
A mathematical state-of-charge evolution equation is present for Flywheel Energy Storage Systems.
△ Less
Submitted 6 November, 2014;
originally announced November 2014.
