-
Data-Driven Strategy Synthesis for Stochastic Systems with Unknown Nonlinear Disturbances
Authors:
Ibon Gracia,
Dimitris Boskos,
Luca Laurenti,
Morteza Lahijanian
Abstract:
In this paper, we introduce a data-driven framework for synthesis of provably-correct controllers for general nonlinear switched systems under complex specifications. The focus is on systems with unknown disturbances whose effects on the dynamics of the system is nonlinear. The specifications are assumed to be given as linear temporal logic over finite traces (LTLf) formulas. Starting from observa…
▽ More
In this paper, we introduce a data-driven framework for synthesis of provably-correct controllers for general nonlinear switched systems under complex specifications. The focus is on systems with unknown disturbances whose effects on the dynamics of the system is nonlinear. The specifications are assumed to be given as linear temporal logic over finite traces (LTLf) formulas. Starting from observations of either the disturbance or the state of the system, we first learn an ambiguity set that contains the unknown distribution of the disturbances with a user-defined confidence. Next, we construct a robust Markov decision process (RMDP) as a finite abstraction of the system. By composing the RMDP with the automaton obtained from the LTLf formula and performing optimal robust value iteration on the composed RMDP, we synthesize a strategy that yields a high probability that the uncertain system satisfies the specifications. Our empirical evaluations on systems with a wide variety of disturbances show that the strategies synthesized with our approach lead to high satisfaction probabilities and validate the theoretical guarantees.
△ Less
Submitted 14 June, 2024;
originally announced June 2024.
-
Entanglement Definitions for Tethered Robots: Exploration and Analysis
Authors:
Gianpietro Battocletti,
Dimitris Boskos,
Domagoj Tolić,
Ivana Palunko,
Bart De Schutter
Abstract:
In this article we consider the problem of tether entanglement for tethered robots. In many applications, such as maintenance of underwater structures, aerial inspection, and underground exploration, tethered robots are often used in place of standalone (i.e., untethered) ones. However, the presence of a tether also introduces the risk for it to get entangled with obstacles present in the environm…
▽ More
In this article we consider the problem of tether entanglement for tethered robots. In many applications, such as maintenance of underwater structures, aerial inspection, and underground exploration, tethered robots are often used in place of standalone (i.e., untethered) ones. However, the presence of a tether also introduces the risk for it to get entangled with obstacles present in the environment or with itself. To avoid these situations, a non-entanglement constraint can be considered in the motion planning problem for tethered robots. This constraint can be expressed either as a set of specific tether configurations that must be avoided, or as a quantitative measure of a `level of entanglement' that can be minimized. However, the literature lacks a generally accepted definition of entanglement, with existing definitions being limited and partial. Namely, the existing entanglement definitions either require a taut tether to come into contact with an obstacle or with another tether, or they require for the tether to do a full loop around an obstacle. In practice, this means that the existing definitions do not effectively cover all instances of tether entanglement. Our goal in this article is to bridge this gap and provide new definitions of entanglement, which, together with the existing ones, can be effectively used to qualify the entanglement state of a tethered robot in diverse situations. The new definitions find application mainly in motion planning for tethered robot systems, where they can be used to obtain more safe and robust entanglement-free trajectories. The present article focuses exclusively on the presentation and analysis of the entanglement definitions. The application of the definitions to the motion planning problem is left for future work.
△ Less
Submitted 7 February, 2024;
originally announced February 2024.
-
Structured ambiguity sets for distributionally robust optimization
Authors:
Lotfi M. Chaouach,
Tom Oomen,
Dimitris Boskos
Abstract:
Distributionally robust optimization (DRO) incorporates robustness against uncertainty in the specification of probabilistic models. This paper focuses on mitigating the curse of dimensionality in data-driven DRO problems with optimal transport ambiguity sets. By exploiting independence across lower-dimensional components of the uncertainty, we construct structured ambiguity sets that exhibit a fa…
▽ More
Distributionally robust optimization (DRO) incorporates robustness against uncertainty in the specification of probabilistic models. This paper focuses on mitigating the curse of dimensionality in data-driven DRO problems with optimal transport ambiguity sets. By exploiting independence across lower-dimensional components of the uncertainty, we construct structured ambiguity sets that exhibit a faster shrinkage as the number of collected samples increases. This narrows down the plausible models of the data-generating distribution and mitigates the conservativeness that the decisions of DRO problems over such ambiguity sets may face. We establish statistical guarantees for these structured ambiguity sets and provide dual reformulations of their associated DRO problems for a wide range of objective functions. The benefits of the approach are demonstrated in a numerical example.
△ Less
Submitted 31 October, 2023;
originally announced October 2023.
-
Efficient Strategy Synthesis for Switched Stochastic Systems with Distributional Uncertainty
Authors:
Ibon Gracia,
Dimitris Boskos,
Morteza Lahijanian,
Luca Laurenti,
Manuel Mazo Jr
Abstract:
We introduce a framework for the control of discrete-time switched stochastic systems with uncertain distributions. In particular, we consider stochastic dynamics with additive noise whose distribution lies in an ambiguity set of distributions that are $\varepsilon-$close, in the Wasserstein distance sense, to a nominal one. We propose algorithms for the efficient synthesis of distributionally rob…
▽ More
We introduce a framework for the control of discrete-time switched stochastic systems with uncertain distributions. In particular, we consider stochastic dynamics with additive noise whose distribution lies in an ambiguity set of distributions that are $\varepsilon-$close, in the Wasserstein distance sense, to a nominal one. We propose algorithms for the efficient synthesis of distributionally robust control strategies that maximize the satisfaction probability of reach-avoid specifications with either a given or an arbitrary (not specified) time horizon, i.e., unbounded-time reachability. The framework consists of two main steps: finite abstraction and control synthesis. First, we construct a finite abstraction of the switched stochastic system as a \emph{robust Markov decision process} (robust MDP) that encompasses both the stochasticity of the system and the uncertainty in the noise distribution. Then, we synthesize a strategy that is robust to the distributional uncertainty on the resulting robust MDP. We employ techniques from optimal transport and stochastic programming to reduce the strategy synthesis problem to a set of linear programs, and propose a tailored and efficient algorithm to solve them. The resulting strategies are correctly refined into switching strategies for the original stochastic system. We illustrate the efficacy of our framework on various case studies comprising both linear and non-linear switched stochastic systems.
△ Less
Submitted 17 May, 2024; v1 submitted 29 December, 2022;
originally announced December 2022.
-
High-Confidence Data-Driven Ambiguity Sets for Time-Varying Linear Systems
Authors:
Dimitris Boskos,
Jorge Cortés,
Sonia Martínez
Abstract:
This paper builds Wasserstein ambiguity sets for the unknown probability distribution of dynamic random variables leveraging noisy partial-state observations. The constructed ambiguity sets contain the true distribution of the data with quantifiable probability and can be exploited to formulate robust stochastic optimization problems with out-of-sample guarantees. We assume the random variable evo…
▽ More
This paper builds Wasserstein ambiguity sets for the unknown probability distribution of dynamic random variables leveraging noisy partial-state observations. The constructed ambiguity sets contain the true distribution of the data with quantifiable probability and can be exploited to formulate robust stochastic optimization problems with out-of-sample guarantees. We assume the random variable evolves in discrete time under uncertain initial conditions and dynamics, and that noisy partial measurements are available. All random elements have unknown probability distributions and we make inferences about the distribution of the state vector using several output samples from multiple realizations of the process. To this end, we leverage an observer to estimate the state of each independent realization and exploit the outcome to construct the ambiguity sets. We illustrate our results in an economic dispatch problem involving distributed energy resources over which the scheduler has no direct control.
△ Less
Submitted 20 July, 2021; v1 submitted 1 February, 2021;
originally announced February 2021.
-
Finite Horizon Discrete Models for Multi-Agent Control Systems with Coupled Dynamics
Authors:
Dimitris Boskos,
Dimos V. Dimarogonas
Abstract:
The goal of this paper is to obtain online abstractions for coupled multi-agent systems in a decentralized manner. A discrete model which captures the motion capabilities of each agent is derived over a bounded time-horizon, by discretizing a corresponding overapproximation of the agent's reachable states. The individual abstractions' composition provides a correct representation of the coupled co…
▽ More
The goal of this paper is to obtain online abstractions for coupled multi-agent systems in a decentralized manner. A discrete model which captures the motion capabilities of each agent is derived over a bounded time-horizon, by discretizing a corresponding overapproximation of the agent's reachable states. The individual abstractions' composition provides a correct representation of the coupled continuous system over the horizon and renders the approach appropriate for control synthesis under high-level specifications which are assigned to the agents over this time window. Sufficient conditions are also provided for the space and time discretization to guarantee the derivation of deterministic abstractions with tunable transition capabilities.
△ Less
Submitted 20 November, 2020;
originally announced November 2020.
-
Dynamics of Data-driven Ambiguity Sets for Hyperbolic Conservation Laws with Uncertain Inputs
Authors:
Francesca Boso,
Dimitris Boskos,
Jorge Cortés,
Sonia Martínez,
Daniel M. Tartakovsky
Abstract:
Ambiguity sets of probability distributions are used to hedge against uncertainty about the true probabilities of random quantities of interest (QoIs). When available, these ambiguity sets are constructed from both data (collected at the initial time and along the boundaries of the physical domain) and concentration-of-measure results on the Wasserstein metric. To propagate the ambiguity sets into…
▽ More
Ambiguity sets of probability distributions are used to hedge against uncertainty about the true probabilities of random quantities of interest (QoIs). When available, these ambiguity sets are constructed from both data (collected at the initial time and along the boundaries of the physical domain) and concentration-of-measure results on the Wasserstein metric. To propagate the ambiguity sets into the future, we use a physics-dependent equation governing the evolution of cumulative distribution functions (CDF) obtained through the method of distributions. This study focuses on the latter step by investigating the spatio-temporal evolution of data-driven ambiguity sets and their associated guarantees when the random QoIs they describe obey hyperbolic partial-differential equations with random inputs. For general nonlinear hyperbolic equations with smooth solutions, the CDF equation is used to propagate the upper and lower envelopes of pointwise ambiguity bands. For linear dynamics, the CDF equation allows us to construct an evolution equation for tighter ambiguity balls. We demonstrate that, in both cases, the ambiguity sets are guaranteed to contain the true (unknown) distributions within a prescribed confidence.
△ Less
Submitted 14 March, 2020;
originally announced March 2020.
-
Data-driven ambiguity sets with probabilistic guarantees for dynamic processes
Authors:
Dimitris Boskos,
Jorge Cortés,
Sonia Martínez
Abstract:
Distributional ambiguity sets provide quantifiable ways to characterize the uncertainty about the true probability distribution of random variables of interest. This makes them a key element in data-driven robust optimization by exploiting high-confidence guarantees to hedge against uncertainty. This paper explores the construction of Wasserstein ambiguity sets in dynamic scenarios where data is c…
▽ More
Distributional ambiguity sets provide quantifiable ways to characterize the uncertainty about the true probability distribution of random variables of interest. This makes them a key element in data-driven robust optimization by exploiting high-confidence guarantees to hedge against uncertainty. This paper explores the construction of Wasserstein ambiguity sets in dynamic scenarios where data is collected progressively and may only reveal partial information about the unknown random variable. For random variables evolving according to known dynamics, we leverage assimilated samples to make inferences about their unknown distribution at the end of the sampling horizon. Under exact knowledge of the flow map, we provide sufficient conditions that relate the growth of the trajectories with the sampling rate to establish a reduction of the ambiguity set size as the horizon increases. Further, we characterize the exploitable sample history that results in a guaranteed reduction of ambiguity sets under errors in the computation of the flow and when the dynamics is subject to bounded unknown disturbances. Our treatment deals with both full- and partial-state measurements and, in the latter case, exploits the sampled-data observability properties of linear time-varying systems under irregular sampling. Simulations on a UAV detection application show the superior performance resulting from the proposed dynamic ambiguity sets.
△ Less
Submitted 24 September, 2019;
originally announced September 2019.
-
On the Timed Temporal Logic Planning of Coupled Multi-Agent Systems
Authors:
Alexandros Nikou,
Dimitris Boskos,
Jana Tumova,
Dimos V. Dimarogonas
Abstract:
This paper presents a fully automated procedure for controller synthesis for multi-agent systems under coupling constraints. Each agent is modeled with dynamics consisting of two terms: the first one models the coupling constraints and the other one is an additional bounded control input. We aim to design these inputs so that each agent meets an individual high-level specification given as a Metri…
▽ More
This paper presents a fully automated procedure for controller synthesis for multi-agent systems under coupling constraints. Each agent is modeled with dynamics consisting of two terms: the first one models the coupling constraints and the other one is an additional bounded control input. We aim to design these inputs so that each agent meets an individual high-level specification given as a Metric Interval Temporal Logic (MITL). First, a decentralized abstraction that provides a space and time discretization of the multi-agent system is designed. Second, by utilizing this abstraction and techniques from formal verification, we propose an algorithm that computes the individual runs which provably satisfy the high-level tasks. The overall approach is demonstrated in a simulation example conducted in MATLAB environment.
△ Less
Submitted 14 October, 2017; v1 submitted 19 September, 2017;
originally announced September 2017.
-
Observer design for triangular systems under weak observability assumptions
Authors:
Dionysis Theodosis,
Dimitris Boskos,
John Tsinias
Abstract:
This paper presents results on the solvability of the observer design problem for general nonlinear triangular systems with inputs, under weak observability assumptions. The local state estimation is exhibited by means of a delayed time-varying Luenberger-type system. In order to achieve the global estimation, a switching sequence of observers is designed.
This paper presents results on the solvability of the observer design problem for general nonlinear triangular systems with inputs, under weak observability assumptions. The local state estimation is exhibited by means of a delayed time-varying Luenberger-type system. In order to achieve the global estimation, a switching sequence of observers is designed.
△ Less
Submitted 2 December, 2016;
originally announced December 2016.
-
Online Abstractions for Interconnected Multi-Agent Control Systems
Authors:
Dimitris Boskos,
Dimos V. Dimarogonas
Abstract:
In this report, we aim at the development of an online abstraction framework for multi-agent systems under coupled constraints. The motion capabilities of each agent are abstracted through a finite state transition system in order to capture reachability properties of the coupled multi-agent system over a finite time horizon in a decentralized manner. In the first part of this work, we define onli…
▽ More
In this report, we aim at the development of an online abstraction framework for multi-agent systems under coupled constraints. The motion capabilities of each agent are abstracted through a finite state transition system in order to capture reachability properties of the coupled multi-agent system over a finite time horizon in a decentralized manner. In the first part of this work, we define online abstractions by discretizing an overapproximation of the agents' reachable sets over the horizon. Then, sufficient conditions relating the discretization and the agent's dynamics properties are provided, in order to quantify the transition possibilities of each agent.
△ Less
Submitted 9 November, 2016;
originally announced November 2016.
-
Cooperative Planning for Coupled Multi-Agent Systems under Timed Temporal Specifications
Authors:
Alexandros Nikou,
Dimitris Boskos,
Jana Tumova,
Dimos V. Dimarogonas
Abstract:
This paper presents a fully automated procedure for controller synthesis for multi-agent systems under coupled constraints. Each agent has dynamics consisting of two terms: the first one models the coupled constraints and the other one is an additional control input. We aim to design these inputs so that each agent meets an individual high-level specification given as a Metric Interval Temporal Lo…
▽ More
This paper presents a fully automated procedure for controller synthesis for multi-agent systems under coupled constraints. Each agent has dynamics consisting of two terms: the first one models the coupled constraints and the other one is an additional control input. We aim to design these inputs so that each agent meets an individual high-level specification given as a Metric Interval Temporal Logic (MITL). First, a decentralized abstraction that provides a time and space discretization of the multi-agent system is designed. Second, by utilizing this abstraction and techniques from formal veri- fication, we provide an algorithm that computes the individual runs which provably satisfy the high-level tasks. The overall approach is demonstrated in a simulation example.
△ Less
Submitted 18 September, 2016; v1 submitted 16 March, 2016;
originally announced March 2016.
-
Abstractions of Varying Decentralization Degree for Coupled Multi-Agent Systems
Authors:
D. Boskos,
D. V. Dimarogonas
Abstract:
In this report, we aim at the development of a decentralized abstraction framework for multi-agent systems under coupled constraints, with the possibility for a varying degree of decentralization. The methodology is based on the analysis employed in our recent work, where decentralized abstractions based exclusively on the information of each agent's neighbors were derived. In the first part of th…
▽ More
In this report, we aim at the development of a decentralized abstraction framework for multi-agent systems under coupled constraints, with the possibility for a varying degree of decentralization. The methodology is based on the analysis employed in our recent work, where decentralized abstractions based exclusively on the information of each agent's neighbors were derived. In the first part of this report, we define the notion each agent's m-neighbor set, which constitutes a measure for the employed degree of decentralization. Then, sufficient conditions are provided on the space and time discretization that provides the abstract system's model, which guarantee the extraction of a transition system with quantifiable transition possibilities.
△ Less
Submitted 8 October, 2016; v1 submitted 15 March, 2016;
originally announced March 2016.
-
A Common Framework for Attitude Synchronization of Unit Vectors in Networks with Switching Topology
Authors:
Pedro O. Pereira,
Dimitris Boskos,
Dimos V. Dimarogonas
Abstract:
In this paper, we study attitude synchronization for elements in the unit sphere of R3 and for elements in the 3D rotation group, for a network with switching topology. The agents angular velocities are assumed to be the control inputs, and a switching control law for each agent is devised that guarantees synchronization, provided that all elements are initially contained in a given region, unknow…
▽ More
In this paper, we study attitude synchronization for elements in the unit sphere of R3 and for elements in the 3D rotation group, for a network with switching topology. The agents angular velocities are assumed to be the control inputs, and a switching control law for each agent is devised that guarantees synchronization, provided that all elements are initially contained in a given region, unknown to the network. The control law is decentralized and it does not require a common orientation frame among all agents. We refer to synchronization of unit vectors in R3 as incomplete synchronization, and of 3D rotation matrices as complete synchronization. Our main contribution lies on showing that these two problems can be analyzed under a common framework, where all elements' dynamics are transformed into unit vectors dynamics on a sphere of appropriate dimension.
△ Less
Submitted 11 February, 2017; v1 submitted 28 September, 2015;
originally announced September 2015.
-
Decentralized Abstractions For Multi-Agent Systems Under Coupled Constraints
Authors:
Dimitris Boskos,
Dimos V. Dimarogonas
Abstract:
The goal of this report is to define abstractions for multi-agent systems with feedback interconnection in their dynamics. In the proposed decentralized framework, we specify a finite or countable transition system for each agent which only takes into account the discrete positions of its neighbors. The dynamics of the considered systems consist of two components. An appropriate feedback law which…
▽ More
The goal of this report is to define abstractions for multi-agent systems with feedback interconnection in their dynamics. In the proposed decentralized framework, we specify a finite or countable transition system for each agent which only takes into account the discrete positions of its neighbors. The dynamics of the considered systems consist of two components. An appropriate feedback law which guarantees that certain system and network requirements are fulfilled and induces coupled constraints, and additional free inputs which we exploit in order to accomplish high level tasks. In this work, we provide sufficient conditions on the space and time discretization for the abstraction of the system's behaviour which ensure that we can extract a well posed and hence meaningful transition system. Furthermore, these conditions include design parameters whose tuning provides the possibility for multiple transitions, and hence, enable the construction of transition systems with motion planning capabilities.
△ Less
Submitted 22 August, 2016; v1 submitted 17 June, 2015;
originally announced June 2015.
-
Robust Connectivity Analysis for Multi-Agent Systems
Authors:
Dimitris Boskos,
Dimos V. Dimarogonas
Abstract:
In this report we provide a decentralized robust control approach, which guarantees that connectivity of a multi-agent network is maintained when certain bounded input terms are added to the control strategy. Our main motivation for this framework is to determine abstractions for multi-agent systems under coupled constraints which are further exploited for high level plan generation.
In this report we provide a decentralized robust control approach, which guarantees that connectivity of a multi-agent network is maintained when certain bounded input terms are added to the control strategy. Our main motivation for this framework is to determine abstractions for multi-agent systems under coupled constraints which are further exploited for high level plan generation.
△ Less
Submitted 24 March, 2015;
originally announced March 2015.
-
Decentralized Abstractions for Feedback Interconnected Multi-Agent Systems
Authors:
Dimitris Boskos,
Dimos V. Dimarogonas
Abstract:
The purpose of this report is to define abstractions for multi-agent systems under coupled constraints. In the proposed decentralized framework, we specify a finite or countable transition system for each agent which only takes into account the discrete positions of its neighbors. The dynamics of the considered systems consist of two components. An appropriate feedback law which guarantees that ce…
▽ More
The purpose of this report is to define abstractions for multi-agent systems under coupled constraints. In the proposed decentralized framework, we specify a finite or countable transition system for each agent which only takes into account the discrete positions of its neighbors. The dynamics of the considered systems consist of two components. An appropriate feedback law which guarantees that certain performance requirements (eg. connectivity) are preserved and induces the coupled constraints and additional free inputs which we exploit in order to accomplish high level tasks. In this work we provide sufficient conditions on the space and time discretization of the system which ensure that we can extract a well posed and hence meaningful finite transition system.
△ Less
Submitted 27 February, 2015;
originally announced February 2015.
-
Observer Design for a General Class of Nonlinear Systems
Authors:
Dimitris Boskos,
John Tsinias
Abstract:
The paper deals with the observer design problem for a wide class of triangular nonlinear time-varying systems. The results of the present work generalize previous results in the literature dealing with the observer design problem for triangular systems and particularly, constitute generalizations of those obtained in a recent authors work concerning a class of triangular systems, whose dynamics h…
▽ More
The paper deals with the observer design problem for a wide class of triangular nonlinear time-varying systems. The results of the present work generalize previous results in the literature dealing with the observer design problem for triangular systems and particularly, constitute generalizations of those obtained in a recent authors work concerning a class of triangular systems, whose dynamics have p-normal form.
△ Less
Submitted 13 March, 2014;
originally announced March 2014.
-
Observer design for nonlinear triangular systems with unobservable linearization
Authors:
D. Boskos,
J. Tsinias
Abstract:
The paper deals with the observer design problem for a wide class of triangular time-varying nonlinear systems, with unobservable linearization. Sufficient conditions are derived for the existence of a Luenberger-type observer, when it is a priori known that the initial state of the system belongs to a given nonempty bounded subset of the state space. For the general case, the state estimation is…
▽ More
The paper deals with the observer design problem for a wide class of triangular time-varying nonlinear systems, with unobservable linearization. Sufficient conditions are derived for the existence of a Luenberger-type observer, when it is a priori known that the initial state of the system belongs to a given nonempty bounded subset of the state space. For the general case, the state estimation is exhibited by means of a switching sequence of time-varying dynamics
△ Less
Submitted 15 April, 2012;
originally announced April 2012.
-
Sufficient Conditions on the Existence of Switching Observers for Nonlinear Time-Varying Systems
Authors:
D. Boskos,
J. Tsinias
Abstract:
We derive sufficient conditions for the solvability of the observer design problem for a wide class of nonlinear time-varying systems, including those having triangular structure. We establish that, under weaker assumptions than those imposed in the existing works in the literature, it is possible to construct a switching sequence of time-varying noncausal dynamics, exhibiting the state determinat…
▽ More
We derive sufficient conditions for the solvability of the observer design problem for a wide class of nonlinear time-varying systems, including those having triangular structure. We establish that, under weaker assumptions than those imposed in the existing works in the literature, it is possible to construct a switching sequence of time-varying noncausal dynamics, exhibiting the state determination of our system.
△ Less
Submitted 2 November, 2011;
originally announced November 2011.
