-
Barrier States Theory for Safety-Critical Multi-Objective Control
Authors:
Hassan Almubarak,
Nader Sadegh,
Evangelos A. Theodorou
Abstract:
Multi-objective safety-critical control entails a diligent design to avoid possibly conflicting scenarios and ensure safety. This paper studies the concept of barrier states (BaS) for safe multi-objective controls in which the safety condition is manifested as a dynamical sub-system to be controlled along other states of the system. This allows us to introduce the idea of safety embedded systems.…
▽ More
Multi-objective safety-critical control entails a diligent design to avoid possibly conflicting scenarios and ensure safety. This paper studies the concept of barrier states (BaS) for safe multi-objective controls in which the safety condition is manifested as a dynamical sub-system to be controlled along other states of the system. This allows us to introduce the idea of safety embedded systems. The proposition is that the control problem is now transformed to designing a control law for the new, unconstrained, system in which the barrier state is driven to stay bounded while achieving other performance objectives. In the stabilization case, for example, we show that designing a stabilizing controller for the safety embedded system implies guaranteed safe stabilization for the original safety-critical system. Consequently, a conflict between performance objectives and safety constraints is substantially avoided. This allows us to embrace various legacy control methods from the literature to acquire safe control laws. Moreover, we discuss how the proposed technique can be espoused for enforcing input constraints. Additionally, dealing with the constraint through a state allows us to extend various existing control approaches to the safety case. We consider the case of bounded input disturbance and adopt the notion of input-to-state stability (ISS) for barrier states to obtain the notion of input-to-state safety (ISSf) to analyze safe robustness of systems. Subsequently, we derive the notion of input-to-state safe stability (IS$^3$) and discuss the synthesis of robust safely stabilizing feedback controls through designing robust stabilizing controllers for the safety embedded systems. The proposed techniques and concepts are used in various examples including the design of proportional-integral-derivative-barrier (PIDB) control for adaptive cruise control.
△ Less
Submitted 10 October, 2023;
originally announced October 2023.
-
Gaussian Process Barrier States for Safe Trajectory Optimization and Control
Authors:
Hassan Almubarak,
Manan Gandhi,
Yuichiro Aoyama,
Nader Sadegh,
Evangelos A. Theodorou
Abstract:
This paper proposes embedded Gaussian Process Barrier States (GP-BaS), a methodology to safely control unmodeled dynamics of nonlinear system using Bayesian learning. Gaussian Processes (GPs) are used to model the dynamics of the safety-critical system, which is subsequently used in the GP-BaS model. We derive the barrier state dynamics utilizing the GP posterior, which is used to construct a safe…
▽ More
This paper proposes embedded Gaussian Process Barrier States (GP-BaS), a methodology to safely control unmodeled dynamics of nonlinear system using Bayesian learning. Gaussian Processes (GPs) are used to model the dynamics of the safety-critical system, which is subsequently used in the GP-BaS model. We derive the barrier state dynamics utilizing the GP posterior, which is used to construct a safety embedded Gaussian process dynamical model (GPDM). We show that the safety-critical system can be controlled to remain inside the safe region as long as we can design a controller that renders the BaS-GPDM's trajectories bounded (or asymptotically stable). The proposed approach overcomes various limitations in early attempts at combining GPs with barrier functions due to the abstention of restrictive assumptions such as linearity of the system with respect to control, relative degree of the constraints and number or nature of constraints. This work is implemented on various examples for trajectory optimization and control including optimal stabilization of unstable linear system and safe trajectory optimization of a Dubins vehicle navigating through an obstacle course and on a quadrotor in an obstacle avoidance task using GP differentiable dynamic programming (GP-DDP). The proposed framework is capable of maintaining safe optimization and control of unmodeled dynamics and is purely data driven.
△ Less
Submitted 30 November, 2022;
originally announced December 2022.
-
Barrier States Embedded Iterative Dynamic Game for Robust and Safe Trajectory Optimization
Authors:
Hassan Almubarak,
Evangelos A. Theodorou,
Nader Sadegh
Abstract:
Considering uncertainties and disturbances is an important, yet challenging, step in successful decision making. The problem becomes more challenging in safety-constrained environments. In this paper, we propose a robust and safe trajectory optimization algorithm through solving a constrained min-max optimal control problem. The proposed method leverages a game theoretic differential dynamic progr…
▽ More
Considering uncertainties and disturbances is an important, yet challenging, step in successful decision making. The problem becomes more challenging in safety-constrained environments. In this paper, we propose a robust and safe trajectory optimization algorithm through solving a constrained min-max optimal control problem. The proposed method leverages a game theoretic differential dynamic programming approach with barrier states to handle parametric and non-parametric uncertainties in safety-critical control systems. Barrier states are embedded into the differential game's dynamics and cost to portray the constrained environment in a higher dimensional state space and certify the safety of the optimized trajectory. Moreover, to find a convergent optimal solution, we propose to perform line-search in a Stackleberg (leader-follower) game fashion instead of picking a constant learning rate. The proposed algorithm is evaluated on a velocity-constrained inverted pendulum model in a moderate and high parametric uncertainties to show its efficacy in such a comprehensible system. The algorithm is subsequently implemented on a quadrotor in a windy environment in which sinusoidal wind turbulences applied in all directions.
△ Less
Submitted 26 March, 2022; v1 submitted 4 November, 2021;
originally announced November 2021.
-
Extreme Ultraviolet-Excited Time-Resolved Luminescence Spectroscopy Using an Ultrafast Table-Top High-Harmonic Generation Source
Authors:
M. van der Geest,
N. Sadegh,
T. M. Meerwijk,
E. I. Wooning,
L. Wu,
R. Bloem,
S. Castellanos Ortega,
A. M. Brouwer,
P. M. Kraus
Abstract:
We present a table-top extreme ultraviolet (XUV) beamline for measuring time- and frequency-resolved XUV excited optical luminescence (XEOL) with additional femtosecond-resolution XUV transient absorption spectroscopy functionality. XUV pulses are generated via high-harmonic generation using a near-infrared pulse in a noble gas medium, and focused to excite luminescence from a solid sample. The lu…
▽ More
We present a table-top extreme ultraviolet (XUV) beamline for measuring time- and frequency-resolved XUV excited optical luminescence (XEOL) with additional femtosecond-resolution XUV transient absorption spectroscopy functionality. XUV pulses are generated via high-harmonic generation using a near-infrared pulse in a noble gas medium, and focused to excite luminescence from a solid sample. The luminescence is collimated and guided into a streak camera, where its spectral components are temporally resolved with picosecond temporal resolution. We time-resolve XUV excited luminescence and compare the results to luminescence decays excited at longer wavelengths for three different materials : (i) sodium salicylate, an often used XUV scintillator, (ii) fluorescent labeling molecule 4-carbazole benzoic acid (CB), and (iii) a zirconium metal oxo-cluster labeled with CB, which is a photoresist candidate for extreme-ultraviolet lithography. Our results establish time-resolved XEOL as a new technique to measure transient XUV-driven phenomena in solid-state samples, and identify decay mechanisms of molecules following XUV and soft-X-ray excitation.
△ Less
Submitted 1 November, 2021;
originally announced November 2021.
-
HJB Based Optimal Safe Control Using Control Barrier Functions
Authors:
Hassan Almubarak,
Evangelos A. Theodorou,
Nader Sadegh
Abstract:
This work proposes an optimal safe controller minimizing an infinite horizon cost functional subject to control barrier functions (CBFs) safety conditions. The constrained optimal control problem is reformulated as a minimization problem of the Hamilton-Jacobi-Bellman (HJB) equation subjected to the safety constraints. By solving the optimization problem, we are able to construct a closed form sol…
▽ More
This work proposes an optimal safe controller minimizing an infinite horizon cost functional subject to control barrier functions (CBFs) safety conditions. The constrained optimal control problem is reformulated as a minimization problem of the Hamilton-Jacobi-Bellman (HJB) equation subjected to the safety constraints. By solving the optimization problem, we are able to construct a closed form solution that satisfies optimality and safety conditions. The proposed solution is shown to be continuous and thus it renders the safe set forward invariant while minimizing the given cost. Hence, optimal stabilizability and safety objectives are achieved simultaneously. To synthesize the optimal safe controller, we present a modified Galerkin successive approximation approach which guarantees an optimal safe solution given a stabilizing safe initialization. The proposed algorithm is implemented on a constrained nonlinear system to show its efficacy.
△ Less
Submitted 2 February, 2022; v1 submitted 29 June, 2021;
originally announced June 2021.
-
Safety Embedded Differential Dynamic Programming Using Discrete Barrier States
Authors:
Hassan Almubarak,
Kyle Stachowicz,
Nader Sadegh,
Evangelos A. Theodorou
Abstract:
Certified safe control is a growing challenge in robotics, especially when performance and safety objectives must be concurrently achieved. In this work, we extend the barrier state (BaS) concept, recently proposed for safe stabilization of continuous time systems, to safety embedded trajectory optimization for discrete time systems using discrete barrier states (DBaS). The constructed DBaS is emb…
▽ More
Certified safe control is a growing challenge in robotics, especially when performance and safety objectives must be concurrently achieved. In this work, we extend the barrier state (BaS) concept, recently proposed for safe stabilization of continuous time systems, to safety embedded trajectory optimization for discrete time systems using discrete barrier states (DBaS). The constructed DBaS is embedded into the discrete model of the safety-critical system integrating safety objectives into the system's dynamics and performance objectives. Thereby, the control policy is directly supplied by safety-critical information through the barrier state. This allows us to employ the DBaS with differential dynamic programming (DDP) to plan and execute safe optimal trajectories. The proposed algorithm is leveraged on various safety-critical control and planning problems including a differential wheeled robot safe navigation in randomized and complex environments and on a quadrotor to safely perform reaching and tracking tasks. The DBaS-based DDP (DBaS-DDP) is shown to consistently outperform penalty methods commonly used to approximate constrained DDP problems as well as CBF-based safety filters.
△ Less
Submitted 2 February, 2022; v1 submitted 30 May, 2021;
originally announced May 2021.
-
Safety Embedded Control of Nonlinear Systems via Barrier States
Authors:
Hassan Almubarak,
Nader Sadegh,
Evangelos A. Theodorou
Abstract:
In many safety-critical control systems, possibly opposing safety restrictions and control performance objectives arise. To confront such a conflict, this letter proposes a novel methodology that embeds safety into stability of control systems. The development enforces safety by means of barrier functions used in optimization through the construction of barrier states (BaS) which are embedded in t…
▽ More
In many safety-critical control systems, possibly opposing safety restrictions and control performance objectives arise. To confront such a conflict, this letter proposes a novel methodology that embeds safety into stability of control systems. The development enforces safety by means of barrier functions used in optimization through the construction of barrier states (BaS) which are embedded in the control system's model. As a result, as long as the equilibrium point of interest of the closed loop system is asymptotically stable, the generated trajectories are guaranteed to be safe. Consequently, a conflict between control objectives and safety constraints is substantially avoided. To show the efficacy of the proposed technique, we employ barrier states with the simple pole placement method to design safe linear controls. Nonlinear optimal control is subsequently employed to fulfill safety, stability and performance objectives by solving the associated Hamilton-Jacobi-Bellman (HJB) which minimizes a cost functional that can involve the BaS. Following this further, we exploit optimal control with barrier states on an unstable, constrained second dimensional pendulum on a cart model that is desired to avoid low velocities regions where the system may exhibit some controllability loss and on two mobile robots to safely arrive to opposite targets with an obstacle on the way.
△ Less
Submitted 19 August, 2021; v1 submitted 19 February, 2021;
originally announced February 2021.
-
Recursive Analytic Solution of Nonlinear Optimal Regulators
Authors:
Nader Sadegh,
Hassan Almubarak
Abstract:
The paper develops an optimal regulator for a general class of multi-input affine nonlinear systems minimizing a nonlinear cost functional with infinite horizon. The cost functional is general enough to enforce saturation limits on the control input if desired. An efficient algorithm utilizing tensor algebra is employed to compute the tensor coefficients of the Taylor series expansion of the value…
▽ More
The paper develops an optimal regulator for a general class of multi-input affine nonlinear systems minimizing a nonlinear cost functional with infinite horizon. The cost functional is general enough to enforce saturation limits on the control input if desired. An efficient algorithm utilizing tensor algebra is employed to compute the tensor coefficients of the Taylor series expansion of the value function (i.e., optimal cost-to-go). The tensor coefficients are found by solving a set of nonlinear matrix equations recursively generalizing the well-known linear quadratic solution. The resulting solution generates the optimal controller as a nonlinear function of the state vector up to a prescribed truncation order. Moreover, a complete convergence of the computed solution together with an estimation of its applicability domain are provided to further guide the user. The algorithm's computational complexity is shown to grow only polynomially with respect to the series order. Finally, several nonlinear examples including some with input saturation are presented to demonstrate the efficacy of the algorithm to generate high order Taylor series solution of the optimal controller.
△ Less
Submitted 28 June, 2020;
originally announced June 2020.
-
XUV Induced Bleaching of a Tin Oxo Cage Photoresist Studied by High Harmonic Absorption Spectroscopy
Authors:
Najmeh Sadegh,
Maarten van der Geest,
Jarich Haitjema,
Filippo Campi,
Sonia Castellanos,
Peter M. Kraus,
Albert M. Brouwer
Abstract:
Inorganic molecular materials such as tin oxo cages are a promising generation of photoresists compatible with the demands of the recently developed Extreme UltraViolet (EUV) lithography technology. Therefore, a detailed understanding of the photon-induced reactions which occur in photoresists after exposure is important. We used XUV broadband laser pulses in the range of 25-40 eV from a table-top…
▽ More
Inorganic molecular materials such as tin oxo cages are a promising generation of photoresists compatible with the demands of the recently developed Extreme UltraViolet (EUV) lithography technology. Therefore, a detailed understanding of the photon-induced reactions which occur in photoresists after exposure is important. We used XUV broadband laser pulses in the range of 25-40 eV from a table-top high-harmonic source to expose thin films of the tin oxo cage resist to shed light on some of the photo-induced chemistry via XUV absorption spectroscopy. During the exposure, the transmitted spectra were recorded and a noticeable absorbance decrease was observed in the resist. Dill parameters were extracted to quantify the XUV induced conversion and compared to EUV exposure results at 92 eV. Based on the absorption changes, we estimate that approximately 60% of tin-carbon bonds are cleaved at the end of the exposure.
△ Less
Submitted 24 March, 2020;
originally announced March 2020.
