-
A Successive Gap Constraint Linearization Method for Optimal Control Problems with Equilibrium Constraints
Authors:
Kangyu Lin,
Toshiyuki Ohtsuka
Abstract:
In this study, we propose a novel gap-constraint-based reformulation for optimal control problems with equilibrium constraints (OCPECs). We show that the proposed reformulation generates a new constraint system equivalent to the original one but more concise and with favorable differentiability. Moreover, constraint regularity can be recovered by a relaxation strategy. We show that the gap constra…
▽ More
In this study, we propose a novel gap-constraint-based reformulation for optimal control problems with equilibrium constraints (OCPECs). We show that the proposed reformulation generates a new constraint system equivalent to the original one but more concise and with favorable differentiability. Moreover, constraint regularity can be recovered by a relaxation strategy. We show that the gap constraint and its gradient can be evaluated efficiently. We then propose a successive gap constraint linearization method to solve the discretized OCPEC. We also provide an intuitive geometric interpretation of the gap constraint. Numerical experiments validate the effectiveness of the proposed reformulation and solution method.
△ Less
Submitted 5 June, 2024;
originally announced June 2024.
-
Convex Optimization of Initial Perturbations toward Quantitative Weather Control
Authors:
Toshiyuki Ohtsuka,
Atsushi Okazaki,
Masaki Ogura,
Shunji Kotsuki
Abstract:
This study proposes introducing convex optimization to find initial perturbations of atmospheric models for realizing specified changes in subsequent forecasts. In the proposed method, we formulate and solve an inverse problem to find effective perturbations in atmospheric variables so that controlled variables satisfy specified changes at a specified time. The proposed method first constructs a s…
▽ More
This study proposes introducing convex optimization to find initial perturbations of atmospheric models for realizing specified changes in subsequent forecasts. In the proposed method, we formulate and solve an inverse problem to find effective perturbations in atmospheric variables so that controlled variables satisfy specified changes at a specified time. The proposed method first constructs a sensitivity matrix of controlled variables, such as accumulated precipitation, to the initial atmospheric variables, such as temperature and humidity, through sensitivity analysis using numerical weather prediction (NWP) models. The sensitivity matrix is used to solve the inverse problem as convex optimization, in which a global optimal solution can be found computationally efficiently. The proposed method was validated through a benchmark warm bubble experiment using an NWP model. The experiments showed that identified perturbation successfully realized specified spatial distributions of accumulated precipitation. These results demonstrated the possibility of controlling the real atmosphere by solving inverse problems and adding small perturbations to atmospheric states.
△ Less
Submitted 28 June, 2024; v1 submitted 29 May, 2024;
originally announced May 2024.
-
Real-time MPC with Control Barrier Functions for Autonomous Driving using Safety Enhanced Collocation
Authors:
Jean Pierre Allamaa,
Panagiotis Patrinos,
Toshiyuki Ohtsuka,
Tong Duy Son
Abstract:
The autonomous driving industry is continuously dealing with more safety-critical scenarios, and nonlinear model predictive control (NMPC) is a powerful control strategy for handling such situations. However, standard safety constraints are not scalable and require a long NMPC horizon. Moreover, the adoption of NMPC in the automotive industry is limited by the heavy computation of numerical optimi…
▽ More
The autonomous driving industry is continuously dealing with more safety-critical scenarios, and nonlinear model predictive control (NMPC) is a powerful control strategy for handling such situations. However, standard safety constraints are not scalable and require a long NMPC horizon. Moreover, the adoption of NMPC in the automotive industry is limited by the heavy computation of numerical optimization routines. To address those issues, this paper presents a real-time capable NMPC for automated driving in urban environments, using control barrier functions (CBFs). Furthermore, the designed NMPC is based on a novel collocation transcription approach, named RESAFE/COL, that allows to reduce the number of optimization variables while still guaranteeing the continuous time (nonlinear) inequality constraints satisfaction, through regional convex hull approximation. RESAFE/COL is proven to be 5 times faster than multiple shooting and more tractable for embedded hardware without a decrease in the performance, nor accuracy and safety of the numerical solution. We validate our NMPC-CBF with RESAFE/COL approach with highly accurate digital twins of the vehicle and the urban environment and show the safe controller's ability to improve crash avoidance by 91%.
△ Less
Submitted 12 January, 2024;
originally announced January 2024.
-
A Non-Interior-Point Continuation Method for the Optimal Control Problem with Equilibrium Constraints
Authors:
Kangyu Lin,
Toshiyuki Ohtsuka
Abstract:
In this study, we focus on the numerical solution method for the optimal control problem with equilibrium constraints (OCPEC).It is extremely challenging to solve OCPEC owing to the absence of constraint regularity and strictly feasible interior points. To solve OCPEC efficiently, we first relax the discretized OCPEC to recover the constraint regularity and then map its Karush--Kuhn--Tucker (KKT)…
▽ More
In this study, we focus on the numerical solution method for the optimal control problem with equilibrium constraints (OCPEC).It is extremely challenging to solve OCPEC owing to the absence of constraint regularity and strictly feasible interior points. To solve OCPEC efficiently, we first relax the discretized OCPEC to recover the constraint regularity and then map its Karush--Kuhn--Tucker (KKT) conditions into a perturbed system of equations. Subsequently, we propose a novel two-stage solution method, called the non-interior-point continuation method, to solve the perturbed system. In the first stage, a non-interior-point method, which solves the perturbed system using the Newton method and globalizes convergence using a dedicated merit function, is employed. In the second stage, a predictor-corrector continuation method is utilized to track the solution trajectory as a function of the perturbed parameter, starting at the solution obtained in the first stage. The proposed method regularizes the KKT matrix and does not enforce iterates to remain in the feasible interior, which mitigates the numerical difficulties of solving OCPEC. Convergence properties are analyzed under certain assumptions. Numerical experiments demonstrate that the proposed method can accurately track the solution trajectory while demanding significantly less computation time compared to the interior-point method.
△ Less
Submitted 27 May, 2024; v1 submitted 19 October, 2022;
originally announced October 2022.
-
Matrix Pontryagin principle approach to controllability metrics maximization under sparsity constraints
Authors:
Tomofumi Ohtsuka,
Takuya Ikeda,
Kenji Kashima
Abstract:
Controllability maximization problem under sparsity constraints is a node selection problem that selects inputs that are effective for control in order to minimize the energy to control for desired state. In this paper we discuss the equivalence between the sparsity constrained controllability metrics maximization problems and their convex relaxation. The proof is based on the matrix-valued Pontry…
▽ More
Controllability maximization problem under sparsity constraints is a node selection problem that selects inputs that are effective for control in order to minimize the energy to control for desired state. In this paper we discuss the equivalence between the sparsity constrained controllability metrics maximization problems and their convex relaxation. The proof is based on the matrix-valued Pontryagin maximum principle applied to the controllability Lyapunov differential equation.
△ Less
Submitted 23 March, 2022;
originally announced March 2022.
-
Whole-body model predictive control with rigid contacts via online switching time optimization
Authors:
Sotaro Katayama,
Toshiyuki Ohtsuka
Abstract:
This study presents a whole-body model predictive control (MPC) of robotic systems with rigid contacts, under a given contact sequence using online switching time optimization (STO). We treat robot dynamics with rigid contacts as a switched system and formulate an optimal control problem of switched systems to implement the MPC. We utilize an efficient solution algorithm for the MPC problem that o…
▽ More
This study presents a whole-body model predictive control (MPC) of robotic systems with rigid contacts, under a given contact sequence using online switching time optimization (STO). We treat robot dynamics with rigid contacts as a switched system and formulate an optimal control problem of switched systems to implement the MPC. We utilize an efficient solution algorithm for the MPC problem that optimizes the switching times and trajectory simultaneously. The present efficient algorithm, unlike inefficient existing methods, enables online optimization as well as switching times. The proposed MPC with online STO is compared over the conventional MPC with fixed switching times, through numerical simulations of dynamic jum** motions of a quadruped robot. In the simulation comparison, the proposed MPC successfully controls the dynamic jum** motions in twice as many cases as the conventional MPC, which indicates that the proposed method extends the ability of the whole-body MPC. We further conduct hardware experiments on the quadrupedal robot Unitree A1 and prove that the proposed method achieves dynamic motions on the real robot.
△ Less
Submitted 24 October, 2022; v1 submitted 2 March, 2022;
originally announced March 2022.
-
Structure-Exploiting Newton-Type Method for Optimal Control of Switched Systems
Authors:
Sotaro Katayama,
Toshiyuki Ohtsuka
Abstract:
This study proposes an efficient Newton-type method for the optimal control of switched systems under a given mode sequence. A mesh-refinement-based approach is utilized to discretize continuous-time optimal control problems (OCPs) and formulate a nonlinear program (NLP), which guarantees the local convergence of a Newton-type method. A dedicated structure-exploiting algorithm (Riccati recursion)…
▽ More
This study proposes an efficient Newton-type method for the optimal control of switched systems under a given mode sequence. A mesh-refinement-based approach is utilized to discretize continuous-time optimal control problems (OCPs) and formulate a nonlinear program (NLP), which guarantees the local convergence of a Newton-type method. A dedicated structure-exploiting algorithm (Riccati recursion) is proposed to perform a Newton-type method for the NLP efficiently because its sparsity structure is different from a standard OCP. The proposed method computes each Newton step with linear time-complexity for the total number of discretization grids as the standard Riccati recursion algorithm. Additionally, the computation is always successful if the solution is sufficiently close to a local minimum. Conversely, general quadratic programming (QP) solvers cannot accomplish this because the Hessian matrix is inherently indefinite. Moreover, a modification on the reduced Hessian matrix is proposed using the nature of the Riccati recursion algorithm as the dynamic programming for a QP subproblem to enhance the convergence. A numerical comparison is conducted with off-the-shelf NLP solvers, which demonstrates that the proposed method is up to two orders of magnitude faster. Whole-body optimal control of quadrupedal gaits is also demonstrated and shows that the proposed method can achieve the whole-body model predictive control (MPC) of robotic systems with rigid contacts.
△ Less
Submitted 20 December, 2021; v1 submitted 14 December, 2021;
originally announced December 2021.
-
Lifted contact dynamics for efficient optimal control of rigid body systems with contacts
Authors:
Sotaro Katayama,
Toshiyuki Ohtsuka
Abstract:
We propose a novel and efficient lifting approach for the optimal control of rigid-body systems with contacts to improve the convergence properties of Newton-type methods. To relax the high nonlinearity, we consider the state, acceleration, contact forces, and control input torques, as optimization variables and the inverse dynamics and acceleration constraints on the contact frames as equality co…
▽ More
We propose a novel and efficient lifting approach for the optimal control of rigid-body systems with contacts to improve the convergence properties of Newton-type methods. To relax the high nonlinearity, we consider the state, acceleration, contact forces, and control input torques, as optimization variables and the inverse dynamics and acceleration constraints on the contact frames as equality constraints. We eliminate the update of the acceleration, contact forces, and their dual variables from the linear equation to be solved in each Newton-type iteration in an efficient manner. As a result, the computational cost per Newton-type iteration is almost identical to that of the conventional non-lifted Newton-type iteration that embeds contact dynamics in the state equation. We conducted numerical experiments on the whole-body optimal control of various quadrupedal gaits subject to the friction cone constraints considered in interior-point methods and demonstrated that the proposed method can significantly increase the convergence speed to more than twice that of the conventional non-lifted approach.
△ Less
Submitted 24 October, 2022; v1 submitted 3 August, 2021;
originally announced August 2021.
-
Efficient solution method based on inverse dynamics for optimal control problems of rigid body systems
Authors:
Sotaro Katayama,
Toshiyuki Ohtsuka
Abstract:
We propose an efficient way of solving optimal control problems for rigid-body systems on the basis of inverse dynamics and the multiple-shooting method. We treat all variables, including the state, acceleration, and control input torques, as optimization variables and treat the inverse dynamics as an equality constraint. We eliminate the update of the control input torques from the linear equatio…
▽ More
We propose an efficient way of solving optimal control problems for rigid-body systems on the basis of inverse dynamics and the multiple-shooting method. We treat all variables, including the state, acceleration, and control input torques, as optimization variables and treat the inverse dynamics as an equality constraint. We eliminate the update of the control input torques from the linear equation of Newton's method by applying condensing for inverse dynamics. The size of the resultant linear equation is the same as that of the multiple-shooting method based on forward dynamics except for the variables related to the passive joints and contacts. Compared with the conventional methods based on forward dynamics, the proposed method reduces the computational cost of the dynamics and their sensitivities by utilizing the recursive Newton-Euler algorithm (RNEA) and its partial derivatives. In addition, it increases the sparsity of the Hessian of the Karush-Kuhn-Tucker conditions, which reduces the computational cost, e.g., of Riccati recursion. Numerical experiments show that the proposed method outperforms state-of-the-art implementations of differential dynamic programming based on forward dynamics in terms of computational time and numerical robustness.
△ Less
Submitted 24 October, 2022; v1 submitted 8 June, 2021;
originally announced June 2021.
-
Bayesian filtering for nonlinear stochastic systems using holonomic gradient method with integral transform
Authors:
Tomoyuki Iori,
Toshiyuki Ohtsuka
Abstract:
This paper proposes a symbolic-numeric Bayesian filtering method for a class of discrete-time nonlinear stochastic systems to achieve high accuracy with a relatively small online computational cost. The proposed method is based on the holonomic gradient method (HGM), which is a symbolic-numeric method to evaluate integrals efficiently depending on several parameters. By approximating the posterior…
▽ More
This paper proposes a symbolic-numeric Bayesian filtering method for a class of discrete-time nonlinear stochastic systems to achieve high accuracy with a relatively small online computational cost. The proposed method is based on the holonomic gradient method (HGM), which is a symbolic-numeric method to evaluate integrals efficiently depending on several parameters. By approximating the posterior probability density function (PDF) of the state as a Gaussian PDF, the update process of its mean and variance can be formulated as evaluations of several integrals that exactly take into account the nonlinearity of the system dynamics. An integral transform is used to evaluate these integrals more efficiently using the HGM than our previous method. Further, a numerical example is provided to demonstrate the efficiency of the proposed method compared to other existing methods.
△ Less
Submitted 22 March, 2022; v1 submitted 28 February, 2021;
originally announced March 2021.
-
Efficient Riccati recursion for optimal control problems with pure-state equality constraints
Authors:
Sotaro Katayama,
Toshiyuki Ohtsuka
Abstract:
A novel approach to efficiently treat pure-state equality constraints in optimal control problems (OCPs) using a Riccati recursion algorithm is proposed. The proposed method transforms a pure-state equality constraint into a mixed state-control constraint such that the constraint is expressed by variables at a certain previous time stage. It is showed that if the solution satisfies the second-orde…
▽ More
A novel approach to efficiently treat pure-state equality constraints in optimal control problems (OCPs) using a Riccati recursion algorithm is proposed. The proposed method transforms a pure-state equality constraint into a mixed state-control constraint such that the constraint is expressed by variables at a certain previous time stage. It is showed that if the solution satisfies the second-order sufficient conditions of the OCP with the transformed mixed state-control constraints, it is a local minimum of the OCP with the original pure-state constraints. A Riccati recursion algorithm is derived to solve the OCP using the transformed constraints with linear time complexity in the grid number of the horizon, in contrast to a previous approach that scales cubically with respect to the total dimension of the pure-state equality constraints. Numerical experiments on the whole-body optimal control of quadrupedal gaits that involve pure-state equality constraints owing to contact switches demonstrate the effectiveness of the proposed method over existing approaches.
△ Less
Submitted 24 October, 2022; v1 submitted 18 February, 2021;
originally announced February 2021.
-
Riccati Recursion for Optimal Control Problems of Nonlinear Switched Systems
Authors:
Sotaro Katayama,
Toshiyuki Ohtsuka
Abstract:
We propose an efficient algorithm for the optimal control problems (OCPs) of nonlinear switched systems that optimizes the control input and switching instants simultaneously for a given switching sequence. We consider the switching instants as the optimization variables and formulate the OCP based on the direct multiple shooting method. We derive a linear equation to be solved in Newton's method…
▽ More
We propose an efficient algorithm for the optimal control problems (OCPs) of nonlinear switched systems that optimizes the control input and switching instants simultaneously for a given switching sequence. We consider the switching instants as the optimization variables and formulate the OCP based on the direct multiple shooting method. We derive a linear equation to be solved in Newton's method and propose a Riccati recursion algorithm to solve the linear equation efficiently. The computational time of the proposed method scales linearly with respect to the number of time stages of the horizon as the standard Riccati recursion. Numerical experiments show that the proposed method converges with a significantly shorter computational time than the conventional methods.
△ Less
Submitted 8 June, 2021; v1 submitted 3 February, 2021;
originally announced February 2021.
-
A Double-Layer Jacobi Method for PDE-Constrained Nonlinear Model Predictive Control
Authors:
Haoyang Deng,
Toshiyuki Ohtsuka
Abstract:
This paper presents a real-time optimization method for nonlinear model predictive control (NMPC) of systems governed by partial differential equations (PDEs). The NMPC problem to be solved is formulated by discretizing the PDE system in space and time by using the finite difference method. The proposed method is called the double-layer Jacobi method, which exploits both the spatial and temporal s…
▽ More
This paper presents a real-time optimization method for nonlinear model predictive control (NMPC) of systems governed by partial differential equations (PDEs). The NMPC problem to be solved is formulated by discretizing the PDE system in space and time by using the finite difference method. The proposed method is called the double-layer Jacobi method, which exploits both the spatial and temporal sparsities of the PDE-constrained NMPC problem. In the upper layer, the NMPC problem is solved by ignoring the temporal couplings of either the state or costate (Lagrange multiplier corresponding to the state equation) equations so that the spatial sparsity is preserved. The lower-layer Jacobi method is a linear solver dedicated to PDE-constrained NMPC problems by exploiting the spatial sparsity. Convergence analysis indicates that the convergence of the proposed method is related to the prediction horizon and regularization. Results of a numerical experiment of controlling a heat transfer process show that the proposed method is two orders of magnitude faster than the conventional structure-exploiting Newton's method.
△ Less
Submitted 6 April, 2020;
originally announced April 2020.
-
Numerical analysis comparing ODE approach and level set method for evolving spirals by crystalline eikonal-curvature flow
Authors:
Tetsuya Ishiwata,
Takeshi Ohtsuka
Abstract:
In this paper, the evolution of a polygonal spiral curve by the crystalline curvature flow with a pinned center is considered with two view points, discrete model consist of an ODE system of facet lengths and a level set method. We investigate the difference of these models numerically by calculating the area of the region enclosed by these spiral curves. The area difference is calculated by the n…
▽ More
In this paper, the evolution of a polygonal spiral curve by the crystalline curvature flow with a pinned center is considered with two view points, discrete model consist of an ODE system of facet lengths and a level set method. We investigate the difference of these models numerically by calculating the area of the region enclosed by these spiral curves. The area difference is calculated by the normalized L1 norm of the difference of step-like functions which are branches of arg(x) whose discontinuities are only on the spirals. We find the differences of the numerical results considered in this paper are very small even though the evolution laws of these models around the center and the farthest facet are slightly different.
△ Less
Submitted 26 January, 2019;
originally announced January 2019.
-
Existence of asymptotic speed of solutions to birth and spread type nonlinear partial differential equations
Authors:
Yoshikazu Giga,
Hiroyoshi Mitake,
Takeshi Ohtsuka,
Hung V. Tran
Abstract:
In this paper, we prove the existence of asymptotic speed of solutions to fully nonlinear, possibly degenerate parabolic partial differential equations in a general setting. We then give some explicit examples of equations in this setting and study further properties of the asymptotic speed for each equation. Some numerical results concerning the asymptotic speed are presented.
In this paper, we prove the existence of asymptotic speed of solutions to fully nonlinear, possibly degenerate parabolic partial differential equations in a general setting. We then give some explicit examples of equations in this setting and study further properties of the asymptotic speed for each equation. Some numerical results concerning the asymptotic speed are presented.
△ Less
Submitted 20 August, 2018;
originally announced August 2018.
-
Growth rate of crystal surfaces with several dislocation centers
Authors:
Takeshi Ohtsuka,
Yen-Hsi Richard Tsai,
Yoshikazu Giga
Abstract:
We study analytically and numerical the growth rate of a crystal surface growing by several screw dislocations. To describe several spiral steps we use the revised level set method for spirals by the authors (Journal of Scientific Computing 62, 831-874, 2015). We carefully compare our simulation results on the growth rates with predictions in a classical paper by Burton et al. (Philos Trans R Soc…
▽ More
We study analytically and numerical the growth rate of a crystal surface growing by several screw dislocations. To describe several spiral steps we use the revised level set method for spirals by the authors (Journal of Scientific Computing 62, 831-874, 2015). We carefully compare our simulation results on the growth rates with predictions in a classical paper by Burton et al. (Philos Trans R Soc Lond Ser A Math Phys Sci 243,299-358, 1951). Then, we propose improved estimates on the growth rate with several different configurations, which are in agreement with our numerical simulations. The influence of distribution of screw dislocations in a group on a line to the growth rate, and the growth rate by a group including different rotational orientations of spirals are also studied in this paper.
△ Less
Submitted 15 June, 2017; v1 submitted 28 December, 2016;
originally announced December 2016.
-
Nonlinear Eigenvalue Approach to Differential Riccati Equations for Contraction Analysis
Authors:
Yu Kawano,
Toshiyuki Ohtsuka
Abstract:
In this paper, we extend the eigenvalue method of the algebraic Riccati equation to the differential Riccati equation (DRE) in contraction analysis. One of the main results is showing that solutions to the DRE can be expressed as functions of nonlinear eigenvectors of the differential Hamiltonian matrix. Moreover, under an assumption for the differential Hamiltonian matrix, real symmetricity, regu…
▽ More
In this paper, we extend the eigenvalue method of the algebraic Riccati equation to the differential Riccati equation (DRE) in contraction analysis. One of the main results is showing that solutions to the DRE can be expressed as functions of nonlinear eigenvectors of the differential Hamiltonian matrix. Moreover, under an assumption for the differential Hamiltonian matrix, real symmetricity, regularity, and positive semidefiniteness of solutions are characterized by nonlinear eigenvalues and eigenvectors.
△ Less
Submitted 19 July, 2016;
originally announced July 2016.
