-
On the Differentiability of the Primal-Dual Interior-Point Method
Authors:
Kevin Tracy,
Zachary Manchester
Abstract:
Primal-Dual Interior-Point methods are capable of solving constrained convex optimization problems to tight tolerances in a fast and robust manner. The derivatives of the primal-dual solution with respect to the problem matrices can be computed using the implicit function theorem, enabling efficient differentiation of these optimizers for a fraction of the cost of the total solution time. In the p…
▽ More
Primal-Dual Interior-Point methods are capable of solving constrained convex optimization problems to tight tolerances in a fast and robust manner. The derivatives of the primal-dual solution with respect to the problem matrices can be computed using the implicit function theorem, enabling efficient differentiation of these optimizers for a fraction of the cost of the total solution time. In the presence of active inequality constraints, this technique is only capable of providing discontinuous subgradients that present a challenge to algorithms that rely on the smoothness of these derivatives. This paper presents a technique for relaxing primal-dual solutions with a logarithmic barrier to provide smooth derivatives near active inequality constraints, with the ability to specify a uniform and consistent amount of smoothing. We pair this with an efficient primal-dual interior-point algorithm for solving an always-feasible $\ell_1$-penalized variant of a convex quadratic program, eliminating the issues surrounding learning potentially infeasible problems. This parallelizable and smoothly differentiable solver is demonstrated on a range of robotics tasks where smoothing is important. An open source implementation in JAX is available at github.com/kevin-tracy/qpax.
△ Less
Submitted 18 June, 2024; v1 submitted 17 June, 2024;
originally announced June 2024.
-
Efficient Online Learning of Contact Force Models for Connector Insertion
Authors:
Kevin Tracy,
Zachary Manchester,
A**kya Jain,
Keegan Go,
Stefan Schaal,
Tom Erez,
Yuval Tassa
Abstract:
Contact-rich manipulation tasks with stiff frictional elements like connector insertion are difficult to model with rigid-body simulators. In this work, we propose a new approach for modeling these environments by learning a quasi-static contact force model instead of a full simulator. Using a feature vector that contains information about the configuration and control, we find a linear map** ad…
▽ More
Contact-rich manipulation tasks with stiff frictional elements like connector insertion are difficult to model with rigid-body simulators. In this work, we propose a new approach for modeling these environments by learning a quasi-static contact force model instead of a full simulator. Using a feature vector that contains information about the configuration and control, we find a linear map** adequately captures the relationship between this feature vector and the sensed contact forces. A novel Linear Model Learning (LML) algorithm is used to solve for the globally optimal map** in real time without any matrix inversions, resulting in an algorithm that runs in nearly constant time on a GPU as the model size increases. We validate the proposed approach for connector insertion both in simulation and hardware experiments, where the learned model is combined with an optimization-based controller to achieve smooth insertions in the presence of misalignments and uncertainty. Our website featuring videos, code, and more materials is available at https://model-based-plugging.github.io/.
△ Less
Submitted 14 December, 2023;
originally announced December 2023.
-
ReLU-QP: A GPU-Accelerated Quadratic Programming Solver for Model-Predictive Control
Authors:
Arun L. Bishop,
John Z. Zhang,
Swaminathan Gurumurthy,
Kevin Tracy,
Zachary Manchester
Abstract:
We present ReLU-QP, a GPU-accelerated solver for quadratic programs (QPs) that is capable of solving high-dimensional control problems at real-time rates. ReLU-QP is derived by exactly reformulating the Alternating Direction Method of Multipliers (ADMM) algorithm for solving QPs as a deep, weight-tied neural network with rectified linear unit (ReLU) activations. This reformulation enables the depl…
▽ More
We present ReLU-QP, a GPU-accelerated solver for quadratic programs (QPs) that is capable of solving high-dimensional control problems at real-time rates. ReLU-QP is derived by exactly reformulating the Alternating Direction Method of Multipliers (ADMM) algorithm for solving QPs as a deep, weight-tied neural network with rectified linear unit (ReLU) activations. This reformulation enables the deployment of ReLU-QP on GPUs using standard machine-learning toolboxes. We evaluate the performance of ReLU-QP across three model-predictive control (MPC) benchmarks: stabilizing random linear dynamical systems with control limits, balancing an Atlas humanoid robot on a single foot, and tracking whole-body reference trajectories on a quadruped equipped with a six-degree-of-freedom arm. These benchmarks indicate that ReLU-QP is competitive with state-of-the-art CPU-based solvers for small-to-medium-scale problems and offers order-of-magnitude speed improvements for larger-scale problems.
△ Less
Submitted 29 November, 2023;
originally announced November 2023.
-
Data-Efficient Model Learning for Control with Jacobian-Regularized Dynamic-Mode Decomposition}
Authors:
Brian E. Jackson,
Jeong Hun Lee,
Kevin Tracy,
Zachary Manchester
Abstract:
We present a data-efficient algorithm for learning models for model-predictive control (MPC). Our approach, Jacobian-Regularized Dynamic-Mode Decomposition (JDMD), offers improved sample efficiency over traditional Koopman approaches based on Dynamic-Mode Decomposition (DMD) by leveraging Jacobian information from an approximate prior model of the system, and improved tracking performance over tra…
▽ More
We present a data-efficient algorithm for learning models for model-predictive control (MPC). Our approach, Jacobian-Regularized Dynamic-Mode Decomposition (JDMD), offers improved sample efficiency over traditional Koopman approaches based on Dynamic-Mode Decomposition (DMD) by leveraging Jacobian information from an approximate prior model of the system, and improved tracking performance over traditional model-based MPC. We demonstrate JDMD's ability to quickly learn bilinear Koopman dynamics representations across several realistic examples in simulation, including a perching maneuver for a fixed-wing aircraft with an empirically derived high-fidelity physics model. In all cases, we show that the models learned by JDMD provide superior tracking and generalization performance within a model-predictive control framework, even in the presence of significant model mismatch, when compared to approximate prior models and models learned by standard Extended DMD (EDMD).
△ Less
Submitted 28 January, 2023; v1 submitted 25 October, 2022;
originally announced December 2022.
-
A Square-Root Kalman Filter Using Only QR Decompositions
Authors:
Kevin Tracy
Abstract:
The Kalman filter operates by storing a Gaussian description of the state estimate in the form of a mean and covariance. Instead of storing and manipulating the covariance matrix directly, a square-root Kalman filter only forms and updates a triangular matrix square root of the covariance matrix. The resulting algorithm is more numerically stable than a traditional Kalman filter, benefiting from d…
▽ More
The Kalman filter operates by storing a Gaussian description of the state estimate in the form of a mean and covariance. Instead of storing and manipulating the covariance matrix directly, a square-root Kalman filter only forms and updates a triangular matrix square root of the covariance matrix. The resulting algorithm is more numerically stable than a traditional Kalman filter, benefiting from double the working precision. This paper presents a formulation of the square root Kalman filter that leverages the QR decomposition to dramatically simplify the resulting algorithm.
△ Less
Submitted 12 August, 2022;
originally announced August 2022.
-
Differentiable Collision Detection for a Set of Convex Primitives
Authors:
Kevin Tracy,
Taylor A. Howell,
Zachary Manchester
Abstract:
Collision detection between objects is critical for simulation, control, and learning for robotic systems. However, existing collision detection routines are inherently non-differentiable, limiting their applications in gradient-based optimization tools. In this work, we propose DCOL: a fast and fully differentiable collision-detection framework that reasons about collisions between a set of compo…
▽ More
Collision detection between objects is critical for simulation, control, and learning for robotic systems. However, existing collision detection routines are inherently non-differentiable, limiting their applications in gradient-based optimization tools. In this work, we propose DCOL: a fast and fully differentiable collision-detection framework that reasons about collisions between a set of composable and highly expressive convex primitive shapes. This is achieved by formulating the collision detection problem as a convex optimization problem that solves for the minimum uniform scaling applied to each primitive before they intersect. The optimization problem is fully differentiable with respect to the configurations of each primitive and is able to return a collision detection metric and contact points on each object, agnostic of interpenetration. We demonstrate the capabilities of DCOL on a range of robotics problems from trajectory optimization and contact physics, and have made an open-source implementation available.
△ Less
Submitted 18 May, 2023; v1 submitted 1 July, 2022;
originally announced July 2022.
-
DiffPills: Differentiable Collision Detection for Capsules and Padded Polygons
Authors:
Kevin Tracy,
Taylor A. Howell,
Zachary Manchester
Abstract:
Collision detection plays an important role in simulation, control, and learning for robotic systems. However, no existing method is differentiable with respect to the configurations of the objects, greatly limiting the sort of algorithms that can be built on top of collision detection. In this work, we propose a set of differentiable collision detection algorithms between capsules and padded poly…
▽ More
Collision detection plays an important role in simulation, control, and learning for robotic systems. However, no existing method is differentiable with respect to the configurations of the objects, greatly limiting the sort of algorithms that can be built on top of collision detection. In this work, we propose a set of differentiable collision detection algorithms between capsules and padded polygons by formulating these problems as differentiable convex quadratic programs. The resulting algorithms are able to return a proximity value indicating if a collision has taken place, as well as the closest points between objects, all of which are differentiable. As a result, they can be used reliably within other gradient-based optimization methods, including trajectory optimization, state estimation, and reinforcement learning methods.
△ Less
Submitted 1 July, 2022;
originally announced July 2022.
-
CALIPSO: A Differentiable Solver for Trajectory Optimization with Conic and Complementarity Constraints
Authors:
Taylor A. Howell,
Simon Le Cleac'h,
Kevin Tracy,
Zachary Manchester
Abstract:
We present a new solver for non-convex trajectory optimization problems that is specialized for robotics applications. CALIPSO, or the Conic Augmented Lagrangian Interior-Point SOlver, combines several strategies for constrained numerical optimization to natively handle second-order cones and complementarity constraints. It reliably solves challenging motion-planning problems that include contact-…
▽ More
We present a new solver for non-convex trajectory optimization problems that is specialized for robotics applications. CALIPSO, or the Conic Augmented Lagrangian Interior-Point SOlver, combines several strategies for constrained numerical optimization to natively handle second-order cones and complementarity constraints. It reliably solves challenging motion-planning problems that include contact-implicit formulations of impacts and Coulomb friction and state-triggered constraints where general-purpose non-convex solvers like SNOPT and Ipopt fail to converge. Additionally, CALIPSO supports efficient differentiation of solutions with respect to problem data, enabling bi-level optimization applications like auto-tuning of feedback policies. Reliable convergence of the solver is demonstrated on a range of problems from manipulation, locomotion, and aerospace domains. An open-source implementation of this solver is available.
△ Less
Submitted 10 January, 2023; v1 submitted 18 May, 2022;
originally announced May 2022.
-
Practical limits on Nanosatellite Telescope Pointing: The Impact of Disturbances and Photon Noise
Authors:
Ewan S. Douglas,
Kevin Tracy,
Zachary Manchester
Abstract:
Accurate and stable spacecraft pointing is a requirement of many astronomical observations. Pointing particularly challenges nanosatellites because of an unfavorable surface area to mass ratio and proportionally large volume required for even the smallest attitude control systems. This work explores the limitations on astrophysical attitude knowledge and control in a regime unrestricted by actuato…
▽ More
Accurate and stable spacecraft pointing is a requirement of many astronomical observations. Pointing particularly challenges nanosatellites because of an unfavorable surface area to mass ratio and proportionally large volume required for even the smallest attitude control systems. This work explores the limitations on astrophysical attitude knowledge and control in a regime unrestricted by actuator precision or actuator-induced disturbances such as jitter. The external disturbances on an archetypal 6U CubeSat are modeled and the limiting sensing knowledge is calculated from the available stellar flux and grasp of a telescope within the available volume. These inputs are integrated using a model-predictive control scheme. For a simple test case at 1 Hz, with an 85 mm telescope and a single 11th magnitude star, the achievable body pointing is predicted to be 0.39 arcseconds. For a more general limit, integrating available star light, the achievable attitude sensing is approximately 1 milliarcsecond, which leads to a predicted body pointing accuracy of 20 milliarcseconds after application of the control model. These results show significant room for attitude sensing and control systems to improve before astrophysical and environmental limits are reached.
△ Less
Submitted 23 December, 2021;
originally announced December 2021.
-
Move of a large but delicate apparatus on a trailer with air-ride suspension
Authors:
B. Thomas,
D. Will,
J. Heilman,
K. Tracy,
M. Hotz,
D. Lyapustin,
L. J Rosenberg,
G. Rybka,
A. Wagner,
J. Hoskins,
C. Martin,
N. S. Sullivan,
D. B. Tanner,
S. J. Asztalos,
G. Carosi,
C. Hagmann,
D. Kinion,
K. van Bibber,
R. Bradley,
J. Clarke
Abstract:
When valuable delicate goods are shipped by truck, attention must be paid to vibrations that may cause damage. We present a case study of moving an extremely delicate 6230-kg superconducting magnet, immersed in liquid nitrogen, from Livermore, CA to Seattle, WA showing the steps of fatigue analysis of the load, a test move, and acceleration monitoring of the final move to ensure a successful damag…
▽ More
When valuable delicate goods are shipped by truck, attention must be paid to vibrations that may cause damage. We present a case study of moving an extremely delicate 6230-kg superconducting magnet, immersed in liquid nitrogen, from Livermore, CA to Seattle, WA showing the steps of fatigue analysis of the load, a test move, and acceleration monitoring of the final move to ensure a successful damage-free transport.
△ Less
Submitted 26 May, 2011;
originally announced May 2011.
