-
Hamiltonian Neural Networks with Automatic Symmetry Detection
Authors:
Eva Dierkes,
Christian Offen,
Sina Ober-Blöbaum,
Kathrin Flaßkamp
Abstract:
Recently, Hamiltonian neural networks (HNN) have been introduced to incorporate prior physical knowledge when learning the dynamical equations of Hamiltonian systems. Hereby, the symplectic system structure is preserved despite the data-driven modeling approach. However, preserving symmetries requires additional attention. In this research, we enhance HNN with a Lie algebra framework to detect and…
▽ More
Recently, Hamiltonian neural networks (HNN) have been introduced to incorporate prior physical knowledge when learning the dynamical equations of Hamiltonian systems. Hereby, the symplectic system structure is preserved despite the data-driven modeling approach. However, preserving symmetries requires additional attention. In this research, we enhance HNN with a Lie algebra framework to detect and embed symmetries in the neural network. This approach allows to simultaneously learn the symmetry group action and the total energy of the system. As illustrating examples, a pendulum on a cart and a two-body problem from astrodynamics are considered.
△ Less
Submitted 24 April, 2023; v1 submitted 19 January, 2023;
originally announced January 2023.
-
The Past Does Matter: Correlation of Subsequent States in Trajectory Predictions of Gaussian Process Models
Authors:
Steffen Ridderbusch,
Sina Ober-Blöbaum,
Paul Goulart
Abstract:
Computing the distribution of trajectories from a Gaussian Process model of a dynamical system is an important challenge in utilizing such models. Motivated by the computational cost of sampling-based approaches, we consider approximations of the model's output and trajectory distribution. We show that previous work on uncertainty propagation, focussed on discrete state-space models, incorrectly i…
▽ More
Computing the distribution of trajectories from a Gaussian Process model of a dynamical system is an important challenge in utilizing such models. Motivated by the computational cost of sampling-based approaches, we consider approximations of the model's output and trajectory distribution. We show that previous work on uncertainty propagation, focussed on discrete state-space models, incorrectly included an independence assumption between subsequent states of the predicted trajectories. Expanding these ideas to continuous ordinary differential equation models, we illustrate the implications of this assumption and propose a novel piecewise linear approximation of Gaussian Processes to mitigate them.
△ Less
Submitted 13 May, 2023; v1 submitted 20 November, 2022;
originally announced November 2022.
-
Discrete Lagrangian Neural Networks with Automatic Symmetry Discovery
Authors:
Yana Lishkova,
Paul Scherer,
Steffen Ridderbusch,
Mateja Jamnik,
Pietro Liò,
Sina Ober-Blöbaum,
Christian Offen
Abstract:
By one of the most fundamental principles in physics, a dynamical system will exhibit those motions which extremise an action functional. This leads to the formation of the Euler-Lagrange equations, which serve as a model of how the system will behave in time. If the dynamics exhibit additional symmetries, then the motion fulfils additional conservation laws, such as conservation of energy (time i…
▽ More
By one of the most fundamental principles in physics, a dynamical system will exhibit those motions which extremise an action functional. This leads to the formation of the Euler-Lagrange equations, which serve as a model of how the system will behave in time. If the dynamics exhibit additional symmetries, then the motion fulfils additional conservation laws, such as conservation of energy (time invariance), momentum (translation invariance), or angular momentum (rotational invariance). To learn a system representation, one could learn the discrete Euler-Lagrange equations, or alternatively, learn the discrete Lagrangian function $\mathcal{L}_d$ which defines them. Based on ideas from Lie group theory, in this work we introduce a framework to learn a discrete Lagrangian along with its symmetry group from discrete observations of motions and, therefore, identify conserved quantities. The learning process does not restrict the form of the Lagrangian, does not require velocity or momentum observations or predictions and incorporates a cost term which safeguards against unwanted solutions and against potential numerical issues in forward simulations. The learnt discrete quantities are related to their continuous analogues using variational backward error analysis and numerical results demonstrate the improvement such models can have both qualitatively and quantitatively even in the presence of noise.
△ Less
Submitted 19 November, 2022;
originally announced November 2022.
-
Verification of safety critical control policies using kernel methods
Authors:
Nikolaus Vertovec,
Sina Ober-Blöbaum,
Kostas Margellos
Abstract:
Hamilton-Jacobi reachability methods for safety-critical control have been well studied, but the safety guarantees derived rely on the accuracy of the numerical computation. Thus, it is crucial to understand and account for any inaccuracies that occur due to uncertainty in the underlying dynamics and environment as well as the induced numerical errors. To this end, we propose a framework for model…
▽ More
Hamilton-Jacobi reachability methods for safety-critical control have been well studied, but the safety guarantees derived rely on the accuracy of the numerical computation. Thus, it is crucial to understand and account for any inaccuracies that occur due to uncertainty in the underlying dynamics and environment as well as the induced numerical errors. To this end, we propose a framework for modeling the error of the value function inherent in Hamilton-Jacobi reachability using a Gaussian process. The derived safety controller can be used in conjuncture with arbitrary controllers to provide a safe hybrid control law. The marginal likelihood of the Gaussian process then provides a confidence metric used to determine switches between a least restrictive controller and a safety controller. We test both the prediction as well as the correction capabilities of the presented method in a classical pursuit-evasion example.
△ Less
Submitted 23 March, 2022;
originally announced March 2022.
-
Efficient time step** for numerical integration using reinforcement learning
Authors:
Michael Dellnitz,
Eyke Hüllermeier,
Marvin Lücke,
Sina Ober-Blöbaum,
Christian Offen,
Sebastian Peitz,
Karlson Pfannschmidt
Abstract:
Many problems in science and engineering require an efficient numerical approximation of integrals or solutions to differential equations. For systems with rapidly changing dynamics, an equidistant discretization is often inadvisable as it either results in prohibitively large errors or computational effort. To this end, adaptive schemes, such as solvers based on Runge--Kutta pairs, have been deve…
▽ More
Many problems in science and engineering require an efficient numerical approximation of integrals or solutions to differential equations. For systems with rapidly changing dynamics, an equidistant discretization is often inadvisable as it either results in prohibitively large errors or computational effort. To this end, adaptive schemes, such as solvers based on Runge--Kutta pairs, have been developed which adapt the step size based on local error estimations at each step. While the classical schemes apply very generally and are highly efficient on regular systems, they can behave sub-optimal when an inefficient step rejection mechanism is triggered by structurally complex systems such as chaotic systems. To overcome these issues, we propose a method to tailor numerical schemes to the problem class at hand. This is achieved by combining simple, classical quadrature rules or ODE solvers with data-driven time-step** controllers. Compared with learning solution operators to ODEs directly, it generalises better to unseen initial data as our approach employs classical numerical schemes as base methods. At the same time it can make use of identified structures of a problem class and, therefore, outperforms state-of-the-art adaptive schemes. Several examples demonstrate superior efficiency. Source code is available at https://github.com/lueckem/quadrature-ML.
△ Less
Submitted 3 March, 2022; v1 submitted 8 April, 2021;
originally announced April 2021.
-
Learning ODE Models with Qualitative Structure Using Gaussian Processes
Authors:
Steffen Ridderbusch,
Christian Offen,
Sina Ober-Blöbaum,
Paul Goulart
Abstract:
Recent advances in learning techniques have enabled the modelling of dynamical systems for scientific and engineering applications directly from data. However, in many contexts explicit data collection is expensive and learning algorithms must be data-efficient to be feasible. This suggests using additional qualitative information about the system, which is often available from prior experiments o…
▽ More
Recent advances in learning techniques have enabled the modelling of dynamical systems for scientific and engineering applications directly from data. However, in many contexts explicit data collection is expensive and learning algorithms must be data-efficient to be feasible. This suggests using additional qualitative information about the system, which is often available from prior experiments or domain knowledge. We propose an approach to learning a vector field of differential equations using sparse Gaussian Processes that allows us to combine data and additional structural information, like Lie Group symmetries and fixed points. We show that this combination improves extrapolation performance and long-term behaviour significantly, while also reducing the computational cost.
△ Less
Submitted 27 March, 2021; v1 submitted 10 November, 2020;
originally announced November 2020.
-
C1-continuous space-time discretization based on Hamilton's law of varying action
Authors:
Janine C. Mergel,
Roger A. Sauer,
Sina Ober-Blöbaum
Abstract:
We develop a class of C1-continuous time integration methods that are applicable to conservative problems in elastodynamics. These methods are based on Hamilton's law of varying action. From the action of the continuous system we derive a spatially and temporally weak form of the governing equilibrium equations. This expression is first discretized in space, considering standard finite elements. T…
▽ More
We develop a class of C1-continuous time integration methods that are applicable to conservative problems in elastodynamics. These methods are based on Hamilton's law of varying action. From the action of the continuous system we derive a spatially and temporally weak form of the governing equilibrium equations. This expression is first discretized in space, considering standard finite elements. The resulting system is then discretized in time, approximating the displacement by piecewise cubic Hermite shape functions. Within the time domain we thus achieve C1-continuity for the displacement field and C0-continuity for the velocity field. From the discrete virtual action we finally construct a class of one-step schemes. These methods are examined both analytically and numerically. Here, we study both linear and nonlinear systems as well as inherently continuous and discrete structures. In the numerical examples we focus on one-dimensional applications. The provided theory, however, is general and valid also for problems in 2D or 3D. We show that the most favorable candidate -- denoted as p2-scheme -- converges with order four. Thus, especially if high accuracy of the numerical solution is required, this scheme can be more efficient than methods of lower order. It further exhibits, for linear simple problems, properties similar to variational integrators, such as symplecticity. While it remains to be investigated whether symplecticity holds for arbitrary systems, all our numerical results show an excellent long-term energy behavior.
△ Less
Submitted 15 April, 2016; v1 submitted 27 October, 2015;
originally announced October 2015.
