-
Pitfalls of Projection: A study of Newton-type solvers for incremental potentials
Authors:
Andreas Longva,
Fabian Löschner,
José Antonio Fernández-Fernández,
Egor Larionov,
Uri M. Ascher,
Jan Bender
Abstract:
Nonlinear systems arising from time integrators like Backward Euler can sometimes be reformulated as optimization problems, known as incremental potentials. We show through a comprehensive experimental analysis that the widely used Projected Newton method, which relies on unconditional semidefinite projection of Hessian contributions, typically exhibits a reduced convergence rate compared to class…
▽ More
Nonlinear systems arising from time integrators like Backward Euler can sometimes be reformulated as optimization problems, known as incremental potentials. We show through a comprehensive experimental analysis that the widely used Projected Newton method, which relies on unconditional semidefinite projection of Hessian contributions, typically exhibits a reduced convergence rate compared to classical Newton's method. We demonstrate how factors like resolution, element order, projection method, material model and boundary handling impact convergence of Projected Newton and Newton.
Drawing on these findings, we propose the hybrid method Project-on-Demand Newton, which projects only conditionally, and show that it enjoys both the robustness of Projected Newton and convergence rate of Newton. We additionally introduce Kinetic Newton, a regularization-based method that takes advantage of the structure of incremental potentials and avoids projection altogether. We compare the four solvers on hyperelasticity and contact problems.
We also present a nuanced discussion of convergence criteria, and propose a new acceleration-based criterion that avoids problems associated with existing residual norm criteria and is easier to interpret. We finally address a fundamental limitation of the Armijo backtracking line search that occasionally blocks convergence, especially for stiff problems. We propose a novel parameter-free, robust line search technique to eliminate this issue.
△ Less
Submitted 24 November, 2023;
originally announced November 2023.
-
Neural DAEs: Constrained neural networks
Authors:
Tue Boesen,
Eldad Haber,
Uri Michael Ascher
Abstract:
This article investigates the effect of explicitly adding auxiliary algebraic trajectory information to neural networks for dynamical systems. We draw inspiration from the field of differential-algebraic equations and differential equations on manifolds and implement related methods in residual neural networks, despite some fundamental scenario differences. Constraint or auxiliary information effe…
▽ More
This article investigates the effect of explicitly adding auxiliary algebraic trajectory information to neural networks for dynamical systems. We draw inspiration from the field of differential-algebraic equations and differential equations on manifolds and implement related methods in residual neural networks, despite some fundamental scenario differences. Constraint or auxiliary information effects are incorporated through stabilization as well as projection methods, and we show when to use which method based on experiments involving simulations of multi-body pendulums and molecular dynamics scenarios. Several of our methods are easy to implement in existing code and have limited impact on training performance while giving significant boosts in terms of inference.
△ Less
Submitted 12 March, 2024; v1 submitted 25 November, 2022;
originally announced November 2022.
-
Fully implicit frictional dynamics with soft constraints
Authors:
Egor Larionov,
Andreas Longva,
Uri M. Ascher,
Jan Bender,
Dinesh K. Pai
Abstract:
Dynamics simulation with frictional contacts is important for a wide range of applications, from cloth simulation to object manipulation. Recent methods using smoothed friction forces have enabled robust and differentiable simulation of elastodynamics with friction. However, the resulting frictional behaviors can be qualitatively inaccurate and may not converge to analytic solutions. Here we propo…
▽ More
Dynamics simulation with frictional contacts is important for a wide range of applications, from cloth simulation to object manipulation. Recent methods using smoothed friction forces have enabled robust and differentiable simulation of elastodynamics with friction. However, the resulting frictional behaviors can be qualitatively inaccurate and may not converge to analytic solutions. Here we propose an alternative, fully implicit, formulation for simulating elastodynamics subject to frictional contacts with realistic friction behavior. Furthermore, we demonstrate how higher-order time integration can be used in our method, as well as in incremental potential methods. We develop an inexact Newton method with forward-mode automatic differentiation that simplifies the implementation and improves performance. Finally, we show how our method can be extended to respond to volume changes using a unified penalty function derived from first principles and capable of emulating compressible as well as nearly incompressible media.
△ Less
Submitted 24 November, 2022; v1 submitted 19 November, 2022;
originally announced November 2022.
-
Simulating deformable objects for computer animation: a numerical perspective
Authors:
Uri M. Ascher,
Egor Larionov,
Seung Heon Sheen,
Dinesh K. Pai
Abstract:
We examine a variety of numerical methods that arise when considering dynamical systems in the context of physics-based simulations of deformable objects. Such problems arise in various applications, including animation, robotics, control and fabrication. The goals and merits of suitable numerical algorithms for these applications are different from those of typical numerical analysis research in…
▽ More
We examine a variety of numerical methods that arise when considering dynamical systems in the context of physics-based simulations of deformable objects. Such problems arise in various applications, including animation, robotics, control and fabrication. The goals and merits of suitable numerical algorithms for these applications are different from those of typical numerical analysis research in dynamical systems. Here the mathematical model is not fixed a priori but must be adjusted as necessary to capture the desired behaviour, with an emphasis on effectively producing lively animations of objects with complex geometries. Results are often judged by how realistic they appear to observers (by the "eye-norm") as well as by the efficacy of the numerical procedures employed. And yet, we show that with an adjusted view numerical analysis and applied mathematics can contribute significantly to the development of appropriate methods and their analysis in a variety of areas including finite element methods, stiff and highly oscillatory ODEs, model reduction, and constrained optimization.
△ Less
Submitted 18 August, 2021; v1 submitted 2 March, 2021;
originally announced March 2021.
