On backpropagating Hessians through ODEs
Authors:
Axel Ciceri,
Thomas Fischbacher
Abstract:
We discuss the problem of numerically backpropagating Hessians through ordinary differential equations (ODEs) in various contexts and elucidate how different approaches may be favourable in specific situations. We discuss both theoretical and pragmatic aspects such as, respectively, bounds on computational effort and typical impact of framework overhead.
Focusing on the approach of hand-implemen…
▽ More
We discuss the problem of numerically backpropagating Hessians through ordinary differential equations (ODEs) in various contexts and elucidate how different approaches may be favourable in specific situations. We discuss both theoretical and pragmatic aspects such as, respectively, bounds on computational effort and typical impact of framework overhead.
Focusing on the approach of hand-implemented ODE-backpropagation, we develop the computation for the Hessian of orbit-nonclosure for a mechanical system. We also clarify the mathematical framework for extending the backward-ODE-evolution of the costate-equation to Hessians, in its most generic form. Some calculations, such as that of the Hessian for orbit non-closure, are performed in a language, defined in terms of a formal grammar, that we introduce to facilitate the tracking of intermediate quantities.
As pedagogical examples, we discuss the Hessian of orbit-nonclosure for the higher dimensional harmonic oscillator and conceptually related problems in Newtonian gravitational theory. In particular, applying our approach to the figure-8 three-body orbit, we readily rediscover a distorted-figure-8 solution originally described by Simó.
Possible applications may include: improvements to training of `neural ODE'- type deep learning with second-order methods, numerical analysis of quantum corrections around classical paths, and, more broadly, studying options for adjusting an ODE's initial configuration such that the impact on some given objective function is small.
△ Less
Submitted 19 January, 2023;
originally announced January 2023.
Localization on $AdS_3 \times S^2$ I: the 4d/5d connection in off-shell Euclidean supergravity
Authors:
Axel Ciceri,
Imtak Jeon,
Sameer Murthy
Abstract:
We begin to develop the formalism of localization for the functional integral of supergravity on $AdS_3 \times S^2$. We show how the condition of supersymmetry in the Euclidean $\mathbb{H}^3/\mathbb{Z} \times S^2$ geometry naturally leads to a twist of the S$^2$ around the time direction of $AdS_3$. The twist gives us a five-dimensional Euclidean supergravity background dual to the elliptic genus…
▽ More
We begin to develop the formalism of localization for the functional integral of supergravity on $AdS_3 \times S^2$. We show how the condition of supersymmetry in the Euclidean $\mathbb{H}^3/\mathbb{Z} \times S^2$ geometry naturally leads to a twist of the S$^2$ around the time direction of $AdS_3$. The twist gives us a five-dimensional Euclidean supergravity background dual to the elliptic genus of $(0,4)$ SCFT$_2$ at the semiclassical level. On this background we set up the off-shell BPS equations for one of the Killing spinors, such that the functional integral of five-dimensional Euclidean supergravity on $\mathbb{H}^3/\mathbb{Z} \times S^2$ localizes to its space of solutions. We obtain a class of solutions to these equations by lifting known off-shell BPS solutions of 4-dimensional supergravity on $AdS_2 \times S^2$. In order to do this consistently, we construct and use a Euclidean version of the off-shell 4d/5d lift of arxiv:1112.5371, which could be of independent interest.
△ Less
Submitted 23 June, 2023; v1 submitted 19 January, 2023;
originally announced January 2023.
