Showing 1–50 of 105 results for author: Lelièvre, T

Condensation in Fleming--Viot particle systems with fast selection mechanism

Authors: Lucas Journel, Tony Lelièvre, Julien Reygner

Abstract: We study the Fleming--Viot particle system in a discrete state space, in the regime of a fast selection mechanism, namely with killing rates which grow to infinity. This asymptotics creates a time scale separation which results in the formation of a condensate of all particles, which then evolves according to a continuous-time Markov chain with jump rates depending in a nontrivial way on both the… ▽ More We study the Fleming--Viot particle system in a discrete state space, in the regime of a fast selection mechanism, namely with killing rates which grow to infinity. This asymptotics creates a time scale separation which results in the formation of a condensate of all particles, which then evolves according to a continuous-time Markov chain with jump rates depending in a nontrivial way on both the underlying mutation dynamics and the relative speed of growth to infinity of the killing rate between neighbouring sites. We prove the convergence of the particle system and completely describe the dynamics of the condensate in the case where the number of particles is kept fixed, and partially in the case when the number of particles goes to infinity together with (but slower than) the minimal killing rate. △ Less

Submitted 2 July, 2024; originally announced July 2024.

MSC Class: 60J27 60J80 60F99

Sampling metastable systems using collective variables and Jarzynski-Crooks paths

Authors: Christoph Schönle, Marylou Gabrié, Tony Lelièvre, Gabriel Stoltz

Abstract: We consider the problem of sampling a high dimensional multimodal target probability measure. We assume that a good proposal kernel to move only a subset of the degrees of freedoms (also known as collective variables) is known a priori. This proposal kernel can for example be built using normalizing flows. We show how to extend the move from the collective variable space to the full space and how… ▽ More We consider the problem of sampling a high dimensional multimodal target probability measure. We assume that a good proposal kernel to move only a subset of the degrees of freedoms (also known as collective variables) is known a priori. This proposal kernel can for example be built using normalizing flows. We show how to extend the move from the collective variable space to the full space and how to implement an accept-reject step in order to get a reversible chain with respect to a target probability measure. The accept-reject step does not require to know the marginal of the original measure in the collective variable (namely to know the free energy). The obtained algorithm admits several variants, some of them being very close to methods which have been proposed previously in the literature. We show how the obtained acceptance ratio can be expressed in terms of the work which appears in the Jarzynski-Crooks equality, at least for some variants. Numerical illustrations demonstrate the efficiency of the approach on various simple test cases, and allow us to compare the variants of the algorithm. △ Less

Submitted 17 June, 2024; v1 submitted 28 May, 2024; originally announced May 2024.

Comments: Added references

Optimizing the diffusion coefficient of overdamped Langevin dynamics

Authors: Tony Lelièvre, Grigorios A. Pavliotis, Geneviève Robin, Régis Santet, Gabriel Stoltz

Abstract: Overdamped Langevin dynamics are reversible stochastic differential equations which are commonly used to sample probability measures in high-dimensional spaces, such as the ones appearing in computational statistical physics and Bayesian inference. By varying the diffusion coefficient, there are in fact infinitely many overdamped Langevin dynamics which are reversible with respect to the target pr… ▽ More Overdamped Langevin dynamics are reversible stochastic differential equations which are commonly used to sample probability measures in high-dimensional spaces, such as the ones appearing in computational statistical physics and Bayesian inference. By varying the diffusion coefficient, there are in fact infinitely many overdamped Langevin dynamics which are reversible with respect to the target probability measure at hand. This suggests to optimize the diffusion coefficient in order to increase the convergence rate of the dynamics, as measured by the spectral gap of the generator associated with the stochastic differential equation. We analytically study this problem here, obtaining in particular necessary conditions on the optimal diffusion coefficient. We also derive an explicit expression of the optimal diffusion in some appropriate homogenized limit. Numerical results, both relying on discretizations of the spectral gap problem and Monte Carlo simulations of the stochastic dynamics, demonstrate the increased quality of the sampling arising from an appropriate choice of the diffusion coefficient. △ Less

Submitted 1 May, 2024; v1 submitted 18 April, 2024; originally announced April 2024.

Comments: 76 pages, 11 figures

A spectral approach to the narrow escape problem in the disk

Authors: Tony Lelièvre, Mohamad Rachid, Gabriel Stoltz

Abstract: We study the narrow escape problem in the disk, which consists in identifying the first exit time and first exit point distribution of a Brownian particle from the ball in dimension 2, with reflecting boundary conditions except on small disjoint windows through which it can escape. This problem is motivated by practical questions arising in various scientific fields (in particular cellular biology… ▽ More We study the narrow escape problem in the disk, which consists in identifying the first exit time and first exit point distribution of a Brownian particle from the ball in dimension 2, with reflecting boundary conditions except on small disjoint windows through which it can escape. This problem is motivated by practical questions arising in various scientific fields (in particular cellular biology and molecular dynamics). We apply the quasi-stationary distribution approach to metastability, which requires to study the eigenvalue problem for the Laplacian operator with Dirichlet boundary conditions on the small absorbing part of the boundary, and Neumann boundary conditions on the remaining reflecting part. We obtain rigorous asymptotic estimates of the first eigenvalue and of the normal derivative of the associated eigenfunction in the limit of infinitely small exit regions, which yield asymptotic estimates of the first exit time and first exit point distribution starting from the quasi-stationary distribution within the disk. △ Less

Submitted 8 April, 2024; v1 submitted 12 January, 2024; originally announced January 2024.

An Application of Reduced Basis Methods to Core Computation in APOLLO3

Authors: Yonah Conjungo Taumhas, Geneviève Dusson, Virginie Ehrlacher, Tony Lelièvre, François Madiot

Abstract: In the aim of reducing the computational cost of the resolution of parameter-dependent eigenvalue problems, a model order reduction (MOR) procedure is proposed. We focus on the case of non-self-adjoint generalized eigenvalue problems, such as the stationary multigroup neutron diffusion equations. The method lies in an approximation of the manifold of solutions using a Proper Orthogonal Decompositi… ▽ More In the aim of reducing the computational cost of the resolution of parameter-dependent eigenvalue problems, a model order reduction (MOR) procedure is proposed. We focus on the case of non-self-adjoint generalized eigenvalue problems, such as the stationary multigroup neutron diffusion equations. The method lies in an approximation of the manifold of solutions using a Proper Orthogonal Decomposition approach. The numerical method is composed of two stages. In the offline stage, we build a reduced space which approximates the manifold. In the online stage, for any given new set of parameters, we solve a reduced problem on the reduced space within a much smaller computational time than the required time to solve the high-fidelity problem. This method is applied to core computations in the APOLLO3 code. △ Less

Submitted 23 November, 2023; originally announced November 2023.

Analyzing multimodal probability measures with autoencoders

Authors: Tony Lelièvre, Thomas Pigeon, Gabriel Stoltz, Wei Zhang

Abstract: Finding collective variables to describe some important coarse-grained information on physical systems, in particular metastable states, remains a key issue in molecular dynamics. Recently, machine learning techniques have been intensively used to complement and possibly bypass expert knowledge in order to construct collective variables. Our focus here is on neural network approaches based on auto… ▽ More Finding collective variables to describe some important coarse-grained information on physical systems, in particular metastable states, remains a key issue in molecular dynamics. Recently, machine learning techniques have been intensively used to complement and possibly bypass expert knowledge in order to construct collective variables. Our focus here is on neural network approaches based on autoencoders. We study some relevant mathematical properties of the loss function considered for training autoencoders, and provide physical interpretations based on conditional variances and minimum energy paths. We also consider various extensions in order to better describe physical systems, by incorporating more information on transition states at saddle points, and/or allowing for multiple decoders in order to describe several transition paths. Our results are illustrated on toy two dimensional systems and on alanine dipeptide. △ Less

Submitted 14 March, 2024; v1 submitted 5 October, 2023; originally announced October 2023.

Comments: 37 pages including 15 figures and 2 appendices

Optimal importance sampling for overdamped Langevin dynamics

Authors: M. Chak, T. Lelièvre, G. Stoltz, U. Vaes

Abstract: Calculating averages with respect to multimodal probability distributions is often necessary in applications. Markov chain Monte Carlo (MCMC) methods to this end, which are based on time averages along a realization of a Markov process ergodic with respect to the target probability distribution, are usually plagued by a large variance due to the metastability of the process. In this work, we mathe… ▽ More Calculating averages with respect to multimodal probability distributions is often necessary in applications. Markov chain Monte Carlo (MCMC) methods to this end, which are based on time averages along a realization of a Markov process ergodic with respect to the target probability distribution, are usually plagued by a large variance due to the metastability of the process. In this work, we mathematically analyze an importance sampling approach for MCMC methods that rely on the overdamped Langevin dynamics. Specifically, we study an estimator based on an ergodic average along a realization of an overdamped Langevin process for a modified potential. The estimator we consider incorporates a reweighting term in order to rectify the bias that would otherwise be introduced by this modification of the potential. We obtain an explicit expression in dimension 1 for the biasing potential that minimizes the asymptotic variance of the estimator for a given observable, and propose a general numerical approach for approximating the optimal potential in the multi-dimensional setting. We also investigate an alternative approach where, instead of the asymptotic variance for a given observable, a weighted average of the asymptotic variances corresponding to a class of observables is minimized. Finally, we demonstrate the capabilities of the proposed method by means of numerical experiments. △ Less

Submitted 11 July, 2023; originally announced July 2023.

MSC Class: 35Q82; 35Q93; 60J25; 82M31

Reduced basis method for non-symmetric eigenvalue problems: application to the multigroup neutron diffusion equations

Authors: Yonah Conjungo Taumhas, Geneviève Dusson, Virginie Ehrlacher, Tony Lelièvre, François Madiot

Abstract: In this article, we propose a reduced basis method for parametrized non-symmetric eigenvalue problems arising in the loading pattern optimization of a nuclear core in neutronics. To this end, we derive a posteriori error estimates for the eigenvalue and left and right eigenvectors. The practical computation of these estimators requires the estimation of a constant called prefactor, which we can ex… ▽ More In this article, we propose a reduced basis method for parametrized non-symmetric eigenvalue problems arising in the loading pattern optimization of a nuclear core in neutronics. To this end, we derive a posteriori error estimates for the eigenvalue and left and right eigenvectors. The practical computation of these estimators requires the estimation of a constant called prefactor, which we can express as the spectral norm of some operator. We provide some elements of theoretical analysis which illustrate the link between the expression of the prefactor we obtain here and its well-known expression in the case of symmetric eigenvalue problems, either using the notion of numerical range of the operator, or via a perturbative analysis. Lastly, we propose a practical method in order to estimate this prefactor which yields interesting numerical results on actual test cases. We provide detailed numerical simulations on two-dimensional examples including a multigroup neutron diffusion equation. △ Less

Submitted 12 July, 2023; originally announced July 2023.

Autoencoders for dimensionality reduction in molecular dynamics: collective variable dimension, biasing and transition states

Authors: Zineb Belkacemi, Marc Bianciotto, Herve Minoux, Tony Lelievre, Gabriel Stoltz, Paraskevi Gkeka

Abstract: The heat shock protein 90 (Hsp90) is a molecular chaperone that controls the folding and activation of client proteins using the free energy of ATP hydrolysis. The Hsp90 active site is in its N-terminal domain (NTD). Our goal is to characterize the dynamics of NTD using an autoencoder-learned collective variable (CV) in conjunction with adaptive biasing force (ABF) Langevin dynamics. Using dihedra… ▽ More The heat shock protein 90 (Hsp90) is a molecular chaperone that controls the folding and activation of client proteins using the free energy of ATP hydrolysis. The Hsp90 active site is in its N-terminal domain (NTD). Our goal is to characterize the dynamics of NTD using an autoencoder-learned collective variable (CV) in conjunction with adaptive biasing force (ABF) Langevin dynamics. Using dihedral analysis, we cluster all available experimental Hsp90 NTD structures into distinct native states. We then perform unbiased molecular dynamics (MD) simulations to construct a dataset that represents each state and use this dataset to train an autoencoder. Two autoencoder architectures are considered, with one and two hidden layers respectively, and bottlenecks of dimension $k$ ranging from 1 to 10. We demonstrate that the addition of an extra hidden layer does not significantly improve the performance, while it leads to complicated CVs that increases the computational cost of biased MD calculations. In addition, a 2D bottleneck can provide enough information of the different states, while the optimal bottleneck dimension is five. For the 2D bottleneck, the two-dimensional CV is directly used in biased MD simulations. For the 5D bottleneck, we perform an analysis of the latent CV space and identify the pair of CV coordinates that best separates the states of Hsp90. Interestingly, selecting a 2D CV out of the 5D CV space leads to better results than directly learning a 2D CV, and allows to observe transitions between native states when running free energy biased dynamics. △ Less

Submitted 5 June, 2023; originally announced June 2023.

Unbiasing Hamiltonian Monte Carlo algorithms for a general Hamiltonian function

Authors: Tony Lelièvre, Régis Santet, Gabriel Stoltz

Abstract: Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo method that allows to sample high dimensional probability measures. It relies on the integration of the Hamiltonian dynamics to propose a move which is then accepted or rejected thanks to a Metropolis procedure. Unbiased sampling is guaranteed by the preservation by the numerical integrators of two key properties of the Hamiltonian dynami… ▽ More Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo method that allows to sample high dimensional probability measures. It relies on the integration of the Hamiltonian dynamics to propose a move which is then accepted or rejected thanks to a Metropolis procedure. Unbiased sampling is guaranteed by the preservation by the numerical integrators of two key properties of the Hamiltonian dynamics: volume-preservation and reversibility up to momentum reversal. For separable Hamiltonian functions, some standard explicit numerical schemes, such as the Störmer-Verlet integrator, satisfy these properties. However, for numerical or physical reasons, one may consider a Hamiltonian function which is nonseparable, in which case the standard numerical schemes which preserve the volume and satisfy reversibility up to momentum reversal are implicit. When implemented in practice, such implicit schemes may admit many solutions or none, especially when the timestep is too large. We show here how to enforce the numerical reversibility, and thus unbiasedness, of HMC schemes in this context by introducing a reversibility check. In addition, for some specific forms of the Hamiltonian function, we discuss the consistency of these HMC schemes with some Langevin dynamics, and show in particular that our algorithm yields an efficient discretization of the metropolized overdamped Langevin dynamics with position-dependent diffusion coefficients. Numerical results illustrate the relevance of the reversibility check on simple problems. △ Less

Submitted 5 August, 2023; v1 submitted 28 March, 2023; originally announced March 2023.

Comments: 63 pages, 8 figures

MSC Class: 65 ACM Class: G.1

Computing Surface Reaction Rates by Adaptive Multilevel Splitting Combined with Machine Learning and Ab Initio Molecular Dynamics

Authors: Thomas Pigeon, Gabriel Stoltz, Manuel Corral-Valero, Ani Anciaux-Sedrakian, Maxime Moreaud, Tony Lelièvre, Pascal Raybaud

Abstract: Computing accurate rate constants for catalytic events occurring at the surface of a given material represents a challenging task with multiple potential applications in chemistry. To address this question, we propose an approach based on a combination of the rare event sampling method called Adaptive Multilevel Splitting (AMS) and ab initio molecular dynamics (AIMD). The AMS method requires a one… ▽ More Computing accurate rate constants for catalytic events occurring at the surface of a given material represents a challenging task with multiple potential applications in chemistry. To address this question, we propose an approach based on a combination of the rare event sampling method called Adaptive Multilevel Splitting (AMS) and ab initio molecular dynamics (AIMD). The AMS method requires a one dimensional reaction coordinate to index the progress of the transition. Identifying a good reaction coordinate is difficult, especially for high dimensional problems such a those encountered in catalysis. We probe various approaches to build reaction coordinates such as Support Vector Machine and path collective variables. The AMS is implemented so as to communicate with a DFT-plane wave code. A relevant case study in catalysis: the change of conformation and the dissociation of a water molecule chemisorbed on the (100) $γ$-alumina surface is used to evaluate our approach. The calculated rate constants and transition mechanisms are discussed and compared to those obtained by a conventional static approach based on the Eyring-Polanyi equation with harmonic approximation. It is revealed that the AMS method may provide rate constants which are smaller than the static approach by up to two orders of magnitude due to entropic effects involved in the chemisorbed water. △ Less

Submitted 10 March, 2023; originally announced March 2023.

Comments: 33 pages, 9 figures

Combining machine-learned and empirical force fields with the parareal algorithm: application to the diffusion of atomistic defects

Authors: Olga Gorynina, Frederic Legoll, Tony Lelievre, Danny Perez

Abstract: We numerically investigate an adaptive version of the parareal algorithm in the context of molecular dynamics. This adaptive variant has been originally introduced in [F. Legoll, T. Lelievre and U. Sharma, SISC 2022]. We focus here on test cases of physical interest where the dynamics of the system is modelled by the Langevin equation and is simulated using the molecular dynamics software LAMMPS.… ▽ More We numerically investigate an adaptive version of the parareal algorithm in the context of molecular dynamics. This adaptive variant has been originally introduced in [F. Legoll, T. Lelievre and U. Sharma, SISC 2022]. We focus here on test cases of physical interest where the dynamics of the system is modelled by the Langevin equation and is simulated using the molecular dynamics software LAMMPS. In this work, the parareal algorithm uses a family of machine-learning spectral neighbor analysis potentials (SNAP) as fine, reference, potentials and embedded-atom method potentials (EAM) as coarse potentials. We consider a self-interstitial atom in a tungsten lattice and compute the average residence time of the system in metastable states. Our numerical results demonstrate significant computational gains using the adaptive parareal algorithm in comparison to a sequential integration of the Langevin dynamics. We also identify a large regime of numerical parameters for which statistical accuracy is reached without being a consequence of trajectorial accuracy. △ Less

Submitted 20 December, 2022; originally announced December 2022.

Using Witten Laplacians to locate index-1 saddle points

Authors: Tony Lelièvre, Panos Parpas

Abstract: We introduce a new stochastic algorithm to locate the index-1 saddle points of a function $V:\mathbb R^d \to \mathbb R$, with $d$ possibly large. This algorithm can be seen as an equivalent of the stochastic gradient descent which is a natural stochastic process to locate local minima. It relies on two ingredients: (i) the concentration properties on index-1 saddle points of the first eigenmodes o… ▽ More We introduce a new stochastic algorithm to locate the index-1 saddle points of a function $V:\mathbb R^d \to \mathbb R$, with $d$ possibly large. This algorithm can be seen as an equivalent of the stochastic gradient descent which is a natural stochastic process to locate local minima. It relies on two ingredients: (i) the concentration properties on index-1 saddle points of the first eigenmodes of the Witten Laplacian (associated with $V$) on $1$-forms and (ii) a probabilistic representation of a partial differential equation involving this differential operator. Numerical examples on simple molecular systems illustrate the efficacy of the proposed approach. △ Less

Submitted 23 August, 2023; v1 submitted 20 December, 2022; originally announced December 2022.

MSC Class: 65C35; 37N30; 65K10

Eyring-Kramers exit rates for the overdamped Langevin dynamics: the case with saddle points on the boundary

Authors: Tony Lelièvre, Dorian Le Peutrec, Boris Nectoux

Abstract: Let $(X_t)_{t\ge 0}$ be the stochastic process solution to the overdamped Langevin dynamics $$dX_t=-\nabla f(X_t) \, dt +\sqrt h \, dB_t$$ and let $Ω\subset \mathbb R^d $ be the basin of attraction of a local minimum of $f: \mathbb R^d \to \mathbb R$. Up to a small perturbation of $Ω$ to make it smooth, we prove that the exit rates of $(X_t)_{t\ge 0}$ from $Ω$ through each of the saddle points o… ▽ More Let $(X_t)_{t\ge 0}$ be the stochastic process solution to the overdamped Langevin dynamics $$dX_t=-\nabla f(X_t) \, dt +\sqrt h \, dB_t$$ and let $Ω\subset \mathbb R^d $ be the basin of attraction of a local minimum of $f: \mathbb R^d \to \mathbb R$. Up to a small perturbation of $Ω$ to make it smooth, we prove that the exit rates of $(X_t)_{t\ge 0}$ from $Ω$ through each of the saddle points of $f$ on $\partial Ω$ can be parametrized by the celebrated Eyring-Kramers laws, in the limit $h \to 0$. This result provides firm mathematical grounds to jump Markov models which are used to model the evolution of molecular systems, as well as to some numerical methods which use these underlying jump Markov models to efficiently sample metastable trajectories of the overdamped Langevin dynamics. △ Less

Submitted 19 July, 2022; originally announced July 2022.

Estimation of statistics of transitions and Hill relation for Langevin dynamics

Authors: Tony Lelièvre, Mouad Ramil, Julien Reygner

Abstract: In molecular dynamics, statistics of transitions, such as the mean transition time, are macroscopic observables which provide important dynamical information on the underlying microscopic stochastic process. A direct estimation using simulations of microscopic trajectories over long time scales is typically computationally intractable in metastable situations. To overcome this issue, several numer… ▽ More In molecular dynamics, statistics of transitions, such as the mean transition time, are macroscopic observables which provide important dynamical information on the underlying microscopic stochastic process. A direct estimation using simulations of microscopic trajectories over long time scales is typically computationally intractable in metastable situations. To overcome this issue, several numerical methods rely on a potential-theoretic identity, sometimes attributed to Hill in the computational statistical physics litterature, which expresses statistics of transitions in terms of the invariant measure of the sequence of configurations by which the underlying process enters metastable sets. The use of this identity then allows to replace the long time simulation problem with a rare event sampling problem, for which efficient algorithms are available. In this article, we rigorously analyse such a method for molecular systems modelled by the Langevin dynamics. Our main contributions are twofold. First, we prove the Hill relation in the fairly general context of positive Harris recurrent chains, and show that this formula applies to the Langevin dynamics. Second, we provide an explicit expression of the invariant measure involved in the Hill relation, and describe an elementary exact simulation procedure. Overall, this yields a simple and complete numerical method to estimate statistics of transitions. △ Less

Submitted 15 May, 2023; v1 submitted 27 June, 2022; originally announced June 2022.

Comments: Accepted version

Generative methods for sampling transition paths in molecular dynamics

Authors: Tony Lelièvre, Geneviève Robin, Inass Sekkat, Gabriel Stoltz, Gabriel Victorino Cardoso

Abstract: Molecular systems often remain trapped for long times around some local minimum of the potential energy function, before switching to another one -- a behavior known as metastability. Simulating transition paths linking one metastable state to another one is difficult by direct numerical methods. In view of the promises of machine learning techniques, we explore in this work two approaches to more… ▽ More Molecular systems often remain trapped for long times around some local minimum of the potential energy function, before switching to another one -- a behavior known as metastability. Simulating transition paths linking one metastable state to another one is difficult by direct numerical methods. In view of the promises of machine learning techniques, we explore in this work two approaches to more efficiently generate transition paths: sampling methods based on generative models such as variational autoencoders, and importance sampling methods based on reinforcement learning. △ Less

Submitted 31 January, 2023; v1 submitted 5 May, 2022; originally announced May 2022.

Enhanced sampling methods for molecular dynamics simulations

Authors: Jérôme Hénin, Tony Lelièvre, Michael R. Shirts, Omar Valsson, Lucie Delemotte

Abstract: Enhanced sampling algorithms have emerged as powerful methods to extend the utility of molecular dynamics simulations and allow the sampling of larger portions of the configuration space of complex systems in a given amount of simulation time. This review aims to present the unifying principles and differences of many of the computational methods currenly used for enhanced sampling in molecular si… ▽ More Enhanced sampling algorithms have emerged as powerful methods to extend the utility of molecular dynamics simulations and allow the sampling of larger portions of the configuration space of complex systems in a given amount of simulation time. This review aims to present the unifying principles and differences of many of the computational methods currenly used for enhanced sampling in molecular simulations of biomolecules, soft matter and molecular crystals. Indeed, despite the apparent abundance and divergence of such methods, the principles at their core can be boiled down to a relatively limited number of statistical and physical principles. To enable comparisons, the various methods are introduced using similar terminology and notation. We then illustrate in which ways many different methods combine principles from a smaller class of enhanced sampling concepts. This review is intended for scientists with an understanding of the basics of molecular dynamics simulations and statistical physics who want a deeper understanding of the ideas that underlie various enhanced sampling methods and the relationships between them. This living review is intended to be updated to continue to reflect the wealth of sampling methods as they continue to emerge in the literature. △ Less

Submitted 25 August, 2022; v1 submitted 8 February, 2022; originally announced February 2022.

Comments: 59 pages, 7 figures

Journal ref: Living J. Comput. Mol. Sci, 4(1), 1583 (2022)

Optimal friction matrix for underdamped Langevin sampling

Authors: Martin Chak, Nikolas Kantas, Tony Lelièvre, Grigorios A. Pavliotis

Abstract: A systematic procedure for optimising the friction coefficient in underdamped Langevin dynamics as a sampling tool is given by taking the gradient of the associated asymptotic variance with respect to friction. We give an expression for this gradient in terms of the solution to an appropriate Poisson equation and show that it can be approximated by short simulations of the associated first variati… ▽ More A systematic procedure for optimising the friction coefficient in underdamped Langevin dynamics as a sampling tool is given by taking the gradient of the associated asymptotic variance with respect to friction. We give an expression for this gradient in terms of the solution to an appropriate Poisson equation and show that it can be approximated by short simulations of the associated first variation/tangent process under concavity assumptions on the log density. Our algorithm is applied to the estimation of posterior means in Bayesian inference problems and reduced variance is demonstrated when compared to the original underdamped and overdamped Langevin dynamics in both full and stochastic gradient cases. △ Less

Submitted 30 November, 2021; originally announced December 2021.

Comments: 44 pages, 6 figures

MSC Class: 60J25; 60J60

Influence of sampling on the convergence rates of greedy algorithms for parameter-dependent random variables

Authors: Mohamed-Raed Blel, Virginie Ehrlacher, Tony Lelièvre

Abstract: The main focus of this article is to provide a mathematical study of the algorithm proposed in \cite{boyaval2010variance} where the authors proposed a variance reduction technique for the computation of parameter-dependent expectations using a reduced basis paradigm. We study the effect of Monte-Carlo sampling on the theoretical properties of greedy algorithms. In particular, using concentration i… ▽ More The main focus of this article is to provide a mathematical study of the algorithm proposed in \cite{boyaval2010variance} where the authors proposed a variance reduction technique for the computation of parameter-dependent expectations using a reduced basis paradigm. We study the effect of Monte-Carlo sampling on the theoretical properties of greedy algorithms. In particular, using concentration inequalities for the empirical measure in Wasserstein distance proved in \cite{fournier2015rate}, we provide sufficient conditions on the number of samples used for the computation of empirical variances at each iteration of the greedy procedure to guarantee that the resulting method algorithm is a weak greedy algorithm with high probability. These theoretical results are not fully practical and we therefore propose a heuristic procedure to choose the number of Monte-Carlo samples at each iteration, inspired from this theoretical study, which provides satisfactory results on several numerical test cases. △ Less

Submitted 23 September, 2021; v1 submitted 28 May, 2021; originally announced May 2021.

Chasing Collective Variables using Autoencoders and biased trajectories

Authors: Zineb Belkacemi, Paraskevi Gkeka, Tony Lelièvre, Gabriel Stoltz

Abstract: Free energy biasing methods have proven to be powerful tools to accelerate the simulation of important conformational changes of molecules by modifying the sampling measure. However, most of these methods rely on the prior knowledge of low-dimensional slow degrees of freedom, i.e. Collective Variables (CV). Alternatively, such CVs can be identified using machine learning (ML) and dimensionality re… ▽ More Free energy biasing methods have proven to be powerful tools to accelerate the simulation of important conformational changes of molecules by modifying the sampling measure. However, most of these methods rely on the prior knowledge of low-dimensional slow degrees of freedom, i.e. Collective Variables (CV). Alternatively, such CVs can be identified using machine learning (ML) and dimensionality reduction algorithms. In this context, approaches where the CVs are learned in an iterative way using adaptive biasing have been proposed: at each iteration, the learned CV is used to perform free energy adaptive biasing to generate new data and learn a new CV. In this paper, we introduce a new iterative method involving CV learning with autoencoders: Free Energy Biasing and Iterative Learning with AutoEncoders (FEBILAE). Our method includes a reweighting scheme to ensure that the learning model optimizes the same loss at each iteration, and achieves CV convergence. Using the alanine dipeptide system and the solvated chignolin mini-protein system as examples, we present results of our algorithm using the extended adaptive biasing force as the free energy adaptive biasing method. △ Less

Submitted 19 October, 2021; v1 submitted 22 April, 2021; originally announced April 2021.

Comments: 57 pages, 15 figures

The Adaptive Biasing Force algorithm with non-conservative forces and related topics

Authors: Tony Lelièvre, Lise Maurin, Pierre Monmarché

Abstract: We propose a study of the Adaptive Biasing Force method's robustness under generic (possibly non-conservative) forces. We first ensure the flat histogram property is satisfied in all cases. We then introduce a fixed point problem yielding the existence of a stationary state for both the Adaptive Biasing Force and Projected Adapted Biasing Force algorithms, relying on generic bounds on the invarian… ▽ More We propose a study of the Adaptive Biasing Force method's robustness under generic (possibly non-conservative) forces. We first ensure the flat histogram property is satisfied in all cases. We then introduce a fixed point problem yielding the existence of a stationary state for both the Adaptive Biasing Force and Projected Adapted Biasing Force algorithms, relying on generic bounds on the invariant probability measures of homogeneous diffusions. Using classical entropy techniques, we prove the exponential convergence of both biasing force and law as time goes to infinity, for both the Adaptive Biasing Force and the Projected Adaptive Biasing Force methods. △ Less

Submitted 19 February, 2021; originally announced February 2021.

Quasi-stationary distribution for the Langevin process in cylindrical domains, part I: existence, uniqueness and long-time convergence

Authors: Tony Lelièvre, Mouad Ramil, Julien Reygner

Abstract: Consider the Langevin process, described by a vector (position,momentum) in $\mathbb{R}^{d}\times\mathbb{R}^d$. Let $\mathcal O$ be a $\mathcal{C}^2$ open bounded and connected set of $\mathbb{R}^d$. We prove the compactness of the semigroup of the Langevin process absorbed at the boundary of the domain $D:=\mathcal{O}\times\mathbb{R}^d$. We then obtain the existence of a unique quasi-stationary d… ▽ More Consider the Langevin process, described by a vector (position,momentum) in $\mathbb{R}^{d}\times\mathbb{R}^d$. Let $\mathcal O$ be a $\mathcal{C}^2$ open bounded and connected set of $\mathbb{R}^d$. We prove the compactness of the semigroup of the Langevin process absorbed at the boundary of the domain $D:=\mathcal{O}\times\mathbb{R}^d$. We then obtain the existence of a unique quasi-stationary distribution (QSD) for the Langevin process on $D$. We also provide a spectral interpretation of this QSD and obtain an exponential convergence of the Langevin process conditioned on non-absorption towards the QSD. △ Less

Submitted 24 September, 2021; v1 submitted 28 January, 2021; originally announced January 2021.

The exit from a metastable state: concentration of the exit point distribution on the low energy saddle points, part 2

Authors: Tony Lelièvre, Dorian Le Peutrec, Boris Nectoux

Abstract: We consider the first exit point distribution from a bounded domain $Ω$ of the stochastic process $(X_t)_{t\ge 0}$ solution to the overdamped Langevin dynamics $$d X_t = -\nabla f(X_t) d t + \sqrt{h} \ d B_t$$ starting from deterministic initial conditions in $Ω$, under rather general assumptions on $f$ (for instance, $f$ may have several critical points in $Ω$). This work is a continuation of… ▽ More We consider the first exit point distribution from a bounded domain $Ω$ of the stochastic process $(X_t)_{t\ge 0}$ solution to the overdamped Langevin dynamics $$d X_t = -\nabla f(X_t) d t + \sqrt{h} \ d B_t$$ starting from deterministic initial conditions in $Ω$, under rather general assumptions on $f$ (for instance, $f$ may have several critical points in $Ω$). This work is a continuation of the previous paper \cite{DLLN-saddle1} where the exit point distribution from $Ω$ is studied when $X_0$ is initially distributed according to the quasi-stationary distribution of $(X_t)_{t\ge 0}$ in $Ω$. The proofs are based on analytical results on the dependency of the exit point distribution on the initial condition, large deviation techniques and results on the genericity of Morse functions. △ Less

Submitted 15 December, 2020; originally announced December 2020.

A probabilistic study of the kinetic Fokker-Planck equation in cylindrical domains

Authors: Tony Lelièvre, Mouad Ramil, Julien Reygner

Abstract: We consider classical solutions to the kinetic Fokker-Planck equation on a bounded domain $\mathcal O \subset~\mathbb{R}^d$ in position, and we obtain a probabilistic representation of the solutions using the Langevin diffusion process with absorbing boundary conditions on the boundary of the phase-space cylindrical domain $D = \mathcal O \times \mathbb{R}^d$. Furthermore, a Harnack inequality, as… ▽ More We consider classical solutions to the kinetic Fokker-Planck equation on a bounded domain $\mathcal O \subset~\mathbb{R}^d$ in position, and we obtain a probabilistic representation of the solutions using the Langevin diffusion process with absorbing boundary conditions on the boundary of the phase-space cylindrical domain $D = \mathcal O \times \mathbb{R}^d$. Furthermore, a Harnack inequality, as well as a maximum principle, is provided on $D$ for solutions to this kinetic Fokker-Planck equation, together with the existence of a smooth transition density for the associated absorbed Langevin process. This transition density is shown to satisfy an explicit Gaussian upper-bound. Finally, the continuity and positivity of this transition density at the boundary of $D$ is also studied. All these results are in particular crucial to study the behavior of the Langevin diffusion process when it is trapped in a metastable state defined in terms of positions. △ Less

Submitted 14 March, 2022; v1 submitted 20 October, 2020; originally announced October 2020.

MSC Class: 82C31; 35B50; 35B65; 60H10

On the Hill relation and the mean reaction time for metastable processes

Authors: Manon Baudel, Arnaud Guyader, Tony Lelièvre

Abstract: We illustrate how the Hill relation and the notion of quasi-stationary distribution can be used to analyse the biasing error introduced by many numerical procedures that have been proposed in the literature, in particular in molecular dynamics, to compute mean reaction times between metastable states for Markov processes. The theoretical findings are illustrated on various examples demonstrating t… ▽ More We illustrate how the Hill relation and the notion of quasi-stationary distribution can be used to analyse the biasing error introduced by many numerical procedures that have been proposed in the literature, in particular in molecular dynamics, to compute mean reaction times between metastable states for Markov processes. The theoretical findings are illustrated on various examples demonstrating the sharpness of the biasing error analysis as well as the applicability of our study to elliptic diffusions. △ Less

Submitted 8 November, 2022; v1 submitted 22 August, 2020; originally announced August 2020.

MSC Class: 60J22; 65C40; 82C31

Adaptive force biasing algorithms: new convergence results and tensor approximations of the bias

Authors: Virginie Ehrlacher, Tony Lelièvre, Pierre Monmarché

Abstract: A modification of the Adaptive Biasing Force method is introduced, in which the free energy is approximated by a sum of tensor products of one-dimensional functions. This enables to handle a larger number of reaction coordinates than the classical algorithm. We prove the algorithm is well-defined and prove the long-time convergence toward a regularized version of the free energy for an idealized v… ▽ More A modification of the Adaptive Biasing Force method is introduced, in which the free energy is approximated by a sum of tensor products of one-dimensional functions. This enables to handle a larger number of reaction coordinates than the classical algorithm. We prove the algorithm is well-defined and prove the long-time convergence toward a regularized version of the free energy for an idealized version of the algorithm. Numerical experiments demonstrate that the method is able to capture correlations between reaction coordinates. △ Less

Submitted 20 July, 2020; originally announced July 2020.

MSC Class: 65C05; 65N12

Machine learning force fields and coarse-grained variables in molecular dynamics: application to materials and biological systems

Authors: Paraskevi Gkeka, Gabriel Stoltz, Amir Barati Farimani, Zineb Belkacemi, Michele Ceriotti, John Chodera, Aaron R. Dinner, Andrew Ferguson, Jean-Bernard Maillet, Hervé Minoux, Christine Peter, Fabio Pietrucci, Ana Silveira, Alexandre Tkatchenko, Zofia Trstanova, Rafal Wiewiora, Tony Leliévre

Abstract: Machine learning encompasses a set of tools and algorithms which are now becoming popular in almost all scientific and technological fields. This is true for molecular dynamics as well, where machine learning offers promises of extracting valuable information from the enormous amounts of data generated by simulation of complex systems. We provide here a review of our current understanding of goals… ▽ More Machine learning encompasses a set of tools and algorithms which are now becoming popular in almost all scientific and technological fields. This is true for molecular dynamics as well, where machine learning offers promises of extracting valuable information from the enormous amounts of data generated by simulation of complex systems. We provide here a review of our current understanding of goals, benefits, and limitations of machine learning techniques for computational studies on atomistic systems, focusing on the construction of empirical force fields from ab-initio databases and the determination of reaction coordinates for free energy computation and enhanced sampling. △ Less

Submitted 15 April, 2020; originally announced April 2020.

Multiple projection MCMC algorithms on submanifolds

Authors: Tony Lelièvre, Gabriel Stoltz, Wei Zhang

Abstract: We propose new Markov Chain Monte Carlo algorithms to sample probability distributions on submanifolds, which generalize previous methods by allowing the use of set-valued maps in the proposal step of the MCMC algorithms. The motivation for this generalization is that the numerical solvers used to project proposed moves to the submanifold of interest may find several solutions. We show that the ne… ▽ More We propose new Markov Chain Monte Carlo algorithms to sample probability distributions on submanifolds, which generalize previous methods by allowing the use of set-valued maps in the proposal step of the MCMC algorithms. The motivation for this generalization is that the numerical solvers used to project proposed moves to the submanifold of interest may find several solutions. We show that the new algorithms indeed sample the target probability measure correctly, thanks to some carefully enforced reversibility property. We demonstrate the interest of the new MCMC algorithms on illustrative numerical examples. △ Less

Submitted 6 October, 2021; v1 submitted 20 March, 2020; originally announced March 2020.

Parareal computation of stochastic differential equations with time-scale separation: a numerical study

Authors: Tony Lelièvre, Frédéric Legoll, Keith Myerscough, Giovanni Samaey

Abstract: The parareal algorithm is known to allow for a significant reduction in wall clock time for accurate numerical solutions by parallelising across the time dimension. We present and test a micro-macro version of parareal, in which the fine propagator is based on a (high-dimensional, slow-fast) stochastic microscopic model, and the coarse propagator is based on a low-dimensional approximate effective… ▽ More The parareal algorithm is known to allow for a significant reduction in wall clock time for accurate numerical solutions by parallelising across the time dimension. We present and test a micro-macro version of parareal, in which the fine propagator is based on a (high-dimensional, slow-fast) stochastic microscopic model, and the coarse propagator is based on a low-dimensional approximate effective dynamics at slow time scales. At the microscopic level, we use an ensemble of Monte Carlo particles, whereas the approximate coarse propagator uses the (deterministic) Fokker-Planck equation for the slow degrees of freedom. The required coupling between microscopic and macroscopic representations of the system introduces several design options, specifically on how to generate a microscopic probability distribution consistent with a required macroscopic probability distribution and how to perform the coarse-level updating of the macroscopic probability distribution in a meaningful manner. We numerically study how these design options affect the efficiency of the algorithm in a number of situations. The choice of the coarse-level updating operator strongly impacts the result, with a superior performance if addition and subtraction of the quantile function (inverse cumulative distribution) is used. How microscopic states are generated has a less pronounced impact, provided a suitable prior microscopic state is used. △ Less

Submitted 19 December, 2019; originally announced December 2019.

MSC Class: 65M75

Statistical Estimation of the Poincar{é} constant and Application to Sampling Multimodal Distributions

Authors: Loucas Pillaud-Vivien, Francis Bach, Tony Lelièvre, Alessandro Rudi, Gabriel Stoltz

Abstract: Poincar{é} inequalities are ubiquitous in probability and analysis and have various applications in statistics (concentration of measure, rate of convergence of Markov chains). The Poincar{é} constant, for which the inequality is tight, is related to the typical convergence rate of diffusions to their equilibrium measure. In this paper, we show both theoretically and experimentally that, given suf… ▽ More Poincar{é} inequalities are ubiquitous in probability and analysis and have various applications in statistics (concentration of measure, rate of convergence of Markov chains). The Poincar{é} constant, for which the inequality is tight, is related to the typical convergence rate of diffusions to their equilibrium measure. In this paper, we show both theoretically and experimentally that, given sufficiently many samples of a measure, we can estimate its Poincar{é} constant. As a by-product of the estimation of the Poincar{é} constant, we derive an algorithm that captures a low dimensional representation of the data by finding directions which are difficult to sample. These directions are of crucial importance for sampling or in fields like molecular dynamics, where they are called reaction coordinates. Their knowledge can leverage, with a simple conditioning step, computational bottlenecks by using importance sampling techniques. △ Less

Submitted 22 November, 2019; v1 submitted 28 October, 2019; originally announced October 2019.

Convergence of metadynamics: discussion of the adiabatic hypothesis

Authors: Benjamin Jourdain, Tony Lelièvre, Pierre-André Zitt

Abstract: By drawing a parallel between metadynamics and self interacting models for polymers, we study the longtime convergence of the original metadynamics algorithm in the adiabatic setting, namely when the dynamics along the collective variables decouples from the dynamics along the other degrees of freedom. We also discuss the bias which is introduced when the adiabatic assumption does not holds. By drawing a parallel between metadynamics and self interacting models for polymers, we study the longtime convergence of the original metadynamics algorithm in the adiabatic setting, namely when the dynamics along the collective variables decouples from the dynamics along the other degrees of freedom. We also discuss the bias which is introduced when the adiabatic assumption does not holds. △ Less

Submitted 18 April, 2019; originally announced April 2019.

The exit from a metastable state: concentration of the exit point distribution on the low energy saddle points

Authors: Giacomo Di Gesù, Tony Lelièvre, Dorian Le Peutrec, Boris Nectoux

Abstract: We consider the first exit point distribution from a bounded domain $Ω$ of the stochastic process $(X_t)_{t\ge 0}$ solution to the overdamped Langevin dynamics $$d X_t = -\nabla f(X_t) d t + \sqrt{h} \ d B_t$$ starting from the quasi-stationary distribution in $Ω$. In the small temperature regime ($h\to 0$) and under rather general assumptions on $f$ (in particular, $f$ may have several critical p… ▽ More We consider the first exit point distribution from a bounded domain $Ω$ of the stochastic process $(X_t)_{t\ge 0}$ solution to the overdamped Langevin dynamics $$d X_t = -\nabla f(X_t) d t + \sqrt{h} \ d B_t$$ starting from the quasi-stationary distribution in $Ω$. In the small temperature regime ($h\to 0$) and under rather general assumptions on $f$ (in particular, $f$ may have several critical points in $Ω$), it is proven that the support of the distribution of the first exit point concentrates on some points realizing the minimum of $f$ on $\partial Ω$. The proof relies on tools to study tunnelling effects in semi-classical analysis. Extensions of the results to more general initial distributions than the quasi-stationary distribution are also presented. △ Less

Submitted 8 February, 2019; originally announced February 2019.

Comments: 113

Local and Global Perspectives on Diffusion Maps in the Analysis of Molecular Systems

Authors: Zofia Trstanova, Ben Leimkuhler, Tony Lelièvre

Abstract: Diffusion maps approximate the generator of Langevin dynamics from simulation data. They afford a means of identifying the slowly-evolving principal modes of high-dimensional molecular systems. When combined with a biasing mechanism, diffusion maps can accelerate the sampling of the stationary Boltzmann-Gibbs distribution. In this work, we contrast the local and global perspectives on diffusion ma… ▽ More Diffusion maps approximate the generator of Langevin dynamics from simulation data. They afford a means of identifying the slowly-evolving principal modes of high-dimensional molecular systems. When combined with a biasing mechanism, diffusion maps can accelerate the sampling of the stationary Boltzmann-Gibbs distribution. In this work, we contrast the local and global perspectives on diffusion maps, based on whether or not the data distribution has been fully explored. In the global setting, we use diffusion maps to identify metastable sets and to approximate the corresponding committor functions of transitions between them. We also discuss the use of diffusion maps within the metastable sets, formalising the locality via the concept of the quasi-stationary distribution and justifying the convergence of diffusion maps within a local equilibrium. This perspective allows us to propose an enhanced sampling algorithm. We demonstrate the practical relevance of these approaches both for simple models and for molecular dynamics problems (alanine dipeptide and deca-alanine). △ Less

Submitted 24 November, 2019; v1 submitted 21 January, 2019; originally announced January 2019.

Exit event from a metastable state and Eyring-Kramers law for the overdamped Langevin dynamics

Authors: Tony Lelièvre, Dorian Le Peutrec, Boris Nectoux

Abstract: In molecular dynamics, several algorithms have been designed over the past few years to accelerate the exit event from a metastable region of the configuration space. Some of them are based on the fact that the exit event from a metastable region is well approximated by a Markov jump process. In this work, we present recent results on the exit event from a metastable region for the overdamped Lang… ▽ More In molecular dynamics, several algorithms have been designed over the past few years to accelerate the exit event from a metastable region of the configuration space. Some of them are based on the fact that the exit event from a metastable region is well approximated by a Markov jump process. In this work, we present recent results on the exit event from a metastable region for the overdamped Langevin dynamics obtained in [17, 18, 49]. These results aim in particular at justifying the use of a Markov jump process parametrized by the Eyring-Kramers law to model the exit event from a metastable region. △ Less

Submitted 16 November, 2018; originally announced November 2018.

On a new class of score functions to estimate tail probabilities of some stochastic processes with Adaptive Multilevel Splitting

Authors: Charles-Edouard Bréhier, Tony Lelièvre

Abstract: We investigate the application of the Adaptive Multilevel Splitting algorithm for the estimation of tail probabilities of solutions of Stochastic Differential Equations evaluated at a given time, and of associated temporal averages. We introduce a new, very general and effective family of score functions which is designed for these problems. We illustrate its behavior on a series of numerical ex… ▽ More We investigate the application of the Adaptive Multilevel Splitting algorithm for the estimation of tail probabilities of solutions of Stochastic Differential Equations evaluated at a given time, and of associated temporal averages. We introduce a new, very general and effective family of score functions which is designed for these problems. We illustrate its behavior on a series of numerical experiments. In particular, we demonstrate how it can be used to estimate large deviation rate functionals for the longtime limit of temporal averages. △ Less

Submitted 15 November, 2018; originally announced November 2018.

Effective dynamics for non-reversible stochastic differential equations: a quantitative study

Authors: Frédéric Legoll, Tony Lelièvre, Upanshu Sharma

Abstract: Coarse-graining is central to reducing dimensionality in molecular dynamics, and is typically characterized by a map** which projects the full state of the system to a smaller class of variables. While extensive literature has been devoted to coarse-graining starting from reversible systems, not much is known in the non-reversible setting. In this article, starting with a non-reversible dynamics… ▽ More Coarse-graining is central to reducing dimensionality in molecular dynamics, and is typically characterized by a map** which projects the full state of the system to a smaller class of variables. While extensive literature has been devoted to coarse-graining starting from reversible systems, not much is known in the non-reversible setting. In this article, starting with a non-reversible dynamics, we introduce and study an effective dynamics which approximates the (non-closed) projected dynamics. Under fairly weak conditions on the system, we prove error bounds on the trajectorial error between the projected and the effective dynamics. In addition to extending existing results to the non-reversible setting, our error estimates also indicate that the notion of mean force motivated by this effective dynamics is a good one. △ Less

Submitted 27 September, 2018; originally announced September 2018.

gen.parRep: a first implementation of the Generalized Parallel Replica dynamics for the long time simulation of metastable biochemical systems

Authors: Florent Hédin, Tony Lelièvre

Abstract: Metastability is one of the major encountered obstacle when performing long molecular dynamics simulations, and many methods were developed to address this challenge. The "Parallel Replica" (ParRep) dynamics is known for allowing to simulate very long trajectories of metastable Langevin dynamics in the materials science community, but it relies on assumptions that can hardly be transposed to the w… ▽ More Metastability is one of the major encountered obstacle when performing long molecular dynamics simulations, and many methods were developed to address this challenge. The "Parallel Replica" (ParRep) dynamics is known for allowing to simulate very long trajectories of metastable Langevin dynamics in the materials science community, but it relies on assumptions that can hardly be transposed to the world of biochemical simulations. The later developed "Generalized ParRep" variant solves those issues, but it was not applied to significant systems of interest so far. In this article, we present the program gen.parRep, the first publicly available implementation of the Generalized Parallel Replica method (BSD 3-Clause license), targeting frequently encountered metastable biochemical systems, such as conformational equilibria or dissociation of protein-ligand complexes. It will be shown that the resulting C++ implementation exhibits a strong linear scalability, providing up to 70 % of the maximum possible speedup on several hundreds of CPUs. △ Less

Submitted 18 December, 2018; v1 submitted 6 July, 2018; originally announced July 2018.

Comments: Third version of the article. 37 pages (including references), 13 Figures, 3 Tables

Hybrid Monte Carlo methods for sampling probability measures on submanifolds

Authors: Tony Lelièvre, Mathias Rousset, Gabriel Stoltz

Abstract: Probability measures supported on submanifolds can be sampled by adding an extra momentum variable to the state of the system, and discretizing the associated Hamiltonian dynamics with some stochastic perturbation in the extra variable. In order to avoid biases in the invariant probability measures sampled by discretizations of these stochastically perturbed Hamiltonian dynamics, a Metropolis reje… ▽ More Probability measures supported on submanifolds can be sampled by adding an extra momentum variable to the state of the system, and discretizing the associated Hamiltonian dynamics with some stochastic perturbation in the extra variable. In order to avoid biases in the invariant probability measures sampled by discretizations of these stochastically perturbed Hamiltonian dynamics, a Metropolis rejection procedure can be considered. The so-obtained scheme belongs to the class of generalized Hybrid Monte Carlo (GHMC) algorithms. We show here how to generalize to GHMC a procedure suggested by Goodman, Holmes-Cerfon and Zappa for Metropolis random walks on submanifolds, where a reverse projection check is performed to enforce the reversibility of the algorithm for large timesteps and hence avoid biases in the invariant measure. We also provide a full mathematical analysis of such procedures, as well as numerical experiments demonstrating the importance of the reverse projection check on simple toy examples. △ Less

Submitted 11 October, 2019; v1 submitted 6 July, 2018; originally announced July 2018.

Comments: V3 corrects an error in the pseudo-code of V2

MSC Class: 65P10; 65C40; 82-08

Central Limit Theorem for stationary Fleming--Viot particle systems in finite spaces

Authors: Tony Lelievre, Loucas Pillaud-Vivien, Julien Reygner

Abstract: We consider the Fleming--Viot particle system associated with a continuous-time Markov chain in a finite space. Assuming irreducibility, it is known that the particle system possesses a unique stationary distribution, under which its empirical measure converges to the quasistationary distribution of the Markov chain. We complement this Law of Large Numbers with a Central Limit Theorem. Our proof… ▽ More We consider the Fleming--Viot particle system associated with a continuous-time Markov chain in a finite space. Assuming irreducibility, it is known that the particle system possesses a unique stationary distribution, under which its empirical measure converges to the quasistationary distribution of the Markov chain. We complement this Law of Large Numbers with a Central Limit Theorem. Our proof essentially relies on elementary computations on the infinitesimal generator of the Fleming--Viot particle system, and involves the so-called $π$-return process in the expression of the asymptotic variance. Our work can be seen as an infinite-time version, in the setting of finite space Markov chains, of results by Del Moral and Miclo [ESAIM: Probab. Statist., 2003] and C{é}rou, Delyon, Guyader and Rousset [arXiv:1611.00515, arXiv:1709.06771]. △ Less

Submitted 2 October, 2018; v1 submitted 12 June, 2018; originally announced June 2018.

Journal ref: ALEA : Latin American Journal of Probability and Mathematical Statistics, Instituto Nacional de Matem{á}tica Pura e Aplicada, 2018, 15, pp.1163-1182

Pathwise estimates for effective dynamics: the case of nonlinear vectorial reaction coordinates

Authors: Tony Lelièvre, Wei Zhang

Abstract: Effective dynamics using conditional expectation was proposed in [F. Legoll and T. Lelièvre, Nonlinearity, 2010] to approximate the essential dynamics of high-dimensional diffusion processes along a given reaction coordinate. The approximation error of the effective dynamics when it is used to approximate the behavior of the original dynamics has been considered in recent years. As a continuation… ▽ More Effective dynamics using conditional expectation was proposed in [F. Legoll and T. Lelièvre, Nonlinearity, 2010] to approximate the essential dynamics of high-dimensional diffusion processes along a given reaction coordinate. The approximation error of the effective dynamics when it is used to approximate the behavior of the original dynamics has been considered in recent years. As a continuation of the previous work [F. Legoll, T. Lelièvre, and S. Olla, Stoch. Process. Appl, 2017], in this paper we obtain pathwise estimates for effective dynamics when the reaction coordinate function is either nonlinear or vector-valued. △ Less

Submitted 4 May, 2018; originally announced May 2018.

MSC Class: 60J60; 60H10; 82C31

Stochastic homogenization of a scalar viscoelastic model exhibiting stress-strain hysteresis

Authors: Thomas Hudson, Frédéric Legoll, Tony Lelièvre

Abstract: Motivated by rate-independent stress-strain hysteresis observed in filled rubber, this article considers a scalar viscoelastic model in which the constitutive law is random and varies on a lengthscale which is small relative to the overall size of the solid. Using stochastic two-scale convergence as introduced by Bourgeat, Mikelic and Wright, we obtain the homogenized limit of the evolution, and d… ▽ More Motivated by rate-independent stress-strain hysteresis observed in filled rubber, this article considers a scalar viscoelastic model in which the constitutive law is random and varies on a lengthscale which is small relative to the overall size of the solid. Using stochastic two-scale convergence as introduced by Bourgeat, Mikelic and Wright, we obtain the homogenized limit of the evolution, and demonstrate that under certain hypotheses, the homogenized model exhibits hysteretic behaviour which persists under asymptotically slow loading. These results are illustrated by means of numerical simulations in a particular one-dimensional instance of the model. △ Less

Submitted 21 November, 2019; v1 submitted 15 February, 2018; originally announced February 2018.

Comments: 54 pages, 4 figures

MSC Class: 74Q10; 35Q74

Mathematical foundations of Accelerated Molecular Dynamics methods

Authors: Tony Lelièvre

Abstract: The objective of this review article is to present recent results on the mathematical analysis of the Accelerated Dynamics algorithms introduced by A.F. Voter in collaboration with D. Perez and M. Sorensen. Using the notion of quasi-stationary distribution, one is able to rigorously justify the fact that the exit event from a metastable state for the Langevin or overdamped Langevin dynamics can be… ▽ More The objective of this review article is to present recent results on the mathematical analysis of the Accelerated Dynamics algorithms introduced by A.F. Voter in collaboration with D. Perez and M. Sorensen. Using the notion of quasi-stationary distribution, one is able to rigorously justify the fact that the exit event from a metastable state for the Langevin or overdamped Langevin dynamics can be modeled by a kinetic Monte Carlo model. Moreover, under some geometric assumptions, one can prove that this kinetic Monte Carlo model can be parameterized using Eyring-Kramers formulas. These are the building blocks required to analyze the Accelerated Dynamics algorithms, to understand their efficiency and their accuracy, and to improve and generalize these techniques beyond their original scope. △ Less

Submitted 16 January, 2018; originally announced January 2018.

Comments: arXiv admin note: text overlap with arXiv:1605.02643

Analysis of a micro-macro acceleration method with minimum relative entropy moment matching

Authors: Tony Lelièvre, Giovanni Samaey, Przemysław Zieliński

Abstract: We analyse convergence of a micro-macro acceleration method for the Monte Carlo simulation of stochastic differential equations with time-scale separation between the (fast) evolution of individual trajectories and the (slow) evolution of the macroscopic function of interest. We consider a class of methods, presented in [Debrabant, K., Samaey, G., Zieliński, P. A micro-macro acceleration method fo… ▽ More We analyse convergence of a micro-macro acceleration method for the Monte Carlo simulation of stochastic differential equations with time-scale separation between the (fast) evolution of individual trajectories and the (slow) evolution of the macroscopic function of interest. We consider a class of methods, presented in [Debrabant, K., Samaey, G., Zieliński, P. A micro-macro acceleration method for the Monte Carlo simulation of stochastic differential equations. SINUM, 55 (2017) no. 6, 2745-2786], that performs short bursts of path simulations, combined with the extrapolation of a few macroscopic state variables forward in time. After extrapolation, a new microscopic state is then constructed, consistent with the extrapolated variable and minimising the perturbation caused by the extrapolation. In the present paper, we study a specific method in which this perturbation is minimised in a relative entropy sense. We discuss why relative entropy is a useful metric, both from a theoretical and practical point of view, and rigorously study local errors and numerical stability of the resulting method as a function of the extrapolation time step and the number of macroscopic state variables. Using these results, we discuss convergence to the full microscopic dynamics, in the limit when the extrapolation time step tends to zero and the number of macroscopic state variables tends to infinity. △ Less

Submitted 5 January, 2018; originally announced January 2018.

Comments: 40 pages

MSC Class: Primary; 65C30; 60H35; 94A17; Secondary; 62E17; 65J22

Variance Reduction Result for a Projected Adaptive Biasing Force Method

Authors: Houssam AlRachid, Tony Lelievre

Abstract: This paper is committed to investigate an extension of the classical adaptive biasing force method, which is used to compute the free energy related to the Boltzmann-Gibbs measure and a reaction coordinate function. The issue of this technique is that the approximated gradient of the free energy, called biasing force, is not a gradient. The commitment to this field is to project the estimated bias… ▽ More This paper is committed to investigate an extension of the classical adaptive biasing force method, which is used to compute the free energy related to the Boltzmann-Gibbs measure and a reaction coordinate function. The issue of this technique is that the approximated gradient of the free energy, called biasing force, is not a gradient. The commitment to this field is to project the estimated biasing force on a gradient using the Helmholtz decomposition. The variance of the biasing force is reduced using this technique, which makes the algorithm more efficient than the standard ABF method. We prove exponential convergence to equilibrium of the estimated free energy, with a precise rate of convergence in function of Logarithmic Sobolev inequality constants. △ Less

Submitted 7 November, 2017; originally announced November 2017.

Analysis of the Adaptive Multilevel Splitting method on the isomerization of alanine dipeptide

Authors: Laura J. S. Lopes, Tony Lelièvre

Abstract: We apply the Adaptive Multilevel Splitting method to the Ceq -> Cax transition of alanine dipeptide in vacuum. Some properties of the algorithm are numerically illustrated, such as the unbiasedness of the probability estimator and the robustness of the method with respect to the choice of the reaction coordinate. We also calculate the transition time obtained via the probability estimator, using a… ▽ More We apply the Adaptive Multilevel Splitting method to the Ceq -> Cax transition of alanine dipeptide in vacuum. Some properties of the algorithm are numerically illustrated, such as the unbiasedness of the probability estimator and the robustness of the method with respect to the choice of the reaction coordinate. We also calculate the transition time obtained via the probability estimator, using an appropriate ensemble of initial conditions. Finally, we show how the Adaptive Multilevel Splitting method can be used to compute an approximation of the committor function. △ Less

Submitted 29 June, 2018; v1 submitted 4 July, 2017; originally announced July 2017.

MSC Class: 82C80

Sharp asymptotics of the first exit point density

Authors: Giacomo Di Gesù, Tony Lelièvre, Dorian Le Peutrec, Boris Nectoux

Abstract: We consider the exit event from a metastable state for the overdamped Langevin dynamics $dX_t = -\nabla f(X_t) dt + \sqrt{h} dB_t$. Using tools from semiclassical analysis, we prove that, starting from the quasi stationary distribution within the state, the exit event can be modeled using a jump Markov process parametrized with the Eyring-Kramers formula, in the small temperature regime $h \to 0$.… ▽ More We consider the exit event from a metastable state for the overdamped Langevin dynamics $dX_t = -\nabla f(X_t) dt + \sqrt{h} dB_t$. Using tools from semiclassical analysis, we prove that, starting from the quasi stationary distribution within the state, the exit event can be modeled using a jump Markov process parametrized with the Eyring-Kramers formula, in the small temperature regime $h \to 0$. We provide in particular sharp asymptotic estimates on the exit distribution which demonstrate the importance of the prefactors in the Eyring-Kramers formula. Numerical experiments indicate that the geometric assumptions we need to perform our analysis are likely to be necessary. These results also hold starting from deterministic initial conditions within the well which are sufficiently low in energy. From a modelling viewpoint, this gives a rigorous justification of the transition state theory and the Eyring-Kramers formula, which are used to relate the overdamped Langevin dynamics (a continuous state space Markov dynamics) to kinetic Monte Carlo or Markov state models (discrete state space Markov dynamics). From a theoretical viewpoint, our analysis paves a new route to study the exit event from a metastable state for a stochastic process. △ Less

Submitted 15 January, 2019; v1 submitted 27 June, 2017; originally announced June 2017.

Comments: 149 pages

Convergence and efficiency of adaptive importance sampling techniques with partial biasing

Authors: Gersende Fort, Benjamin Jourdain, Tony Lelièvre, Gabriel Stoltz

Abstract: We consider a generalization of the discrete-time Self Healing Umbrella Sampling method, which is an adaptive importance technique useful to sample multimodal target distributions. The importance function is based on the weights (namely the relative probabilities) of disjoint sets which form a partition of the space. These weights are unknown but are learnt on the fly yielding an adaptive algorith… ▽ More We consider a generalization of the discrete-time Self Healing Umbrella Sampling method, which is an adaptive importance technique useful to sample multimodal target distributions. The importance function is based on the weights (namely the relative probabilities) of disjoint sets which form a partition of the space. These weights are unknown but are learnt on the fly yielding an adaptive algorithm. In the context of computational statistical physics, the logarithm of these weights is, up to a multiplicative constant, the free energy, and the discrete valued function defining the partition is called the collective variable. The algorithm falls into the general class of Wang-Landau type methods, and is a generalization of the original Self Healing Umbrella Sampling method in two ways: (i) the updating strategy leads to a larger penalization strength of already visited sets in order to escape more quickly from metastable states, and (ii) the target distribution is biased using only a fraction of the free energy, in order to increase the effective sample size and reduce the variance of importance sampling estimators. The algorithm can also be seen as a generalization of well-tempered metadynamics. We prove the convergence of the algorithm and analyze numerically its efficiency on a toy example. △ Less

Submitted 1 September, 2017; v1 submitted 28 October, 2016; originally announced October 2016.

Pathwise estimates for an effective dynamics

Authors: Frederic Legoll, Tony Lelievre, Stefano Olla

Abstract: Starting from the overdamped Langevin dynamics in $\mathbb{R}^n$, $$ dX_t = -\nabla V(X_t) dt + \sqrt{2 β^{-1}} dW_t, $$ we consider a scalar Markov process $ξ_t$ which approximates the dynamics of the first component $X^1_t$. In the previous work [F. Legoll, T. Lelievre, Nonlinearity 2010], the fact that $(ξ_t)_{t \ge 0}$ is a good approximation of $(X^1_t)_{t \ge 0}$ is proven in terms of time m… ▽ More Starting from the overdamped Langevin dynamics in $\mathbb{R}^n$, $$ dX_t = -\nabla V(X_t) dt + \sqrt{2 β^{-1}} dW_t, $$ we consider a scalar Markov process $ξ_t$ which approximates the dynamics of the first component $X^1_t$. In the previous work [F. Legoll, T. Lelievre, Nonlinearity 2010], the fact that $(ξ_t)_{t \ge 0}$ is a good approximation of $(X^1_t)_{t \ge 0}$ is proven in terms of time marginals, under assumptions quantifying the timescale separation between the first component and the other components of $X_t$. Here, we prove an upper bound on the trajectorial error $\mathbb{E} \left( \sup_{0 \leq t \leq T} \left| X^1_t - ξ_t \right| \right)$, for any $T > 0$, under a similar set of assumptions. We also show that the technique of proof can be used to obtain quantitative averaging results. △ Less

Submitted 9 May, 2016; originally announced May 2016.

Jump Markov models and transition state theory: the Quasi-Stationary Distribution approach

Authors: Giacomo Di Gesù, Tony Lelièvre, Dorian Le Peutrec, Boris Nectoux

Abstract: We are interested in the connection between a metastable continuous state space Markov process (satisfying e.g. the Langevin or overdamped Langevin equation) and a jump Markov process in a discrete state space. More precisely, we use the notion of quasi-stationary distribution within a metastable state for the continuous state space Markov process to parametrize the exit event from the state. This… ▽ More We are interested in the connection between a metastable continuous state space Markov process (satisfying e.g. the Langevin or overdamped Langevin equation) and a jump Markov process in a discrete state space. More precisely, we use the notion of quasi-stationary distribution within a metastable state for the continuous state space Markov process to parametrize the exit event from the state. This approach is useful to analyze and justify methods which use the jump Markov process underlying a metastable dynamics as a support to efficiently sample the state-to-state dynamics (accelerated dynamics techniques). Moreover, it is possible by this approach to quantify the error on the exit event when the parametrization of the jump Markov model is based on the Eyring-Kramers formula. This therefore provides a mathematical framework to justify the use of transition state theory and the Eyring-Kramers formula to build kinetic Monte Carlo or Markov state models. △ Less

Submitted 9 May, 2016; originally announced May 2016.

Comments: 14 pages

MSC Class: 60J60; 35P20

Local and global solution for a nonlocal Fokker-Planck equation related to the adaptive biaising force processes

Authors: Houssam Alrachid, Tony Lelièvre, Raafat Talhouk

Abstract: We prove global existence, uniqueness and regularity of the mild, Lp and classical solution of a non-linear Fokker-Planck equation arising in an adaptive importance sampling method for molecular dynamics calculations. The non- linear term is related to a conditional expectation, and is thus non-local. The proof uses tools from the theory of semigroups of linear operators for the local existence re… ▽ More We prove global existence, uniqueness and regularity of the mild, Lp and classical solution of a non-linear Fokker-Planck equation arising in an adaptive importance sampling method for molecular dynamics calculations. The non- linear term is related to a conditional expectation, and is thus non-local. The proof uses tools from the theory of semigroups of linear operators for the local existence result, and an a priori estimate based on a supersolution for the global existence result. △ Less

Submitted 14 October, 2015; originally announced October 2015.

Comments: 37 pages