-
Generalizing the SINDy approach with nested neural networks
Authors:
Camilla Fiorini,
Clément Flint,
Louis Fostier,
Emmanuel Franck,
Reyhaneh Hashemi,
Victor Michel-Dansac,
Wassim Tenachi
Abstract:
Symbolic Regression (SR) is a widely studied field of research that aims to infer symbolic expressions from data. A popular approach for SR is the Sparse Identification of Nonlinear Dynamical Systems (\sindy) framework, which uses sparse regression to identify governing equations from data. This study introduces an enhanced method, Nested SINDy, that aims to increase the expressivity of the SINDy…
▽ More
Symbolic Regression (SR) is a widely studied field of research that aims to infer symbolic expressions from data. A popular approach for SR is the Sparse Identification of Nonlinear Dynamical Systems (\sindy) framework, which uses sparse regression to identify governing equations from data. This study introduces an enhanced method, Nested SINDy, that aims to increase the expressivity of the SINDy approach thanks to a nested structure. Indeed, traditional symbolic regression and system identification methods often fail with complex systems that cannot be easily described analytically. Nested SINDy builds on the SINDy framework by introducing additional layers before and after the core SINDy layer. This allows the method to identify symbolic representations for a wider range of systems, including those with compositions and products of functions. We demonstrate the ability of the Nested SINDy approach to accurately find symbolic expressions for simple systems, such as basic trigonometric functions, and sparse (false but accurate) analytical representations for more complex systems. Our results highlight Nested SINDy's potential as a tool for symbolic regression, surpassing the traditional SINDy approach in terms of expressivity. However, we also note the challenges in the optimization process for Nested SINDy and suggest future research directions, including the designing of a more robust methodology for the optimization process. This study proves that Nested SINDy can effectively discover symbolic representations of dynamical systems from data, offering new opportunities for understanding complex systems through data-driven methods.
△ Less
Submitted 24 April, 2024;
originally announced April 2024.
-
Accelerating the convergence of Newton's method for nonlinear elliptic PDEs using Fourier neural operators
Authors:
Joubine Aghili,
Emmanuel Franck,
Romain Hild,
Victor Michel-Dansac,
Vincent Vigon
Abstract:
It is well known that Newton's method, especially when applied to large problems such as the discretization of nonlinear partial differential equations (PDEs), can have trouble converging if the initial guess is too far from the solution. This work focuses on accelerating this convergence, in the context of the discretization of nonlinear elliptic PDEs. We first provide a quick review of existing…
▽ More
It is well known that Newton's method, especially when applied to large problems such as the discretization of nonlinear partial differential equations (PDEs), can have trouble converging if the initial guess is too far from the solution. This work focuses on accelerating this convergence, in the context of the discretization of nonlinear elliptic PDEs. We first provide a quick review of existing methods, and justify our choice of learning an initial guess with a Fourier neural operator (FNO). This choice was motivated by the mesh-independence of such operators, whose training and evaluation can be performed on grids with different resolutions. The FNO is trained using a loss minimization over generated data, loss functions based on the PDE discretization. Numerical results, in one and two dimensions, show that the proposed initial guess accelerates the convergence of Newton's method by a large margin compared to a naive initial guess, especially for highly nonlinear or anisotropic problems.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
Hamiltonian reduction using a convolutional auto-encoder coupled to an Hamiltonian neural network
Authors:
Raphaël Côte,
Emmanuel Franck,
Laurent Navoret,
Guillaume Steimer,
Vincent Vigon
Abstract:
The reduction of Hamiltonian systems aims to build smaller reduced models, valid over a certain range of time and parameters, in order to reduce computing time. By maintaining the Hamiltonian structure in the reduced model, certain long-term stability properties can be preserved. In this paper, we propose a non-linear reduction method for models coming from the spatial discretization of partial di…
▽ More
The reduction of Hamiltonian systems aims to build smaller reduced models, valid over a certain range of time and parameters, in order to reduce computing time. By maintaining the Hamiltonian structure in the reduced model, certain long-term stability properties can be preserved. In this paper, we propose a non-linear reduction method for models coming from the spatial discretization of partial differential equations: it is based on convolutional auto-encoders and Hamiltonian neural networks. Their training is coupled in order to simultaneously learn the encoder-decoder operators and the reduced dynamics. Several test cases on non-linear wave dynamics show that the method has better reduction properties than standard linear Hamiltonian reduction methods.
△ Less
Submitted 10 November, 2023;
originally announced November 2023.
-
Optimal scenario for road evacuation in an urban environment
Authors:
Mickael Bestard,
Emmanuel Franck,
Laurent Navoret,
Yannick Privat
Abstract:
How to free a road from vehicle traffic as efficiently as possible and in a given time, in order to allow for example the passage of emergency vehicles? We are interested in this question which we reformulate as an optimal control problem. We consider a macroscopic road traffic model on networks, semi-discretized in space and decide to give ourselves the possibility to control the flow at junction…
▽ More
How to free a road from vehicle traffic as efficiently as possible and in a given time, in order to allow for example the passage of emergency vehicles? We are interested in this question which we reformulate as an optimal control problem. We consider a macroscopic road traffic model on networks, semi-discretized in space and decide to give ourselves the possibility to control the flow at junctions. Our target is to smooth the traffic along a given path within a fixed time. A parsimony constraint is imposed on the controls, in order to ensure that the optimal strategies are feasible in practice. We perform an analysis of the resulting optimal control problem, proving the existence of an optimal control and deriving optimality conditions, which we rewrite as a single functional equation. We then use this formulation to derive a new mixed algorithm interpreting it as a mix between two methods: a descent method combined with a fixed point method allowing global perturbations. We verify with numerical experiments the efficiency of this method on examples of graphs, first simple, then more complex. We highlight the efficiency of our approach by comparing it to standard methods. We propose an open source code implementing this approach in the Julia language.
△ Less
Submitted 23 October, 2023;
originally announced October 2023.
-
Approximately well-balanced Discontinuous Galerkin methods using bases enriched with Physics-Informed Neural Networks
Authors:
Emmanuel Franck,
Victor Michel-Dansac,
Laurent Navoret
Abstract:
This work concerns the enrichment of Discontinuous Galerkin (DG) bases, so that the resulting scheme provides a much better approximation of steady solutions to hyperbolic systems of balance laws. The basis enrichment leverages a prior - an approximation of the steady solution - which we propose to compute using a Physics-Informed Neural Network (PINN). To that end, after presenting the classical…
▽ More
This work concerns the enrichment of Discontinuous Galerkin (DG) bases, so that the resulting scheme provides a much better approximation of steady solutions to hyperbolic systems of balance laws. The basis enrichment leverages a prior - an approximation of the steady solution - which we propose to compute using a Physics-Informed Neural Network (PINN). To that end, after presenting the classical DG scheme, we show how to enrich its basis with a prior. Convergence results and error estimates follow, in which we prove that the basis with prior does not change the order of convergence, and that the error constant is improved. To construct the prior, we elect to use parametric PINNs, which we introduce, as well as the algorithms to construct a prior from PINNs. We finally perform several validation experiments on four different hyperbolic balance laws to highlight the properties of the scheme. Namely, we show that the DG scheme with prior is much more accurate on steady solutions than the DG scheme without prior, while retaining the same approximation quality on unsteady solutions.
△ Less
Submitted 24 May, 2024; v1 submitted 23 October, 2023;
originally announced October 2023.
-
An optimal control deep learning method to design artificial viscosities for Discontinuous Galerkin schemes
Authors:
L éo Bois,
Emmanuel Franck,
Laurent Navoret,
Vincent Vigon
Abstract:
In this paper, we propose a method for constructing a neural network viscosity in order to reduce the non-physical oscillations generated by high-order Discontiuous Galerkin (DG) methods. To this end, the problem is reformulated as an optimal control problem for which the control is the viscosity function and the cost function involves comparison with a reference solution after several composition…
▽ More
In this paper, we propose a method for constructing a neural network viscosity in order to reduce the non-physical oscillations generated by high-order Discontiuous Galerkin (DG) methods. To this end, the problem is reformulated as an optimal control problem for which the control is the viscosity function and the cost function involves comparison with a reference solution after several compositions of the scheme. The learning process is strongly based on gradient backpropagation tools. Numerical simulations show that the artificial viscosities constructed in this way are just as good or better than those used in the literatur
△ Less
Submitted 21 September, 2023;
originally announced September 2023.
-
Reduced modelling and optimal control of epidemiological individual-based models with contact heterogeneity
Authors:
C. Courtès,
E. Franck,
K. Lutz,
L. Navoret,
Y. Privat
Abstract:
Modelling epidemics via classical population-based models suffers from shortcomings that so-called individual-based models are able to overcome, as they are able to take heterogeneity features into account, such as super-spreaders, and describe the dynamics involved in small clusters. In return, such models often involve large graphs which are expensive to simulate and difficult to optimize, both…
▽ More
Modelling epidemics via classical population-based models suffers from shortcomings that so-called individual-based models are able to overcome, as they are able to take heterogeneity features into account, such as super-spreaders, and describe the dynamics involved in small clusters. In return, such models often involve large graphs which are expensive to simulate and difficult to optimize, both in theory and in practice.
By combining the reinforcement learning philosophy with reduced models, we propose a numerical approach to determine optimal health policies for a stochastic epidemiological graph-model taking into account super-spreaders. More precisely, we introduce a deterministic reduced population-based model involving a neural network, and use it to derive optimal health policies through an optimal control approach. It is meant to faithfully mimic the local dynamics of the original, more complex, graph-model. Roughly speaking, this is achieved by sequentially training the network until an optimal control strategy for the corresponding reduced model manages to equally well contain the epidemic when simulated on the graph-model.
After describing the practical implementation of this approach, we will discuss the range of applicability of the reduced model and to what extent the estimated control strategies could provide useful qualitative information to health authorities.
△ Less
Submitted 13 May, 2022;
originally announced May 2022.
-
The JOREK non-linear extended MHD code and applications to large-scale instabilities and their control in magnetically confined fusion plasmas
Authors:
M Hoelzl,
GTA Huijsmans,
SJP Pamela,
M Becoulet,
E Nardon,
FJ Artola,
B Nkonga,
CV Atanasiu,
V Bandaru,
A Bhole,
D Bonfiglio,
A Cathey,
O Czarny,
A Dvornova,
T Feher,
A Fil,
E Franck,
S Futatani,
M Gruca,
H Guillard,
JW Haverkort,
I Holod,
D Hu,
SK Kim,
SQ Korving
, et al. (28 additional authors not shown)
Abstract:
JOREK is a massively parallel fully implicit non-linear extended MHD code for realistic tokamak X-point plasmas. It has become a widely used versatile code for studying large-scale plasma instabilities and their control developed in an international community. This article gives a comprehensive overview of the physics models implemented, numerical methods applied for solving the equations and phys…
▽ More
JOREK is a massively parallel fully implicit non-linear extended MHD code for realistic tokamak X-point plasmas. It has become a widely used versatile code for studying large-scale plasma instabilities and their control developed in an international community. This article gives a comprehensive overview of the physics models implemented, numerical methods applied for solving the equations and physics studies performed with the code. A dedicated section highlights some of the verification work done for the code. A hierarchy of different physics models is available including a free boundary and resistive wall extension and hybrid kinetic-fluid models. The code allows for flux-surface aligned iso-parametric finite element grids in single and double X-point plasmas which can be extended to the true physical walls and uses a robust fully implicit time step**. Particular focus is laid on plasma edge and scrape-off layer (SOL) physics as well as disruption related phenomena. Among the key results obtained with JOREK regarding plasma edge and SOL, are deep insights into the dynamics of edge localized modes (ELMs), ELM cycles, and ELM control by resonant magnetic perturbations, pellet injection, as well as by vertical magnetic kicks. Also ELM free regimes, detachment physics, the generation and transport of impurities during an ELM, and electrostatic turbulence in the pedestal region are investigated. Regarding disruptions, the focus is on the dynamics of the thermal quench and current quench triggered by massive gas injection (MGI) and shattered pellet injection (SPI), runaway electron (RE) dynamics as well as the RE interaction with MHD modes, and vertical displacement events (VDEs). Also the seeding and suppression of tearing modes (TMs), the dynamics of naturally occurring thermal quenches triggered by locked modes, and radiative collapses are being studied.
△ Less
Submitted 21 April, 2021; v1 submitted 18 November, 2020;
originally announced November 2020.
-
A neural network closure for the Euler-Poisson system based on kinetic simulations
Authors:
Léo Bois,
Emmanuel Franck,
Laurent Navoret,
Vincent Vigon
Abstract:
This work deals with the modeling of plasmas, which are charged-particle fluids. Thanks to machine leaning, we construct a closure for the one-dimensional Euler-Poisson system valid for a wide range of collision regimes. This closure, based on a fully convolutional neural network called V-net, takes as input the whole spatial density, mean velocity and temperature and predicts as output the whole…
▽ More
This work deals with the modeling of plasmas, which are charged-particle fluids. Thanks to machine leaning, we construct a closure for the one-dimensional Euler-Poisson system valid for a wide range of collision regimes. This closure, based on a fully convolutional neural network called V-net, takes as input the whole spatial density, mean velocity and temperature and predicts as output the whole heat flux. It is learned from data coming from kinetic simulations of the Vlasov-Poisson equations. Data generation and preprocessings are designed to ensure an almost uniform accuracy over the chosen range of Knudsen numbers (which parametrize collision regimes). Finally, several numerical tests are carried out to assess validity and flexibility of the whole pipeline.
△ Less
Submitted 12 November, 2020;
originally announced November 2020.
-
An analysis of over-relaxation in kinetic approximation
Authors:
Florence Drui,
Emmanuel Franck,
Philippe Helluy,
Laurent Navoret
Abstract:
The over-relaxation approach is an alternative to the **-Xin relaxation method (** and Xin [1]) in order to apply the equilibrium source term in a more precise way (Coulette et al. [2, 3]). This is also a key ingredient of the Lattice-Boltzmann method for achieving second order accuracy (Dellar [4]). In this work we provide an analysis of the over-relaxation kinetic scheme. We compute its equiva…
▽ More
The over-relaxation approach is an alternative to the **-Xin relaxation method (** and Xin [1]) in order to apply the equilibrium source term in a more precise way (Coulette et al. [2, 3]). This is also a key ingredient of the Lattice-Boltzmann method for achieving second order accuracy (Dellar [4]). In this work we provide an analysis of the over-relaxation kinetic scheme. We compute its equivalent equation, which is particularly useful for devising stable boundary conditions for the hidden kinetic variables.
△ Less
Submitted 16 July, 2018;
originally announced July 2018.
-
High-order implicit palindromic discontinuous Galerkin method for kinetic-relaxation approximation
Authors:
David Coulette,
Emmanuel Franck,
Philippe Helluy,
Michel Mehrenberger,
Laurent Navoret
Abstract:
We construct a high order discontinuous Galerkin method for solving general hyperbolic systems of conservation laws. The method is CFL-less, matrix-free, has the complexity of an explicit scheme and can be of arbitrary order in space and time. The construction is based on: (a) the representation of the system of conservation laws by a kinetic vectorial representation with a stiff relaxation term;…
▽ More
We construct a high order discontinuous Galerkin method for solving general hyperbolic systems of conservation laws. The method is CFL-less, matrix-free, has the complexity of an explicit scheme and can be of arbitrary order in space and time. The construction is based on: (a) the representation of the system of conservation laws by a kinetic vectorial representation with a stiff relaxation term; (b) a matrix-free, CFL-less implicit discontinuous Galerkin transport solver; and (c) a stiffly accurate composition method for time integration. The method is validated on several one-dimensional test cases. It is then applied on two-dimensional and three-dimensional test cases: flow past a cylinder, magnetohydrodynamics and multifluid sedimentation.
△ Less
Submitted 13 February, 2018;
originally announced February 2018.
-
Task-based parallelization of an implicit kinetic scheme
Authors:
Jayesh Badwaik,
Matthieu Boileau,
David Coulette,
Emmanuel Franck,
Philippe Helluy,
Laura Mendoza,
Herbert Oberlin
Abstract:
In this paper we present and implement the Palindromic Discontinuous Galerkin (PDG) method in dimensions higher than one. The method has already been exposed and tested in [4] in the one-dimensional context. The PDG method is a general implicit high order method for approximating systems of conservation laws. It relies on a kinetic interpretation of the conservation laws containing stiff relaxatio…
▽ More
In this paper we present and implement the Palindromic Discontinuous Galerkin (PDG) method in dimensions higher than one. The method has already been exposed and tested in [4] in the one-dimensional context. The PDG method is a general implicit high order method for approximating systems of conservation laws. It relies on a kinetic interpretation of the conservation laws containing stiff relaxation terms. The kinetic system is approximated with an asymptotic-preserving high order DG method. We describe the parallel implementation of the method, based on the StarPU runtime library. Then we apply it on preliminary test cases.
△ Less
Submitted 1 February, 2017;
originally announced February 2017.
-
Palindromic discontinuous Galerkin method for kinetic equations with stiff relaxation
Authors:
David Coulette,
Emmanuel Franck,
Philippe Helluy,
Michel Mehrenberger,
Laurent Navoret
Abstract:
We present a high order scheme for approximating kinetic equations with stiff relaxation. The objective is to provide efficient methods for solving the underlying system of conservation laws. The construction is based on several ingredients: (i) a high order implicit upwind Discontinuous Galerkin approximation of the kinetic equations with easy-to-solve triangular linear systems; (ii) a second ord…
▽ More
We present a high order scheme for approximating kinetic equations with stiff relaxation. The objective is to provide efficient methods for solving the underlying system of conservation laws. The construction is based on several ingredients: (i) a high order implicit upwind Discontinuous Galerkin approximation of the kinetic equations with easy-to-solve triangular linear systems; (ii) a second order asymptotic-preserving time integration based on symmetry arguments; (iii) a palindromic composition of the second order method for achieving higher orders in time. The method is then tested at orders 2, 4 and 6. It is asymptotic-preserving with respect to the stiff relaxation and accepts high CFL numbers.
△ Less
Submitted 30 December, 2016;
originally announced December 2016.
-
Energy conservation and numerical stability for the reduced MHD models of the non-linear JOREK code
Authors:
Emmanuel Franck,
Matthias Hoelzl,
Alexander Lessig,
Eric Sonnendrücker
Abstract:
In this paper we present a rigorous derivation of the reduced MHD models with and without parallel velocity that are implemented in the non-linear MHD code JOREK. The model we obtain contains some terms that have been neglected in the implementation but might be relevant in the non-linear phase. These are necessary to guarantee exact conservation with respect to the full MHD energy.
For the second…
▽ More
In this paper we present a rigorous derivation of the reduced MHD models with and without parallel velocity that are implemented in the non-linear MHD code JOREK. The model we obtain contains some terms that have been neglected in the implementation but might be relevant in the non-linear phase. These are necessary to guarantee exact conservation with respect to the full MHD energy.
For the second part of this work, we have replaced the linearized time step** of JOREK by a non-linear solver based on the Inexact Newton method including adaptive time step**. We demonstrate that this approach is more robust especially with respect to numerical errors in the saturation phase of an instability and allows to use larger time steps in the non-linear phase.
△ Less
Submitted 30 January, 2015; v1 submitted 9 August, 2014;
originally announced August 2014.
-
Asymptotic preserving schemes on distorted meshes for Friedrichs systems with sti relaxation: application to angular models in linear transport
Authors:
Christophe Buet,
Bruno Després,
Emmanuel Franck
Abstract:
In this paper we propose an asymptotic preserving scheme for a family of Friedrichs systems on unstructured meshes based on a decomposition between the hyperbolic heat equation and a linear hyperbolic which not involved in the di usive regime. For the hyperbolic heat equation we use asymptotic preserving schemes recently designed previously. To discretize the second part we use classical Rusanov o…
▽ More
In this paper we propose an asymptotic preserving scheme for a family of Friedrichs systems on unstructured meshes based on a decomposition between the hyperbolic heat equation and a linear hyperbolic which not involved in the di usive regime. For the hyperbolic heat equation we use asymptotic preserving schemes recently designed previously. To discretize the second part we use classical Rusanov or upwind schemes. To nish we apply this method for the discretization of the PN and SN models which are widely used in transport codes.
△ Less
Submitted 9 April, 2013;
originally announced April 2013.
