-
Anisotropic, Sparse and Interpretable Physics-Informed Neural Networks for PDEs
Authors:
Amuthan A. Ramabathiran,
Prabhu Ramachandran
Abstract:
There has been a growing interest in the use of Deep Neural Networks (DNNs) to solve Partial Differential Equations (PDEs). Despite the promise that such approaches hold, there are various aspects where they could be improved. Two such shortcomings are (i) their computational inefficiency relative to classical numerical methods, and (ii) the non-interpretability of a trained DNN model. In this wor…
▽ More
There has been a growing interest in the use of Deep Neural Networks (DNNs) to solve Partial Differential Equations (PDEs). Despite the promise that such approaches hold, there are various aspects where they could be improved. Two such shortcomings are (i) their computational inefficiency relative to classical numerical methods, and (ii) the non-interpretability of a trained DNN model. In this work we present ASPINN, an anisotropic extension of our earlier work called SPINN--Sparse, Physics-informed, and Interpretable Neural Networks--to solve PDEs that addresses both these issues. ASPINNs generalize radial basis function networks. We demonstrate using a variety of examples involving elliptic and hyperbolic PDEs that the special architecture we propose is more efficient than generic DNNs, while at the same time being directly interpretable. Further, they improve upon the SPINN models we proposed earlier in that fewer nodes are require to capture the solution using ASPINN than using SPINN, thanks to the anisotropy of the local zones of influence of each node. The interpretability of ASPINN translates to a ready visualization of their weights and biases, thereby yielding more insight into the nature of the trained model. This in turn provides a systematic procedure to improve the architecture based on the quality of the computed solution. ASPINNs thus serve as an effective bridge between classical numerical algorithms and modern DNN based methods to solve PDEs. In the process, we also streamline the training of ASPINNs into a form that is closer to that of supervised learning algorithms.
△ Less
Submitted 23 December, 2022; v1 submitted 1 July, 2022;
originally announced July 2022.
-
SPINN: Sparse, Physics-based, and partially Interpretable Neural Networks for PDEs
Authors:
Amuthan A. Ramabathiran,
Prabhu Ramachandran
Abstract:
We introduce a class of Sparse, Physics-based, and partially Interpretable Neural Networks (SPINN) for solving ordinary and partial differential equations (PDEs). By reinterpreting a traditional meshless representation of solutions of PDEs we develop a class of sparse neural network architectures that are partially interpretable. The SPINN model we propose here serves as a seamless bridge between…
▽ More
We introduce a class of Sparse, Physics-based, and partially Interpretable Neural Networks (SPINN) for solving ordinary and partial differential equations (PDEs). By reinterpreting a traditional meshless representation of solutions of PDEs we develop a class of sparse neural network architectures that are partially interpretable. The SPINN model we propose here serves as a seamless bridge between two extreme modeling tools for PDEs, namely dense neural network based methods like Physics Informed Neural Networks (PINNs) and traditional mesh-free numerical methods, thereby providing a novel means to develop a new class of hybrid algorithms that build on the best of both these viewpoints. A unique feature of the SPINN model that distinguishes it from other neural network based approximations proposed earlier is that it is (i) interpretable, in a particular sense made precise in the work, and (ii) sparse in the sense that it has much fewer connections than typical dense neural networks used for PDEs. Further, the SPINN algorithm implicitly encodes mesh adaptivity and is able to handle discontinuities in the solutions. In addition, we demonstrate that Fourier series representations can also be expressed as a special class of SPINN and propose generalized neural network analogues of Fourier representations. We illustrate the utility of the proposed method with a variety of examples involving ordinary differential equations, elliptic, parabolic, hyperbolic and nonlinear partial differential equations, and an example in fluid dynamics.
△ Less
Submitted 28 July, 2021; v1 submitted 25 February, 2021;
originally announced February 2021.
-
An iterative scheme for the generalized Peierls-Nabarro model based on the inverse Hilbert transform
Authors:
Amuthan A. Ramabathiran
Abstract:
A new semi-analytical iterative scheme is proposed in this work for solving the generalized Peierls-Nabarro model. The numerical method developed here exploits certain basic properties of the Hilbert transform to achieve the desired reduction of the non-local and non-linear equations characterizing the generalized Peierls-Nabarro model to a local fixed point iteration scheme. The method is validat…
▽ More
A new semi-analytical iterative scheme is proposed in this work for solving the generalized Peierls-Nabarro model. The numerical method developed here exploits certain basic properties of the Hilbert transform to achieve the desired reduction of the non-local and non-linear equations characterizing the generalized Peierls-Nabarro model to a local fixed point iteration scheme. The method is validated with simple examples involving the 1D Peierls-Nabarro model corresponding to a sinusoidal stacking fault energy, and with calculations of the core structure of both edge and screw dislocations on the close-packed $\{111\}$ planes in Aluminium. An approximate technique to incorporate external stresses within the framework of the proposed iterative scheme is also discussed with applications to the equilibration of a dislocation dipole. Finally, the advantages, limitations and avenues for future extension of the proposed method are discussed.
△ Less
Submitted 2 July, 2019;
originally announced July 2019.
