-
Solving partial differential equations with sampled neural networks
Authors:
Chinmay Datar,
Taniya Kapoor,
Abhishek Chandra,
Qing Sun,
Iryna Burak,
Erik Lien Bolager,
Anna Veselovska,
Massimo Fornasier,
Felix Dietrich
Abstract:
Approximation of solutions to partial differential equations (PDE) is an important problem in computational science and engineering. Using neural networks as an ansatz for the solution has proven a challenge in terms of training time and approximation accuracy. In this contribution, we discuss how sampling the hidden weights and biases of the ansatz network from data-agnostic and data-dependent pr…
▽ More
Approximation of solutions to partial differential equations (PDE) is an important problem in computational science and engineering. Using neural networks as an ansatz for the solution has proven a challenge in terms of training time and approximation accuracy. In this contribution, we discuss how sampling the hidden weights and biases of the ansatz network from data-agnostic and data-dependent probability distributions allows us to progress on both challenges. In most examples, the random sampling schemes outperform iterative, gradient-based optimization of physics-informed neural networks regarding training time and accuracy by several orders of magnitude. For time-dependent PDE, we construct neural basis functions only in the spatial domain and then solve the associated ordinary differential equation with classical methods from scientific computing over a long time horizon. This alleviates one of the greatest challenges for neural PDE solvers because it does not require us to parameterize the solution in time. For second-order elliptic PDE in Barron spaces, we prove the existence of sampled networks with $L^2$ convergence to the solution. We demonstrate our approach on several time-dependent and static PDEs. We also illustrate how sampled networks can effectively solve inverse problems in this setting. Benefits compared to common numerical schemes include spectral convergence and mesh-free construction of basis functions.
△ Less
Submitted 31 May, 2024;
originally announced May 2024.
-
New physics search via angular distribution of $B \rightarrow D^* \ell ν_{\ell}$ decay in the light of the new lattice data
Authors:
Tejhas Kapoor,
Zhuo-Ran Huang,
Emi Kou
Abstract:
In this article, we investigate the potential of the angular distribution of the $B \rightarrow D^* \ell ν_{\ell}$ process to search for new physics signals. The Belle collaboration has analysed it to constraint $V_{cb}$ and the $B\to D^*$ form factors, under the assumption of the Standard Model. With the newly released lattice QCD data, we can perform a simultaneous fit of the form factors,…
▽ More
In this article, we investigate the potential of the angular distribution of the $B \rightarrow D^* \ell ν_{\ell}$ process to search for new physics signals. The Belle collaboration has analysed it to constraint $V_{cb}$ and the $B\to D^*$ form factors, under the assumption of the Standard Model. With the newly released lattice QCD data, we can perform a simultaneous fit of the form factors, $V_{cb}$ as well as new physics parameters. We use the Belle data and the lattice data to constrain right-handed new physics. In addition, we also generate unbinned pseudo-dataset and perform a sensitivity study on more general new physics models, using the lattice data.
△ Less
Submitted 8 March, 2024; v1 submitted 21 January, 2024;
originally announced January 2024.
-
Transfer learning for improved generalizability in causal physics-informed neural networks for beam simulations
Authors:
Taniya Kapoor,
Hongrui Wang,
Alfredo Nunez,
Rolf Dollevoet
Abstract:
This paper introduces a novel methodology for simulating the dynamics of beams on elastic foundations. Specifically, Euler-Bernoulli and Timoshenko beam models on the Winkler foundation are simulated using a transfer learning approach within a causality-respecting physics-informed neural network (PINN) framework. Conventional PINNs encounter challenges in handling large space-time domains, even fo…
▽ More
This paper introduces a novel methodology for simulating the dynamics of beams on elastic foundations. Specifically, Euler-Bernoulli and Timoshenko beam models on the Winkler foundation are simulated using a transfer learning approach within a causality-respecting physics-informed neural network (PINN) framework. Conventional PINNs encounter challenges in handling large space-time domains, even for problems with closed-form analytical solutions. A causality-respecting PINN loss function is employed to overcome this limitation, effectively capturing the underlying physics. However, it is observed that the causality-respecting PINN lacks generalizability. We propose using solutions to similar problems instead of training from scratch by employing transfer learning while adhering to causality to accelerate convergence and ensure accurate results across diverse scenarios. Numerical experiments on the Euler-Bernoulli beam highlight the efficacy of the proposed approach for various initial conditions, including those with noise in the initial data. Furthermore, the potential of the proposed method is demonstrated for the Timoshenko beam in an extended spatial and temporal domain. Several comparisons suggest that the proposed method accurately captures the inherent dynamics, outperforming the state-of-the-art physics-informed methods under standard $L^2$-norm metric and accelerating convergence.
△ Less
Submitted 1 November, 2023;
originally announced November 2023.
-
New physics search via CP observables in $B_s^0 \rightarrow φφ$ decay with Chromomagnetic operators
Authors:
Tejhas Kapoor
Abstract:
In this work, we investigate the time-dependent angular analysis of $B_s^0 \rightarrow φφ$ decay to search for new physics signals via CP-violating observables. We work with a new physics Hamiltonian containing both left- and right-handed Chromomagnetic dipole operators. The hierarchy of the helicity amplitudes in this model gives us a new scheme of experimental search, which is different from the…
▽ More
In this work, we investigate the time-dependent angular analysis of $B_s^0 \rightarrow φφ$ decay to search for new physics signals via CP-violating observables. We work with a new physics Hamiltonian containing both left- and right-handed Chromomagnetic dipole operators. The hierarchy of the helicity amplitudes in this model gives us a new scheme of experimental search, which is different from the ones LHCb has used in its analysis. To illustrate this new scheme, we perform a sensitivity study using two pseudo datasets generated using LHCb's measured values. We find the sensitivity of CP-violating observables to be of the order of $5-7\%$ with the current LHCb statistics. In addition, we present a revised version of the table of coefficients of time-dependent terms in the angular decay distribution with precisely defined quantities.
△ Less
Submitted 10 October, 2023;
originally announced October 2023.
-
Neural oscillators for magnetic hysteresis modeling
Authors:
Abhishek Chandra,
Taniya Kapoor,
Bram Daniels,
Mitrofan Curti,
Koen Tiels,
Daniel M. Tartakovsky,
Elena A. Lomonova
Abstract:
Hysteresis is a ubiquitous phenomenon in science and engineering; its modeling and identification are crucial for understanding and optimizing the behavior of various systems. We develop an ordinary differential equation-based recurrent neural network (RNN) approach to model and quantify the hysteresis, which manifests itself in sequentiality and history-dependence. Our neural oscillator, HystRNN,…
▽ More
Hysteresis is a ubiquitous phenomenon in science and engineering; its modeling and identification are crucial for understanding and optimizing the behavior of various systems. We develop an ordinary differential equation-based recurrent neural network (RNN) approach to model and quantify the hysteresis, which manifests itself in sequentiality and history-dependence. Our neural oscillator, HystRNN, draws inspiration from coupled-oscillatory RNN and phenomenological hysteresis models to update the hidden states. The performance of HystRNN is evaluated to predict generalized scenarios, involving first-order reversal curves and minor loops. The findings show the ability of HystRNN to generalize its behavior to previously untrained regions, an essential feature that hysteresis models must have. This research highlights the advantage of neural oscillators over the traditional RNN-based methods in capturing complex hysteresis patterns in magnetic materials, where traditional rate-dependent methods are inadequate to capture intrinsic nonlinearity.
△ Less
Submitted 23 August, 2023;
originally announced August 2023.
-
Neural oscillators for generalization of physics-informed machine learning
Authors:
Taniya Kapoor,
Abhishek Chandra,
Daniel M. Tartakovsky,
Hongrui Wang,
Alfredo Nunez,
Rolf Dollevoet
Abstract:
A primary challenge of physics-informed machine learning (PIML) is its generalization beyond the training domain, especially when dealing with complex physical problems represented by partial differential equations (PDEs). This paper aims to enhance the generalization capabilities of PIML, facilitating practical, real-world applications where accurate predictions in unexplored regions are crucial.…
▽ More
A primary challenge of physics-informed machine learning (PIML) is its generalization beyond the training domain, especially when dealing with complex physical problems represented by partial differential equations (PDEs). This paper aims to enhance the generalization capabilities of PIML, facilitating practical, real-world applications where accurate predictions in unexplored regions are crucial. We leverage the inherent causality and temporal sequential characteristics of PDE solutions to fuse PIML models with recurrent neural architectures based on systems of ordinary differential equations, referred to as neural oscillators. Through effectively capturing long-time dependencies and mitigating the exploding and vanishing gradient problem, neural oscillators foster improved generalization in PIML tasks. Extensive experimentation involving time-dependent nonlinear PDEs and biharmonic beam equations demonstrates the efficacy of the proposed approach. Incorporating neural oscillators outperforms existing state-of-the-art methods on benchmark problems across various metrics. Consequently, the proposed method improves the generalization capabilities of PIML, providing accurate solutions for extrapolation and prediction beyond the training data.
△ Less
Submitted 18 December, 2023; v1 submitted 17 August, 2023;
originally announced August 2023.
-
Physics-informed machine learning for moving load problems
Authors:
Taniya Kapoor,
Hongrui Wang,
Alfredo Núñez,
Rolf Dollevoet
Abstract:
This paper presents a new approach to simulate forward and inverse problems of moving loads using physics-informed machine learning (PIML). Physics-informed neural networks (PINNs) utilize the underlying physics of moving load problems and aim to predict the deflection of beams and the magnitude of the loads. The mathematical representation of the moving load considered in this work involves a Dir…
▽ More
This paper presents a new approach to simulate forward and inverse problems of moving loads using physics-informed machine learning (PIML). Physics-informed neural networks (PINNs) utilize the underlying physics of moving load problems and aim to predict the deflection of beams and the magnitude of the loads. The mathematical representation of the moving load considered in this work involves a Dirac delta function, to capture the effect of the load moving across the structure. Approximating the Dirac delta function with PINNs is challenging because of its instantaneous change of output at a single point, causing difficulty in the convergence of the loss function. We propose to approximate the Dirac delta function with a Gaussian function. The incorporated Gaussian function physical equations are used in the physics-informed neural architecture to simulate beam deflections and to predict the magnitude of the load. Numerical results show that PIML is an effective method for simulating the forward and inverse problems for the considered model of a moving load.
△ Less
Submitted 1 April, 2023;
originally announced April 2023.
-
New physics search via CP observables in $B^0_s \rightarrow φφ$ decays with left- and right-handed Chromomagnetic operators
Authors:
Tejhas Kapoor,
Emi Kou
Abstract:
In this paper, we investigate the time-dependent angular analysis of $B_s^0 \rightarrow φφ$ decay to search for new physics signals via CP-violating observables. We work with a new physics Hamiltonian containing both left- and right-handed Chromomagnetic dipole operators. The hierarchy of the helicity amplitudes in this model gives us a new scheme of experimental search, which is different from th…
▽ More
In this paper, we investigate the time-dependent angular analysis of $B_s^0 \rightarrow φφ$ decay to search for new physics signals via CP-violating observables. We work with a new physics Hamiltonian containing both left- and right-handed Chromomagnetic dipole operators. The hierarchy of the helicity amplitudes in this model gives us a new scheme of experimental search, which is different from the ones LHCb has used in its analysis. To illustrate this new scheme, we perform a sensitivity study using two pseudo datasets generated using LHCb's measured values. We find the sensitivity of CP-violating observables to be of the order of $5-7\%$ with the current LHCb statistics. Moreover, we show that Belle(II)'s $B^0_d \rightarrow φK_s$ and LHCb's $B_s^0 \rightarrow φφ$ measurements could be coupled within our model to obtain the chirality of the new physics.
△ Less
Submitted 4 July, 2023; v1 submitted 8 March, 2023;
originally announced March 2023.
-
Physics-informed neural networks for solving forward and inverse problems in complex beam systems
Authors:
Taniya Kapoor,
Hongrui Wang,
Alfredo Nunez,
Rolf Dollevoet
Abstract:
This paper proposes a new framework using physics-informed neural networks (PINNs) to simulate complex structural systems that consist of single and double beams based on Euler-Bernoulli and Timoshenko theory, where the double beams are connected with a Winkler foundation. In particular, forward and inverse problems for the Euler-Bernoulli and Timoshenko partial differential equations (PDEs) are s…
▽ More
This paper proposes a new framework using physics-informed neural networks (PINNs) to simulate complex structural systems that consist of single and double beams based on Euler-Bernoulli and Timoshenko theory, where the double beams are connected with a Winkler foundation. In particular, forward and inverse problems for the Euler-Bernoulli and Timoshenko partial differential equations (PDEs) are solved using nondimensional equations with the physics-informed loss function. Higher-order complex beam PDEs are efficiently solved for forward problems to compute the transverse displacements and cross-sectional rotations with less than 1e-3 percent error. Furthermore, inverse problems are robustly solved to determine the unknown dimensionless model parameters and applied force in the entire space-time domain, even in the case of noisy data. The results suggest that PINNs are a promising strategy for solving problems in engineering structures and machines involving beam systems.
△ Less
Submitted 29 August, 2023; v1 submitted 2 March, 2023;
originally announced March 2023.
-
Feature Selection and Feature Extraction in Pattern Analysis: A Literature Review
Authors:
Benyamin Ghojogh,
Maria N. Samad,
Sayema Asif Mashhadi,
Tania Kapoor,
Wahab Ali,
Fakhri Karray,
Mark Crowley
Abstract:
Pattern analysis often requires a pre-processing stage for extracting or selecting features in order to help the classification, prediction, or clustering stage discriminate or represent the data in a better way. The reason for this requirement is that the raw data are complex and difficult to process without extracting or selecting appropriate features beforehand. This paper reviews theory and mo…
▽ More
Pattern analysis often requires a pre-processing stage for extracting or selecting features in order to help the classification, prediction, or clustering stage discriminate or represent the data in a better way. The reason for this requirement is that the raw data are complex and difficult to process without extracting or selecting appropriate features beforehand. This paper reviews theory and motivation of different common methods of feature selection and extraction and introduces some of their applications. Some numerical implementations are also shown for these methods. Finally, the methods in feature selection and extraction are compared.
△ Less
Submitted 7 May, 2019;
originally announced May 2019.
