-
Approximation by a new sequence of operators involving Laguerre polynomials
Authors:
Kapil Kumar,
Naokant Deo,
Durvesh Kumar Verma
Abstract:
This paper offers a newly created integral approach for operators employing the orthogonal modified Laguerre polynomials and Păltănea basis. These operators approximate the functions over the interval $[0,\infty)$. Further, the moments are established for the proposed operators, and the universal Korovkin's theorem is used to derive the approximation properties of the operators. We examine converg…
▽ More
This paper offers a newly created integral approach for operators employing the orthogonal modified Laguerre polynomials and Păltănea basis. These operators approximate the functions over the interval $[0,\infty)$. Further, the moments are established for the proposed operators, and the universal Korovkin's theorem is used to derive the approximation properties of the operators. We examine convergence using a variety of analytical methods, including the Lipschitz class, Peetre's K-functional, the second-order modulus of smoothness, and the modulus of continuity. Moreover, an asymptotic formula associated with the Voronovskaja-type is established. The approximation is estimated through the weighted modulus of continuity, and convergence of the proposed operators in weighted spaces of functions is investigated as well. Ultimately, we employ numerical examples and visual representations to validate the theoretical findings.
△ Less
Submitted 12 May, 2024;
originally announced May 2024.
-
Bilinear Hardy inequalities on metric measure spaces
Authors:
Michael Ruzhansky,
Anjali Shriwastawa,
Daulti Verma
Abstract:
In this paper, we discuss the Hardy inequality with bilinear operators on general metric measure spaces. We give the characterization of weights for the bilinear Hardy inequality to hold on general metric measure spaces having polar decompositions. We also provide several examples of the results, finding conditions on the weights for integral Hardy inequalities on homogeneous Lie groups, as well a…
▽ More
In this paper, we discuss the Hardy inequality with bilinear operators on general metric measure spaces. We give the characterization of weights for the bilinear Hardy inequality to hold on general metric measure spaces having polar decompositions. We also provide several examples of the results, finding conditions on the weights for integral Hardy inequalities on homogeneous Lie groups, as well as on hyperbolic spaces and more generally on Cartan-Hadamard manifolds.
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
Neural Network Approaches for Parameterized Optimal Control
Authors:
Deepanshu Verma,
Nick Winovich,
Lars Ruthotto,
Bart van Bloemen Waanders
Abstract:
We consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage to enable rapid decision-making and be able to react to changes in the parameter in the online stage. To tackle the curse of dimensionality arising when the st…
▽ More
We consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage to enable rapid decision-making and be able to react to changes in the parameter in the online stage. To tackle the curse of dimensionality arising when the state and/or parameter are high-dimensional, we represent the policy using neural networks. We compare two training paradigms: First, our model-based approach leverages the dynamics and definition of the objective function to learn the value function of the parameterized optimal control problem and obtain the policy using a feedback form. Second, we use actor-critic reinforcement learning to approximate the policy in a data-driven way. Using an example involving a two-dimensional convection-diffusion equation, which features high-dimensional state and parameter spaces, we investigate the accuracy and efficiency of both training paradigms. While both paradigms lead to a reasonable approximation of the policy, the model-based approach is more accurate and considerably reduces the number of PDE solves.
△ Less
Submitted 15 February, 2024;
originally announced February 2024.
-
Learning Control Policies of Hodgkin-Huxley Neuronal Dynamics
Authors:
Malvern Madondo,
Deepanshu Verma,
Lars Ruthotto,
Nicholas Au Yong
Abstract:
We present a neural network approach for closed-loop deep brain stimulation (DBS). We cast the problem of finding an optimal neurostimulation strategy as a control problem. In this setting, control policies aim to optimize therapeutic outcomes by tailoring the parameters of a DBS system, typically via electrical stimulation, in real time based on the patient's ongoing neuronal activity. We approxi…
▽ More
We present a neural network approach for closed-loop deep brain stimulation (DBS). We cast the problem of finding an optimal neurostimulation strategy as a control problem. In this setting, control policies aim to optimize therapeutic outcomes by tailoring the parameters of a DBS system, typically via electrical stimulation, in real time based on the patient's ongoing neuronal activity. We approximate the value function offline using a neural network to enable generating controls (stimuli) in real time via the feedback form. The neuronal activity is characterized by a nonlinear, stiff system of differential equations as dictated by the Hodgkin-Huxley model. Our training process leverages the relationship between Pontryagin's maximum principle and Hamilton-Jacobi-Bellman equations to update the value function estimates simultaneously. Our numerical experiments illustrate the accuracy of our approach for out-of-distribution samples and the robustness to moderate shocks and disturbances in the system.
△ Less
Submitted 13 November, 2023;
originally announced November 2023.
-
Some Approximation Properties by Szász-P{ă}lt{ă}nea type Operators involving the Appell Polynomials of class $A^2$
Authors:
Naokant Deo,
Chandra Prakash,
D. K. Verma
Abstract:
This article contributes to the new summation of Szász operators with the help of Appell polynomials of class $A^{2}$. We verified Bohman-Korovkin's theorem and prove the convergence results like Lipschitz-type space, Voronvaskaja-type asymptotic formula, and modulus of continuity using the given operators. Furthermore, we have shown the weighted modulus of continuity and the derivative of bounded…
▽ More
This article contributes to the new summation of Szász operators with the help of Appell polynomials of class $A^{2}$. We verified Bohman-Korovkin's theorem and prove the convergence results like Lipschitz-type space, Voronvaskaja-type asymptotic formula, and modulus of continuity using the given operators. Furthermore, we have shown the weighted modulus of continuity and the derivative of bounded variation.
△ Less
Submitted 7 August, 2023;
originally announced August 2023.
-
A Neural Network Approach for Stochastic Optimal Control
Authors:
Xingjian Li,
Deepanshu Verma,
Lars Ruthotto
Abstract:
We present a neural network approach for approximating the value function of high-dimensional stochastic control problems. Our training process simultaneously updates our value function estimate and identifies the part of the state space likely to be visited by optimal trajectories. Our approach leverages insights from optimal control theory and the fundamental relation between semi-linear parabol…
▽ More
We present a neural network approach for approximating the value function of high-dimensional stochastic control problems. Our training process simultaneously updates our value function estimate and identifies the part of the state space likely to be visited by optimal trajectories. Our approach leverages insights from optimal control theory and the fundamental relation between semi-linear parabolic partial differential equations and forward-backward stochastic differential equations. To focus the sampling on relevant states during neural network training, we use the stochastic Pontryagin maximum principle (PMP) to obtain the optimal controls for the current value function estimate. By design, our approach coincides with the method of characteristics for the non-viscous Hamilton-Jacobi-Bellman equation arising in deterministic control problems. Our training loss consists of a weighted sum of the objective functional of the control problem and penalty terms that enforce the HJB equations along the sampled trajectories. Importantly, training is unsupervised in that it does not require solutions of the control problem.
Our numerical experiments highlight our scheme's ability to identify the relevant parts of the state space and produce meaningful value estimates. Using a two-dimensional model problem, we demonstrate the importance of the stochastic PMP to inform the sampling and compare to a finite element approach. With a nonlinear control affine quadcopter example, we illustrate that our approach can handle complicated dynamics. For a 100-dimensional benchmark problem, we demonstrate that our approach improves accuracy and time-to-solution and, via a modification, we show the wider applicability of our scheme.
△ Less
Submitted 7 May, 2024; v1 submitted 26 September, 2022;
originally announced September 2022.
-
Deep Neural Nets with Fixed Bias Configuration
Authors:
Harbir Antil,
Thomas S. Brown,
Rainald Löhner,
Fumiya Togashi,
Deepanshu Verma
Abstract:
For any given neural network architecture a permutation of weights and biases results in the same functional network. This implies that optimization algorithms used to `train' or `learn' the network are faced with a very large number (in the millions even for small networks) of equivalent optimal solutions in the parameter space. To the best of our knowledge, this observation is absent in the lite…
▽ More
For any given neural network architecture a permutation of weights and biases results in the same functional network. This implies that optimization algorithms used to `train' or `learn' the network are faced with a very large number (in the millions even for small networks) of equivalent optimal solutions in the parameter space. To the best of our knowledge, this observation is absent in the literature. In order to narrow down the parameter search space, a novel technique is introduced in order to fix the bias vector configurations to be monotonically increasing. This is achieved by augmenting a typical learning problem with inequality constraints on the bias vectors in each layer. A Moreau-Yosida regularization based algorithm is proposed to handle these inequality constraints and a theoretical convergence of the this algorithm is established. Applications of the proposed approach to standard trigonometric functions and more challenging stiff ordinary differential equations arising in chemically reacting ows clearly illustrate the benefits of the proposed approach.
△ Less
Submitted 18 February, 2022; v1 submitted 2 July, 2021;
originally announced July 2021.
-
Optimal Control, Numerics, and Applications of Fractional PDEs
Authors:
Harbir Antil,
Thomas S. Brown,
Ratna Khatri,
Akwum Onwunta,
Deepanshu Verma,
Mahamadi Warma
Abstract:
This article provides a brief review of recent developments on two nonlocal operators: fractional Laplacian and fractional time derivative. We start by accounting for several applications of these operators in imaging science, geophysics, harmonic maps and deep (machine) learning. Various notions of solutions to linear fractional elliptic equations are provided and numerical schemes for fractional…
▽ More
This article provides a brief review of recent developments on two nonlocal operators: fractional Laplacian and fractional time derivative. We start by accounting for several applications of these operators in imaging science, geophysics, harmonic maps and deep (machine) learning. Various notions of solutions to linear fractional elliptic equations are provided and numerical schemes for fractional Laplacian and fractional time derivative are discussed. Special emphasis is given to exterior optimal control problems with a linear elliptic equation as constraints. In addition, optimal control problems with interior control and state constraints are considered. We also provide a discussion on fractional deep neural networks, which is shown to be a minimization problem with fractional in time ordinary differential equation as constraint. The paper concludes with a discussion on several open problems.
△ Less
Submitted 24 June, 2021;
originally announced June 2021.
-
Non-diffusive Variational Problems with Distributional and Weak Gradient Constraints
Authors:
Harbir Antil,
Rafael Arndt,
Carlos N. Rautenberg,
Deepanshu Verma
Abstract:
In this paper, we consider non-diffusive variational problems with mixed boundary conditions and (distributional and weak) gradient constraints. The upper bound in the constraint is either a function or a Borel measure, leading to the state space being a Sobolev one or the space of functions of bounded variation. We address existence and uniqueness of the model under low regularity assumptions, an…
▽ More
In this paper, we consider non-diffusive variational problems with mixed boundary conditions and (distributional and weak) gradient constraints. The upper bound in the constraint is either a function or a Borel measure, leading to the state space being a Sobolev one or the space of functions of bounded variation. We address existence and uniqueness of the model under low regularity assumptions, and rigorously identify its Fenchel pre-dual problem. The latter in some cases is posed on a non-standard space of Borel measures with square integrable divergences. We also establish existence and uniqueness of solutions to this pre-dual problem under some assumptions. We conclude the paper by introducing a mixed finite-element method to solve the primal-dual system. The numerical examples confirm our theoretical findings.
△ Less
Submitted 23 June, 2021;
originally announced June 2021.
-
Novel DNNs for Stiff ODEs with Applications to Chemically Reacting Flows
Authors:
Thomas S. Brown,
Harbir Antil,
Rainald Löhner,
Fumiya Togashi,
Deepanshu Verma
Abstract:
Chemically reacting flows are common in engineering, such as hypersonic flow, combustion, explosions, manufacturing processes and environmental assessments. For combustion, the number of reactions can be significant (over 100) and due to the very large CPU requirements of chemical reactions (over 99%) a large number of flow and combustion problems are presently beyond the capabilities of even the…
▽ More
Chemically reacting flows are common in engineering, such as hypersonic flow, combustion, explosions, manufacturing processes and environmental assessments. For combustion, the number of reactions can be significant (over 100) and due to the very large CPU requirements of chemical reactions (over 99%) a large number of flow and combustion problems are presently beyond the capabilities of even the largest supercomputers. Motivated by this, novel Deep Neural Networks (DNNs) are introduced to approximate stiff ODEs. Two approaches are compared, i.e., either learn the solution or the derivative of the solution to these ODEs. These DNNs are applied to multiple species and reactions common in chemically reacting flows. Experimental results show that it is helpful to account for the physical properties of species while designing DNNs. The proposed approach is shown to generalize well.
△ Less
Submitted 1 April, 2021;
originally announced April 2021.
-
Hardy inequalities on metric measure spaces, II: The case $p>q$
Authors:
Michael Ruzhansky,
Daulti Verma
Abstract:
In this note we continue giving the characterisation of weights for two-weight Hardy inequalities to hold on general metric measure spaces possessing polar decompositions. Since there may be no differentiable structure on such spaces, the inequalities are given in the integral form in the spirit of Hardy's original inequality. This is a continuation of our paper [M. Ruzhansky and D. Verma. Hardy i…
▽ More
In this note we continue giving the characterisation of weights for two-weight Hardy inequalities to hold on general metric measure spaces possessing polar decompositions. Since there may be no differentiable structure on such spaces, the inequalities are given in the integral form in the spirit of Hardy's original inequality. This is a continuation of our paper [M. Ruzhansky and D. Verma. Hardy inequalities on metric measure spaces, Proc. R. Soc. A., 475(2223):20180310, 2018] where we treated the case $p\leq q$. Here the remaining range $p>q$ is considered, namely, $0<q<p$, $1<p<\infty.$ We give examples obtaining new weighted Hardy inequalities on $\mathbb R^n$, on homogeneous groups, on hyperbolic spaces, and on Cartan-Hadamard manifolds. We note that doubling conditions are not required for our analysis.
△ Less
Submitted 11 May, 2021; v1 submitted 11 February, 2021;
originally announced February 2021.
-
Novel Deep neural networks for solving Bayesian statistical inverse
Authors:
Harbir Antil,
Howard C Elman,
Akwum Onwunta,
Deepanshu Verma
Abstract:
We consider the simulation of Bayesian statistical inverse problems governed by large-scale linear and nonlinear partial differential equations (PDEs). Markov chain Monte Carlo (MCMC) algorithms are standard techniques to solve such problems. However, MCMC techniques are computationally challenging as they require several thousands of forward PDE solves. The goal of this paper is to introduce a fr…
▽ More
We consider the simulation of Bayesian statistical inverse problems governed by large-scale linear and nonlinear partial differential equations (PDEs). Markov chain Monte Carlo (MCMC) algorithms are standard techniques to solve such problems. However, MCMC techniques are computationally challenging as they require several thousands of forward PDE solves. The goal of this paper is to introduce a fractional deep neural network based approach for the forward solves within an MCMC routine. Moreover, we discuss some approximation error estimates and illustrate the efficiency of our approach via several numerical examples.
△ Less
Submitted 7 February, 2021;
originally announced February 2021.
-
Moreau-Yosida regularization for optimal control of fractional PDEs with state constraints: parabolic case
Authors:
Harbir Antil,
Thomas S. Brown,
Deepanshu Verma,
Mahamadi Warma
Abstract:
This paper considers optimal control of fractional parabolic PDEs with both state and control constraints. The key challenge is how to handle the state constraints. Similarly, to the elliptic case, in this paper, we establish several new mathematical tools in the parabolic setting that are of wider interest. For example, existence of solution to the fractional parabolic equation with measure data…
▽ More
This paper considers optimal control of fractional parabolic PDEs with both state and control constraints. The key challenge is how to handle the state constraints. Similarly, to the elliptic case, in this paper, we establish several new mathematical tools in the parabolic setting that are of wider interest. For example, existence of solution to the fractional parabolic equation with measure data on the right-hand-side. We employ the Moreau-Yosida regularization to handle the state constraints. We establish convergence, with rate, of the regularized optimal control problem to the original one. Numerical experiments confirm what we have proven theoretically.
△ Less
Submitted 20 April, 2020;
originally announced April 2020.
-
Fractional Deep Neural Network via Constrained Optimization
Authors:
Harbir Antil,
Ratna Khatri,
Rainald Löhner,
Deepanshu Verma
Abstract:
This paper introduces a novel algorithmic framework for a deep neural network (DNN), which in a mathematically rigorous manner, allows us to incorporate history (or memory) into the network -- it ensures all layers are connected to one another. This DNN, called Fractional-DNN, can be viewed as a time-discretization of a fractional in time nonlinear ordinary differential equation (ODE). The learnin…
▽ More
This paper introduces a novel algorithmic framework for a deep neural network (DNN), which in a mathematically rigorous manner, allows us to incorporate history (or memory) into the network -- it ensures all layers are connected to one another. This DNN, called Fractional-DNN, can be viewed as a time-discretization of a fractional in time nonlinear ordinary differential equation (ODE). The learning problem then is a minimization problem subject to that fractional ODE as constraints. We emphasize that an analogy between the existing DNN and ODEs, with standard time derivative, is well-known by now. The focus of our work is the Fractional-DNN. Using the Lagrangian approach, we provide a derivation of the backward propagation and the design equations. We test our network on several datasets for classification problems. Fractional-DNN offers various advantages over the existing DNN. The key benefits are a significant improvement to the vanishing gradient issue due to the memory effect, and better handling of nonsmooth data due to the network's ability to approximate non-smooth functions.
△ Less
Submitted 1 April, 2020;
originally announced April 2020.
-
Moreau-Yosida Regularization for Optimal Control of Fractional Elliptic Problems with State and Control Constraints
Authors:
Harbir Antil,
Thomas S. Brown,
Deepanshu Verma
Abstract:
Recently the authors have studied a state and control constrained optimal control problem with fractional elliptic PDE as constraints. The goal of this paper is to continue that program forward and introduce an algorithm to solve such optimal control problems. We shall employ the well-known Moreau-Yosida regularization to handle the state constraints. Similarly to the classical case, we establish…
▽ More
Recently the authors have studied a state and control constrained optimal control problem with fractional elliptic PDE as constraints. The goal of this paper is to continue that program forward and introduce an algorithm to solve such optimal control problems. We shall employ the well-known Moreau-Yosida regularization to handle the state constraints. Similarly to the classical case, we establish the convergence (with rate) of the regularized control problem to the original one. We discretize the problem using a finite element method and establish convergence of our numerical scheme. We emphasize that due to the non-smooth nature of the fractional Laplacian, the proof for the classical case does not apply to the fractional case. The numerical experiments confirm all our theoretical findings.
△ Less
Submitted 10 December, 2019;
originally announced December 2019.
-
Optimal Control of Fractional Elliptic PDEs with State Constraints and Characterization of the dual of Fractional Order Sobolev Spaces
Authors:
Harbir Antil,
Deepanshu Verma,
Mahamadi Warma
Abstract:
This paper introduces the notion of state constraints for optimal control problems governed by fractional elliptic PDEs of order $s \in (0,1)$. There are several mathematical tools that are developed during the process to study this problem, for instance, the characterization of the dual of the fractional order Sobolev spaces and well-posedness of fractional PDEs with measure-valued datum. These t…
▽ More
This paper introduces the notion of state constraints for optimal control problems governed by fractional elliptic PDEs of order $s \in (0,1)$. There are several mathematical tools that are developed during the process to study this problem, for instance, the characterization of the dual of the fractional order Sobolev spaces and well-posedness of fractional PDEs with measure-valued datum. These tools are widely applicable. We show well-posedness of the optimal control problem and derive the first order optimality conditions. Notice that the adjoint equation is a fractional PDE with measure as the right-hand-side datum. We use the characterization of the fractional order dual spaces to study the regularity of the state and adjoint equations. We emphasize that the classical case ($s=1$) was considered by E. Casas in \cite{ECasas_1986a} but almost none of the existing results are applicable to our fractional case.
△ Less
Submitted 31 May, 2019;
originally announced June 2019.
-
External optimal control of fractional parabolic PDEs
Authors:
Harbir Antil,
Deepanshu Verma,
Mahamadi Warma
Abstract:
In this paper we introduce a new notion of optimal control, or source identification in inverse, problems with fractional parabolic PDEs as constraints. This new notion allows a source/control placement outside the domain where the PDE is fulfilled. We tackle the Dirichlet, the Neumann and the Robin cases. For the fractional elliptic PDEs this has been recently investigated by the authors in \cite…
▽ More
In this paper we introduce a new notion of optimal control, or source identification in inverse, problems with fractional parabolic PDEs as constraints. This new notion allows a source/control placement outside the domain where the PDE is fulfilled. We tackle the Dirichlet, the Neumann and the Robin cases. For the fractional elliptic PDEs this has been recently investigated by the authors in \cite{HAntil_RKhatri_MWarma_2018a}. The need for these novel optimal control concepts stems from the fact that the classical PDE models only allow placing the source/control either on the boundary or in the interior where the PDE is satisfied. However, the nonlocal behavior of the fractional operator now allows placing the control in the exterior. We introduce the notions of weak and very-weak solutions to the parabolic Dirichlet problem. We present an approach on how to approximate the parabolic Dirichlet solutions by the parabolic Robin solutions (with convergence rates). A complete analysis for the Dirichlet and Robin optimal control problems has been discussed. The numerical examples confirm our theoretical findings and further illustrate the potential benefits of nonlocal models over the local ones.
△ Less
Submitted 11 April, 2019;
originally announced April 2019.
-
Hardy inequalities on metric measure spaces
Authors:
Michael Ruzhansky,
Daulti Verma
Abstract:
In this note we give several characterisations of weights for two-weight Hardy inequalities to hold on general metric measure spaces possessing polar decompositions. Since there may be no differentiable structure on such spaces, the inequalities are given in the integral form in the spirit of Hardy's original inequality. We give examples obtaining new weighted Hardy inequalities on $\mathbb R^n$,…
▽ More
In this note we give several characterisations of weights for two-weight Hardy inequalities to hold on general metric measure spaces possessing polar decompositions. Since there may be no differentiable structure on such spaces, the inequalities are given in the integral form in the spirit of Hardy's original inequality. We give examples obtaining new weighted Hardy inequalities on $\mathbb R^n$, on homogeneous groups, on hyperbolic spaces, and on Cartan-Hadamard manifolds.
△ Less
Submitted 22 December, 2019; v1 submitted 10 June, 2018;
originally announced June 2018.
-
A natural representation model for symmetric groups
Authors:
Vijay Kodiyalam,
D. -N. Verma
Abstract:
For any positive integer $N$, we describe a natural complex representation of the symmetric group $Σ_N$ on the vector space spanned by its involutions that contains each irreducible representation exactly once.
For any positive integer $N$, we describe a natural complex representation of the symmetric group $Σ_N$ on the vector space spanned by its involutions that contains each irreducible representation exactly once.
△ Less
Submitted 13 February, 2004;
originally announced February 2004.
