Showing 1–50 of 85 results for author: Antil, H

Rockafellian Relaxation for PDE-Constrained Optimization with Distributional Uncertainty

Authors: Harbir Antil, Sean P. Carney, Hugo Díaz, Johannes O. Royset

Abstract: Stochastic optimization problems are generally known to be ill-conditioned to the form of the underlying uncertainty. A framework is introduced for optimal control problems with partial differential equations as constraints that is robust to inaccuracies in the precise form of the problem uncertainty. The framework is based on problem relaxation and involves optimizing a bivariate, "Rockafellian"… ▽ More Stochastic optimization problems are generally known to be ill-conditioned to the form of the underlying uncertainty. A framework is introduced for optimal control problems with partial differential equations as constraints that is robust to inaccuracies in the precise form of the problem uncertainty. The framework is based on problem relaxation and involves optimizing a bivariate, "Rockafellian" objective functional that features both a standard control variable and an additional perturbation variable that handles the distributional ambiguity. In the presence of distributional corruption, the Rockafellian objective functionals are shown in the appropriate settings to $Γ$-converge to uncorrupted objective functionals in the limit of vanishing corruption. Numerical examples illustrate the framework's utility for outlier detection and removal and for variance reduction. △ Less

Submitted 30 April, 2024; originally announced May 2024.

MSC Class: 49M37; 90C30; 93C20; 93E20; 49K20; 49J20

Integer Optimal Control with Fractional Perimeter Regularization

Authors: Harbir Antil, Paul Manns

Abstract: Motivated by many applications, optimal control problems with integer controls have recently received a significant attention. Some state-of-the-art work uses perimeter-regularization to derive stationarity conditions and trust-region algorithms. However, the discretization is difficult in this case because the perimeter is concentrated on a set of dimension $d - 1$ for a domain of dimension $d$.… ▽ More Motivated by many applications, optimal control problems with integer controls have recently received a significant attention. Some state-of-the-art work uses perimeter-regularization to derive stationarity conditions and trust-region algorithms. However, the discretization is difficult in this case because the perimeter is concentrated on a set of dimension $d - 1$ for a domain of dimension $d$. This article proposes a potential way to overcome this challenge by using the fractional nonlocal perimeter with fractional exponent $0<α<1$. In this way, the boundary integrals in the perimeter regularization are replaced by volume integrals. Besides establishing some non-trivial properties associated with this perimeter, a $Γ$-convergence result is derived. This result establishes convergence of minimizers of fractional perimeter-regularized problem, to the standard one, as the exponent $α$ tends to 1. In addition, the stationarity results are derived and algorithmic convergence analysis is carried out for $α\in (0.5,1)$ under an additional assumption on the gradient of the reduced objective. The theoretical results are supplemented by a preliminary computational experiment. We observe that the isotropy of the total variation may be approximated by means of the fractional perimeter functional. △ Less

Submitted 8 June, 2024; v1 submitted 7 April, 2024; originally announced April 2024.

MSC Class: 49M05; 49M25; 49Q20

Elliptic Reconstruction and A Posteriori Error Estimates for Parabolic Variational Inequalities

Authors: Harbir Antil, Rohit Khandelwal

Abstract: Elliptic reconstruction property, originally introduced by Makridakis and Nochetto for linear parabolic problems, is a well-known tool to derive optimal a posteriori error estimates. No such results are known for nonlinear and nonsmooth problems such as parabolic variational inequalities (VIs). This article establishes the elliptic reconstruction property for parabolic VIs and derives a posteriori… ▽ More Elliptic reconstruction property, originally introduced by Makridakis and Nochetto for linear parabolic problems, is a well-known tool to derive optimal a posteriori error estimates. No such results are known for nonlinear and nonsmooth problems such as parabolic variational inequalities (VIs). This article establishes the elliptic reconstruction property for parabolic VIs and derives a posteriori error estimates in $L^{\infty}(0,T;L^{2}(Ω))$. The estimator consists of discrete complementarity terms and standard residual. As an application, the residual-type error estimates are presented. △ Less

Submitted 27 May, 2024; v1 submitted 27 February, 2024; originally announced February 2024.

Exterior Nonlocal Variational Inequalities

Authors: Harbir Antil, Madeline O. Horton, Mahamadi Warma

Abstract: This paper introduces a new class of variational inequalities where the obstacle is placed in the exterior domain that is disjoint from the observation domain. This is carried out with the help of nonlocal fractional operators. The need for such novel variational inequalities stems from the fact that the classical approach only allows placing the obstacle either inside the observation domain or on… ▽ More This paper introduces a new class of variational inequalities where the obstacle is placed in the exterior domain that is disjoint from the observation domain. This is carried out with the help of nonlocal fractional operators. The need for such novel variational inequalities stems from the fact that the classical approach only allows placing the obstacle either inside the observation domain or on the boundary. A complete analysis of the continuous problem is provided. Additionally, perturbation arguments to approximate the problem are discussed. △ Less

Submitted 19 February, 2024; originally announced February 2024.

Well-posedness of a Pseudo-Parabolic KWC System in Materials Science

Authors: Harbir Antil, Daiki Mizuno, Ken Shirakawa

Abstract: The original KWC-system is widely used in materials science. It was proposed in [Kobayashi et al, Physica D, 140, 141--150 (2000)] and is based on the phase field model of planar grain boundary motion. This model suffers from two key challenges. Firstly, it is difficult to establish its relation to physics, in particular, a variational model. Secondly, it lacks uniqueness. The former has been rece… ▽ More The original KWC-system is widely used in materials science. It was proposed in [Kobayashi et al, Physica D, 140, 141--150 (2000)] and is based on the phase field model of planar grain boundary motion. This model suffers from two key challenges. Firstly, it is difficult to establish its relation to physics, in particular, a variational model. Secondly, it lacks uniqueness. The former has been recently studied within the realm of BV-theory. The latter only holds under various simplifications. This article introduces a pseudo-parabolic version of the KWC-system. A direct relationship with variational model (as gradient-flow) and uniqueness are established without making any unrealistic simplifications. Namely, this is the first KWC-system which is both physically and mathematically valid. The proposed model overcomes the well-known open issues. △ Less

Submitted 15 February, 2024; originally announced February 2024.

Comments: 24 pages

MSC Class: 35A15; 35G50; 35G61; 35K70; 74N20

Mathematical Opportunities in Digital Twins (MATH-DT)

Authors: Harbir Antil

Abstract: The report describes the discussions from the Workshop on Mathematical Opportunities in Digital Twins (MATH-DT) from December 11-13, 2023, George Mason University. It illustrates that foundational Mathematical advances are required for Digital Twins (DTs) that are different from traditional approaches. A traditional model, in biology, physics, engineering or medicine, starts with a generic physi… ▽ More The report describes the discussions from the Workshop on Mathematical Opportunities in Digital Twins (MATH-DT) from December 11-13, 2023, George Mason University. It illustrates that foundational Mathematical advances are required for Digital Twins (DTs) that are different from traditional approaches. A traditional model, in biology, physics, engineering or medicine, starts with a generic physical law (e.g., equations) and is often a simplification of reality. A DT starts with a specific ecosystem, object or person (e.g., personalized care) representing reality, requiring multi -scale, -physics modeling and coupling. Thus, these processes begin at opposite ends of the simulation and modeling pipeline, requiring different reliability criteria and uncertainty assessments. Additionally, unlike existing approaches, a DT assists humans to make decisions for the physical system, which (via sensors) in turn feeds data into the DT, and operates for the life of the physical system. While some of the foundational mathematical research can be done without a specific application context, one must also keep specific applications in mind for DTs. E.g., modeling a bridge or a biological system (a patient), or a socio-technical system (a city) is very different. The models range from differential equations (deterministic/uncertain) in engineering, to stochastic in biology, including agent-based. These are multi-scale hybrid models or large scale (multi-objective) optimization problems under uncertainty. There are no universal models or approaches. For e.g., Kalman filters for forecasting might work in engineering, but can fail in biomedical domain. Ad hoc studies, with limited systematic work, have shown that AI/ML methods can fail for simple engineering systems and can work well for biomedical problems. A list of `Mathematical Opportunities and Challenges' concludes the report. △ Less

Submitted 21 March, 2024; v1 submitted 15 February, 2024; originally announced February 2024.

A Discontinuous Galerkin Method for Optimal Control of the Obstacle Problem

Authors: Harbir Antil, Rohit Khandelwal, Umarkhon Rakhimov

Abstract: This article provides quasi-optimal a priori error estimates for an optimal control problem constrained by an elliptic obstacle problem where the finite element discretization is carried out using the symmetric interior penalty discontinuous Galerkin method. The main proofs are based on the improved $L^2$-error estimates for the obstacle problem, the discrete maximum principle, and a well-known qu… ▽ More This article provides quasi-optimal a priori error estimates for an optimal control problem constrained by an elliptic obstacle problem where the finite element discretization is carried out using the symmetric interior penalty discontinuous Galerkin method. The main proofs are based on the improved $L^2$-error estimates for the obstacle problem, the discrete maximum principle, and a well-known quadratic growth property. The standard (restrictive) assumptions on mesh are not assumed here. △ Less

Submitted 19 December, 2023; originally announced December 2023.

On The Use of Risk Measures in Digital Twins to Identify Weaknesses in Structures

Authors: Facundo N. Airaudo, Harbir Antil, Rainald Löhner, Umarkhon Rakhimov

Abstract: Given measurements from sensors and a set of standard forces, an optimization based approach to identify weakness in structures is introduced. The key novelty lies in letting the load and measurements to be random variables. Subsequently the conditional-value-at-risk (CVaR) is minimized subject to the elasticity equations as constraints. CVaR is a risk measure that leads to minimization of rare an… ▽ More Given measurements from sensors and a set of standard forces, an optimization based approach to identify weakness in structures is introduced. The key novelty lies in letting the load and measurements to be random variables. Subsequently the conditional-value-at-risk (CVaR) is minimized subject to the elasticity equations as constraints. CVaR is a risk measure that leads to minimization of rare and low probability events which the standard expectation cannot. The optimization variable is the (deterministic) strength factor which appears as a coefficient in the elasticity equation, thus making the problem nonconvex. Due to uncertainty, the problem is high dimensional and, due to CVaR, the problem is nonsmooth. An adjoint based approach is developed with quadrature in the random variables. Numerical results are presented in the context of a plate, a large structure with trusses similar to those used in solar arrays or cranes, and a footbridge. △ Less

Submitted 20 November, 2023; originally announced November 2023.

High-Fidelity Digital Twins: Detecting and Localizing Weaknesses in Structures

Authors: Rainald Löhner, Facundo N. Airaudo, Harbir Antil, Roland Wüchner, Fabian Meister, Suneth Warnakulasuriya

Abstract: An adjoint-based procedure to determine weaknesses, or, more generally, the material properties of structures is developed and tested. Given a series of load cases and corresponding displacement/strain measurements, the material properties are obtained by minimizing the weighted differences between the measured and computed values. In a subsequent step, techniques to minimize the number of load ca… ▽ More An adjoint-based procedure to determine weaknesses, or, more generally, the material properties of structures is developed and tested. Given a series of load cases and corresponding displacement/strain measurements, the material properties are obtained by minimizing the weighted differences between the measured and computed values. In a subsequent step, techniques to minimize the number of load cases and sensors are proposed and tested. Several examples show the viability, accuracy and efficiency of the proposed methodology and its potential use for high fidelity digital twins. △ Less

Submitted 17 November, 2023; originally announced November 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2303.15329

On-Manifold Projected Gradient Descent

Authors: Aaron Mahler, Tyrus Berry, Tom Stephens, Harbir Antil, Michael Merritt, Jeanie Schreiber, Ioannis Kevrekidis

Abstract: This work provides a computable, direct, and mathematically rigorous approximation to the differential geometry of class manifolds for high-dimensional data, along with nonlinear projections from input space onto these class manifolds. The tools are applied to the setting of neural network image classifiers, where we generate novel, on-manifold data samples, and implement a projected gradient desc… ▽ More This work provides a computable, direct, and mathematically rigorous approximation to the differential geometry of class manifolds for high-dimensional data, along with nonlinear projections from input space onto these class manifolds. The tools are applied to the setting of neural network image classifiers, where we generate novel, on-manifold data samples, and implement a projected gradient descent algorithm for on-manifold adversarial training. The susceptibility of neural networks (NNs) to adversarial attack highlights the brittle nature of NN decision boundaries in input space. Introducing adversarial examples during training has been shown to reduce the susceptibility of NNs to adversarial attack; however, it has also been shown to reduce the accuracy of the classifier if the examples are not valid examples for that class. Realistic "on-manifold" examples have been previously generated from class manifolds in the latent of an autoencoder. Our work explores these phenomena in a geometric and computational setting that is much closer to the raw, high-dimensional input space than can be provided by VAE or other black box dimensionality reductions. We employ conformally invariant diffusion maps (CIDM) to approximate class manifolds in diffusion coordinates, and develop the Nyström projection to project novel points onto class manifolds in this setting. On top of the manifold approximation, we leverage the spectral exterior calculus (SEC) to determine geometric quantities such as tangent vectors of the manifold. We use these tools to obtain adversarial examples that reside on a class manifold, yet fool a classifier. These misclassifications then become explainable in terms of human-understandable manipulations within the data, by expressing the on-manifold adversary in the semantic basis on the manifold. △ Less

Submitted 23 August, 2023; originally announced August 2023.

GNEP Based Dynamic Segmentation and Motion Estimation for Neuromorphic Imaging

Authors: Harbir Antil, David Sayre

Abstract: This paper explores the application of event-based cameras in the domains of image segmentation and motion estimation. These cameras offer a groundbreaking technology by capturing visual information as a continuous stream of asynchronous events, departing from the conventional frame-based image acquisition. We introduce a Generalized Nash Equilibrium based framework that leverages the temporal and… ▽ More This paper explores the application of event-based cameras in the domains of image segmentation and motion estimation. These cameras offer a groundbreaking technology by capturing visual information as a continuous stream of asynchronous events, departing from the conventional frame-based image acquisition. We introduce a Generalized Nash Equilibrium based framework that leverages the temporal and spatial information derived from the event stream to carry out segmentation and velocity estimation. To establish the theoretical foundations, we derive an existence criteria and propose a multi-level optimization method for calculating equilibrium. The efficacy of this approach is shown through a series of experiments. △ Less

Submitted 8 July, 2023; v1 submitted 5 July, 2023; originally announced July 2023.

Randomized Reduced Basis Methods for Parameterized Fractional Elliptic PDEs

Authors: Harbir Antil, Arvind K. Saibaba

Abstract: This paper is interested in develo** reduced order models (ROMs) for repeated simulation of fractional elliptic partial differential equations (PDEs) for multiple values of the parameters (e.g., diffusion coefficients or fractional exponent) governing these models. These problems arise in many applications including simulating Gaussian processes, and geophysical electromagnetics. The approach us… ▽ More This paper is interested in develo** reduced order models (ROMs) for repeated simulation of fractional elliptic partial differential equations (PDEs) for multiple values of the parameters (e.g., diffusion coefficients or fractional exponent) governing these models. These problems arise in many applications including simulating Gaussian processes, and geophysical electromagnetics. The approach uses the Kato integral formula to express the solution as an integral involving the solution of a parametrized elliptic PDE, which is discretized using finite elements in space and sinc quadrature for the fractional part. The offline stage of the ROM is accelerated using a solver for shifted linear systems, MPGMRES-Sh, and using a randomized approach for compressing the snapshot matrix. Our approach is both computational and memory efficient. Numerical experiments on a range of model problems, including an application to Gaussian processes, show the benefits of our approach. △ Less

Submitted 29 June, 2023; v1 submitted 28 June, 2023; originally announced June 2023.

Comments: 15 pages, 5 figures, 2 tables

A Note on Dimensionality Reduction in Deep Neural Networks using Empirical Interpolation Method

Authors: Harbir Antil, Madhu Gupta, Randy Price

Abstract: Empirical interpolation method (EIM) is a well-known technique to efficiently approximate parameterized functions. This paper proposes to use EIM algorithm to efficiently reduce the dimension of the training data within supervised machine learning. This is termed as DNN-EIM. Applications in data science (e.g., MNIST) and parameterized (and time-dependent) partial differential equations (PDEs) are… ▽ More Empirical interpolation method (EIM) is a well-known technique to efficiently approximate parameterized functions. This paper proposes to use EIM algorithm to efficiently reduce the dimension of the training data within supervised machine learning. This is termed as DNN-EIM. Applications in data science (e.g., MNIST) and parameterized (and time-dependent) partial differential equations (PDEs) are considered. The proposed DNNs in case of classification are trained in parallel for each class. This approach is sequential, i.e., new classes can be added without having to retrain the network. In case of PDEs, a DNN is designed corresponding to each EIM point. Again, these networks can be trained in parallel, for each EIM point. In all cases, the parallel networks require fewer than ten times the number of training weights. Significant gains are observed in terms of training times, without sacrificing accuracy. △ Less

Submitted 16 May, 2023; originally announced May 2023.

Comments: 13 pages

MSC Class: 68T07; 76B75; 93C20; 93C15

Adjoint-based Determination of Weaknesses in Structures

Authors: Facundo N. Airaudo, Rainald Löhner, Roland Wüchner, Harbir Antil

Abstract: An adjoint-based procedure to determine weaknesses, or, more generally the material properties of structures is developed and tested. Given a series of force and deformation/strain measurements, the material properties are obtained by minimizing the weighted differences between the measured and computed values. Several examples with truss, plain strain and volume elements show the viability, accur… ▽ More An adjoint-based procedure to determine weaknesses, or, more generally the material properties of structures is developed and tested. Given a series of force and deformation/strain measurements, the material properties are obtained by minimizing the weighted differences between the measured and computed values. Several examples with truss, plain strain and volume elements show the viability, accuracy and efficiency of the proposed methodology using both displacement and strain measurements. An important finding was that in order to obtain reliable, convergent results the gradient of the cost function has to be smoothed. △ Less

Submitted 27 March, 2023; originally announced March 2023.

Strong stationarity for optimal control problems with non-smooth integral equation constraints: Application to continuous DNNs

Authors: Harbir Antil, Livia Betz, Daniel Wachsmuth

Abstract: Motivated by the residual type neural networks (ResNet), this paper studies optimal control problems constrained by a non-smooth integral equation. Such non-smooth equations, for instance, arise in the continuous representation of fractional deep neural networks (DNNs). Here the underlying non-differentiable function is the ReLU or max function. The control enters in a nonlinear and multiplicati… ▽ More Motivated by the residual type neural networks (ResNet), this paper studies optimal control problems constrained by a non-smooth integral equation. Such non-smooth equations, for instance, arise in the continuous representation of fractional deep neural networks (DNNs). Here the underlying non-differentiable function is the ReLU or max function. The control enters in a nonlinear and multiplicative manner and we additionally impose control constraints. Because of the presence of the non-differentiable map**, the application of standard adjoint calculus is excluded. We derive strong stationary conditions by relying on the limited differentiability properties of the non-smooth map. While traditional approaches smoothen the non-differentiable function, no such smoothness is retained in our final strong stationarity system. Thus, this work also closes a gap which currently exists in continuous neural networks with ReLU type activation function. △ Less

Submitted 10 February, 2023; originally announced February 2023.

Bilevel Inverse Problems in Neuromorphic Imaging

Authors: Harbir Antil, David Sayre

Abstract: Event or Neuromorphic cameras are novel biologically inspired sensors that record data based on the change in light intensity at each pixel asynchronously. They have a temporal resolution of microseconds. This is useful for scenes with fast moving objects that can cause motion blur in traditional cameras, which record the average light intensity over an exposure time for each pixel synchronously.… ▽ More Event or Neuromorphic cameras are novel biologically inspired sensors that record data based on the change in light intensity at each pixel asynchronously. They have a temporal resolution of microseconds. This is useful for scenes with fast moving objects that can cause motion blur in traditional cameras, which record the average light intensity over an exposure time for each pixel synchronously. This paper presents a bilevel inverse problem framework for neuromorphic imaging. Existence of solution to the inverse problem is established. Second order sufficient conditions are derived under special situations for this nonconvex problem. A second order Newton type solver is derived to solve the problem. The efficacy of the approach is shown on several examples. △ Less

Submitted 3 February, 2023; originally announced February 2023.

Smoothed Moreau-Yosida Tensor Train Approximation of State-constrained Optimization Problems under Uncertainty

Authors: Harbir Antil, Sergey Dolgov, Akwum Onwunta

Abstract: We propose an algorithm to solve optimization problems constrained by partial (ordinary) differential equations under uncertainty, with almost sure constraints on the state variable. To alleviate the computational burden of high-dimensional random variables, we approximate all random fields by the tensor-train decomposition. To enable efficient tensor-train approximation of the state constraints,… ▽ More We propose an algorithm to solve optimization problems constrained by partial (ordinary) differential equations under uncertainty, with almost sure constraints on the state variable. To alleviate the computational burden of high-dimensional random variables, we approximate all random fields by the tensor-train decomposition. To enable efficient tensor-train approximation of the state constraints, the latter are handled using the Moreau-Yosida penalty, with an additional smoothing of the positive part (plus/ReLU) function by a softplus function. In a special case of a quadratic cost minimization constrained by linear elliptic partial differential equations, and some additional constraint qualification, we prove strong convergence of the regularized solution to the optimal control. This result also proposes a practical recipe for selecting the smoothing parameter as a function of the penalty parameter. We develop a second order Newton type method with a fast matrix-free action of the approximate Hessian to solve the smoothed Moreau-Yosida problem. This algorithm is tested on benchmark elliptic problems with random coefficients, optimization problems constrained by random elliptic variational inequalities, and a real-world epidemiological model with 20 random variables. These examples demonstrate mild (at most polynomial) scaling with respect to the dimension and regularization parameters. △ Less

Submitted 4 July, 2024; v1 submitted 20 January, 2023; originally announced January 2023.

Comments: 28 pages

Adjoint-Based Estimation of Sensitivity of Clinical Measures to Boundary Conditions for Arteries

Authors: Rainald Löhner, Harbir Antil, Juan Cebral, Fernando Mut

Abstract: The use of adjoint solvers is considered in order to obtain the sensitivity of clinical measures in aneurysms to incomplete (or unknown) boundary conditions and/or geometry. It is shown that these techniques offer interesting theoretical insights and viable computational tools to obtain these sensitivities. The use of adjoint solvers is considered in order to obtain the sensitivity of clinical measures in aneurysms to incomplete (or unknown) boundary conditions and/or geometry. It is shown that these techniques offer interesting theoretical insights and viable computational tools to obtain these sensitivities. △ Less

Submitted 11 January, 2023; originally announced January 2023.

Analysis of a sinc-Galerkin Method for the Fractional Laplacian

Authors: Harbir Antil, Patrick Dondl, Ludwig Striet

Abstract: We provide the convergence analysis for a sinc-Galerkin method to solve the fractional Dirichlet problem. This can be understood as a follow-up of an earlier article by the same authors, where the authors presented a sinc-function based method to solve fractional PDEs. While the original method was formulated as a collocation method, we show that the same method can be interpreted as a nonconformi… ▽ More We provide the convergence analysis for a sinc-Galerkin method to solve the fractional Dirichlet problem. This can be understood as a follow-up of an earlier article by the same authors, where the authors presented a sinc-function based method to solve fractional PDEs. While the original method was formulated as a collocation method, we show that the same method can be interpreted as a nonconforming Galerkin method, giving access to abstract error estimates. Optimal order of convergence is shown without any unrealistic regularity assumptions on the solution. △ Less

Submitted 21 August, 2023; v1 submitted 22 December, 2022; originally announced December 2022.

MSC Class: 35R11; 65N30; 65N35 ACM Class: G.1

Neural Network Representation of Time Integrators

Authors: Rainald Löhner, Harbir Antil

Abstract: Deep neural network (DNN) architectures are constructed that are the exact equivalent of explicit Runge-Kutta schemes for numerical time integration. The network weights and biases are given, i.e., no training is needed. In this way, the only task left for physics-based integrators is the DNN approximation of the right-hand side. This allows to clearly delineate the approximation estimates for rig… ▽ More Deep neural network (DNN) architectures are constructed that are the exact equivalent of explicit Runge-Kutta schemes for numerical time integration. The network weights and biases are given, i.e., no training is needed. In this way, the only task left for physics-based integrators is the DNN approximation of the right-hand side. This allows to clearly delineate the approximation estimates for right-hand side errors and time integration errors. The architecture required for the integration of a simple mass-damper-stiffness case is included as an example. △ Less

Submitted 30 November, 2022; originally announced November 2022.

Boundary control of time-harmonic eddy current equations

Authors: Harbir Antil, Hugo Díaz

Abstract: Motivated by various applications, this article develops the notion of boundary control for Maxwell's equations in the frequency domain. Surface curl is shown to be the appropriate regularization in order for the optimal control problem to be well-posed. Since, all underlying variables are assumed to be complex valued, the standard results on differentiability do not directly apply. Instead, we ex… ▽ More Motivated by various applications, this article develops the notion of boundary control for Maxwell's equations in the frequency domain. Surface curl is shown to be the appropriate regularization in order for the optimal control problem to be well-posed. Since, all underlying variables are assumed to be complex valued, the standard results on differentiability do not directly apply. Instead, we extend the notion of Wirtinger derivatives to complexified Hilbert spaces. Optimality conditions are rigorously derived and higher order boundary regularity of the adjoint variable is established. The state and adjoint variables are discretized using higher order Nédélec finite elements. The finite element space for controls is identified, as a space, which preserves the structure of the control regularization. Convergence of the fully discrete scheme is established. The theory is validated by numerical experiments, in some cases, motivated by realistic applications. △ Less

Submitted 29 September, 2022; originally announced September 2022.

Comments: 25 pages, 6 figures

MSC Class: 49J20; 49K20; 65M60; 78M10

Optimal Control of a Quasi-Variational Swee** Process

Authors: Harbir Antil, Rafael Arndt, Boris S. Mordukhovich, Dao Nguyen, Carlos N. Rautenberg

Abstract: The paper addresses the study of a class of evolutionary quasi-variational inequalities of the parabolic type arising in the formation and growth models of granular and cohensionless materials. Such models and their mathematical descriptions are highly challenging and require powerful tools of their analysis and implementation. We formulate a space-time continuous optimal control problem for a bas… ▽ More The paper addresses the study of a class of evolutionary quasi-variational inequalities of the parabolic type arising in the formation and growth models of granular and cohensionless materials. Such models and their mathematical descriptions are highly challenging and require powerful tools of their analysis and implementation. We formulate a space-time continuous optimal control problem for a basic model of this type, develop several regularization and approximation procedures, and establish the existence of optimal solutions for the time-continuous and space-discrete problem. Viewing a version of this problem as a controlled quasi-variational swee** process leads us to deriving necessary optimality conditions for the fully discrete problem by using the advanced machinery of variational analysis and generalized differentiation. △ Less

Submitted 31 August, 2022; originally announced September 2022.

Nonlocal Bounded Variations with Applications

Authors: Harbir Antil, Hugo Díaz, Tian **g, Armin Schikorra

Abstract: Motivated by problems where jumps across lower dimensional subsets and sharp transitions across interfaces are of interest, this paper studies the properties of fractional bounded variation ($BV$)-type spaces. Two different natural fractional analogs of classical $BV$ are considered: $BV^α$, a space induced from the Riesz-fractional gradient that has been recently studied by Comi-Stefani; and… ▽ More Motivated by problems where jumps across lower dimensional subsets and sharp transitions across interfaces are of interest, this paper studies the properties of fractional bounded variation ($BV$)-type spaces. Two different natural fractional analogs of classical $BV$ are considered: $BV^α$, a space induced from the Riesz-fractional gradient that has been recently studied by Comi-Stefani; and $bv^α$, induced by the Gagliardo-type fractional gradient often used in Dirichlet forms and Peridynamics - this one is naturally related to the Caffarelli-Roquejoffre-Savin fractional perimeter. Our main theoretical result is that the latter $bv^α$ actually corresponds to the Gagliardo-Slobodeckij space $W^{α,1}$. As an application, using the properties of these spaces, novel image denoising models are introduced and their corresponding Fenchel pre-dual formulations are derived. The latter requires density of smooth functions with compact support. We establish this density property for convex domains. △ Less

Submitted 24 August, 2022; originally announced August 2022.

Efficient algorithms for Bayesian Inverse Problems with Whittle--Matérn Priors

Authors: Harbir Antil, Arvind K. Saibaba

Abstract: This paper tackles efficient methods for Bayesian inverse problems with priors based on Whittle--Matérn Gaussian random fields. The Whittle--Matérn prior is characterized by a mean function and a covariance operator that is taken as a negative power of an elliptic differential operator. This approach is flexible in that it can incorporate a wide range of prior information including non-stationary… ▽ More This paper tackles efficient methods for Bayesian inverse problems with priors based on Whittle--Matérn Gaussian random fields. The Whittle--Matérn prior is characterized by a mean function and a covariance operator that is taken as a negative power of an elliptic differential operator. This approach is flexible in that it can incorporate a wide range of prior information including non-stationary effects, but it is currently computationally advantageous only for integer values of the exponent. In this paper, we derive an efficient method for handling all admissible noninteger values of the exponent. The method first discretizes the covariance operator using finite elements and quadrature, and uses preconditioned Krylov subspace solvers for shifted linear systems to efficiently apply the resulting covariance matrix to a vector. This approach can be used for generating samples from the distribution in two different ways: by solving a stochastic partial differential equation, and by using a truncated Karhunen-Loève expansion. We show how to incorporate this prior representation into the infinite-dimensional Bayesian formulation, and show how to efficiently compute the maximum a posteriori estimate, and approximate the posterior variance. Although the focus of this paper is on Bayesian inverse problems, the techniques developed here are applicable to solving systems with fractional Laplacians and Gaussian random fields. Numerical experiments demonstrate the performance and scalability of the solvers and their applicability to model and real-data inverse problems in tomography and a time-dependent heat equation. △ Less

Submitted 11 May, 2022; v1 submitted 9 May, 2022; originally announced May 2022.

Comments: 21 pages

MSC Class: 65M60; 65F50; 65F10; 65N21

Sparse optimization problems in fractional order Sobolev spaces

Authors: Harbir Antil, Daniel Wachsmuth

Abstract: We consider optimization problems in the fractional order Sobolev spaces $H^s(Ω)$, $s\in (0,1)$, with sparsity promoting objective functionals containing $L^p$-pseudonorms, $p\in (0,1)$. Existence of solutions is proven. By means of a smoothing scheme, we obtain first-order optimality conditions. An algorithm based on this smoothing scheme is developed. Weak limit points of iterates are shown to s… ▽ More We consider optimization problems in the fractional order Sobolev spaces $H^s(Ω)$, $s\in (0,1)$, with sparsity promoting objective functionals containing $L^p$-pseudonorms, $p\in (0,1)$. Existence of solutions is proven. By means of a smoothing scheme, we obtain first-order optimality conditions. An algorithm based on this smoothing scheme is developed. Weak limit points of iterates are shown to satisfy a stationarity system that is slightly weaker than that given by the necessary condition. △ Less

Submitted 29 June, 2023; v1 submitted 25 April, 2022; originally announced April 2022.

Comments: Corrected version of published paper

Journal ref: Inverse problems 39, 044001 (2023)

An Optimal Time Variable Learning Framework for Deep Neural Networks

Authors: Harbir Antil, Hugo Díaz, Evelyn Herberg

Abstract: Feature propagation in Deep Neural Networks (DNNs) can be associated to nonlinear discrete dynamical systems. The novelty, in this paper, lies in letting the discretization parameter (time step-size) vary from layer to layer, which needs to be learned, in an optimization framework. The proposed framework can be applied to any of the existing networks such as ResNet, DenseNet or Fractional-DNN. Thi… ▽ More Feature propagation in Deep Neural Networks (DNNs) can be associated to nonlinear discrete dynamical systems. The novelty, in this paper, lies in letting the discretization parameter (time step-size) vary from layer to layer, which needs to be learned, in an optimization framework. The proposed framework can be applied to any of the existing networks such as ResNet, DenseNet or Fractional-DNN. This framework is shown to help overcome the vanishing and exploding gradient issues. Stability of some of the existing continuous DNNs such as Fractional-DNN is also studied. The proposed approach is applied to an ill-posed 3D-Maxwell's equation. △ Less

Submitted 18 April, 2022; originally announced April 2022.

MSC Class: 34A08; 49J15; 68T05; 82C32

NINNs: Nudging Induced Neural Networks

Authors: Harbir Antil, Rainald Löhner, Randy Price

Abstract: New algorithms called nudging induced neural networks (NINNs), to control and improve the accuracy of deep neural networks (DNNs), are introduced. The NINNs framework can be applied to almost all pre-existing DNNs, with forward propagation, with costs comparable to existing DNNs. NINNs work by adding a feedback control term to the forward propagation of the network. The feedback term nudges the ne… ▽ More New algorithms called nudging induced neural networks (NINNs), to control and improve the accuracy of deep neural networks (DNNs), are introduced. The NINNs framework can be applied to almost all pre-existing DNNs, with forward propagation, with costs comparable to existing DNNs. NINNs work by adding a feedback control term to the forward propagation of the network. The feedback term nudges the neural network towards a desired quantity of interest. NINNs offer multiple advantages, for instance, they lead to higher accuracy when compared with existing data assimilation algorithms such as nudging. Rigorous convergence analysis is established for NINNs. The algorithmic and theoretical findings are illustrated on examples from data assimilation and chemically reacting flows. △ Less

Submitted 15 March, 2022; originally announced March 2022.

Comments: 20 pages

MSC Class: 93C20; 93C15; 68T07; 80A32; 76B75

A Deterministic Pathogen Transmission Model Based on High-Fidelity Physics

Authors: Rainald Löhner, Harbir Antil, Juan Marcelo Gimenez, Sergio Idelsohn, Eugenio Oñate

Abstract: A deterministic pathogen transmission model based on high-fidelity physics has been developed. The model combines computational fluid dynamics and computational crowd dynamics in order to be able to provide accurate tracing of viral matter that is exhaled, transmitted and inhaled via aerosols. The examples shown indicate that even with modest computing resources, the propagation and transmission o… ▽ More A deterministic pathogen transmission model based on high-fidelity physics has been developed. The model combines computational fluid dynamics and computational crowd dynamics in order to be able to provide accurate tracing of viral matter that is exhaled, transmitted and inhaled via aerosols. The examples shown indicate that even with modest computing resources, the propagation and transmission of viral matter can be simulated for relatively large areas with thousands of square meters, hundreds of pedestrians and several minutes of physical time. The results obtained and insights gained from these simulations can be used to inform global pandemic propagation models, increasing substantially their accuracy. △ Less

Submitted 17 February, 2022; originally announced February 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:2009.03365

Data Assimilation with Deep Neural Nets Informed by Nudging

Authors: Harbir Antil, Rainald Löhner, Randy Price

Abstract: The nudging data assimilation algorithm is a powerful tool used to forecast phenomena of interest given incomplete and noisy observations. Machine learning is becoming increasingly popular in data assimilation given its ease of computation and forecasting ability. This work proposes a new approach to data assimilation via machine learning where Deep Neural Networks (DNNs) are being taught the nudg… ▽ More The nudging data assimilation algorithm is a powerful tool used to forecast phenomena of interest given incomplete and noisy observations. Machine learning is becoming increasingly popular in data assimilation given its ease of computation and forecasting ability. This work proposes a new approach to data assimilation via machine learning where Deep Neural Networks (DNNs) are being taught the nudging algorithm. The accuracy of the proposed DNN based algorithm is comparable to the nudging algorithm and it is confirmed by the Lorenz 63 and Lorenz 96 numerical examples. The key advantage of the proposed approach is the fact that, once trained, DNNs are cheap to evaluate in comparison to nudging where typically differential equations are needed to be solved. Standard exponential type approximation results are established for the Lorenz 63 model for both the continuous and discrete in time models. These results can be directly coupled with estimates for DNNs (whenever available), to derive the overall approximation error estimates of the proposed algorithm. △ Less

Submitted 22 November, 2021; originally announced November 2021.

Comments: 20 pages

MSC Class: 93C20; 93C15; 68T07; 76B75

TTRISK: Tensor Train Decomposition Algorithm for Risk Averse Optimization

Authors: Harbir Antil, Sergey Dolgov, Akwum Onwunta

Abstract: This article develops a new algorithm named TTRISK to solve high-dimensional risk-averse optimization problems governed by differential equations (ODEs and/or PDEs) under uncertainty. As an example, we focus on the so-called Conditional Value at Risk (CVaR), but the approach is equally applicable to other coherent risk measures. Both the full and reduced space formulations are considered. The algo… ▽ More This article develops a new algorithm named TTRISK to solve high-dimensional risk-averse optimization problems governed by differential equations (ODEs and/or PDEs) under uncertainty. As an example, we focus on the so-called Conditional Value at Risk (CVaR), but the approach is equally applicable to other coherent risk measures. Both the full and reduced space formulations are considered. The algorithm is based on low rank tensor approximations of random fields discretized using stochastic collocation. To avoid non-smoothness of the objective function underpinning the CVaR, we propose an adaptive strategy to select the width parameter of the smoothed CVaR to balance the smoothing and tensor approximation errors. Moreover, unbiased Monte Carlo CVaR estimate can be computed by using the smoothed CVaR as a control variate. To accelerate the computations, we introduce an efficient preconditioner for the KKT system in the full space formulation.The numerical experiments demonstrate that the proposed method enables accurate CVaR optimization constrained by large-scale discretized systems. In particular, the first example consists of an elliptic PDE with random coefficients as constraints. The second example is motivated by a realistic application to devise a lockdown plan for United Kingdom under COVID-19. The results indicate that the risk-averse framework is feasible with the tensor approximations under tens of random variables. △ Less

Submitted 1 December, 2022; v1 submitted 9 November, 2021; originally announced November 2021.

Comments: 28 pages

MSC Class: 93E20; 49J55; 49K20; 49K45; 90C15; 65D15; 15A69; 15A23

A unified framework for optimal control of fractional in time subdiffusive semilinear PDEs

Authors: Harbir Antil, Ciprian G. Gal, Mahamadi Warma

Abstract: We consider optimal control of fractional in time (subdiffusive, i.e., for $% 0<γ<1$) semilinear parabolic PDEs associated with various notions of diffusion operators in an unifying fashion. Under general assumptions on the nonlinearity we{~\textsf{first show}} the existence and regularity of solutions to the forward and the associated {\textsf{backward (adjoint)}} problems. In the second part, we… ▽ More We consider optimal control of fractional in time (subdiffusive, i.e., for $% 0<γ<1$) semilinear parabolic PDEs associated with various notions of diffusion operators in an unifying fashion. Under general assumptions on the nonlinearity we{~\textsf{first show}} the existence and regularity of solutions to the forward and the associated {\textsf{backward (adjoint)}} problems. In the second part, we prove existence of optimal {\textsf{controls% }} and characterize the associated {\textsf{first order}} optimality conditions. Several examples involving fractional in time (and some fractional in space diffusion) equations are described in detail. The most challenging obstacle we overcome is the failure of the\ semigroup property for the semilinear problem in any scaling of (frequency-domain) Hilbert spaces. △ Less

Submitted 6 October, 2021; originally announced October 2021.

Deep Neural Nets with Fixed Bias Configuration

Authors: Harbir Antil, Thomas S. Brown, Rainald Löhner, Fumiya Togashi, Deepanshu Verma

Abstract: For any given neural network architecture a permutation of weights and biases results in the same functional network. This implies that optimization algorithms used to `train' or `learn' the network are faced with a very large number (in the millions even for small networks) of equivalent optimal solutions in the parameter space. To the best of our knowledge, this observation is absent in the lite… ▽ More For any given neural network architecture a permutation of weights and biases results in the same functional network. This implies that optimization algorithms used to `train' or `learn' the network are faced with a very large number (in the millions even for small networks) of equivalent optimal solutions in the parameter space. To the best of our knowledge, this observation is absent in the literature. In order to narrow down the parameter search space, a novel technique is introduced in order to fix the bias vector configurations to be monotonically increasing. This is achieved by augmenting a typical learning problem with inequality constraints on the bias vectors in each layer. A Moreau-Yosida regularization based algorithm is proposed to handle these inequality constraints and a theoretical convergence of the this algorithm is established. Applications of the proposed approach to standard trigonometric functions and more challenging stiff ordinary differential equations arising in chemically reacting ows clearly illustrate the benefits of the proposed approach. △ Less

Submitted 18 February, 2022; v1 submitted 2 July, 2021; originally announced July 2021.

Temperature Control of PDE Constrained Optimization Problems Governed by Kobayashi--Warren--Carter Type Models of Grain Boundary Motions

Authors: Harbir Antil, Shodai Kubota, Ken Shirakawa, Noriaki Yamazaki

Abstract: In this paper, we consider a class of optimal control problems governed by state-equations of Kobayashi--Warren--Carter type. The control is given by physical temperature. The focus is on problems in dimensions less than equal to 4. The results are divided in four Main Theorems, concerned with: solvability and parameter-dependence of state-equations and optimal control problems; the first order ne… ▽ More In this paper, we consider a class of optimal control problems governed by state-equations of Kobayashi--Warren--Carter type. The control is given by physical temperature. The focus is on problems in dimensions less than equal to 4. The results are divided in four Main Theorems, concerned with: solvability and parameter-dependence of state-equations and optimal control problems; the first order necessary optimality conditions for these regularized optimal control problems. Subsequently, we derive the limiting systems and optimality conditions and study their well-posedness. △ Less

Submitted 24 June, 2021; originally announced June 2021.

Comments: arXiv admin note: substantial text overlap with arXiv:2003.01297, arXiv:2010.00777

MSC Class: 35K51; 49J20; 49K20; 74N05

Optimal Control, Numerics, and Applications of Fractional PDEs

Authors: Harbir Antil, Thomas S. Brown, Ratna Khatri, Akwum Onwunta, Deepanshu Verma, Mahamadi Warma

Abstract: This article provides a brief review of recent developments on two nonlocal operators: fractional Laplacian and fractional time derivative. We start by accounting for several applications of these operators in imaging science, geophysics, harmonic maps and deep (machine) learning. Various notions of solutions to linear fractional elliptic equations are provided and numerical schemes for fractional… ▽ More This article provides a brief review of recent developments on two nonlocal operators: fractional Laplacian and fractional time derivative. We start by accounting for several applications of these operators in imaging science, geophysics, harmonic maps and deep (machine) learning. Various notions of solutions to linear fractional elliptic equations are provided and numerical schemes for fractional Laplacian and fractional time derivative are discussed. Special emphasis is given to exterior optimal control problems with a linear elliptic equation as constraints. In addition, optimal control problems with interior control and state constraints are considered. We also provide a discussion on fractional deep neural networks, which is shown to be a minimization problem with fractional in time ordinary differential equation as constraint. The paper concludes with a discussion on several open problems. △ Less

Submitted 24 June, 2021; originally announced June 2021.

Non-diffusive Variational Problems with Distributional and Weak Gradient Constraints

Authors: Harbir Antil, Rafael Arndt, Carlos N. Rautenberg, Deepanshu Verma

Abstract: In this paper, we consider non-diffusive variational problems with mixed boundary conditions and (distributional and weak) gradient constraints. The upper bound in the constraint is either a function or a Borel measure, leading to the state space being a Sobolev one or the space of functions of bounded variation. We address existence and uniqueness of the model under low regularity assumptions, an… ▽ More In this paper, we consider non-diffusive variational problems with mixed boundary conditions and (distributional and weak) gradient constraints. The upper bound in the constraint is either a function or a Borel measure, leading to the state space being a Sobolev one or the space of functions of bounded variation. We address existence and uniqueness of the model under low regularity assumptions, and rigorously identify its Fenchel pre-dual problem. The latter in some cases is posed on a non-standard space of Borel measures with square integrable divergences. We also establish existence and uniqueness of solutions to this pre-dual problem under some assumptions. We conclude the paper by introducing a mixed finite-element method to solve the primal-dual system. The numerical examples confirm our theoretical findings. △ Less

Submitted 23 June, 2021; originally announced June 2021.

MSC Class: 49N15; 49M29; 46E27

Approximation of fractional harmonic maps

Authors: Harbir Antil, Sören Bartels, Armin Schikorra

Abstract: This paper addresses the approximation of fractional harmonic maps. Besides a unit-length constraint, one has to tackle the difficulty of nonlocality. We establish weak compactness results for critical points of the fractional Dirichlet energy on unit-length vector fields. We devise and analyze numerical methods for the approximation of various partial differential equations related to fractional… ▽ More This paper addresses the approximation of fractional harmonic maps. Besides a unit-length constraint, one has to tackle the difficulty of nonlocality. We establish weak compactness results for critical points of the fractional Dirichlet energy on unit-length vector fields. We devise and analyze numerical methods for the approximation of various partial differential equations related to fractional harmonic maps. The compactness results imply the convergence of numerical approximations. Numerical examples on spin chain dynamics and point defects are presented to demonstrate the effectiveness of the proposed methods. △ Less

Submitted 20 April, 2021; originally announced April 2021.

MSC Class: 35K20 35R11 35S15 65R20

Novel DNNs for Stiff ODEs with Applications to Chemically Reacting Flows

Authors: Thomas S. Brown, Harbir Antil, Rainald Löhner, Fumiya Togashi, Deepanshu Verma

Abstract: Chemically reacting flows are common in engineering, such as hypersonic flow, combustion, explosions, manufacturing processes and environmental assessments. For combustion, the number of reactions can be significant (over 100) and due to the very large CPU requirements of chemical reactions (over 99%) a large number of flow and combustion problems are presently beyond the capabilities of even the… ▽ More Chemically reacting flows are common in engineering, such as hypersonic flow, combustion, explosions, manufacturing processes and environmental assessments. For combustion, the number of reactions can be significant (over 100) and due to the very large CPU requirements of chemical reactions (over 99%) a large number of flow and combustion problems are presently beyond the capabilities of even the largest supercomputers. Motivated by this, novel Deep Neural Networks (DNNs) are introduced to approximate stiff ODEs. Two approaches are compared, i.e., either learn the solution or the derivative of the solution to these ODEs. These DNNs are applied to multiple species and reactions common in chemically reacting flows. Experimental results show that it is helpful to account for the physical properties of species while designing DNNs. The proposed approach is shown to generalize well. △ Less

Submitted 1 April, 2021; originally announced April 2021.

Convergence Analysis of the Rank-Restricted Soft SVD Algorithm

Authors: Mahendra Panagoda, Tyrus Berry, Harbir Antil

Abstract: The soft SVD is a robust matrix decomposition algorithm and a key component of matrix completion methods. However, computing the soft SVD for large sparse matrices is often impractical using conventional numerical methods for the SVD due to large memory requirements. The Rank-Restricted Soft SVD (RRSS) algorithm introduced by Hastie et al. addressed this issue by sequentially computing low-rank SV… ▽ More The soft SVD is a robust matrix decomposition algorithm and a key component of matrix completion methods. However, computing the soft SVD for large sparse matrices is often impractical using conventional numerical methods for the SVD due to large memory requirements. The Rank-Restricted Soft SVD (RRSS) algorithm introduced by Hastie et al. addressed this issue by sequentially computing low-rank SVDs that easily fit in memory. We analyze the convergence of the standard RRSS algorithm and we give examples where the standard algorithm does not converge. We show that convergence requires a modification of the standard algorithm, and is related to non-uniqueness of the SVD. Our modification specifies a consistent choice of sign for the left singular vectors of the low-rank SVDs in the iteration. Under these conditions, we prove linear convergence of the singular vectors using a technique motivated by alternating subspace iteration. We then derive a fixed point iteration for the evolution of the singular values and show linear convergence to the soft thresholded singular values of the original matrix. This last step requires a perturbation result for fixed point iterations which may be of independent interest. △ Less

Submitted 3 April, 2021; originally announced April 2021.

Novel Deep neural networks for solving Bayesian statistical inverse

Authors: Harbir Antil, Howard C Elman, Akwum Onwunta, Deepanshu Verma

Abstract: We consider the simulation of Bayesian statistical inverse problems governed by large-scale linear and nonlinear partial differential equations (PDEs). Markov chain Monte Carlo (MCMC) algorithms are standard techniques to solve such problems. However, MCMC techniques are computationally challenging as they require several thousands of forward PDE solves. The goal of this paper is to introduce a fr… ▽ More We consider the simulation of Bayesian statistical inverse problems governed by large-scale linear and nonlinear partial differential equations (PDEs). Markov chain Monte Carlo (MCMC) algorithms are standard techniques to solve such problems. However, MCMC techniques are computationally challenging as they require several thousands of forward PDE solves. The goal of this paper is to introduce a fractional deep neural network based approach for the forward solves within an MCMC routine. Moreover, we discuss some approximation error estimates and illustrate the efficiency of our approach via several numerical examples. △ Less

Submitted 7 February, 2021; originally announced February 2021.

MSC Class: 65C60; 65C40; 65F22; 65N12

A Note on Multigrid Preconditioning for Fractional PDE-Constrained Optimization Problems

Authors: Harbir Antil, Andrei Dr{ă}g{ă}nescu, Kiefer Green

Abstract: In this note we present a multigrid preconditioning method for solving quadratic optimization problems constrained by a fractional diffusion equation. Multigrid methods within the all-at-once approach to solve the first order-order optimality Karush-Kuhn-Tucker (KKT) systems are widely popular, but their development have relied on the underlying systems being sparse. On the other hand, for most di… ▽ More In this note we present a multigrid preconditioning method for solving quadratic optimization problems constrained by a fractional diffusion equation. Multigrid methods within the all-at-once approach to solve the first order-order optimality Karush-Kuhn-Tucker (KKT) systems are widely popular, but their development have relied on the underlying systems being sparse. On the other hand, for most discretizations, the matrix representation of fractional operators is expected to be dense. We develop a preconditioning strategy for our problem based on a reduced approach, namely we eliminate the state constraint using the control-to-state map. Our multigrid preconditioning approach shows a dramatic reduction in the number of CG iterations. We assess the quality of preconditioner in terms of the spectral distance. Finally, we provide a partial theoretical analysis for this preconditioner, and we formulate a conjecture which is clearly supported by our numerical experiments. △ Less

Submitted 27 October, 2020; originally announced October 2020.

Approximation of Integral Fractional Laplacian and Fractional PDEs via sinc-Basis

Authors: Harbir Antil, Patrick Dondl, Ludwig Striet

Abstract: Fueled by many applications in random processes, imaging science, geophysics, etc., fractional Laplacians have recently received significant attention. The key driving force behind the success of this operator is its ability to capture non-local effects while enforcing less smoothness on functions. In this paper, we introduce a spectral method to approximate this operator employing a sinc basis. U… ▽ More Fueled by many applications in random processes, imaging science, geophysics, etc., fractional Laplacians have recently received significant attention. The key driving force behind the success of this operator is its ability to capture non-local effects while enforcing less smoothness on functions. In this paper, we introduce a spectral method to approximate this operator employing a sinc basis. Using our scheme, the evaluation of the operator and its application onto a vector has complexity of $\mathcal O(N\log(N))$ where $N$ is the number of unknowns. Thus, using iterative methods such as CG, we provide an efficient strategy to solve fractional partial differential equations with exterior Dirichlet conditions on arbitrary Lipschitz domains. Our implementation works in both $2d$ and $3d$. We also recover the FEM rates of convergence on benchmark problems. We further illustrate the efficiency of our approach by applying it to fractional Allen-Cahn and image denoising problems. △ Less

Submitted 13 July, 2021; v1 submitted 13 October, 2020; originally announced October 2020.

MSC Class: 35R11; 65N35 ACM Class: G.1

High Fidelity Modeling of Aerosol Pathogen Propagation in Built Environments with Moving Pedestrians

Authors: Rainald Löhner, Harbir Antil

Abstract: A high fidelity model for the propagation of pathogens via aerosols in the presence of moving pedestrians is proposed. The key idea is the tight coupling of computational fluid dynamics and computational crowd dynamics in order to capture the emission, transport and inhalation of pathogen loads in space and time. An example simulating pathogen propagation in a narrow corridor with moving pedestria… ▽ More A high fidelity model for the propagation of pathogens via aerosols in the presence of moving pedestrians is proposed. The key idea is the tight coupling of computational fluid dynamics and computational crowd dynamics in order to capture the emission, transport and inhalation of pathogen loads in space and time. An example simulating pathogen propagation in a narrow corridor with moving pedestrians clearly shows the considerable effect that pedestrian motion has on airflow, and hence on pathogen propagation and potential infectivity. △ Less

Submitted 7 September, 2020; originally announced September 2020.

Detailed Simulation of Viral Propagation In The Built Environment

Authors: Rainald Löhner, Harbir Antil, Sergio Idelsohn, Eugenio Oñate

Abstract: A summary is given of the mechanical characteristics of virus contaminants and the transmission via droplets and aerosols. The ordinary and partial differential equations describing the physics of these processes with high fidelity are presented, as well as appropriate numerical schemes to solve them. Several examples taken from recent evaluations of the built environment are shown, as well as the… ▽ More A summary is given of the mechanical characteristics of virus contaminants and the transmission via droplets and aerosols. The ordinary and partial differential equations describing the physics of these processes with high fidelity are presented, as well as appropriate numerical schemes to solve them. Several examples taken from recent evaluations of the built environment are shown, as well as the optimal placement of sensors. △ Less

Submitted 22 June, 2020; originally announced June 2020.

Moreau-Yosida regularization for optimal control of fractional PDEs with state constraints: parabolic case

Authors: Harbir Antil, Thomas S. Brown, Deepanshu Verma, Mahamadi Warma

Abstract: This paper considers optimal control of fractional parabolic PDEs with both state and control constraints. The key challenge is how to handle the state constraints. Similarly, to the elliptic case, in this paper, we establish several new mathematical tools in the parabolic setting that are of wider interest. For example, existence of solution to the fractional parabolic equation with measure data… ▽ More This paper considers optimal control of fractional parabolic PDEs with both state and control constraints. The key challenge is how to handle the state constraints. Similarly, to the elliptic case, in this paper, we establish several new mathematical tools in the parabolic setting that are of wider interest. For example, existence of solution to the fractional parabolic equation with measure data on the right-hand-side. We employ the Moreau-Yosida regularization to handle the state constraints. We establish convergence, with rate, of the regularized optimal control problem to the original one. Numerical experiments confirm what we have proven theoretically. △ Less

Submitted 20 April, 2020; originally announced April 2020.

On a Fractional Version of a Murat Compactness Result and Applications

Authors: Harbir Antil, Carlos N. Rautenberg, Armin Schikorra

Abstract: The paper provides an extension, to fractional order Sobolev spaces, of the classical result of Murat and Brezis which states that the positive cone of elements in $H^{-1}(Ω)$ compactly embeds in $W^{-1,q}(Ω)$, for every $q < 2$ and for any open and bounded set $Ω$ with Lipschitz boundary. In particular, our proof contains the classical result. Several new analysis tools are developed during the c… ▽ More The paper provides an extension, to fractional order Sobolev spaces, of the classical result of Murat and Brezis which states that the positive cone of elements in $H^{-1}(Ω)$ compactly embeds in $W^{-1,q}(Ω)$, for every $q < 2$ and for any open and bounded set $Ω$ with Lipschitz boundary. In particular, our proof contains the classical result. Several new analysis tools are developed during the course of the proof to our main result which are of wider interest. Subsequently, we apply our results to the convergence of convex sets and establish a fractional version of the Mosco convergence result of Boccardo and Murat. We conclude with an application of this result to quasi-variational inequalities. △ Less

Submitted 17 March, 2021; v1 submitted 3 April, 2020; originally announced April 2020.

Comments: Condition on Lipschitz boundary added. Further changes in the presentation. Accepted for publication in SIAM Journal on Mathematical Analysis

Fractional Deep Neural Network via Constrained Optimization

Authors: Harbir Antil, Ratna Khatri, Rainald Löhner, Deepanshu Verma

Abstract: This paper introduces a novel algorithmic framework for a deep neural network (DNN), which in a mathematically rigorous manner, allows us to incorporate history (or memory) into the network -- it ensures all layers are connected to one another. This DNN, called Fractional-DNN, can be viewed as a time-discretization of a fractional in time nonlinear ordinary differential equation (ODE). The learnin… ▽ More This paper introduces a novel algorithmic framework for a deep neural network (DNN), which in a mathematically rigorous manner, allows us to incorporate history (or memory) into the network -- it ensures all layers are connected to one another. This DNN, called Fractional-DNN, can be viewed as a time-discretization of a fractional in time nonlinear ordinary differential equation (ODE). The learning problem then is a minimization problem subject to that fractional ODE as constraints. We emphasize that an analogy between the existing DNN and ODEs, with standard time derivative, is well-known by now. The focus of our work is the Fractional-DNN. Using the Lagrangian approach, we provide a derivation of the backward propagation and the design equations. We test our network on several datasets for classification problems. Fractional-DNN offers various advantages over the existing DNN. The key benefits are a significant improvement to the vanishing gradient issue due to the memory effect, and better handling of nonsmooth data due to the network's ability to approximate non-smooth functions. △ Less

Submitted 1 April, 2020; originally announced April 2020.

MSC Class: 49J15; 49J20; 82C32; 68T05

Optimal Control Problems Governed by 1-D Kobayashi-Warren-Carter Type Systems

Authors: Harbir Antil, Shodai Kubota, Ken Shirakawa, Noriaki Yamazaki

Abstract: This paper is devoted to the study of a class of optimal control problems governed by 1-D Kobayashi-Warren-Carter type systems, which are based on a phase-field model of grain boundary motion, proposed by [Kobayashi et al, Physica D, 140, 141-150, 2000]. The class consists of an optimal control problem for a physically realistic state-system of Kobayashi-Warren-Carter type, and its regularized app… ▽ More This paper is devoted to the study of a class of optimal control problems governed by 1-D Kobayashi-Warren-Carter type systems, which are based on a phase-field model of grain boundary motion, proposed by [Kobayashi et al, Physica D, 140, 141-150, 2000]. The class consists of an optimal control problem for a physically realistic state-system of Kobayashi-Warren-Carter type, and its regularized approximating problems. The results of this paper are stated in three Main Theorems 1-3. The first Main Theorem 1 is concerned with the solvability and continuous dependence for the state-systems. Meanwhile, the second Main Theorem 2 is concerned with the solvability of optimal control problems, and some semi-continuous association in the class of our optimal control problems. Finally, in the third Main Theorem 3, we derive the first order necessary optimality conditions for optimal controls of the regularized approximating problems. By taking the approximating limit, we also derive the optimality conditions for the optimal controls for the physically realistic problem. △ Less

Submitted 5 August, 2020; v1 submitted 2 March, 2020; originally announced March 2020.

Comments: 42 pages

MSC Class: 35K61; 49J20; 49J45; 49K20; 74N05; 74N20

Moreau-Yosida Regularization for Optimal Control of Fractional Elliptic Problems with State and Control Constraints

Authors: Harbir Antil, Thomas S. Brown, Deepanshu Verma

Abstract: Recently the authors have studied a state and control constrained optimal control problem with fractional elliptic PDE as constraints. The goal of this paper is to continue that program forward and introduce an algorithm to solve such optimal control problems. We shall employ the well-known Moreau-Yosida regularization to handle the state constraints. Similarly to the classical case, we establish… ▽ More Recently the authors have studied a state and control constrained optimal control problem with fractional elliptic PDE as constraints. The goal of this paper is to continue that program forward and introduce an algorithm to solve such optimal control problems. We shall employ the well-known Moreau-Yosida regularization to handle the state constraints. Similarly to the classical case, we establish the convergence (with rate) of the regularized control problem to the original one. We discretize the problem using a finite element method and establish convergence of our numerical scheme. We emphasize that due to the non-smooth nature of the fractional Laplacian, the proof for the classical case does not apply to the fractional case. The numerical experiments confirm all our theoretical findings. △ Less

Submitted 10 December, 2019; originally announced December 2019.

Revisiting Calderon's Problem

Authors: Rainald Löhner, Harbir Antil

Abstract: A finite element code for heat conduction, together with an adjoint solver and a suite of optimization tools was applied for the solution of Calderon's problem. One of the questions whose answer was sought was whether the solution to these problems is unique and obtainable. The results to date show that while the optimization procedure is able to obtain spatial distributions of the conductivity… ▽ More A finite element code for heat conduction, together with an adjoint solver and a suite of optimization tools was applied for the solution of Calderon's problem. One of the questions whose answer was sought was whether the solution to these problems is unique and obtainable. The results to date show that while the optimization procedure is able to obtain spatial distributions of the conductivity $k$ that reduce the cost function significantly, the resulting conductivity $k$ is still significantly different from the target distribution sought. While the normal fluxes recovered are very close to the prescribed ones, the tangential fluxes can differ considerably. △ Less

Submitted 5 December, 2019; originally announced December 2019.

MSC Class: 35R30; 49N45; 65N21; 49K20; 49J20; 65N30

Diffusion Maps for Embedded Manifolds with Boundary with Applications to PDEs

Authors: Ryan Vaughn, Tyrus Berry, Harbir Antil

Abstract: Given only a collection of points sampled from a Riemannian manifold embedded in a Euclidean space, in this paper we propose a new method to solve elliptic partial differential equations (PDEs) supplemented with boundary conditions. Notice that the construction of triangulations on unknown manifolds can be both difficult and expensive, both in terms of computational and data requirements, our goal… ▽ More Given only a collection of points sampled from a Riemannian manifold embedded in a Euclidean space, in this paper we propose a new method to solve elliptic partial differential equations (PDEs) supplemented with boundary conditions. Notice that the construction of triangulations on unknown manifolds can be both difficult and expensive, both in terms of computational and data requirements, our goal is to solve these problems without such constructions. Instead, we rely only on using the sample points to define quadrature formulas on the unknown manifold. Our main tool is the diffusion maps algorithm. We re-analyze this well-known method in a weak (variational) sense. The latter reduces the smoothness requirements on the underlying functions which is crucial to approximating weak solutions to PDEs. As a by-product, we also provide a rigorous justification of the well-known relationship between diffusion maps and the Neumann eigenvalue problems. We then use a recently developed method of estimating the distance to boundary function (notice that the boundary location is assumed to be unknown and must be estimated from data) in order to correct the boundary error term in the diffusion maps construction. Finally, using this estimated distance, we illustrate how to impose Dirichlet, Neumann, and mixed boundary conditions for some common PDEs based on the Laplacian. Several numerical examples confirm our theoretical findings. △ Less

Submitted 27 November, 2022; v1 submitted 28 November, 2019; originally announced December 2019.