-
Identifying the source term in the potential equation with weighted sparsity regularization
Authors:
Ole Løseth Elvetun,
Bjørn Fredrik Nielsen
Abstract:
We explore the possibility for using boundary measurements to recover a sparse source term f(x) in the potential equation. Employing weighted sparsity regularization and standard results for subgradients, we derive simple-to-check criteria which assure that a number of sinks (f(x) < 0) and sources (f(x) > 0) can be identified. Furthermore, we present two cases for which these criteria always are f…
▽ More
We explore the possibility for using boundary measurements to recover a sparse source term f(x) in the potential equation. Employing weighted sparsity regularization and standard results for subgradients, we derive simple-to-check criteria which assure that a number of sinks (f(x) < 0) and sources (f(x) > 0) can be identified. Furthermore, we present two cases for which these criteria always are fulfilled: a) well-separated sources and sinks, and b) many sources or sinks located at the boundary plus one interior source/sink. Our approach is such that the linearity of the associated forward operator is preserved in the discrete formulation. The theory is therefore conveniently developed in terms of Euclidean spaces, and it can be applied to a wide range of problems. In particular, it can be applied to both isotropic and anisotropic cases. We present a series of numerical experiments. This work is motivated by the observation that standard methods typically suggest that internal sinks and sources are located close to the boundary.
△ Less
Submitted 3 November, 2023; v1 submitted 8 December, 2022;
originally announced December 2022.
-
Box constraints and weighted sparsity regularization for identifying sources in elliptic PDEs
Authors:
Ole Løseth Elvetun,
Bjørn Fredrik Nielsen
Abstract:
We explore the possibility for using boundary data to identify sources in elliptic PDEs. Even though the associated forward operator has a large null space, it turns out that box constraints, combined with weighted sparsity regularization, can enable rather accurate recovery of sources with constant magnitude/strength. In addition, for sources with varying strength, the support of the inverse solu…
▽ More
We explore the possibility for using boundary data to identify sources in elliptic PDEs. Even though the associated forward operator has a large null space, it turns out that box constraints, combined with weighted sparsity regularization, can enable rather accurate recovery of sources with constant magnitude/strength. In addition, for sources with varying strength, the support of the inverse solution will be a subset of the support of the true source. We present both an analysis of the problem and a series of numerical experiments. Our work only addresses discretized problems.
The reason for introducing the weighting procedure is that standard (unweighted) sparsity regularization fails to provide adequate results for the source identification task considered in this paper. This investigation is also motivated by applications, e.g., recovering mass distributions from measurements of gravitational fields and inverse scattering. We develop the methodology and the analysis in terms of Euclidean spaces, and our results can therefore be applied to many problems. For example, the results are equally applicable to models involving the screened Poisson equation as to models using the Helmholtz equation, with both large and small wave numbers.
△ Less
Submitted 3 March, 2023; v1 submitted 13 June, 2022;
originally announced June 2022.
-
Numerical approximation of the spectrum of self-adjoint continuously invertible operators
Authors:
Tomáš Gergelits,
Bjørn Fredrik Nielsen,
Zdeněk Strakoš
Abstract:
This paper deals with the generalized spectrum of continuously invertible linear operators defined on infinite dimensional Hilbert spaces. More precisely, we consider two bounded, coercive, and self-adjoint operators $\bc{A, B}: V\mapsto V^{\#}$, where $V^{\#}$ denotes the dual of $V$, and investigate the conditions under which the whole spectrum of $\bc{B}^{-1}\bc{A}:V\mapsto V$ can be approximat…
▽ More
This paper deals with the generalized spectrum of continuously invertible linear operators defined on infinite dimensional Hilbert spaces. More precisely, we consider two bounded, coercive, and self-adjoint operators $\bc{A, B}: V\mapsto V^{\#}$, where $V^{\#}$ denotes the dual of $V$, and investigate the conditions under which the whole spectrum of $\bc{B}^{-1}\bc{A}:V\mapsto V$ can be approximated to an arbitrary accuracy by the eigenvalues of the finite dimensional discretization $\bc{B}_n^{-1}\bc{A}_n$. Since $\bc{B}^{-1}\bc{A}$ is continuously invertible, such an investigation cannot use the concept of uniform (normwise) convergence, and it relies instead on the pointwise (strong) convergence of $\bc{B}_n^{-1}\bc{A}_n$ to $\bc{B}^{-1}\bc{A}$.
The paper is motivated by operator preconditioning which is employed in the numerical solution of boundary value problems. In this context, $\bc{A}, \bc{B}: H_0^1(Ω) \mapsto H^{-1}(Ω)$ are the standard integral/functional representations of the differential operators $ -\nabla \cdot (k(x)\nabla u)$ and $-\nabla \cdot (g(x)\nabla u)$, respectively, and $k(x)$ and $g(x)$ are scalar coefficient functions. The investigated question differs from the eigenvalue problem studied in the numerical PDE literature which is based on the approximation of the eigenvalues within the framework of compact operators.
This work follows the path started by the two recent papers published in [SIAM J. Numer. Anal., 57 (2019), pp.~1369-1394 and 58 (2020), pp.~2193-2211] and addresses one of the open questions formulated at the end of the second paper.
△ Less
Submitted 1 March, 2021;
originally announced March 2021.
-
RAP-modulated Fluid Processes: First Passages and the Stationary Distribution
Authors:
Nigel G. Bean,
Giang T. Nguyen,
Bo F. Nielsen,
Oscar Peralta
Abstract:
We construct a stochastic fluid process with an underlying piecewise deterministic Markov process (PDMP) akin to the one used in the construction of the rational arrival process (RAP), which we call the RAP-modulated fluid process. As opposed to the classic stochastic fluid process driven by a Markov jump process, the underlying PDMP of a RAP-modulated fluid process has a continuous state space an…
▽ More
We construct a stochastic fluid process with an underlying piecewise deterministic Markov process (PDMP) akin to the one used in the construction of the rational arrival process (RAP), which we call the RAP-modulated fluid process. As opposed to the classic stochastic fluid process driven by a Markov jump process, the underlying PDMP of a RAP-modulated fluid process has a continuous state space and is driven by matrix parameters which may not be related to an intensity matrix. Through novel techniques we show how well-known formulae associated to the classic stochastic fluid process, such as first passage probabilities and the stationary distribution of its queue, translate to its RAP-modulated counterpart.
△ Less
Submitted 8 January, 2021;
originally announced January 2021.
-
Weighted sparsity regularization for source identification for elliptic PDEs
Authors:
Ole Løseth Elvetun,
Bjørn Fredrik Nielsen
Abstract:
This investigation is motivated by PDE-constrained optimization problems arising in connection with electrocardiograms (ECGs) and electroencephalography (EEG). Standard sparsity regularization does not necessarily produce adequate results for these applications because only boundary data/observations are available for the identification of the unknown source, which may be interior. We therefore st…
▽ More
This investigation is motivated by PDE-constrained optimization problems arising in connection with electrocardiograms (ECGs) and electroencephalography (EEG). Standard sparsity regularization does not necessarily produce adequate results for these applications because only boundary data/observations are available for the identification of the unknown source, which may be interior. We therefore study a weighted $\ell^1$-regularization technique for solving inverse problems when the forward operator has a significant null space. In particular, we prove that a sparse source, regardless of whether it is interior or located at the boundary, can be exactly recovered with this weighting procedure as the regularization parameter $α$ tends to zero. Our analysis is supported by numerical experiments for cases with one and several local sources. The theory is developed in terms of Euclidean spaces, and our results can therefore be applied to many problems.
△ Less
Submitted 24 May, 2023; v1 submitted 21 December, 2020;
originally announced December 2020.
-
Modified Tikhonov regularization for identifying several sources
Authors:
Ole Løseth Elvetun,
Bjørn Fredrik Nielsen
Abstract:
We study whether a modified version of Tikhonov regularization can be used to identify several local sources from Dirichlet boundary data for a prototypical elliptic PDE. This paper extends the results presented in [5]. It turns out that the possibility of distinguishing between two, or more, sources depends on the smoothing properties of a second or fourth order PDE. Consequently, the geometry of…
▽ More
We study whether a modified version of Tikhonov regularization can be used to identify several local sources from Dirichlet boundary data for a prototypical elliptic PDE. This paper extends the results presented in [5]. It turns out that the possibility of distinguishing between two, or more, sources depends on the smoothing properties of a second or fourth order PDE. Consequently, the geometry of the involved domain, as well as the position of the sources relative to the boundary of this domain, determines the identifiability.
We also present a uniqueness result for the identification of a single local source. This result is derived in terms of an abstract operator framework and is therefore not only applicable to the model problem studied in this paper. Our schemes yield quadratic optimization problems and can thus be solved with standard software tools. In addition to a theoretical investigation, this paper also contains several numerical experiments.
△ Less
Submitted 9 November, 2020;
originally announced November 2020.
-
A regularization operator for source identification for elliptic PDEs
Authors:
Ole Løseth Elvetun,
Bjørn Fredrik Nielsen
Abstract:
We study a source identification problem for a prototypical elliptic PDE from Dirichlet boundary data. This problem is ill-posed, and the involved forward operator has a significant nullspace. Standard Tikhonov regularization yields solutions which approach the minimum $L^2$-norm least-squares solution as the regularization parameter tends to zero. We show that this approach 'always' suggests that…
▽ More
We study a source identification problem for a prototypical elliptic PDE from Dirichlet boundary data. This problem is ill-posed, and the involved forward operator has a significant nullspace. Standard Tikhonov regularization yields solutions which approach the minimum $L^2$-norm least-squares solution as the regularization parameter tends to zero. We show that this approach 'always' suggests that the unknown local source is very close to the boundary of the domain of the PDE, regardless of the position of the true local source.
We propose an alternative regularization procedure, realized in terms of a novel regularization operator, which is better suited for identifying local sources positioned anywhere in the domain of the PDE. Our approach is motivated by the classical theory for Tikhonov regularization and yields a standard quadratic optimization problem. Since the new methodology is derived for an abstract operator equation, it can be applied to many other source identification problems. This paper contains several numerical experiments and an analysis of the new methodology.
△ Less
Submitted 28 October, 2020; v1 submitted 19 May, 2020;
originally announced May 2020.
-
Generalized spectrum of second order differential operators
Authors:
Tomáš Gergelits,
Bjørn Fredrik Nielsen,
Zdeněk Strakoš
Abstract:
We analyze the spectrum of the operator $Δ^{-1} [\nabla \cdot (K\nabla u)]$, where $Δ$ denotes the Laplacian and $K=K(x,y)$ is a symmetric tensor. Our main result shows that this spectrum can be derived from the spectral decomposition $K=Q ΛQ^T$, where $Q=Q(x,y)$ is an orthogonal matrix and $Λ=Λ(x,y)$ is a diagonal matrix. More precisely, provided that $K$ is continuous, the spectrum equals the co…
▽ More
We analyze the spectrum of the operator $Δ^{-1} [\nabla \cdot (K\nabla u)]$, where $Δ$ denotes the Laplacian and $K=K(x,y)$ is a symmetric tensor. Our main result shows that this spectrum can be derived from the spectral decomposition $K=Q ΛQ^T$, where $Q=Q(x,y)$ is an orthogonal matrix and $Λ=Λ(x,y)$ is a diagonal matrix. More precisely, provided that $K$ is continuous, the spectrum equals the convex hull of the ranges of the diagonal function entries of $Λ$. The involved domain is assumed to be bounded and Lipschitz, and both homogeneous Dirichlet and homogeneous Neumann boundary conditions are considered. We study operators defined on infinite dimensional Sobolev spaces. Our theoretical investigations are illuminated by numerical experiments, using discretized problems.
The results presented in this paper extend previous analyses which have addressed elliptic differential operators with scalar coefficient functions. Our investigation is motivated by both preconditioning issues (efficient numerical computations) and the need to further develop the spectral theory of second order PDEs (core analysis).
△ Less
Submitted 3 February, 2020;
originally announced February 2020.
-
Laplacian preconditioning of elliptic PDEs: Localization of the eigenvalues of the discretized operator
Authors:
Tomáš Gergelits,
Kent-André Mardal,
Bjørn Fredrik Nielsen,
Zdeněk Strakoš
Abstract:
In the paper \textit{Preconditioning by inverting the {L}aplacian; an analysis of the eigenvalues. IMA Journal of Numerical Analysis 29, 1 (2009), 24--42}, Nielsen, Hackbusch and Tveito study the operator generated by using the inverse of the Laplacian as preconditioner for second order elliptic PDEs $\nabla \cdot (k(x) \nabla u) = f$. They prove that the range of $k(x)$ is contained in the spectr…
▽ More
In the paper \textit{Preconditioning by inverting the {L}aplacian; an analysis of the eigenvalues. IMA Journal of Numerical Analysis 29, 1 (2009), 24--42}, Nielsen, Hackbusch and Tveito study the operator generated by using the inverse of the Laplacian as preconditioner for second order elliptic PDEs $\nabla \cdot (k(x) \nabla u) = f$. They prove that the range of $k(x)$ is contained in the spectrum of the preconditioned operator, provided that $k$ is continuous. Their rigorous analysis only addresses map**s defined on infinite dimensional spaces, but the numerical experiments in the paper suggest that a similar property holds in the discrete case.
% Motivated by this investigation, we analyze the eigenvalues of the matrix $\bf{L}^{-1}\bf{A}$, where $\bf{L}$ and ${\bf{A}}$ are the stiffness matrices associated with the Laplace operator and general second order elliptic operators, respectively. Without any assumption about the continuity of $k(x)$, we prove the existence of a one-to-one pairing between the eigenvalues of $\bf{L}^{-1}\bf{A}$ and the intervals determined by the images under $k(x)$ of the supports of the FE nodal basis functions. As a consequence, we can show that the nodal values of $k(x)$ yield accurate approximations of the eigenvalues of $\bf{L}^{-1}\bf{A}$. Our theoretical results are illuminated by several numerical experiments.
△ Less
Submitted 11 September, 2018;
originally announced September 2018.
-
Regularization of ill-posed point neuron models
Authors:
Bjørn Fredrik Nielsen
Abstract:
Point neuron models with a Heaviside firing rate function can be ill-posed. That is, the initial-condition-to-solution map might become discontinuous in finite time. If a Lipschitz continuous, but steep, firing rate function is employed, then standard ODE theory implies that such models are well-posed and can thus, approximately, be solved with finite precision arithmetic. We investigate whether t…
▽ More
Point neuron models with a Heaviside firing rate function can be ill-posed. That is, the initial-condition-to-solution map might become discontinuous in finite time. If a Lipschitz continuous, but steep, firing rate function is employed, then standard ODE theory implies that such models are well-posed and can thus, approximately, be solved with finite precision arithmetic. We investigate whether the solution of this well-posed model converges to a solution of the ill-posed limit problem as the steepness parameter, of the firing rate function, tends to infinity. Our argument employs the Arzelà-Ascoli theorem and also yields the existence of a solution of the limit problem. However, we only obtain convergence of a subsequence of the regularized solutions. This is consistent with the fact that we show that models with a Heaviside firing rate function can have several solutions. Our analysis assumes that the Lebesgue measure of the time the limit function, provided by the Arzelà-Ascoli theorem, equals the threshold value for firing, is zero. If this assumption does not hold, we argue that the regularized solutions may not converge to a solution of the limit problem with a Heaviside firing function.
△ Less
Submitted 1 March, 2017;
originally announced March 2017.
-
Robust preconditioners for PDE-constrained optimization with limited observations
Authors:
Kent-André Mardal,
Bjørn Fredrik Nielsen,
Magne Nordaas
Abstract:
Regularization robust preconditioners for PDE-constrained optimization problems have been successfully developed. These methods, however, typically assume that observation data is available throughout the entire domain of the state equation. For many inverse problems, this is an unrealistic assumption. In this paper we propose and analyze preconditioners for PDE-constrained optimization problems w…
▽ More
Regularization robust preconditioners for PDE-constrained optimization problems have been successfully developed. These methods, however, typically assume that observation data is available throughout the entire domain of the state equation. For many inverse problems, this is an unrealistic assumption. In this paper we propose and analyze preconditioners for PDE-constrained optimization problems with limited observation data, e.g. observations are only available at the boundary of the solution domain. Our methods are robust with respect to both the regularization parameter and the mesh size. That is, the condition number of the preconditioned optimality system is uniformly bounded, independently of the size of these two parameters. We first consider a prototypical elliptic control problem and thereafter more general PDE-constrained optimization problems. Our theoretical findings are illuminated by several numerical results.
△ Less
Submitted 22 June, 2015;
originally announced June 2015.
