-
Numerical analysis of a nonsmooth quasilinear elliptic control problem: II. Finite element discretization and error estimates
Authors:
Christian Clason,
Vu Huu Nhu,
Arnd Rösch
Abstract:
In this paper, we carry out the numerical analysis of a nonsmooth quasilinear elliptic optimal control problem, where the coefficient in the divergence term of the corresponding state equation is not differentiable with respect to the state variable. Despite the lack of differentiability of the nonlinearity in the quasilinear elliptic equation, the corresponding control-to-state operator is of cla…
▽ More
In this paper, we carry out the numerical analysis of a nonsmooth quasilinear elliptic optimal control problem, where the coefficient in the divergence term of the corresponding state equation is not differentiable with respect to the state variable. Despite the lack of differentiability of the nonlinearity in the quasilinear elliptic equation, the corresponding control-to-state operator is of class $C^1$ but not of class $C^2$. Analogously, the discrete control-to-state operators associated with the approximated control problems are proven to be of class $C^1$ only. By using an explicit second-order sufficient optimality condition, we prove a priori error estimates for a variational approximation, a piecewise constant approximation, and a continuous piecewise linear approximation of the continuous optimal control problem. The numerical tests confirm these error estimates.
△ Less
Submitted 22 February, 2024; v1 submitted 6 March, 2023;
originally announced March 2023.
-
Numerical analysis of a nonsmooth quasilinear elliptic control problem: I. Explicit second-order optimality conditions
Authors:
Christian Clason,
Vu Huu Nhu,
Arnd Rösch
Abstract:
In this paper, we derive explicit second-order necessary and sufficient optimality conditions of a local minimizer to an optimal control problem for a quasilinear second-order partial differential equation with a piecewise smooth but not differentiable nonlinearity in the leading term. The key argument rests on the analysis of level sets of the state. Specifically, we show that if a function vanis…
▽ More
In this paper, we derive explicit second-order necessary and sufficient optimality conditions of a local minimizer to an optimal control problem for a quasilinear second-order partial differential equation with a piecewise smooth but not differentiable nonlinearity in the leading term. The key argument rests on the analysis of level sets of the state. Specifically, we show that if a function vanishes on the boundary and its the gradient is different from zero on a level set, then this set decomposes into finitely many closed simple curves. Moreover, the level sets depend continuously on the functions defining these sets. We also prove the continuity of the integrals on the level sets. In particular, Green's first identity is shown to be applicable on an open set determined by two functions with nonvanishing gradients. In the second part to this paper, the explicit sufficient second-order conditions will be used to derive error estimates for a finite-element discretization of the control problem.
△ Less
Submitted 12 September, 2023; v1 submitted 31 March, 2022;
originally announced March 2022.
-
Convex relaxation of discrete vector-valued optimization problems
Authors:
Christian Clason,
Carla Tameling,
Benedikt Wirth
Abstract:
We consider a class of infinite-dimensional optimization problems in which a distributed vector-valued variable should pointwise almost everywhere take values from a given finite set $\mathcal{M}\subset\mathbb{R}^m$. Such hybrid discrete--continuous problems occur in, e.g., topology optimization or medical imaging and are challenging due to their lack of weak lower semicontinuity. To circumvent th…
▽ More
We consider a class of infinite-dimensional optimization problems in which a distributed vector-valued variable should pointwise almost everywhere take values from a given finite set $\mathcal{M}\subset\mathbb{R}^m$. Such hybrid discrete--continuous problems occur in, e.g., topology optimization or medical imaging and are challenging due to their lack of weak lower semicontinuity. To circumvent this difficulty, we introduce as a regularization term a convex integral functional with an integrand that has a polyhedral epigraph with vertices corresponding to the values of $\mathcal{M}$; similar to the $L^1$ norm in sparse regularization, this "vector multibang penalty" promotes solutions with the desired structure while allowing the use of tools from convex optimization for the analysis as well as the numerical solution of the resulting problem.
We show well-posedness of the regularized problem and analyze stability properties of its solution in a general setting. We then illustrate the approach for three specific model optimization problems of broader interest: optimal control of the Bloch equation, optimal control of an elastic deformation, and a multimaterial branched transport problem. In the first two cases, we derive explicit characterizations of the penalty and its generalized derivatives for a concrete class of sets $\mathcal{M}$. For the third case, we discuss the algorithmic computation of these derivatives for general sets. These derivatives are then used in a superlinearly convergent semismooth Newton method applied to a sequence of regularized optimization problems.
We illustrate the behavior of this approach for the three model problems with numerical examples.
△ Less
Submitted 24 August, 2021; v1 submitted 23 August, 2021;
originally announced August 2021.
-
No-gap second-order optimality conditions for optimal control of a non-smooth quasilinear elliptic equation
Authors:
Christian Clason,
Vu Huu Nhu,
Arnd Rösch
Abstract:
This paper deals with second-order optimality conditions for a quasilinear elliptic control problem with a nonlinear coefficient in the principal part that is countably $PC^2$ (continuous and $C^2$ apart from countably many points). We prove that the control-to-state operator is continuously differentiable even though the nonlinear coefficient is non-smooth. This enables us to establish "no-gap" s…
▽ More
This paper deals with second-order optimality conditions for a quasilinear elliptic control problem with a nonlinear coefficient in the principal part that is countably $PC^2$ (continuous and $C^2$ apart from countably many points). We prove that the control-to-state operator is continuously differentiable even though the nonlinear coefficient is non-smooth. This enables us to establish "no-gap" second-order necessary and sufficient optimality conditions in terms of an abstract curvature functional, i. e., for which the sufficient condition only differs from the necessary one in the fact that the inequality is strict. A condition that is equivalent to the second-order sufficient optimality condition and could be useful for error estimates in, e.g., finite element discretizations is also provided.
△ Less
Submitted 9 September, 2020; v1 submitted 25 March, 2020;
originally announced March 2020.
-
Regularization of Inverse Problems
Authors:
Christian Clason
Abstract:
These lecture notes for a graduate class present the regularization theory for linear and nonlinear ill-posed operator equations in Hilbert spaces. Covered are the general framework of regularization methods and their analysis via spectral filters as well as the concrete examples of Tikhonov regularization, Landweber iteration, regularization by discretization for linear inverse problems. In the n…
▽ More
These lecture notes for a graduate class present the regularization theory for linear and nonlinear ill-posed operator equations in Hilbert spaces. Covered are the general framework of regularization methods and their analysis via spectral filters as well as the concrete examples of Tikhonov regularization, Landweber iteration, regularization by discretization for linear inverse problems. In the nonlinear setting, Tikhonov regularization and iterative regularization (Landweber, Levenberg-Marquardt, and iteratively regularized Gauß-Newton methods) are discussed. The necessary background from functional analysis is also briefly summarized. The notes end with a brief outlook to statistical inverse problems from both a frequentist and a Bayesian point of view.
△ Less
Submitted 8 February, 2021; v1 submitted 2 January, 2020;
originally announced January 2020.
-
Introduction to Nonsmooth Analysis and Optimization
Authors:
Christian Clason,
Tuomo Valkonen
Abstract:
This book aims to give an introduction to generalized derivative concepts useful in deriving necessary optimality conditions and numerical algorithms for infinite-dimensional nondifferentiable optimization problems that arise in inverse problems, imaging, and PDE-constrained optimization. They cover convex subdifferentials, Fenchel duality, monotone operators and resolvents, Moreau--Yosida regular…
▽ More
This book aims to give an introduction to generalized derivative concepts useful in deriving necessary optimality conditions and numerical algorithms for infinite-dimensional nondifferentiable optimization problems that arise in inverse problems, imaging, and PDE-constrained optimization. They cover convex subdifferentials, Fenchel duality, monotone operators and resolvents, Moreau--Yosida regularization as well as Clarke and (briefly) limiting subdifferentials. Both first-order (proximal point and splitting) methods and second-order (semismooth Newton) methods are treated. In addition, differentiation of set-valued map** is discussed and used for deriving second-order optimality conditions for as well as Lipschitz stability properties of minimizers. The required background from functional analysis and calculus of variations is also briefly summarized.
△ Less
Submitted 26 July, 2023; v1 submitted 1 January, 2020;
originally announced January 2020.
-
Optimal control of the principal coefficient in a scalar wave equation
Authors:
Christian Clason,
Karl Kunisch,
Philip Trautmann
Abstract:
We consider optimal control of the scalar wave equation where the control enters as a coefficient in the principal part. Adding a total variation penalty allows showing existence of optimal controls, which requires continuity results for the coefficient-to-solution map** for discontinuous coefficients. We additionally consider a so-called "multi-bang" penalty that promotes controls taking on val…
▽ More
We consider optimal control of the scalar wave equation where the control enters as a coefficient in the principal part. Adding a total variation penalty allows showing existence of optimal controls, which requires continuity results for the coefficient-to-solution map** for discontinuous coefficients. We additionally consider a so-called "multi-bang" penalty that promotes controls taking on values pointwise almost everywhere from a specified discrete set. Under additional assumptions on the data, we derive an improved regularity result for the state, leading to optimality conditions that can be interpreted in an appropriate pointwise fashion. The numerical solution makes use of a stabilized finite element method and a nonlinear primal-dual proximal splitting algorithm.
△ Less
Submitted 12 November, 2020; v1 submitted 18 December, 2019;
originally announced December 2019.
-
Entropic regularization of continuous optimal transport problems
Authors:
Christian Clason,
Dirk A. Lorenz,
Hinrich Mahler,
Benedikt Wirth
Abstract:
We analyze continuous optimal transport problems in the so-called Kantorovich form, where we seek a transport plan between two marginals that are probability measures on compact subsets of Euclidean space. We consider the case of regularization with the negative entropy with respect to the Lebesgue measure, which has attracted attention because it can be solved by the very simple Sinkhorn algorith…
▽ More
We analyze continuous optimal transport problems in the so-called Kantorovich form, where we seek a transport plan between two marginals that are probability measures on compact subsets of Euclidean space. We consider the case of regularization with the negative entropy with respect to the Lebesgue measure, which has attracted attention because it can be solved by the very simple Sinkhorn algorithm. We first analyze the regularized problem in the context of classical Fenchel duality and derive a strong duality result for a predual problem in the space of continuous functions. However, this problem may not admit a minimizer, which prevents obtaining primal-dual optimality conditions. We then show that the primal problem is naturally analyzed in the Orlicz space of functions with finite entropy in the sense that the entropically regularized problem admits a minimizer if and only if the marginals have finite entropy. We then derive a dual problem in the corresponding dual space, for which existence can be shown by purely variational arguments and primal-dual optimality conditions can be derived. For marginals that do not have finite entropy, we finally show Gamma-convergence of the regularized problem with smoothed marginals to the original Kantorovich problem.
△ Less
Submitted 15 June, 2020; v1 submitted 4 June, 2019;
originally announced June 2019.
-
Bouligand-Levenberg-Marquardt iteration for a non-smooth ill-posed inverse problem
Authors:
Christian Clason,
Vu Huu Nhu
Abstract:
In this paper, we consider a modified Levenberg--Marquardt method for solving an ill-posed inverse problem where the forward map** is not Gâteaux differentiable. By relaxing the standard assumptions for the classical smooth setting, we derive asymptotic stability estimates that are then used to prove the convergence of the proposed method. This method can be applied to an inverse source problem…
▽ More
In this paper, we consider a modified Levenberg--Marquardt method for solving an ill-posed inverse problem where the forward map** is not Gâteaux differentiable. By relaxing the standard assumptions for the classical smooth setting, we derive asymptotic stability estimates that are then used to prove the convergence of the proposed method. This method can be applied to an inverse source problem for a non-smooth semilinear elliptic PDE where a Bouligand subdifferential can be used in place of the non-existing Fréchet derivative, and we show that the corresponding Bouligand-Levenberg-Marquardt iteration is an iterative regularization scheme. Numerical examples illustrate the advantage over the corresponding Bouligand-Landweber iteration.
△ Less
Submitted 23 June, 2019; v1 submitted 27 February, 2019;
originally announced February 2019.
-
Primal-dual proximal splitting and generalized conjugation in non-smooth non-convex optimization
Authors:
Christian Clason,
Stanislav Mazurenko,
Tuomo Valkonen
Abstract:
We demonstrate that difficult non-convex non-smooth optimization problems, such as Nash equilibrium problems and anisotropic as well as isotropic Potts segmentation model, can be written in terms of generalized conjugates of convex functionals. These, in turn, can be formulated as saddle-point problems involving convex non-smooth functionals and a general smooth but non-bilinear coupling term. We…
▽ More
We demonstrate that difficult non-convex non-smooth optimization problems, such as Nash equilibrium problems and anisotropic as well as isotropic Potts segmentation model, can be written in terms of generalized conjugates of convex functionals. These, in turn, can be formulated as saddle-point problems involving convex non-smooth functionals and a general smooth but non-bilinear coupling term. We then show through detailed convergence analysis that a conceptually straightforward extension of the primal--dual proximal splitting method of Chambolle and Pock is applicable to the solution of such problems. Under sufficient local strong convexity assumptions of the functionals -- but still with a non-bilinear coupling term -- we even demonstrate local linear convergence of the method. We illustrate these theoretical results numerically on the aforementioned example problems.
△ Less
Submitted 19 March, 2020; v1 submitted 9 January, 2019;
originally announced January 2019.
-
Optimal control of a non-smooth quasilinear elliptic equation
Authors:
Christian Clason,
Vu Huu Nhu,
Arnd Rösch
Abstract:
This work is concerned with an optimal control problem governed by a non-smooth quasilinear elliptic equation with a nonlinear coefficient in the principal part that is locally Lipschitz continuous and directionally but not Gâteaux differentiable. This leads to a control-to-state operator that is directionally but not Gâteaux differentiable as well. Based on a suitable regularization scheme, we de…
▽ More
This work is concerned with an optimal control problem governed by a non-smooth quasilinear elliptic equation with a nonlinear coefficient in the principal part that is locally Lipschitz continuous and directionally but not Gâteaux differentiable. This leads to a control-to-state operator that is directionally but not Gâteaux differentiable as well. Based on a suitable regularization scheme, we derive C- and strong stationarity conditions. Under the additional assumption that the nonlinearity is a PC^1 function with countably many points of nondifferentiability, we show that both conditions are equivalent. Furthermore, under this assumption we derive a relaxed optimality system that is amenable to numerical solution using a semi-smooth Newton method. This is illustrated by numerical examples.
△ Less
Submitted 5 December, 2018; v1 submitted 18 October, 2018;
originally announced October 2018.
-
Optimal control problems with control complementarity constraints
Authors:
Christian Clason,
Yu Deng,
Patrick Mehlitz,
Uwe Prüfert
Abstract:
A special class of optimal control problems with complementarity constraints on the control functions is studied. It is shown that such problems possess optimal solutions whenever the underlying control space is a first-order Sobolev space. After deriving necessary optimality conditions of strong stationarity-type, a penalty method based on the Fischer-Burmeister function is suggested and its theo…
▽ More
A special class of optimal control problems with complementarity constraints on the control functions is studied. It is shown that such problems possess optimal solutions whenever the underlying control space is a first-order Sobolev space. After deriving necessary optimality conditions of strong stationarity-type, a penalty method based on the Fischer-Burmeister function is suggested and its theoretical properties are analyzed. Finally, the numerical treatment of the problem is discussed and results of computational experiments are presented.
△ Less
Submitted 21 January, 2019; v1 submitted 26 September, 2018;
originally announced September 2018.
-
Generalized modes in Bayesian inverse problems
Authors:
Christian Clason,
Tapio Helin,
Remo Kretschmann,
Petteri Piiroinen
Abstract:
Uncertainty quantification requires efficient summarization of high- or even infinite-dimensional (i.e., non-parametric) distributions based on, e.g., suitable point estimates (modes) for posterior distributions arising from model-specific prior distributions. In this work, we consider non-parametric modes and MAP estimates for priors that do not admit continuous densities, for which previous appr…
▽ More
Uncertainty quantification requires efficient summarization of high- or even infinite-dimensional (i.e., non-parametric) distributions based on, e.g., suitable point estimates (modes) for posterior distributions arising from model-specific prior distributions. In this work, we consider non-parametric modes and MAP estimates for priors that do not admit continuous densities, for which previous approaches based on small ball probabilities fail. We propose a novel definition of generalized modes based on the concept of approximating sequences, which reduce to the classical mode in certain situations that include Gaussian priors but also exist for a more general class of priors. The latter includes the case of priors that impose strict bounds on the admissible parameters and in particular of uniform priors. For uniform priors defined by random series with uniformly distributed coefficients, we show that generalized MAP estimates -- but not classical MAP estimates -- can be characterized as minimizers of a suitable functional that plays the role of a generalized Onsager--Machlup functional. This is then used to show consistency of nonlinear Bayesian inverse problems with uniform priors and Gaussian noise.
△ Less
Submitted 14 January, 2019; v1 submitted 1 June, 2018;
originally announced June 2018.
-
Regularization of ill-posed problems with non-negative solutions
Authors:
Christian Clason,
Barbara Kaltenbacher,
Elena Resmerita
Abstract:
This survey reviews variational and iterative methods for reconstructing non-negative solutions of ill-posed problems in infinite-dimensional spaces. We focus on two classes of methods: variational methods based on entropy-minimization or constraints, and iterative methods involving projections or non-negativity-preserving multiplicative updates. We summarize known results and point out some open…
▽ More
This survey reviews variational and iterative methods for reconstructing non-negative solutions of ill-posed problems in infinite-dimensional spaces. We focus on two classes of methods: variational methods based on entropy-minimization or constraints, and iterative methods involving projections or non-negativity-preserving multiplicative updates. We summarize known results and point out some open problems.
△ Less
Submitted 4 May, 2018;
originally announced May 2018.
-
Quasi-solution of linear inverse problems in non-reflexive Banach spaces
Authors:
Christian Clason,
Andrej Klassen
Abstract:
We consider the method of quasi-solutions (also referred to as Ivanov regularization) for the regularization of linear ill-posed problems in non-reflexive Banach spaces. Using the equivalence to a metric projection onto the image of the forward operator, it is possible to show regularization properties and to characterize parameter choice rules that lead to a convergent regularization method, whic…
▽ More
We consider the method of quasi-solutions (also referred to as Ivanov regularization) for the regularization of linear ill-posed problems in non-reflexive Banach spaces. Using the equivalence to a metric projection onto the image of the forward operator, it is possible to show regularization properties and to characterize parameter choice rules that lead to a convergent regularization method, which includes the Morozov discrepancy principle. Convergence rates in a suitably chosen Bregman distance can be obtained as well. We also address the numerical computation of quasi-solutions to inverse source problems for partial differential equations in $L^\infty(Ω)$ using a semismooth Newton method and a backtracking line search for the parameter choice according to the discrepancy principle. Numerical examples illustrate the behavior of quasi-solutions in this setting.
△ Less
Submitted 5 July, 2018; v1 submitted 27 March, 2018;
originally announced March 2018.
-
Error estimates for the approximation of multibang control problems
Authors:
Christian Clason,
Thi Bich Tram Do,
Frank Pörner
Abstract:
This work is concerned with optimal control problems where the objective functional consists of a tracking-type functional and an additional "multibang" regularization functional that promotes optimal control taking values from a given discrete set pointwise almost everywhere. Under a regularity condition on the set where these discrete values are attained, error estimates for the Moreau--Yosida a…
▽ More
This work is concerned with optimal control problems where the objective functional consists of a tracking-type functional and an additional "multibang" regularization functional that promotes optimal control taking values from a given discrete set pointwise almost everywhere. Under a regularity condition on the set where these discrete values are attained, error estimates for the Moreau--Yosida approximation (which allows its solution by a semismooth Newton method) and the discretization of the problem are derived. Numerical results support the theoretical findings.
△ Less
Submitted 6 July, 2018; v1 submitted 12 March, 2018;
originally announced March 2018.
-
Bouligand-Landweber iteration for a non-smooth ill-posed problem
Authors:
Christian Clason,
Vu Huu Nhu
Abstract:
This work is concerned with the iterative regularization of a non-smooth nonlinear ill-posed problem where the forward map** is merely directionally but not Gâteaux differentiable. Using a Bouligand subderivative of the forward map**, a modified Landweber method can be applied; however, the standard analysis is not applicable since the Bouligand subderivative map** is not continuous unless t…
▽ More
This work is concerned with the iterative regularization of a non-smooth nonlinear ill-posed problem where the forward map** is merely directionally but not Gâteaux differentiable. Using a Bouligand subderivative of the forward map**, a modified Landweber method can be applied; however, the standard analysis is not applicable since the Bouligand subderivative map** is not continuous unless the forward map** is Gâteaux differentiable. We therefore provide a novel convergence analysis of the modified Landweber method that is based on the concept of asymptotic stability and merely requires a generalized tangential cone condition. These conditions are verified for an inverse source problem for an elliptic PDE with a non-smooth Lipschitz continuous nonlinearity, showing that the corresponding Bouligand--Landweber iteration converges strongly for exact data as well as in the limit of vanishing data if the iteration is stopped according to the discrepancy principle. This is illustrated
△ Less
Submitted 12 February, 2019; v1 submitted 6 March, 2018;
originally announced March 2018.
-
Contingent derivatives and regularization for noncoercive inverse problems
Authors:
Christian Clason,
Akhtar A. Khan,
Miguel Sama,
Christiane Tammer
Abstract:
We study the inverse problem of parameter identification in non-coercive variational problems that commonly appear in applied models. We examine the differentiability of the set-valued parameter-to-solution map by using the first-order and the second-order contingent derivatives. We explore the inverse problem by using the output least-squares and the modified output least-squares objectives. By r…
▽ More
We study the inverse problem of parameter identification in non-coercive variational problems that commonly appear in applied models. We examine the differentiability of the set-valued parameter-to-solution map by using the first-order and the second-order contingent derivatives. We explore the inverse problem by using the output least-squares and the modified output least-squares objectives. By regularizing the non-coercive variational problem, we obtain a single-valued regularized parameter-to-solution map and investigate its smoothness and boundedness. We also consider optimization problems using the output least-squares and the modified output least-squares objectives for the regularized variational problem. We give a complete convergence analysis showing that for the output least-squares and the modified output least-squares, the regularized minimization problems approximate the original optimization problems suitably. We also provide the first-order and the second-order adjoint method for the computation of the first-order and the second-order derivatives of the output least-squares objective. We provide discrete formulas for the gradient and the Hessian calculation and present numerical results.
△ Less
Submitted 14 February, 2018;
originally announced February 2018.
-
Acceleration and global convergence of a first-order primal--dual method for nonconvex problems
Authors:
Christian Clason,
Stanislav Mazurenko,
Tuomo Valkonen
Abstract:
The primal--dual hybrid gradient method (PDHGM, also known as the Chambolle--Pock method) has proved very successful for convex optimization problems involving linear operators arising in image processing and inverse problems. In this paper, we analyze an extension to nonconvex problems that arise if the operator is nonlinear. Based on the idea of testing, we derive new step length parameter condi…
▽ More
The primal--dual hybrid gradient method (PDHGM, also known as the Chambolle--Pock method) has proved very successful for convex optimization problems involving linear operators arising in image processing and inverse problems. In this paper, we analyze an extension to nonconvex problems that arise if the operator is nonlinear. Based on the idea of testing, we derive new step length parameter conditions for the convergence in infinite-dimensional Hilbert spaces and provide acceleration rules for suitably (locally and/or partially) monotone problems. Importantly, we prove linear convergence rates as well as global convergence in certain cases. We demonstrate the efficacy of these step length rules for PDE-constrained optimization problems.
△ Less
Submitted 8 August, 2018; v1 submitted 9 February, 2018;
originally announced February 2018.
-
A Sinkhorn-Newton method for entropic optimal transport
Authors:
Christoph Brauer,
Christian Clason,
Dirk Lorenz,
Benedikt Wirth
Abstract:
We consider the entropic regularization of discretized optimal transport and propose to solve its optimality conditions via a logarithmic Newton iteration. We show a quadratic convergence rate and validate numerically that the method compares favorably with the more commonly used Sinkhorn--Knopp algorithm for small regularization strength. We further investigate numerically the robustness of the p…
▽ More
We consider the entropic regularization of discretized optimal transport and propose to solve its optimality conditions via a logarithmic Newton iteration. We show a quadratic convergence rate and validate numerically that the method compares favorably with the more commonly used Sinkhorn--Knopp algorithm for small regularization strength. We further investigate numerically the robustness of the proposed method with respect to parameters such as the mesh size of the discretization.
△ Less
Submitted 9 February, 2018; v1 submitted 18 October, 2017;
originally announced October 2017.
-
Introduction to Finite Element Methods
Authors:
Christian Clason
Abstract:
These lecture notes for a graduate course present an introduction to the mathematical theory of finite element methods for the numerical solution of partial differential equations. Covered are conforming and nonconforming (in particular, discontinuous Galerkin and mixed methods) for elliptic partial differential equations and Galerkin methods for parabolic equations.
These lecture notes for a graduate course present an introduction to the mathematical theory of finite element methods for the numerical solution of partial differential equations. Covered are conforming and nonconforming (in particular, discontinuous Galerkin and mixed methods) for elliptic partial differential equations and Galerkin methods for parabolic equations.
△ Less
Submitted 19 August, 2021; v1 submitted 25 September, 2017;
originally announced September 2017.
-
Total variation regularization of multi-material topology optimization
Authors:
Christian Clason,
Florian Kruse,
Karl Kunisch
Abstract:
This work is concerned with the determination of the diffusion coefficient from distributed data of the state. This problem is related to homogenization theory on the one hand and to regularization theory on the other hand. An approach is proposed which involves total variation regularization combined with a suitably chosen cost functional that promotes the diffusion coefficient assuming prespecif…
▽ More
This work is concerned with the determination of the diffusion coefficient from distributed data of the state. This problem is related to homogenization theory on the one hand and to regularization theory on the other hand. An approach is proposed which involves total variation regularization combined with a suitably chosen cost functional that promotes the diffusion coefficient assuming prespecified values at each point of the domain. The main difficulty lies in the delicate functional-analytic structure of the resulting nondifferentiable optimization problem with pointwise constraints for functions of bounded variation, which makes the derivation of useful pointwise optimality conditions challenging. To cope with this difficulty, a novel reparametrization technique is introduced. Numerical examples using a regularized semismooth Newton method illustrate the structure of the obtained diffusion coefficient. ~
△ Less
Submitted 4 May, 2018; v1 submitted 21 August, 2017;
originally announced August 2017.
-
Nonsmooth Analysis and Optimization
Authors:
Christian Clason
Abstract:
These lecture notes for a graduate course cover generalized derivative concepts useful in deriving necessary optimality conditions and numerical algorithms for nondifferentiable optimization problems in inverse problems, imaging, and PDE-constrained optimization. Treated are convex functions and subdifferentials, Fenchel duality, monotone operators and resolvents, Moreau--Yosida regularization, pr…
▽ More
These lecture notes for a graduate course cover generalized derivative concepts useful in deriving necessary optimality conditions and numerical algorithms for nondifferentiable optimization problems in inverse problems, imaging, and PDE-constrained optimization. Treated are convex functions and subdifferentials, Fenchel duality, monotone operators and resolvents, Moreau--Yosida regularization, proximal point and (some) first-order splitting methods, Clarke subdifferentials, and semismooth Newton methods. The required background from functional analysis and calculus of variations is also briefly summarized.
△ Less
Submitted 15 March, 2022; v1 submitted 14 August, 2017;
originally announced August 2017.
-
Convex regularization of discrete-valued inverse problems
Authors:
Christian Clason,
Thi Bich Tram Do
Abstract:
This work is concerned with linear inverse problems where a distributed parameter is known a priori to only take on values from a given discrete set. This property can be promoted in Tikhonov regularization with the aid of a suitable convex but nondifferentiable regularization term. This allows applying standard approaches to show well-posedness and convergence rates in Bregman distance. Using the…
▽ More
This work is concerned with linear inverse problems where a distributed parameter is known a priori to only take on values from a given discrete set. This property can be promoted in Tikhonov regularization with the aid of a suitable convex but nondifferentiable regularization term. This allows applying standard approaches to show well-posedness and convergence rates in Bregman distance. Using the specific properties of the regularization term, it can be shown that convergence (albeit without rates) actually holds pointwise. Furthermore, the resulting Tikhonov functional can be minimized efficiently using a semi-smooth Newton method. Numerical examples illustrate the properties of the regularization term and the numerical solution.
△ Less
Submitted 26 July, 2017; v1 submitted 4 July, 2017;
originally announced July 2017.
-
Optimal control of a non-smooth semilinear elliptic equation
Authors:
Constantin Christof,
Christian Clason,
Christian Meyer,
Stephan Walther
Abstract:
This paper is concerned with an optimal control problem governed by a non-smooth semilinear elliptic equation. We show that the control-to-state map** is directionally differentiable and precisely characterize its Bouligand subdifferential. By means of a suitable regularization, first-order optimality conditions including an adjoint equation are derived and afterwards interpreted in light of the…
▽ More
This paper is concerned with an optimal control problem governed by a non-smooth semilinear elliptic equation. We show that the control-to-state map** is directionally differentiable and precisely characterize its Bouligand subdifferential. By means of a suitable regularization, first-order optimality conditions including an adjoint equation are derived and afterwards interpreted in light of the previously obtained characterization. In addition, the directional derivative of the control-to-state map** is used to establish strong stationarity conditions. While the latter conditions are shown to be stronger, we demonstrate by numerical examples that the former conditions are amenable to numerical solution using a semi-smooth Newton method.
△ Less
Submitted 27 November, 2017; v1 submitted 2 May, 2017;
originally announced May 2017.
-
A convex analysis approach to optimal controls with switching structure for partial differential equations
Authors:
Christian Clason,
Kazufumi Ito,
Karl Kunisch
Abstract:
Optimal control problems involving hybrid binary-continuous control costs are challenging due to their lack of convexity and weak lower semicontinuity. Replacing such costs with their convex relaxation leads to a primal-dual optimality system that allows an explicit pointwise characterization and whose Moreau-Yosida regularization is amenable to a semismooth Newton method in function space. This a…
▽ More
Optimal control problems involving hybrid binary-continuous control costs are challenging due to their lack of convexity and weak lower semicontinuity. Replacing such costs with their convex relaxation leads to a primal-dual optimality system that allows an explicit pointwise characterization and whose Moreau-Yosida regularization is amenable to a semismooth Newton method in function space. This approach is especially suited for computing switching controls for partial differential equations. In this case, the optimality gap between the original functional and its relaxation can be estimated and shown to be zero for controls with switching structure. Numerical examples illustrate the effectiveness of this approach.
△ Less
Submitted 24 February, 2017;
originally announced February 2017.
-
Optimal control of elliptic equations with positive measures
Authors:
Christian Clason,
Anton Schiela
Abstract:
Optimal control problems without control costs in general do not possess solutions due to the lack of coercivity. However, unilateral constraints together with the assumption of existence of strictly positive solutions of a pre-adjoint state equation, are sufficient to obtain existence of optimal solutions in the space of Radon measures. Optimality conditions for these generalized minimizers can b…
▽ More
Optimal control problems without control costs in general do not possess solutions due to the lack of coercivity. However, unilateral constraints together with the assumption of existence of strictly positive solutions of a pre-adjoint state equation, are sufficient to obtain existence of optimal solutions in the space of Radon measures. Optimality conditions for these generalized minimizers can be obtained using Fenchel duality, which requires a non-standard perturbation approach if the control-to-observation map** is not continuous (e.g., for Neumann boundary control in three dimensions). Combining a conforming discretization of the measure space with a semismooth Newton method allows the numerical solution of the optimal control problem.
△ Less
Submitted 24 February, 2017;
originally announced February 2017.
-
A convex analysis approach to multi-material topology optimization
Authors:
Christian Clason,
Karl Kunisch
Abstract:
This work is concerned with optimal control of partial differential equations where the control enters the state equation as a coefficient and should take on values only from a given discrete set of values corresponding to available materials. A "multi-bang" framework based on convex analysis is proposed where the desired piecewise constant structure is incorporated using a convex penalty term. To…
▽ More
This work is concerned with optimal control of partial differential equations where the control enters the state equation as a coefficient and should take on values only from a given discrete set of values corresponding to available materials. A "multi-bang" framework based on convex analysis is proposed where the desired piecewise constant structure is incorporated using a convex penalty term. Together with a suitable tracking term, this allows formulating the problem of optimizing the topology of the distribution of material parameters as minimizing a convex functional subject to a (nonlinear) equality constraint. The applicability of this approach is validated for two model problems where the control enters as a potential and a diffusion coefficient, respectively. This is illustrated in both cases by numerical results based on a semi-smooth Newton method.
△ Less
Submitted 24 February, 2017;
originally announced February 2017.
-
A convex penalty for switching control of partial differential equations
Authors:
Christian Clason,
Armin Rund,
Karl Kunisch,
Richard C. Barnard
Abstract:
A convex penalty for promoting switching controls for partial differential equations is introduced; such controls consist of an arbitrary number of components of which at most one should be simultaneously active. Using a Moreau-Yosida approximation, a family of approximating problems is obtained that is amenable to solution by a semismooth Newton method. The efficiency of this approach and the str…
▽ More
A convex penalty for promoting switching controls for partial differential equations is introduced; such controls consist of an arbitrary number of components of which at most one should be simultaneously active. Using a Moreau-Yosida approximation, a family of approximating problems is obtained that is amenable to solution by a semismooth Newton method. The efficiency of this approach and the structure of the obtained controls are demonstrated by numerical examples.
△ Less
Submitted 24 February, 2017;
originally announced February 2017.
-
Efficient high-resolution RF pulse design applied to simultaneous multi-slice excitation
Authors:
Christoph Aigner,
Christian Clason,
Armin Rund,
Rudolf Stollberger
Abstract:
RF pulse design via optimal control is typically based on gradient and quasi-Newton approaches and therefore suffers from slow convergence. We present a flexible and highly efficient method that uses exact second-order information within a globally convergent trust-region CG-Newton method to yield an improved convergence rate. The approach is applied to the design of RF pulses for single- and simu…
▽ More
RF pulse design via optimal control is typically based on gradient and quasi-Newton approaches and therefore suffers from slow convergence. We present a flexible and highly efficient method that uses exact second-order information within a globally convergent trust-region CG-Newton method to yield an improved convergence rate. The approach is applied to the design of RF pulses for single- and simultaneous multi-slice (SMS) excitation and validated using phantom and in-vivo experiments on a 3T scanner using a modified gradient echo sequence.
△ Less
Submitted 24 February, 2017;
originally announced February 2017.
-
Vector-valued multibang control of differential equations
Authors:
Christian Clason,
Carla Tameling,
Benedikt Wirth
Abstract:
We consider a class of (ill-posed) optimal control problems in which a distributed vector-valued control is enforced to pointwise take values in a finite set $\mathcal{M}\subset\mathbb{R}^m$. After convex relaxation, one obtains a well-posed optimization problem, which still promotes control values in $\mathcal{M}$. We state the corresponding well-posedness and stability analysis and exemplify the…
▽ More
We consider a class of (ill-posed) optimal control problems in which a distributed vector-valued control is enforced to pointwise take values in a finite set $\mathcal{M}\subset\mathbb{R}^m$. After convex relaxation, one obtains a well-posed optimization problem, which still promotes control values in $\mathcal{M}$. We state the corresponding well-posedness and stability analysis and exemplify the results for two specific cases of quite general interest, optimal control of the Bloch equation and optimal control of an elastic deformation. We finally formulate a semismooth Newton method to numerically solve a regularized version of the optimal control problem and illustrate the behavior of the approach for our example cases.
△ Less
Submitted 15 September, 2017; v1 submitted 23 November, 2016;
originally announced November 2016.
-
L1 penalization of volumetric dose objectives in optimal control of PDEs
Authors:
Richard C. Barnard,
Christian Clason
Abstract:
This work is concerned with a class of optimal control problems governed by a partial differential equation that are motivated by an application in radiotherapy treatment planning, where the primary design objective is to minimize the volume where a functional of the state violates a prescribed level, but prescribing these levels in the form of pointwise state constraints can lead to infeasible pr…
▽ More
This work is concerned with a class of optimal control problems governed by a partial differential equation that are motivated by an application in radiotherapy treatment planning, where the primary design objective is to minimize the volume where a functional of the state violates a prescribed level, but prescribing these levels in the form of pointwise state constraints can lead to infeasible problems. We therefore propose an alternative approach based on $L^1$ penalization of the violation. We establish well-posedness of the corresponding optimal control problem, derive first-order optimality conditions, and present a semismooth Newton method for the efficient numerical solution of these problems. The performance of this method for a model problem is illustrated and contrasted with the alternative approach based on (regularized) state constraints.
△ Less
Submitted 11 February, 2017; v1 submitted 6 July, 2016;
originally announced July 2016.
-
Primal-dual extragradient methods for nonlinear nonsmooth PDE-constrained optimization
Authors:
Christian Clason,
Tuomo Valkonen
Abstract:
We study the extension of the Chambolle--Pock primal-dual algorithm to nonsmooth optimization problems involving nonlinear operators between function spaces. Local convergence is shown under technical conditions including metric regularity of the corresponding primal-dual optimality conditions. We also show convergence for a Nesterov-type accelerated variant provided one part of the functional is…
▽ More
We study the extension of the Chambolle--Pock primal-dual algorithm to nonsmooth optimization problems involving nonlinear operators between function spaces. Local convergence is shown under technical conditions including metric regularity of the corresponding primal-dual optimality conditions. We also show convergence for a Nesterov-type accelerated variant provided one part of the functional is strongly convex.
We show the applicability of the accelerated algorithm to examples of inverse problems with $L^1$- and $L^\infty$-fitting terms as well as of state-constrained optimal control problems, where convergence can be guaranteed after introducing an (arbitrary small, still nonsmooth) Moreau--Yosida regularization. This is verified in numerical examples.
△ Less
Submitted 15 March, 2017; v1 submitted 20 June, 2016;
originally announced June 2016.
-
Nonconvex penalization of switching control of partial differential equations
Authors:
Christian Clason,
Armin Rund,
Karl Kunisch
Abstract:
This paper is concerned with optimal control problems for parabolic partial differential equations with pointwise in time switching constraints on the control. A standard approach to treat constraints in nonlinear optimization is penalization, in particular using $L^1$-type norms. Applying this approach to the switching constraint leads to a nonsmooth and nonconvex infinite-dimensional minimizatio…
▽ More
This paper is concerned with optimal control problems for parabolic partial differential equations with pointwise in time switching constraints on the control. A standard approach to treat constraints in nonlinear optimization is penalization, in particular using $L^1$-type norms. Applying this approach to the switching constraint leads to a nonsmooth and nonconvex infinite-dimensional minimization problem which is challenging both analytically and numerically. Adding $H^1$ regularization or restricting to a finite-dimensional control space allows showing existence of optimal controls. First-order necessary optimality conditions are then derived using tools of nonsmooth analysis. Their solution can be computed using a combination of Moreau-Yosida regularization and a semismooth Newton method. Numerical examples illustrate the properties of this approach.
△ Less
Submitted 27 April, 2018; v1 submitted 31 May, 2016;
originally announced May 2016.
-
Stability of saddle points via explicit coderivatives of pointwise subdifferentials
Authors:
Christian Clason,
Tuomo Valkonen
Abstract:
We derive stability criteria for saddle points of a class of nonsmooth optimization problems in Hilbert spaces arising in PDE-constrained optimization, using metric regularity of infinite-dimensional set-valued map**s. A main ingredient is an explicit pointwise characterization of the Fréchet coderivative of the subdifferential of convex integral functionals. This is applied to several stability…
▽ More
We derive stability criteria for saddle points of a class of nonsmooth optimization problems in Hilbert spaces arising in PDE-constrained optimization, using metric regularity of infinite-dimensional set-valued map**s. A main ingredient is an explicit pointwise characterization of the Fréchet coderivative of the subdifferential of convex integral functionals. This is applied to several stability properties for parameter identification problems for an elliptic partial differential equation with non-differentiable data fitting terms.
△ Less
Submitted 10 February, 2017; v1 submitted 22 September, 2015;
originally announced September 2015.
-
Functional error estimators for the adaptive discretization of inverse problems
Authors:
Christian Clason,
Barbara Kaltenbacher,
Daniel Wachsmuth
Abstract:
So-called functional error estimators provide a valuable tool for reliably estimating the discretization error for a sum of two convex functions. We apply this concept to Tikhonov regularization for the solution of inverse problems for partial differential equations, not only for quadratic Hilbert space regularization terms but also for nonsmooth Banach space penalties. Examples include the measur…
▽ More
So-called functional error estimators provide a valuable tool for reliably estimating the discretization error for a sum of two convex functions. We apply this concept to Tikhonov regularization for the solution of inverse problems for partial differential equations, not only for quadratic Hilbert space regularization terms but also for nonsmooth Banach space penalties. Examples include the measure-space norm (i.e., sparsity regularization) or the indicator function of an $L^\infty$ ball (i.e., Ivanov regularization). The error estimators can be written in terms of residuals in the optimality system that can then be estimated by conventional techniques, thus leading to explicit estimators. This is illustrated by means of an elliptic inverse source problem with the above-mentioned penalties, and numerical results are provided for the case of sparsity regularization.
△ Less
Submitted 10 February, 2017; v1 submitted 29 July, 2015;
originally announced July 2015.
