-
Numerical Methods for Shape Optimal Design of Fluid-Structure Interaction Problems
Authors:
Johannes Haubner,
Michael Ulbrich
Abstract:
We consider the method of map**s for performing shape optimization for unsteady fluid-structure interaction (FSI) problems. In this work, we focus on the numerical implementation. We model the optimization problem such that it takes several theoretical results into account, such as regularity requirements on the transformations and a differential geometrical point of view on the manifold of shap…
▽ More
We consider the method of map**s for performing shape optimization for unsteady fluid-structure interaction (FSI) problems. In this work, we focus on the numerical implementation. We model the optimization problem such that it takes several theoretical results into account, such as regularity requirements on the transformations and a differential geometrical point of view on the manifold of shapes. Moreover, we discretize the problem such that we can compute exact discrete gradients. This allows for the use of general purpose optimization solvers. We focus on an FSI benchmark problem to validate our numerical implementation. The method is used to optimize parts of the outer boundary and the interface. The numerical simulations build on FEniCS, dolfin-adjoint and IPOPT. Moreover, as an additional theoretical result, we show that for a linear special case the adjoint attains the same structure as the forward problem but reverses the temporal flow of information.
△ Less
Submitted 19 June, 2024;
originally announced June 2024.
-
A Stochastic Proximal Polyak Step Size
Authors:
Fabian Schaipp,
Robert M. Gower,
Michael Ulbrich
Abstract:
Recently, the stochastic Polyak step size (SPS) has emerged as a competitive adaptive step size scheme for stochastic gradient descent. Here we develop ProxSPS, a proximal variant of SPS that can handle regularization terms. Develo** a proximal variant of SPS is particularly important, since SPS requires a lower bound of the objective function to work well. When the objective function is the sum…
▽ More
Recently, the stochastic Polyak step size (SPS) has emerged as a competitive adaptive step size scheme for stochastic gradient descent. Here we develop ProxSPS, a proximal variant of SPS that can handle regularization terms. Develo** a proximal variant of SPS is particularly important, since SPS requires a lower bound of the objective function to work well. When the objective function is the sum of a loss and a regularizer, available estimates of a lower bound of the sum can be loose. In contrast, ProxSPS only requires a lower bound for the loss which is often readily available. As a consequence, we show that ProxSPS is easier to tune and more stable in the presence of regularization. Furthermore for image classification tasks, ProxSPS performs as well as AdamW with little to no tuning, and results in a network with smaller weight parameters. We also provide an extensive convergence analysis for ProxSPS that includes the non-smooth, smooth, weakly convex and strongly convex setting.
△ Less
Submitted 4 May, 2023; v1 submitted 12 January, 2023;
originally announced January 2023.
-
Sample Size Estimates for Risk-Neutral Semilinear PDE-Constrained Optimization
Authors:
Johannes Milz,
Michael Ulbrich
Abstract:
The sample average approximation (SAA) approach is applied to risk-neutral optimization problems governed by semilinear elliptic partial differential equations with random inputs. After constructing a compact set that contains the SAA critical points, we derive nonasymptotic sample size estimates for SAA critical points using the covering number approach. Thereby, we derive upper bounds on the num…
▽ More
The sample average approximation (SAA) approach is applied to risk-neutral optimization problems governed by semilinear elliptic partial differential equations with random inputs. After constructing a compact set that contains the SAA critical points, we derive nonasymptotic sample size estimates for SAA critical points using the covering number approach. Thereby, we derive upper bounds on the number of samples needed to obtain accurate critical points of the risk-neutral PDE-constrained optimization problem through SAA critical points. We quantify accuracy using expectation and exponential tail bounds. Numerical illustrations are presented.
△ Less
Submitted 4 September, 2023; v1 submitted 29 July, 2022;
originally announced July 2022.
-
A Semismooth Newton Stochastic Proximal Point Algorithm with Variance Reduction
Authors:
Andre Milzarek,
Fabian Schaipp,
Michael Ulbrich
Abstract:
We develop an implementable stochastic proximal point (SPP) method for a class of weakly convex, composite optimization problems. The proposed stochastic proximal point algorithm incorporates a variance reduction mechanism and the resulting SPP updates are solved using an inexact semismooth Newton framework. We establish detailed convergence results that take the inexactness of the SPP steps into…
▽ More
We develop an implementable stochastic proximal point (SPP) method for a class of weakly convex, composite optimization problems. The proposed stochastic proximal point algorithm incorporates a variance reduction mechanism and the resulting SPP updates are solved using an inexact semismooth Newton framework. We establish detailed convergence results that take the inexactness of the SPP steps into account and that are in accordance with existing convergence guarantees of (proximal) stochastic variance-reduced gradient methods. Numerical experiments show that the proposed algorithm competes favorably with other state-of-the-art methods and achieves higher robustness with respect to the step size selection.
△ Less
Submitted 26 March, 2024; v1 submitted 1 April, 2022;
originally announced April 2022.
-
A continuous perspective on modeling of shape optimal design problems
Authors:
Johannes Haubner,
Martin Siebenborn,
Michael Ulbrich
Abstract:
In this article we consider shape optimization problems as optimal control problems via the method of map**s. Instead of optimizing over a set of admissible shapes a reference domain is introduced and it is optimized over a set of admissible transformations. The focus is on the choice of the set of transformations, which we motivate from a function space perspective. In order to guarantee local…
▽ More
In this article we consider shape optimization problems as optimal control problems via the method of map**s. Instead of optimizing over a set of admissible shapes a reference domain is introduced and it is optimized over a set of admissible transformations. The focus is on the choice of the set of transformations, which we motivate from a function space perspective. In order to guarantee local injectivity of the admissible transformations we enrich the optimization problem by a nonlinear constraint. The approach requires no parameter tuning for the extension equation and can naturally be combined with geometric constraints on volume and barycenter of the shape. Numerical results for drag minimization of Stokes flow are presented.
△ Less
Submitted 15 April, 2020;
originally announced April 2020.
-
Differentiability results and sensitivity calculation for optimal control of incompressible two-phase Navier-Stokes equations with surface tension
Authors:
Elisabeth Diehl,
Johannes Haubner,
Michael Ulbrich,
Stefan Ulbrich
Abstract:
We analyze optimal control problems for two-phase Navier-Stokes equations with surface tension. Based on $L_p$-maximal regularity of the underlying linear problem and recent well-posedness results of the problem for sufficiently small data we show the differentiability of the solution with respect to initial and distributed controls for appropriate spaces resulting form the $L_p$-maximal regularit…
▽ More
We analyze optimal control problems for two-phase Navier-Stokes equations with surface tension. Based on $L_p$-maximal regularity of the underlying linear problem and recent well-posedness results of the problem for sufficiently small data we show the differentiability of the solution with respect to initial and distributed controls for appropriate spaces resulting form the $L_p$-maximal regularity setting. We consider first a formulation where the interface is transformed to a hyperplane. Then we deduce differentiability results for the solution in the physical coordinates. Finally, we state an equivalent Volume-of-Fluid type formulation and use the obtained differentiability results to derive rigorosly the corresponding sensitivity equations of the Volume-of-Fluid type formulation. For objective functionals involving the velocity field or the discontinuous pressure or phase indciator field we derive differentiability results with respect to controls and state formulas for the derivative. The results of the paper form an analytical foundation for stating optimality conditions, justifying the application of derivative based optimization methods and for studying the convergence of discrete sensitivity schemes based on Volume-of-Fluid discretizations for optimal control of two-phase Navier-Stokes equations.
△ Less
Submitted 3 June, 2021; v1 submitted 9 March, 2020;
originally announced March 2020.
-
A Stochastic Semismooth Newton Method for Nonsmooth Nonconvex Optimization
Authors:
Andre Milzarek,
Xiantao Xiao,
Shicong Cen,
Zaiwen Wen,
Michael Ulbrich
Abstract:
In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only noisy gradient and Hessian information of the smooth part of the objective function is available via calling stochastic first and second order oracles. The proposed method can be s…
▽ More
In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only noisy gradient and Hessian information of the smooth part of the objective function is available via calling stochastic first and second order oracles. The proposed method can be seen as a hybrid approach combining stochastic semismooth Newton steps and stochastic proximal gradient steps. Two inexact growth conditions are incorporated to monitor the convergence and the acceptance of the semismooth Newton steps and it is shown that the algorithm converges globally to stationary points in expectation. Moreover, under standard assumptions and utilizing random matrix concentration inequalities, we prove that the proposed approach locally turns into a pure stochastic semismooth Newton method and converges r-superlinearly with high probability. We present numerical results and comparisons on $\ell_1$-regularized logistic regression and nonconvex binary classification that demonstrate the efficiency of our algorithm.
△ Less
Submitted 9 March, 2018;
originally announced March 2018.
-
On the Analysis of the Discretized Kohn-Sham Density Functional Theory
Authors:
Xin Liu,
Zaiwen Wen,
Xiao Wang,
Michael Ulbrich,
Yaxiang Yuan
Abstract:
In this paper, we study a few theoretical issues in the discretized Kohn-Sham (KS) density functional theory (DFT). The equivalence between either a local or global minimizer of the KS total energy minimization problem and the solution to the KS equation is established under certain assumptions. The nonzero charge densities of a strong local minimizer are shown to be bounded below by a positive co…
▽ More
In this paper, we study a few theoretical issues in the discretized Kohn-Sham (KS) density functional theory (DFT). The equivalence between either a local or global minimizer of the KS total energy minimization problem and the solution to the KS equation is established under certain assumptions. The nonzero charge densities of a strong local minimizer are shown to be bounded below by a positive constant uniformly. We analyze the self-consistent field (SCF) iteration by formulating the KS equation as a fixed point map with respect to the potential. The Jacobian of these fixed point maps is derived explicitly. Both global and local convergence of the simple mixing scheme can be established if the gap between the occupied states and unoccupied states is sufficiently large. This assumption can be relaxed if the charge density is computed using the Fermi-Dirac distribution and it is not required if there is no exchange correlation functional in the total energy functional. Although our assumption on the gap is very stringent and is almost never satisfied in reality, our analysis is still valuable for a better understanding of the KS minimization problem, the KS equation and the SCF iteration.
△ Less
Submitted 20 February, 2014;
originally announced February 2014.
