-
A Sequential Homotopy Method for Mathematical Programming Problems
Authors:
Andreas Potschka,
Hans Georg Bock
Abstract:
We propose a sequential homotopy method for the solution of mathematical programming problems formulated in abstract Hilbert spaces under the Guignard constraint qualification. The method is equivalent to performing projected backward Euler timestep** on a projected gradient/antigradient flow of the augmented Lagrangian. The projected backward Euler equations can be interpreted as the necessary…
▽ More
We propose a sequential homotopy method for the solution of mathematical programming problems formulated in abstract Hilbert spaces under the Guignard constraint qualification. The method is equivalent to performing projected backward Euler timestep** on a projected gradient/antigradient flow of the augmented Lagrangian. The projected backward Euler equations can be interpreted as the necessary optimality conditions of a primal-dual proximal regularization of the original problem. The regularized problems are always feasible, satisfy a strong constraint qualification guaranteeing uniqueness of Lagrange multipliers, yield unique primal solutions provided that the stepsize is sufficiently small, and can be solved by a continuation in the stepsize. We show that equilibria of the projected gradient/antigradient flow and critical points of the optimization problem are identical, provide sufficient conditions for the existence of global flow solutions, and show that critical points with emanating descent curves cannot be asymptotically stable equilibria of the projected gradient/antigradient flow, practically eradicating convergence to saddle points and maxima. The sequential homotopy method can be used to globalize any locally convergent optimization method that can be used in a homotopy framework. We demonstrate its efficiency for a class of highly nonlinear and badly conditioned control constrained elliptic optimal control problems with a semismooth Newton approach for the regularized subproblems.
△ Less
Submitted 17 May, 2019; v1 submitted 19 February, 2019;
originally announced February 2019.
-
Approximation of weak adjoints by reverse automatic differentiation of BDF methods
Authors:
Dörte Beigel,
Mario S. Mommer,
Leonard Wirsching,
Hans Georg Bock
Abstract:
With this contribution, we shed light on the relation between the discrete adjoints of multistep backward differentiation formula (BDF) methods and the solution of the adjoint differential equation. To this end, we develop a functional-analytic framework based on a constrained variational problem and introduce the notion of weak adjoint solutions. We devise a finite element Petrov-Galerkin interpr…
▽ More
With this contribution, we shed light on the relation between the discrete adjoints of multistep backward differentiation formula (BDF) methods and the solution of the adjoint differential equation. To this end, we develop a functional-analytic framework based on a constrained variational problem and introduce the notion of weak adjoint solutions. We devise a finite element Petrov-Galerkin interpretation of the BDF method together with its discrete adjoint scheme obtained by reverse internal numerical differentiation. We show how the finite element approximation of the weak adjoint is computed by the discrete adjoint scheme and prove its asymptotic convergence in the space of normalized functions of bounded variation. We also obtain asymptotic convergence of the discrete adjoints to the classical adjoints on the inner time interval. Finally, we give numerical results for non-adaptive and fully adaptive BDF schemes. The presented framework opens the way to carry over the existing theory on global error estimation techniques from finite element methods to BDF methods.
△ Less
Submitted 14 September, 2011;
originally announced September 2011.
-
A nonlinear preconditioner for experimental design problems
Authors:
M. S. Mommer,
A. Sommer,
J. P. Schlöder,
H. G. Bock
Abstract:
We address the slow convergence and poor stability of quasi-newton sequential quadratic programming (SQP) methods that is observed when solving experimental design problems, in particular when they are large. Our findings suggest that this behavior is due to the fact that these problems often have bad absolute condition numbers. To shed light onto the structure of the problem close to the solution…
▽ More
We address the slow convergence and poor stability of quasi-newton sequential quadratic programming (SQP) methods that is observed when solving experimental design problems, in particular when they are large. Our findings suggest that this behavior is due to the fact that these problems often have bad absolute condition numbers. To shed light onto the structure of the problem close to the solution, we formulate a model problem (based on the $A$-criterion), that is defined in terms of a given initial design that is to be improved. We prove that the absolute condition number of the model problem grows without bounds as the quality of the initial design improves. Additionally, we devise a preconditioner that ensures that the condition number will instead stay uniformly bounded. Using numerical experiments, we study the effect of this reformulation on relevant cases of the general problem, and find that it leads to significant improvements in stability and convergence behavior.
△ Less
Submitted 8 August, 2011;
originally announced August 2011.
