-
Mini-batch descent in semiflows
Authors:
Alberto Domínguez Corella,
Martín Hernández
Abstract:
This paper investigates the application of mini-batch gradient descent to semiflows. Given a loss function, we introduce a continuous version of mini-batch gradient descent by randomly selecting sub-loss functions over time, defining a piecewise flow. We prove that, under suitable assumptions on the gradient flow, the mini-batch descent flow trajectory closely approximates the original gradient fl…
▽ More
This paper investigates the application of mini-batch gradient descent to semiflows. Given a loss function, we introduce a continuous version of mini-batch gradient descent by randomly selecting sub-loss functions over time, defining a piecewise flow. We prove that, under suitable assumptions on the gradient flow, the mini-batch descent flow trajectory closely approximates the original gradient flow trajectory on average. Additionally, we propose a randomized minimizing movement scheme that also approximates the gradient flow of the loss function. We illustrate the versatility of this approach across various problems, including constrained optimization, sparse inversion, and domain decomposition. Finally, we validate our results with several numerical examples.
△ Less
Submitted 10 July, 2024;
originally announced July 2024.
-
Stability analysis of the Navier-Stokes velocity tracking problem with bang-bang controls
Authors:
Alberto Domínguez Corella,
Nicolai Jork,
Šarká Nečasová,
John Sebastian H. Simon
Abstract:
This paper focuses on the stability of solutions for a velocity-tracking problem associated with the two-dimensional Navier-Stokes equations. The considered optimal control problem does not possess any regularizer in the cost, and hence bang-bang solutions can be expected. We investigate perturbations that account for uncertainty in the tracking data and the initial condition of the state, and ana…
▽ More
This paper focuses on the stability of solutions for a velocity-tracking problem associated with the two-dimensional Navier-Stokes equations. The considered optimal control problem does not possess any regularizer in the cost, and hence bang-bang solutions can be expected. We investigate perturbations that account for uncertainty in the tracking data and the initial condition of the state, and analyze the convergence rate of solutions when the original problem is regularized by the Tikhonov term. The stability analysis relies on the Hölder subregularity of the optimality map**, which stems from the necessary conditions of the problem.
△ Less
Submitted 19 February, 2024; v1 submitted 14 July, 2023;
originally announced July 2023.
-
Stability and genericity of bang-bang controls in affine problems
Authors:
Alberto Domínguez Corella,
Gerd Wachsmuth
Abstract:
We analyse the role of the bang-bang property in affine optimal control problems. We show that many essential stability properties of affine problems are only satisfied when minimizers are bang-bang. Moreover, we prove that almost any perturbation in an affine optimal control problem leads to a bang-bang strict global minimizer. We work in an abstract framework that allows to cover many problems i…
▽ More
We analyse the role of the bang-bang property in affine optimal control problems. We show that many essential stability properties of affine problems are only satisfied when minimizers are bang-bang. Moreover, we prove that almost any perturbation in an affine optimal control problem leads to a bang-bang strict global minimizer. We work in an abstract framework that allows to cover many problems in the literature of optimal control, this includes problems constrained by partial and ordinary differential equations. We give examples that show the applicability of our results to specific optimal control problems.
△ Less
Submitted 12 July, 2023; v1 submitted 11 July, 2023;
originally announced July 2023.
-
Solution stability of parabolic optimal control problems with fixed state-distribution of the controls
Authors:
Alberto Domínguez Corella,
Nicolai Jork,
Vladimir M. Veliov
Abstract:
The paper presents results about strong metric subregularity of the optimality map** associated with the system of first-order necessary optimality conditions for a problem of optimal control of a semilinear parabolic equation. The control has a predefined spatial distribution and only the magnitude at any time is a subject of choice. The obtained conditions for subregularity imply, in particula…
▽ More
The paper presents results about strong metric subregularity of the optimality map** associated with the system of first-order necessary optimality conditions for a problem of optimal control of a semilinear parabolic equation. The control has a predefined spatial distribution and only the magnitude at any time is a subject of choice. The obtained conditions for subregularity imply, in particular, sufficient optimality conditions that extend the known ones. The paper is complementary to a companion one by the same authors, in which a distributed control is considered.
△ Less
Submitted 25 December, 2022;
originally announced December 2022.
-
On the solution stability of parabolic optimal control problems
Authors:
Alberto Domínguez Corella,
Nicolai Jork,
Vladimir M. Veliov
Abstract:
The paper investigates stability properties of solutions of optimal control problems for semilinear parabolic partial differential equations. Hölder or Lipschitz dependence of the optimal solution on perturbations are obtained for problems in which the equation and the objective functional are affine with respect to the control. The perturbations may appear in both the equation and in the objectiv…
▽ More
The paper investigates stability properties of solutions of optimal control problems for semilinear parabolic partial differential equations. Hölder or Lipschitz dependence of the optimal solution on perturbations are obtained for problems in which the equation and the objective functional are affine with respect to the control. The perturbations may appear in both the equation and in the objective functional and may non-linearly depend on the state and control variables. The main results are based on an extension of recently introduced assumptions on the joint growth of the first and second variation of the objective functional. The stability of the optimal solution is obtained as a consequence of a more general result obtained in the paper -- the proved metric subregularity of the map** associated with the system of first-order necessary optimality conditions. This property also enables error estimates for approximation methods. Lipschitz estimate for the dependence of the optimal control on the Tikhonov regularization parameter is obtained as a by-product.
△ Less
Submitted 19 September, 2022;
originally announced September 2022.
-
New assumptions for stability analysis in elliptic optimal control problems
Authors:
Eduardo Casas,
Alberto Domínguez Corella,
Nicolai Jork
Abstract:
This paper is dedicated to the stability analysis of the optimal solutions of a control problem associated with a semilinear elliptic equation. The linear differential operator of the equation is neither monotone nor coercive due to the presence of a convection term. The control appears only linearly, or even it can not appear in an explicit form in the objective functional. Under new assumptions,…
▽ More
This paper is dedicated to the stability analysis of the optimal solutions of a control problem associated with a semilinear elliptic equation. The linear differential operator of the equation is neither monotone nor coercive due to the presence of a convection term. The control appears only linearly, or even it can not appear in an explicit form in the objective functional. Under new assumptions, we prove Lipschitz stability of the optimal controls and associated states with respect to perturbations in the equation and the objective functional as well as with respect to the Tikhonov regularization parameter.
△ Less
Submitted 3 January, 2023; v1 submitted 8 May, 2022;
originally announced May 2022.
-
Stability in affine optimal control problems constrained by semilinear elliptic partial differential equations
Authors:
Alberto Domínguez Corella,
Nicolai Jork,
Vladimir Veliov
Abstract:
This paper investigates stability properties of affine optimal control problems constrained by semilinear elliptic partial differential equations. This is done by studying the so called metric subregularity of the set-valued map** associated with the system of first order necessary optimality conditions. Preliminary results concerning the differentiability of the functions involved are establish…
▽ More
This paper investigates stability properties of affine optimal control problems constrained by semilinear elliptic partial differential equations. This is done by studying the so called metric subregularity of the set-valued map** associated with the system of first order necessary optimality conditions. Preliminary results concerning the differentiability of the functions involved are established, especially the so-called switching function. Using this ansatz, more general nonlinear perturbations are encompassed, and under weaker assumptions, than the ones previously considered in the literature on control constrained elliptic problems. Finally, the applicability of the results is illustrated with some error estimates for the Tikhonov regularization.
△ Less
Submitted 22 November, 2022; v1 submitted 27 April, 2022;
originally announced April 2022.
