-
Affordable mixed-integer Lagrangian methods: optimality conditions and convergence analysis
Authors:
Alberto De Marchi
Abstract:
Necessary optimality conditions in Lagrangian form and the augmented Lagrangian framework are extended to mixed-integer nonlinear optimization, without any convexity assumptions. Building upon a recently developed notion of local optimality for problems with polyhedral and integrality constraints, a characterization of local minimizers and critical points is given for problems including also nonli…
▽ More
Necessary optimality conditions in Lagrangian form and the augmented Lagrangian framework are extended to mixed-integer nonlinear optimization, without any convexity assumptions. Building upon a recently developed notion of local optimality for problems with polyhedral and integrality constraints, a characterization of local minimizers and critical points is given for problems including also nonlinear constraints. This approach lays the foundations for develo** affordable sequential minimization algorithms with convergence guarantees to critical points from arbitrary initializations. A primal-dual perspective, a local saddle point property, and the dual relationships with the proximal point algorithm are also advanced in the presence of integer variables.
△ Less
Submitted 18 June, 2024;
originally announced June 2024.
-
A penalty barrier framework for nonconvex constrained optimization
Authors:
Alberto De Marchi,
Andreas Themelis
Abstract:
Focusing on minimization problems with structured objective function and smooth constraints, we present a flexible technique that combines the beneficial regularization effects of (exact) penalty and interior-point methods. Working in the fully nonconvex setting, a pure barrier approach requires careful steps when approaching the infeasible set, thus hindering convergence. We show how a tight inte…
▽ More
Focusing on minimization problems with structured objective function and smooth constraints, we present a flexible technique that combines the beneficial regularization effects of (exact) penalty and interior-point methods. Working in the fully nonconvex setting, a pure barrier approach requires careful steps when approaching the infeasible set, thus hindering convergence. We show how a tight integration with a penalty scheme overcomes such conservatism, does not require a strictly feasible starting point, and thus accommodates equality constraints. The crucial advancement that allows us to invoke generic (possibly accelerated) subsolvers is a marginalization step: amounting to a conjugacy operation, this step effectively merges (exact) penalty and barrier into a smooth, full domain functional object. When the penalty exactness takes effect, the generated subproblems do not suffer the ill-conditioning typical of penalty methods, nor do they exhibit the nonsmoothness of exact penalty terms. We provide a theoretical characterization of the algorithm and its asymptotic properties, deriving convergence results for fully nonconvex problems. Illustrative examples and numerical simulations demonstrate the wide range of problems our theory and algorithm are able to cover.
△ Less
Submitted 14 June, 2024;
originally announced June 2024.
-
Relic Neutrino Background from Cosmic-Ray Reservoirs
Authors:
Andrea Giovanni De Marchi,
Alessandro Granelli,
Jacopo Nava,
Filippo Sala
Abstract:
We compute the flux of relic neutrino background (R$ν$B) up-scattered by ultra-high-energy (UHE) cosmic rays (CRs) in clusters that act as CR-reservoirs. The long trap** times of UHECRs make this flux larger than that of R$ν$B up-scattered by UHECRs on their way to Earth, which we also compute. We find that IceCube excludes R$ν$B weighted overdensities larger than $10^{10}$ in clusters, and that…
▽ More
We compute the flux of relic neutrino background (R$ν$B) up-scattered by ultra-high-energy (UHE) cosmic rays (CRs) in clusters that act as CR-reservoirs. The long trap** times of UHECRs make this flux larger than that of R$ν$B up-scattered by UHECRs on their way to Earth, which we also compute. We find that IceCube excludes R$ν$B weighted overdensities larger than $10^{10}$ in clusters, and that PUEO, RNO-G, GRAND and IceCube-Gen2 will test values down to $10^{8}$. Our treatment incorporates the momentum transfer dependence of the neutrino-nucleus cross section, deep inelastic scattering, a mixed UHECR composition, and flavour information on the up-scattered R$ν$B fluxes for both cases of neutrino mass spectrum with normal and inverted ordering, providing new handles to possibly disentangle the up-scattered R$ν$B from cosmogenic neutrinos.
△ Less
Submitted 7 May, 2024;
originally announced May 2024.
-
Hybrid optimal control with mixed-integer Lagrangian methods
Authors:
Viktoriya Nikitina,
Alberto De Marchi,
Matthias Gerdts
Abstract:
Models involving hybrid systems are versatile in their application, but difficult to handle and optimize efficiently due to their combinatorial nature. This work presents a method to cope with hybrid optimal control problems which, in contrast to decomposition techniques, does not require relaxing the integrality constraints. Based on the discretize-then-optimize approach, our scheme addresses mix…
▽ More
Models involving hybrid systems are versatile in their application, but difficult to handle and optimize efficiently due to their combinatorial nature. This work presents a method to cope with hybrid optimal control problems which, in contrast to decomposition techniques, does not require relaxing the integrality constraints. Based on the discretize-then-optimize approach, our scheme addresses mixed-integer nonlinear problems under mild assumptions. The proposed numerical algorithm builds upon the augmented Lagrangian framework, whose subproblems are handled using successive mixed-integer linearizations with trust regions. We validate the performance of the numerical routine with extensive investigations using several hybrid optimal control problems from different fields of application. Promising preliminary results are presented for a motion planning task with hysteresis and drag, a Lotka-Volterra fishing problem, and a facility location design problem.
△ Less
Submitted 11 March, 2024;
originally announced March 2024.
-
Collision Avoidance using Iterative Dynamic and Nonlinear Programming with Adaptive Grid Refinements
Authors:
Rebecca Richter,
Alberto De Marchi,
Matthias Gerdts
Abstract:
Nonlinear optimal control problems for trajectory planning with obstacle avoidance present several challenges. While general-purpose optimizers and dynamic programming methods struggle when adopted separately, their combination enabled by a penalty approach was found capable of handling highly nonlinear systems while overcoming the curse of dimensionality. Nevertheless, using dynamic programming w…
▽ More
Nonlinear optimal control problems for trajectory planning with obstacle avoidance present several challenges. While general-purpose optimizers and dynamic programming methods struggle when adopted separately, their combination enabled by a penalty approach was found capable of handling highly nonlinear systems while overcoming the curse of dimensionality. Nevertheless, using dynamic programming with a fixed state space discretization limits the set of reachable solutions, hindering convergence or requiring enormous memory resources for uniformly spaced grids. In this work we solve this issue by incorporating an adaptive refinement of the state space grid, splitting cells where needed to better capture the problem structure while requiring less discretization points overall. Numerical results on a space manipulator demonstrate the improved robustness and efficiency of the combined method with respect to the single components.
△ Less
Submitted 12 November, 2023; v1 submitted 6 November, 2023;
originally announced November 2023.
-
Mixed-integer linearity in nonlinear optimization: a trust region approach
Authors:
Alberto De Marchi
Abstract:
Bringing together nonlinear optimization with polyhedral and integrality constraints enables versatile modeling, but poses significant computational challenges. We investigate a method to address these problems based on sequential mixed-integer linearization with trust region safeguard, computing feasible iterates via calls to a generic mixed-integer linear solver. Convergence to critical, possibl…
▽ More
Bringing together nonlinear optimization with polyhedral and integrality constraints enables versatile modeling, but poses significant computational challenges. We investigate a method to address these problems based on sequential mixed-integer linearization with trust region safeguard, computing feasible iterates via calls to a generic mixed-integer linear solver. Convergence to critical, possibly suboptimal, feasible points is established for arbitrary starting points. Finally, we present numerical applications in nonsmooth optimal control and optimal network design and operation.
△ Less
Submitted 11 March, 2024; v1 submitted 26 October, 2023;
originally announced October 2023.
-
Local properties and augmented Lagrangians in fully nonconvex composite optimization
Authors:
Alberto De Marchi,
Patrick Mehlitz
Abstract:
A broad class of optimization problems can be cast in composite form, that is, considering the minimization of the composition of a lower semicontinuous function with a differentiable map**. This paper investigates the versatile template of composite optimization without any convexity assumptions. First- and second-order optimality conditions are discussed. We highlight the difficulties that ste…
▽ More
A broad class of optimization problems can be cast in composite form, that is, considering the minimization of the composition of a lower semicontinuous function with a differentiable map**. This paper investigates the versatile template of composite optimization without any convexity assumptions. First- and second-order optimality conditions are discussed. We highlight the difficulties that stem from the lack of convexity when dealing with necessary conditions in a Lagrangian framework and when considering error bounds. Building upon these characterizations, a local convergence analysis is delineated for a recently developed augmented Lagrangian method, deriving rates of convergence in the fully nonconvex setting.
△ Less
Submitted 15 May, 2024; v1 submitted 5 September, 2023;
originally announced September 2023.
-
Implicit augmented Lagrangian and generalized optimization
Authors:
Alberto De Marchi
Abstract:
Generalized nonlinear programming is considered without any convexity assumption, capturing a variety of problems that include nonsmooth objectives, combinatorial structures, and set-membership nonlinear constraints. We extend the augmented Lagrangian framework to this broad problem class, preserving an implicit formulation and introducing slack variables merely as a formal device. This, however,…
▽ More
Generalized nonlinear programming is considered without any convexity assumption, capturing a variety of problems that include nonsmooth objectives, combinatorial structures, and set-membership nonlinear constraints. We extend the augmented Lagrangian framework to this broad problem class, preserving an implicit formulation and introducing slack variables merely as a formal device. This, however, gives rise to a generalized augmented Lagrangian function that lacks regularity, due to the marginalization with respect to slack variables. Based on parametric optimization, we develop a tailored stationarity concept to better qualify the iterates, generated as approximate solutions to a sequence of subproblems. Using this variational characterization and the lifted representation, a suitable multiplier update rule is derived, and then asymptotic properties and convergence guarantees are established for a safeguarded augmented Lagrangian scheme. An illustrative numerical example showcases the modelling versatility gained by drop** convexity assumptions and indicates the practical benefits of the advocated implicit approach.
△ Less
Submitted 2 August, 2023; v1 submitted 1 February, 2023;
originally announced February 2023.
-
Relativistic Digital Twin: Bringing the IoT to the Future
Authors:
Luca Sciullo,
Alberto De Marchi,
Angelo Trotta,
Federico Montori,
Luciano Bononi,
Marco Di Felice
Abstract:
Complex IoT ecosystems often require the usage of Digital Twins (DTs) of their physical assets in order to perform predictive analytics and simulate what-if scenarios. DTs are able to replicate IoT devices and adapt over time to their behavioral changes. However, DTs in IoT are typically tailored to a specific use case, without the possibility to seamlessly adapt to different scenarios. Further, t…
▽ More
Complex IoT ecosystems often require the usage of Digital Twins (DTs) of their physical assets in order to perform predictive analytics and simulate what-if scenarios. DTs are able to replicate IoT devices and adapt over time to their behavioral changes. However, DTs in IoT are typically tailored to a specific use case, without the possibility to seamlessly adapt to different scenarios. Further, the fragmentation of IoT poses additional challenges on how to deploy DTs in heterogeneous scenarios characterized by the usage of multiple data formats and IoT network protocols. In this paper, we propose the Relativistic Digital Twin (RDT) framework, through which we automatically generate general-purpose DTs of IoT entities and tune their behavioral models over time by constantly observing their real counterparts. The framework relies on the object representation via the Web of Things (WoT), to offer a standardized interface to each of the IoT devices as well as to their DTs. To this purpose, we extended the W3C WoT standard in order to encompass the concept of behavioral model and define it in the Thing Description (TD) through a new vocabulary. Finally, we evaluated the RDT framework over two disjoint use cases to assess its correctness and learning performance, i.e., the DT of a simulated smart home scenario with the capability of forecasting the indoor temperature, and the DT of a real-world drone with the capability of forecasting its trajectory in an outdoor scenario. Experiments show that the generated DT can estimate the behavior of its real counterpart after an observation stage, regardless of the considered scenario.
△ Less
Submitted 30 December, 2023; v1 submitted 18 January, 2023;
originally announced January 2023.
-
Proximal gradient methods beyond monotony
Authors:
Alberto De Marchi
Abstract:
We address composite optimization problems, which consist in minimizing the sum of a smooth and a merely lower semicontinuous function, without any convexity assumptions. Numerical solutions of these problems can be obtained by proximal gradient methods, which often rely on a line search procedure as globalization mechanism. We consider an adaptive nonmonotone proximal gradient scheme based on an…
▽ More
We address composite optimization problems, which consist in minimizing the sum of a smooth and a merely lower semicontinuous function, without any convexity assumptions. Numerical solutions of these problems can be obtained by proximal gradient methods, which often rely on a line search procedure as globalization mechanism. We consider an adaptive nonmonotone proximal gradient scheme based on an averaged merit function and establish asymptotic convergence guarantees under weak assumptions, delivering results on par with the monotone strategy. Global worst-case rates for the iterates and a stationarity measure are also derived. Finally, a numerical example indicates the potential of nonmonotonicity and spectral approximations.
△ Less
Submitted 1 June, 2023; v1 submitted 9 November, 2022;
originally announced November 2022.
-
Regularized Interior Point Methods for Constrained Optimization and Control
Authors:
Alberto De Marchi
Abstract:
Regularization and interior point approaches offer valuable perspectives to address constrained nonlinear optimization problems in view of control applications. This paper discusses the interactions between these techniques and proposes an algorithm that synergistically combines them. Building a sequence of closely related subproblems and approximately solving each of them, this approach inherentl…
▽ More
Regularization and interior point approaches offer valuable perspectives to address constrained nonlinear optimization problems in view of control applications. This paper discusses the interactions between these techniques and proposes an algorithm that synergistically combines them. Building a sequence of closely related subproblems and approximately solving each of them, this approach inherently exploits warm-starting, early termination, and the possibility to adopt subsolvers tailored to specific problem structures. Moreover, by relaxing the equality constraints with a proximal penalty, the regularized subproblems are feasible and satisfy a strong constraint qualification by construction, allowing the safe use of efficient solvers. We show how regularization benefits the underlying linear algebra and a detailed convergence analysis indicates that limit points tend to minimize constraint violation and satisfy suitable optimality conditions. Finally, we report on numerical results in terms of robustness, indicating that the combined approach compares favorably against both interior point and augmented Lagrangian codes.
△ Less
Submitted 27 October, 2022;
originally announced October 2022.
-
An interior proximal gradient method for nonconvex optimization
Authors:
Alberto De Marchi,
Andreas Themelis
Abstract:
We consider structured minimization problems subject to smooth inequality constraints and present a flexible algorithm that combines interior point (IP) and proximal gradient schemes. While traditional IP methods cannot cope with nonsmooth objective functions and proximal algorithms cannot handle complicated constraints, their combined usage is shown to successfully compensate the respective short…
▽ More
We consider structured minimization problems subject to smooth inequality constraints and present a flexible algorithm that combines interior point (IP) and proximal gradient schemes. While traditional IP methods cannot cope with nonsmooth objective functions and proximal algorithms cannot handle complicated constraints, their combined usage is shown to successfully compensate the respective shortcomings. We provide a theoretical characterization of the algorithm and its asymptotic properties, deriving convergence results for fully nonconvex problems, thus bridging the gap with previous works that successfully addressed the convex case. Our interior proximal gradient algorithm benefits from warm starting, generates strictly feasible iterates with decreasing objective value, and returns after finitely many iterations a primal-dual pair approximately satisfying suitable optimality conditions. As a byproduct of our analysis of proximal gradient iterations we demonstrate that a slight refinement of traditional backtracking techniques waives the need for upper bounding the stepsize sequence, as required in existing results for the nonconvex setting.
△ Less
Submitted 28 January, 2024; v1 submitted 1 August, 2022;
originally announced August 2022.
-
Constrained composite optimization and augmented Lagrangian methods
Authors:
Alberto De Marchi,
Xiaoxi Jia,
Christian Kanzow,
Patrick Mehlitz
Abstract:
We investigate finite-dimensional constrained structured optimization problems, featuring composite objective functions and set-membership constraints. Offering an expressive yet simple language, this problem class provides a modeling framework for a variety of applications. We study stationarity and regularity concepts, and propose a flexible augmented Lagrangian scheme. We provide a theoretical…
▽ More
We investigate finite-dimensional constrained structured optimization problems, featuring composite objective functions and set-membership constraints. Offering an expressive yet simple language, this problem class provides a modeling framework for a variety of applications. We study stationarity and regularity concepts, and propose a flexible augmented Lagrangian scheme. We provide a theoretical characterization of the algorithm and its asymptotic properties, deriving convergence results for fully nonconvex problems. It is demonstrated how the inner subproblems can be solved by off-the-shelf proximal methods, notwithstanding the possibility to adopt any solvers, insofar as they return approximate stationary points. Finally, we describe our matrix-free implementation of the proposed algorithm and test it numerically. Illustrative examples show the versatility of constrained composite programs as a modeling tool and expose difficulties arising in this vast problem class.
△ Less
Submitted 30 January, 2023; v1 submitted 10 March, 2022;
originally announced March 2022.
-
Proximal Gradient Algorithms under Local Lipschitz Gradient Continuity: A Convergence and Robustness Analysis of PANOC
Authors:
Alberto De Marchi,
Andreas Themelis
Abstract:
Composite optimization offers a powerful modeling tool for a variety of applications and is often numerically solved by means of proximal gradient methods. In this paper, we consider fully nonconvex composite problems under only local Lipschitz gradient continuity for the smooth part of the objective function. We investigate an adaptive scheme for PANOC-type methods (Stella et al. in Proceedings o…
▽ More
Composite optimization offers a powerful modeling tool for a variety of applications and is often numerically solved by means of proximal gradient methods. In this paper, we consider fully nonconvex composite problems under only local Lipschitz gradient continuity for the smooth part of the objective function. We investigate an adaptive scheme for PANOC-type methods (Stella et al. in Proceedings of the IEEE 56th CDC, 1939--1944, 2017), namely accelerated linesearch algorithms requiring only the simple oracle of proximal gradient. While including the classical proximal gradient method, our theoretical results cover a broader class of algorithms and provide convergence guarantees for accelerated methods with possibly inexact computation of the proximal map**. These findings have also significant practical impact, as they widen scope and performance of existing, and possibly future, general purpose optimization software that invoke PANOC as inner solver.
△ Less
Submitted 18 April, 2022; v1 submitted 24 December, 2021;
originally announced December 2021.
