-
Scalarization via utility functions in multi-objective optimization
Authors:
Lorenzo Lampariello,
Simone Sagratella,
Valerio Giuseppe Sasso,
Vladimir Shikhman
Abstract:
We study a general scalarization approach via utility functions in multi-objective optimization. It consists of maximizing utility which is obtained from the objectives' bargaining with regard to a disagreement reference point. The theoretical framework for a broad class of utility functions from microeconomics is developed. For that, we associate a utility-dependent single-objective optimization…
▽ More
We study a general scalarization approach via utility functions in multi-objective optimization. It consists of maximizing utility which is obtained from the objectives' bargaining with regard to a disagreement reference point. The theoretical framework for a broad class of utility functions from microeconomics is developed. For that, we associate a utility-dependent single-objective optimization problem with the given multi-objective optimization problem. We show that Pareto optimal points of the latter can be recovered by solving the former. In particular, Cobb-Douglas, Leontief, and CES utility functions are considered. We prove that any Pareto optimal point can be obtained as a solution of scalarization via one of the mentioned utility functions. Further, we propose a numerical scheme to solve utility-dependent single-objective optimization problems. Here, the main difficulty comes from the necessity to address constraints which are associated with a disagreement reference point. Our crucial observation is that the explicit treatment of these additional constraints may be avoided. This is the case if the Slater condition is satisfied and the utility function under consideration has the so-called barrier property. Under these assumptions, we prove the convergence of our scheme to Pareto optimal points. Numerical experiments on real-world financial datasets in a portfolio selection context confirm the efficiency of our scalarization approach via utility functions.
△ Less
Submitted 24 January, 2024;
originally announced January 2024.
-
On the solution of monotone nested variational inequalities
Authors:
Lorenzo Lampariello,
Gianluca Priori,
Simone Sagratella
Abstract:
We study nested variational inequalities, which are variational inequalities whose feasible set is the solution set of another variational inequality. We present a projected averaging Tikhonov algorithm requiring the weakest conditions in the literature to guarantee the convergence to solutions of the nested variational inequality. Specifically, we only need monotonicity of the upper- and the lowe…
▽ More
We study nested variational inequalities, which are variational inequalities whose feasible set is the solution set of another variational inequality. We present a projected averaging Tikhonov algorithm requiring the weakest conditions in the literature to guarantee the convergence to solutions of the nested variational inequality. Specifically, we only need monotonicity of the upper- and the lower-level variational inequalities. Also, we provide the first complexity analysis for nested variational inequalities considering optimality of both the upper- and lower-level.
△ Less
Submitted 17 December, 2021; v1 submitted 27 May, 2021;
originally announced May 2021.
-
Diminishing Stepsize Methods for Nonconvex Composite Problems via Ghost Penalties: from the General to the Convex Regular Constrained Case
Authors:
Francisco Facchinei,
Vyacheskav Kungurtsevb,
Lorenzo Lampariello,
Gesualdo Scutari
Abstract:
In this paper we first extend the diminishing stepsize method for nonconvex constrained problems presented in [4] to deal with equality constraints and a nonsmooth objective function of composite type. We then consider the particular case in which the constraints are convex and satisfy a standard constraint qualification and show that in this setting the algorithm can be considerably simplified, r…
▽ More
In this paper we first extend the diminishing stepsize method for nonconvex constrained problems presented in [4] to deal with equality constraints and a nonsmooth objective function of composite type. We then consider the particular case in which the constraints are convex and satisfy a standard constraint qualification and show that in this setting the algorithm can be considerably simplified, reducing the computational burden of each iteration.
△ Less
Submitted 30 July, 2020;
originally announced July 2020.
-
Ghost Penalties in Nonconvex Constrained Optimization: Diminishing Stepsizes and Iteration Complexity
Authors:
Francisco Facchinei,
Vyacheslav Kungurtsev,
Lorenzo Lampariello,
Gesualdo Scutari
Abstract:
We consider nonconvex constrained optimization problems and propose a new approach to the convergence analysis based on penalty functions. We make use of classical penalty functions in an unconventional way, in that penalty functions only enter in the theoretical analysis of convergence while the algorithm itself is penalty-free. Based on this idea, we are able to establish several new results, in…
▽ More
We consider nonconvex constrained optimization problems and propose a new approach to the convergence analysis based on penalty functions. We make use of classical penalty functions in an unconventional way, in that penalty functions only enter in the theoretical analysis of convergence while the algorithm itself is penalty-free. Based on this idea, we are able to establish several new results, including the first general analysis for diminishing stepsize methods in nonconvex, constrained optimization, showing convergence to generalized stationary points, and a complexity study for SQP-type algorithms.
△ Less
Submitted 30 May, 2020; v1 submitted 11 September, 2017;
originally announced September 2017.
-
A dominance maximization approach to portfolio selection
Authors:
Francesco Cesarone,
Lorenzo Lampariello,
Simone Sagratella
Abstract:
In the portfolio multiobjective optimization framework, we propose to compare and choose, among all feasible asset portfolios of a given market, the one that maximizes the product of the distances between its values of risk and gain and those of a suitable reference point (e.g., the so-called nadir). We show that this approach has distinctive and remarkable features. While being not influenced by…
▽ More
In the portfolio multiobjective optimization framework, we propose to compare and choose, among all feasible asset portfolios of a given market, the one that maximizes the product of the distances between its values of risk and gain and those of a suitable reference point (e.g., the so-called nadir). We show that this approach has distinctive and remarkable features. While being not influenced by how the objectives are scaled, it provides one with an efficient (Pareto) portfolio that "dominates the most" with respect to the reference point. Furthermore, although our no-preference strategy generally requires the solution of a nonconvex (constrained) single-objective problem, we show how the resulting (global) optimal portfolio can be easily and efficiently computed. We also perform numerical tests based on some publicly available benchmark data sets often used in the literature, highlighting the nice properties of our approach.
△ Less
Submitted 15 January, 2018; v1 submitted 21 October, 2016;
originally announced October 2016.
-
A Bridge between Bilevel Programs and Nash Games
Authors:
Lorenzo Lampariello,
Simone Sagratella
Abstract:
We study connections between optimistic bilevel programming problems and Generalized Nash Equilibrium Problems (GNEP)s. We remark that, when addressing bilevel problems, we consider the general case in which the lower level program is not assumed to have a unique solution. Inspired by the optimal value approach, we propose a new GNEP model that is closely related to the bilevel program. We provide…
▽ More
We study connections between optimistic bilevel programming problems and Generalized Nash Equilibrium Problems (GNEP)s. We remark that, when addressing bilevel problems, we consider the general case in which the lower level program is not assumed to have a unique solution. Inspired by the optimal value approach, we propose a new GNEP model that is closely related to the bilevel program. We provide a complete analysis of the relationship between the "vertical" bilevel problem and the corresponding "horizontal" (one-level) GNEP model. We define classes of problems for which solutions of the bilevel program can be computed by finding equilibria of the GNEP. We develop a simple algorithm, which turns out to be globally convergent, for the solution of classes of our GNEP; we study how it is then possible to recover a solution of the bilevel problem from the computed equilibrium. Numerical experience shows the effectiveness of our approach, even when addressing big nonlinear bilevel problems.
△ Less
Submitted 15 September, 2016; v1 submitted 22 October, 2015;
originally announced October 2015.
-
Parallel and Distributed Methods for Nonconvex Optimization-Part I: Theory
Authors:
Gesualdo Scutari,
Francisco Facchinei,
Lorenzo Lampariello,
Peiran Song
Abstract:
In this two-part paper, we propose a general algorithmic framework for the minimization of a nonconvex smooth function subject to nonconvex smooth constraints. The algorithm solves a sequence of (separable) strongly convex problems and mantains feasibility at each iteration. Convergence to a stationary solution of the original nonconvex optimization is established. Our framework is very general an…
▽ More
In this two-part paper, we propose a general algorithmic framework for the minimization of a nonconvex smooth function subject to nonconvex smooth constraints. The algorithm solves a sequence of (separable) strongly convex problems and mantains feasibility at each iteration. Convergence to a stationary solution of the original nonconvex optimization is established. Our framework is very general and flexible; it unifies several existing Successive Convex Approximation (SCA)-based algorithms such as (proximal) gradient or Newton type methods, block coordinate (parallel) descent schemes, difference of convex functions methods, and improves on their convergence properties. More importantly, and differently from current SCA approaches, it naturally leads to distributed and parallelizable implementations for a large class of nonconvex problems.
This Part I is devoted to the description of the framework in its generality. In Part II we customize our general methods to several multi-agent optimization problems, mainly in communications and networking; the result is a new class of (distributed) algorithms that compare favorably to existing ad-hoc (centralized) schemes (when they exist).
△ Less
Submitted 14 January, 2016; v1 submitted 17 October, 2014;
originally announced October 2014.