Skip to main content

Showing 1–20 of 20 results for author: Lucidi, S

.
  1. arXiv:2403.17613  [pdf, other

    math.OC

    A Globally Convergent Gradient Method with Momentum

    Authors: Matteo Lapucci, Giampaolo Liuzzi, Stefano Lucidi, Marco Sciandrone

    Abstract: In this work, we consider smooth unconstrained optimization problems and we deal with the class of gradient methods with momentum, i.e., descent algorithms where the search direction is defined as a linear combination of the current gradient and the preceding search direction. This family of algorithms includes nonlinear conjugate gradient methods and Polyak's heavy-ball approach, and is thus of h… ▽ More

    Submitted 26 March, 2024; originally announced March 2024.

  2. arXiv:2402.10801  [pdf, ps, other

    math.OC

    Complexity results and active-set identification of a derivative-free method for bound-constrained problems

    Authors: Andrea Brilli, Andrea Cristofari, Giampaolo Liuzzi, Stefano Lucidi

    Abstract: In this paper, we analyze a derivative-free line search method designed for bound-constrained problems. Our analysis demonstrates that this method exhibits a worst-case complexity comparable to other derivative-free methods for unconstrained and linearly constrained problems. In particular, when minimizing a function with $n$ variables, we prove that at most ${\cal O}(nε^{-2})$ iterations are need… ▽ More

    Submitted 11 July, 2024; v1 submitted 16 February, 2024; originally announced February 2024.

  3. arXiv:2302.05278  [pdf, other

    math.OC

    A clustering heuristic to improve a derivative-free algorithm for nonsmooth optimization

    Authors: Manlio Gaudioso, Giampaolo Liuzzi, Stefano Lucidi

    Abstract: In this paper we propose an heuristic to improve the performances of the recently proposed derivative-free method for nonsmooth optimization CS-DFN. The heuristic is based on a clustering-type technique to compute a direction { which relies on an estimate of Clarke's generalized gradient} of the objective function. As such, this direction (as it is shown by the numerical experiments) is a good des… ▽ More

    Submitted 10 February, 2023; originally announced February 2023.

    MSC Class: 90C30; 90C56; 65K05; 49J52

  4. arXiv:2302.05274  [pdf, other

    math.OC

    Worst case complexity bounds for linesearch-type derivative-free algorithms

    Authors: Andrea Brilli, Morteza Kimiaei, Giampaolo Liuzzi, Stefano Lucidi

    Abstract: This paper is devoted to the analysis of worst case complexity bounds for linesearch-type derivative-free algorithms for the minimization of general non-convex smooth functions. We prove that two linesearch-type algorithms enjoy the same complexity properties which have been proved for pattern and direct search algorithms. In particular, we consider two derivative-free algorithms based on two diff… ▽ More

    Submitted 13 February, 2023; v1 submitted 10 February, 2023; originally announced February 2023.

    MSC Class: 90C56

  5. arXiv:2204.06830  [pdf, other

    math.OC

    A derivative-free approach to mixed integer constrained multiobjective nonsmooth optimization

    Authors: Giampaolo Liuzzi, Stefano Lucidi

    Abstract: In this work, we consider multiobjective optimization problems with both bound constraints on the variables and general nonlinear constraints, where objective and constraint function values can only be obtained by querying a black box. Furthermore, we consider the case where a subset of the variables can only take integer values. We propose a new linesearch-based solution method and show that it c… ▽ More

    Submitted 14 April, 2022; originally announced April 2022.

    MSC Class: 90C30; 90C11; 90C56; 65K05; 49J52

  6. arXiv:2108.05157  [pdf, other

    math.OC

    An interior point method for nonlinear constrained derivative-free optimization

    Authors: Andrea Brilli, Giampaolo Liuzzi, Stefano Lucidi

    Abstract: In this paper we consider constrained optimization problems where both the objective and constraint functions are of the black-box type. Furthermore, we assume that the nonlinear inequality constraints are non-relaxable, i.e. their values and that of the objective function cannot be computed outside of the feasible region. This situation happens frequently in practice especially in the black-box s… ▽ More

    Submitted 19 July, 2022; v1 submitted 11 August, 2021; originally announced August 2021.

    Comments: We dropped the convexity assumption to take into account that convexity is no longer required, we changed the theoretical analysis, exposition of the main algorithm has changed. We first present a simpler method and then the main algorithm. Numerical results have been a lot extended by adding some comparison

    MSC Class: 65K05; 90C30; 90C56

  7. arXiv:2108.00237  [pdf, ps, other

    math.OC

    Minimization over the l1-ball using an active-set non-monotone projected gradient

    Authors: Andrea Cristofari, Marianna De Santis, Stefano Lucidi, Francesco Rinaldi

    Abstract: The l1-ball is a nicely structured feasible set that is widely used in many fields (e.g., machine learning, statistics and signal analysis) to enforce some sparsity in the model solutions. In this paper, we devise an active-set strategy for efficiently dealing with minimization problems over the l1-ball and embed it into a tailored algorithmic scheme that makes use of a non-monotone first-order ap… ▽ More

    Submitted 7 April, 2022; v1 submitted 31 July, 2021; originally announced August 2021.

    Comments: 28 pages, 2 figures

  8. arXiv:2107.00601  [pdf, other

    math.OC

    Derivative-free methods for mixed-integer nonsmooth constrained optimization

    Authors: Tommaso Giovannelli, Giampaolo Liuzzi, Stefano Lucidi, Francesco Rinaldi

    Abstract: In this paper, we consider mixed-integer nonsmooth constrained optimization problems whose objective/constraint functions are available only as the output of a black-box zeroth-order oracle (i.e., an oracle that does not provide derivative information) and we propose a new derivative-free linesearch-based algorithmic framework to suitably handle those problems. We first describe a scheme for bound… ▽ More

    Submitted 1 July, 2021; originally announced July 2021.

    MSC Class: 90C11; 90C56; 65K05

  9. arXiv:2106.06477  [pdf, other

    math.OC

    Avoiding local minima in multilayer network optimization by incremental training

    Authors: Alberto De Santis, Giampaolo Liuzzi, Stefano Lucidi, Edoardo Maria Tronci

    Abstract: Training a large multilayer neural network can present many difficulties due to the large number of useless stationary points. These points usually attract the minimization algorithm used during the training phase, which therefore results inefficient. Extending some results proposed in literature for shallow networks, we propose the mathematical characterization of a class of such stationary point… ▽ More

    Submitted 11 June, 2021; originally announced June 2021.

  10. arXiv:2105.09606  [pdf, ps, other

    math.OC

    Mixed Finite Differences Scheme for Gradient Approximation

    Authors: Marco Boresta, Tommaso Colombo, Alberto De Santis, Stefano Lucidi

    Abstract: In this paper we focus on the linear functionals defining an approximate version of the gradient of a function. These functionals are often used when dealing with optimization problems where the computation of the gradient of the objective function is costly or the objective function values are affected by some noise. These functionals have been considered to estimate the gradient of the objective… ▽ More

    Submitted 20 May, 2021; originally announced May 2021.

  11. arXiv:2104.15018  [pdf, other

    math.OC

    An augmented Lagrangian method exploiting an active-set strategy and second-order information

    Authors: Andrea Cristofari, Gianni Di Pillo, Giampaolo Liuzzi, Stefano Lucidi

    Abstract: In this paper, we consider nonlinear optimization problems with nonlinear equality constraints and bound constraints on the variables. For the solution of such problems, many augmented Lagrangian methods have been defined in the literature. Here, we propose to modify one of these algorithms, namely ALGENCAN by Andreani et al., in such a way to incorporate second-order information into the augmente… ▽ More

    Submitted 11 January, 2022; v1 submitted 30 April, 2021; originally announced April 2021.

    MSC Class: 90C30; 65K05

  12. arXiv:2102.00945  [pdf, other

    math.OC

    A simulation-based optimization approach for the calibration of a discrete event simulation model of an emergency department

    Authors: A. De Santis, T. Giovannelli, S. Lucidi, M. Messedaglia, M. Roma

    Abstract: Accurate modeling of the patient flow within an Emergency Department (ED) is required by all studies dealing with the increasing and well-known problem of overcrowding. Since Discrete Event Simulation (DES) models are often adopted with the aim of assessing solutions for reducing the impact of this worldwide phenomenon, an accurate estimation of the service time of the ED processes is necessary to… ▽ More

    Submitted 1 February, 2021; originally announced February 2021.

    Comments: 28 pages, 33 figures

  13. arXiv:2101.11138  [pdf, other

    math.OC

    Determining the optimal piecewise constant approximation for the Nonhomogeneous Poisson Process rate of Emergency Department patient arrivals

    Authors: A. De Santis, T. Giovannelli, S. Lucidi, M. Messedaglia, M. Roma

    Abstract: Modeling the arrival process to an Emergency Department (ED) is the first step of all studies dealing with the patient flow within the ED. Many of them focus on the increasing phenomenon of ED overcrowding, which is afflicting hospitals all over the world. Since Discrete Event Simulation models are often adopted with the aim to assess solutions for reducing the impact of this problem, proper nonst… ▽ More

    Submitted 26 January, 2021; originally announced January 2021.

    Comments: 27 pages, 14 figures. Submitted to Flexible Services and Manufacturing Journal

  14. arXiv:2002.12198  [pdf, ps, other

    math.OC

    Solving non-monotone equilibrium problems via a DIRECT-type approach

    Authors: Stefano Lucidi, Mauro Passacantando, Francesco Rinaldi

    Abstract: A global optimization approach for solving non-monotone equilibrium problems (EPs) is proposed. The class of (regularized) gap functions is used to reformulate any EP as a constrained global optimization program and some bounds on the Lipschitz constant of such functions are provided. The proposed global optimization approach is a combination of an improved version of the \texttt{DIRECT} algorithm… ▽ More

    Submitted 27 February, 2020; originally announced February 2020.

    Comments: Technical Report of Department of Computer Science, University of Pisa, Italy

    MSC Class: 90C26; 90C33; 90C56

  15. On global minimizers of quadratic functions with cubic regularization

    Authors: Andrea Cristofari, Tayebeh Dehghan Niri, Stefano Lucidi

    Abstract: In this paper, we analyze some theoretical properties of the problem of minimizing a quadratic function with a cubic regularization term, arising in many methods for unconstrained and constrained optimization that have been proposed in the last years. First we show that, given any stationary point that is not a global solution, it is possible to compute, in closed form, a new point with a smaller… ▽ More

    Submitted 31 August, 2018; v1 submitted 3 November, 2017; originally announced November 2017.

    Comments: Optimization Letters (2018)

  16. An Active-Set Algorithmic Framework for Non-Convex Optimization Problems over the Simplex

    Authors: Andrea Cristofari, Marianna De Santis, Stefano Lucidi, Francesco Rinaldi

    Abstract: In this paper, we describe a new active-set algorithmic framework for minimizing a non-convex function over the unit simplex. At each iteration, the method makes use of a rule for identifying active variables (i.e., variables that are zero at a stationary point) and specific directions (that we name active-set gradient related directions) satisfying a new "nonorthogonality" type of condition. We p… ▽ More

    Submitted 18 May, 2020; v1 submitted 22 March, 2017; originally announced March 2017.

    Comments: 29 pages, 3 figures

    MSC Class: 65K05; 90C06; 90C30

  17. A Two-Stage Active-Set Algorithm for Bound-Constrained Optimization

    Authors: Andrea Cristofari, Marianna De Santis, Stefano Lucidi, Francesco Rinaldi

    Abstract: In this paper, we describe a two-stage method for solving optimization problems with bound constraints. It combines the active-set estimate described in [Facchinei and Lucidi, 1995] with a modification of the non-monotone line search framework recently proposed in [De Santis et al., 2012]. In the first stage, the algorithm exploits a property of the active-set estimate that ensures a significant r… ▽ More

    Submitted 7 November, 2016; v1 submitted 28 July, 2016; originally announced July 2016.

    Comments: Journal of Optimization Theory and Applications (2016)

  18. arXiv:1512.02369  [pdf, ps, other

    math.OC

    A Feasible Active Set Method with Reoptimization for Convex Quadratic Mixed-Integer Programming

    Authors: Christoph Buchheim, Marianna De Santis, Stefano Lucidi, Francesco Rinaldi, Long Trieu

    Abstract: We propose a feasible active set method for convex quadratic programming problems with non-negativity constraints. This method is specifically designed to be embedded into a branch-and-bound algorithm for convex quadratic mixed integer programming problems. The branch-and-bound algorithm generalizes the approach for unconstrained convex quadratic integer programming proposed by Buchheim, Caprara a… ▽ More

    Submitted 8 December, 2015; originally announced December 2015.

    Comments: 22 pages, 4 figures

    MSC Class: 90C10; 90C20; 90C57

  19. arXiv:1403.1738  [pdf, ps, other

    math.OC cs.IT

    A Fast Active Set Block Coordinate Descent Algorithm for $\ell_1$-regularized least squares

    Authors: Marianna De Santis, Stefano Lucidi, Francesco Rinaldi

    Abstract: The problem of finding sparse solutions to underdetermined systems of linear equations arises in several applications (e.g. signal and image processing, compressive sensing, statistical inference). A standard tool for dealing with sparse recovery is the $\ell_1$-regularized least-squares approach that has been recently attracting the attention of many researchers. In this paper, we describe an act… ▽ More

    Submitted 9 September, 2015; v1 submitted 7 March, 2014; originally announced March 2014.

    Comments: 28 pages, 5 figures

    MSC Class: 65K05; 90C25; 90C06

  20. arXiv:1209.1907  [pdf

    physics.space-ph hep-ex physics.ins-det

    Active Radiation Shield for Space Exploration Missions (ARSSEM)

    Authors: R. Battiston, W. J. Burger, V. Calvelli, R. Musenich, V. Choutko, V. I. Datskov, A. Della Torre, F. Venditti, C. Gargiulo, G. Laurenti, S. Lucidi, S. Harrison, R. Meinke

    Abstract: One of the major issues to be solved is the protection from the effects of ionizing radiation. Exploration mission, lasting two to three years in space, represents a very significant step from the point of view of radiation protection: both the duration (up to 5 times) and the intensity (up to 5 times) of the exposure to radiation are increased at the same time with respect to mission on the ISS r… ▽ More

    Submitted 10 September, 2012; originally announced September 2012.