-
A derivative-free approach to partitioned optimization
Authors:
Charles Audet,
Pierre-Yves Bouchet,
Loïc Bourdin
Abstract:
This work introduces a partitioned optimization framework (POf) to ease the solving process for optimization problems for which fixing some variables to a tunable value removes some difficulties. The variables space may be continuously partitioned into subsets where these variables are fixed to a given value, so that minimizing the objective function restricted to any of the partition sets is easi…
▽ More
This work introduces a partitioned optimization framework (POf) to ease the solving process for optimization problems for which fixing some variables to a tunable value removes some difficulties. The variables space may be continuously partitioned into subsets where these variables are fixed to a given value, so that minimizing the objective function restricted to any of the partition sets is easier than minimizing the objective function over the whole variables space. Then the major difficulty is translated from solving the original problem to choosing the partition set minimizing the minimum of the objective function restricted to this set. Hence, a local solution to the original problem is given by computing this partition set and selecting the minimizer of the objective function restricted to this set. This work formalizes this framework, studies its theoretical guarantees, and provides a numerical method to seek for an optimal partition set using a derivative-free algorithm. Some illustrative problems are presented to show how to apply the POf and to highlight the gain in numerical performance it provides.
△ Less
Submitted 6 July, 2024;
originally announced July 2024.
-
solar: A solar thermal power plant simulator for blackbox optimization benchmarking
Authors:
Nicolau Andrés-Thió,
Charles Audet,
Miguel Diago,
Aimen E. Gheribi,
Sébastien Le Digabel,
Xavier Lebeuf,
Mathieu Lemyre Garneau,
Christophe Tribes
Abstract:
This work introduces solar, a collection of ten optimization problem instances for benchmarking blackbox optimization solvers. The instances present different design aspects of a concentrated solar power plant simulated by blackbox numerical models. The type of variables (discrete or continuous), dimensionality, and number and types of constraints (including hidden constraints) differ across insta…
▽ More
This work introduces solar, a collection of ten optimization problem instances for benchmarking blackbox optimization solvers. The instances present different design aspects of a concentrated solar power plant simulated by blackbox numerical models. The type of variables (discrete or continuous), dimensionality, and number and types of constraints (including hidden constraints) differ across instances. Some are deterministic, others are stochastic with possibilities to execute several replications to control stochasticity. Most instances offer variable fidelity surrogates, two are biobjective and one is unconstrained. The solar plant model takes into account various subsystems: a heliostats field, a central cavity receiver (the receiver), a molten salt thermal energy storage, a steam generator and an idealized power block. Several numerical methods are implemented throughout the solar code and most of the executions are time-consuming. Great care was applied to guarantee reproducibility across platforms. The solar tool encompasses most of the characteristics that can be found in industrial and real-life blackbox optimization problems, all in an open-source and stand-alone code.
△ Less
Submitted 31 May, 2024;
originally announced June 2024.
-
A graph-structured distance for heterogeneous datasets with meta variables
Authors:
Edward Hallé-Hannan,
Charles Audet,
Youssef Diouane,
Sébastien Le Digabel,
Paul Saves
Abstract:
Heterogeneous datasets emerge in various machine learning or optimization applications that feature different data sources, various data types and complex relationships between variables. In practice, heterogeneous datasets are often partitioned into smaller well-behaved ones that are easier to process. However, some applications involve expensive-to-generate or limited size datasets, which motiva…
▽ More
Heterogeneous datasets emerge in various machine learning or optimization applications that feature different data sources, various data types and complex relationships between variables. In practice, heterogeneous datasets are often partitioned into smaller well-behaved ones that are easier to process. However, some applications involve expensive-to-generate or limited size datasets, which motivates methods based on the whole dataset. The first main contribution of this work is a modeling graph-structured framework that generalizes state-of-the-art hierarchical, tree-structured, or variable-size frameworks. This framework models domains that involve heterogeneous datasets in which variables may be continuous, integer, or categorical, with some identified as meta if their values determine the inclusion/exclusion or affect the bounds of other so-called decreed variables. Excluded variables are introduced to manage variables that are either included or excluded depending on the given points. The second main contribution is the graph-structured distance that compares extended points with any combination of included and excluded variables: any pair of points can be compared, allowing to work directly in heterogeneous datasets with meta variables. The contributions are illustrated with some regression experiments, in which the performance of a multilayer perceptron with respect to its hyperparameters is modeled with inverse distance weighting and $K$-nearest neighbors models.
△ Less
Submitted 20 May, 2024;
originally announced May 2024.
-
The cosine measure relative to a subspace
Authors:
Charles Audet,
Warren Hare,
Gabriel Jarry-Bolduc
Abstract:
The cosine measure was introduced in 2003 to quantify the richness of a finite positive spanning sets of directions in the context of derivative-free directional methods. A positive spanning set is a set of vectors whose nonnegative linear combinations span the whole space. The present work extends the definition of cosine measure. In particular, the paper studies cosine measures relative to a sub…
▽ More
The cosine measure was introduced in 2003 to quantify the richness of a finite positive spanning sets of directions in the context of derivative-free directional methods. A positive spanning set is a set of vectors whose nonnegative linear combinations span the whole space. The present work extends the definition of cosine measure. In particular, the paper studies cosine measures relative to a subspace,
and proposes a deterministic algorithm to compute it. The paper also studies the situation in which the set of vectors is infinite. The extended definition of the cosine measure might be useful for subspace decomposition methods.
△ Less
Submitted 17 January, 2024;
originally announced January 2024.
-
Convergence towards a local minimum by direct search methods with a covering step
Authors:
Charles Audet,
Pierre-Yves Bouchet. Loïc Bourdin
Abstract:
This paper introduces a new step to the Direct Search Method (DSM) to strengthen its convergence analysis. By design, this so-called covering step may ensure that for all refined points of the sequence of incumbent solutions generated by the resulting cDSM (covering DSM), the set of all evaluated trial points is dense in a neighborhood of that refined point. We prove that this additional property…
▽ More
This paper introduces a new step to the Direct Search Method (DSM) to strengthen its convergence analysis. By design, this so-called covering step may ensure that for all refined points of the sequence of incumbent solutions generated by the resulting cDSM (covering DSM), the set of all evaluated trial points is dense in a neighborhood of that refined point. We prove that this additional property guarantees that all refined points are local solutions to the optimization problem. This new result holds true even for discontinuous objective function, under a mild assumption that we discuss in details. We also provide a practical construction scheme for the covering step that works at low additional cost per iteration. Finally, we show that the covering step may be adapted to classes of algorithms differing from the DSM.
△ Less
Submitted 26 June, 2024; v1 submitted 13 January, 2024;
originally announced January 2024.
-
Hierarchically constrained multi-fidelity blackbox optimization
Authors:
Stéphane Alarie,
Charles Audet,
Miguel Diago,
Sébastien Le Digabel,
Xavier Lebeuf
Abstract:
This work introduces a novel multi-fidelity blackbox optimization algorithm designed to alleviate the resource-intensive task of evaluating infeasible points. This algorithm is an intermediary component bridging a direct search solver and a blackbox, resulting in reduced computation time per evaluation, all while preserving the efficiency and convergence properties of the chosen solver. This is ma…
▽ More
This work introduces a novel multi-fidelity blackbox optimization algorithm designed to alleviate the resource-intensive task of evaluating infeasible points. This algorithm is an intermediary component bridging a direct search solver and a blackbox, resulting in reduced computation time per evaluation, all while preserving the efficiency and convergence properties of the chosen solver. This is made possible by assessing feasibility through a broad range of fidelities, leveraging information from cost-effective evaluations before committing to a full computation. These feasibility estimations are generated through a hierarchical evaluation of constraints, tailored to the multi-fidelity nature of the blackbox problem, and defined by a biadjacency matrix, for which we propose a construction. A series of computational tests using the NOMAD solver on the Solar family of blackbox problems are conducted to validate the approach. The results show a significant improvement in solution quality when an initial feasible starting point is known in advance of the optimization process. When this condition is not met, the outcomes are contingent upon certain properties of the blackbox.
△ Less
Submitted 20 December, 2023;
originally announced December 2023.
-
Risk averse constrained blackbox optimization under mixed aleatory/epistemic uncertainties
Authors:
Charles Audet,
Jean Bigeon,
Romain Couderc,
Michael Kokkolaras
Abstract:
This paper addresses risk averse constrained optimization problems where the objective and constraint functions can only be computed by a blackbox subject to unknown uncertainties. To handle mixed aleatory/epistemic uncertainties, the problem is transformed into a conditional value-at-risk (CVaR) constrained optimization problem. General inequality constraints are managed through Lagrangian relaxa…
▽ More
This paper addresses risk averse constrained optimization problems where the objective and constraint functions can only be computed by a blackbox subject to unknown uncertainties. To handle mixed aleatory/epistemic uncertainties, the problem is transformed into a conditional value-at-risk (CVaR) constrained optimization problem. General inequality constraints are managed through Lagrangian relaxation. A convolution between a truncated Gaussian density and the Lagrangian function is used to smooth the problem. A gradient estimator of the smooth Lagrangian function is derived, possessing attractive properties: it estimates the gradient with only two outputs of the blackbox, regardless of dimension, and evaluates the blackbox only within the bound constraints. This gradient estimator is then utilized in a multi-timescale stochastic approximation algorithm to solve the smooth problem. Under mild assumptions, this algorithm almost surely converges to a feasible point of the CVaR-constrained problem whose objective function value is arbitrarily close to that of a local solution. Finally, numerical experiments are conducted to serve three purposes. Firstly, they provide insights on how to set the hyperparameter values of the algorithm. Secondly, they demonstrate the effectiveness of the algorithm when a truncated Gaussian gradient estimator is used. Lastly, they show its ability to handle mixed aleatory/epistemic uncertainties in practical applications.
△ Less
Submitted 17 October, 2023;
originally announced October 2023.
-
Sequential stochastic blackbox optimization with zeroth-order gradient estimators
Authors:
Charles Audet,
Jean Bigeon,
Romain Couderc,
Michael Kokkolaras
Abstract:
This work considers stochastic optimization problems in which the objective function values can only be computed by a blackbox corrupted by some random noise following an unknown distribution. The proposed method is based on sequential stochastic optimization (SSO): the original problem is decomposed into a sequence of subproblems. Each of these subproblems is solved using a zeroth order version o…
▽ More
This work considers stochastic optimization problems in which the objective function values can only be computed by a blackbox corrupted by some random noise following an unknown distribution. The proposed method is based on sequential stochastic optimization (SSO): the original problem is decomposed into a sequence of subproblems. Each of these subproblems is solved using a zeroth order version of a sign stochastic gradient descent with momentum algorithm (ZO-Signum) and with an increasingly fine precision. This decomposition allows a good exploration of the space while maintaining the efficiency of the algorithm once it gets close to the solution. Under Lipschitz continuity assumption on the blackbox, a convergence rate in expectation is derived for the ZO-signum algorithm. Moreover, if the blackbox is smooth and convex or locally convex around its minima, a convergence rate to an $ε$-optimal point of the problem may be obtained for the SSO algorithm. Numerical experiments are conducted to compare the SSO algorithm with other state-of-the-art algorithms and to demonstrate its competitiveness.
△ Less
Submitted 11 August, 2023; v1 submitted 30 May, 2023;
originally announced May 2023.
-
Erratum, counterexample and an additional revealing poll step for a result of "Analysis of direct searches for discontinuous functions''
Authors:
Charles Audet,
Pierre-Yves Bouchet,
Loïc Bourdin
Abstract:
This note provides a counterexample to a theorem announced in the last part of the paper ''Analysis of direct searches for discontinuous functions'', Mathematical Programming Vol. 133, pp.~299--325, 2012. The counterexample involves an objective function $f: \mathbb{R} \to \mathbb{R}$ which satisfies all the assumptions required by the theorem but contradicts some of its conclusions. A corollary o…
▽ More
This note provides a counterexample to a theorem announced in the last part of the paper ''Analysis of direct searches for discontinuous functions'', Mathematical Programming Vol. 133, pp.~299--325, 2012. The counterexample involves an objective function $f: \mathbb{R} \to \mathbb{R}$ which satisfies all the assumptions required by the theorem but contradicts some of its conclusions. A corollary of this theorem is also affected by this counterexample. The main flaw revealed by the counterexample is the possibility that a directional direct search method (dDSM) generates a sequence of trial points $(x_k)_k$ converging to a point $x_*$ where $f$ is discontinuous and whose objective function value $f(x_*)$ is strictly less than $\lim_{k\to\infty} f(x_k)$. Moreover the dDSM generates no trial point in one of the two branches of $f$ near $x_*$. This note also investigates the proof of the theorem to highlight the inexact statements in the original paper. Finally this work concludes with a modification of the dDSM that allows to recover the properties broken by the counterexample.
△ Less
Submitted 18 December, 2022; v1 submitted 17 November, 2022;
originally announced November 2022.
-
A general mathematical framework for constrained mixed-variable blackbox optimization problems with meta and categorical variables
Authors:
Charles Audet,
Edward Hallé-Hannan,
Sébastien Le Digabel
Abstract:
A mathematical framework for modelling constrained mixed-variable optimization problems is presented in a blackbox optimization context. The framework introduces a new notation and allows solution strategies. The notation framework allows meta and categorical variables to be explicitly and efficiently modelled, which facilitates the solution of such problems. The new term meta variables is used to…
▽ More
A mathematical framework for modelling constrained mixed-variable optimization problems is presented in a blackbox optimization context. The framework introduces a new notation and allows solution strategies. The notation framework allows meta and categorical variables to be explicitly and efficiently modelled, which facilitates the solution of such problems. The new term meta variables is used to describe variables that influence which variables are acting or nonacting: meta variables may affect the number of variables and constraints. The flexibility of the solution strategies supports the main blackbox mixed-variable optimization approaches: direct search methods and surrogate-based methods (Bayesian optimization). The notation system and solution strategies are illustrated through an example of a hyperparameter optimization problem from the machine learning community.
△ Less
Submitted 2 April, 2022;
originally announced April 2022.
-
A derivative-free approach to optimal control problems with piecewise constant Mayer cost function
Authors:
P. -Y. Bouchet,
C. Audet,
L. Bourdin
Abstract:
A piecewise constant Mayer cost function is used to model optimal control problems in which the state space is partitioned into several regions, each having its own Mayer cost value. In such a context, the standard numerical methods used in optimal control theory naturally fail, due to the discontinuities and the null gradients associated with the Mayer cost function. In this paper an hybrid numer…
▽ More
A piecewise constant Mayer cost function is used to model optimal control problems in which the state space is partitioned into several regions, each having its own Mayer cost value. In such a context, the standard numerical methods used in optimal control theory naturally fail, due to the discontinuities and the null gradients associated with the Mayer cost function. In this paper an hybrid numerical method, based on both derivative-free optimization and smooth optimization techniques, is proposed to solve this class of problems. Numerical simulations are performed on some standard control systems to show the efficiency of the hybrid method, where NOMAD and IPOPT are used as, respectively, derivative-free optimization and smooth optimization solvers.
△ Less
Submitted 1 December, 2021;
originally announced December 2021.
-
Hierarchically constrained blackbox optimization
Authors:
Stéphane Alarie,
Charles Audet,
Paulin Jacquot,
Sébastien Le Digabel
Abstract:
In blackbox optimization, evaluation of the objective and constraint functions is time consuming. In some situations, constraint values may be evaluated independently or sequentially. The present work proposes and compares two strategies to define a hierarchical ordering of the constraints and to interrupt the evaluation process at a trial point when it is detected that it will not improve the cur…
▽ More
In blackbox optimization, evaluation of the objective and constraint functions is time consuming. In some situations, constraint values may be evaluated independently or sequentially. The present work proposes and compares two strategies to define a hierarchical ordering of the constraints and to interrupt the evaluation process at a trial point when it is detected that it will not improve the current best solution. Numerical experiments are performed on a closed-form test problem.
△ Less
Submitted 27 November, 2021;
originally announced November 2021.
-
The equilateral small octagon of maximal width
Authors:
Christian Bingane,
Charles Audet
Abstract:
A small polygon is a polygon of unit diameter. The maximal width of an equilateral small polygon with $n=2^s$ vertices is not known when $s \ge 3$. This paper solves the first open case and finds the optimal equilateral small octagon. Its width is approximately $3.24\%$ larger than the width of the regular octagon: $\cos(π/8)$. In addition, the paper proposes a family of equilateral small $n$-gons…
▽ More
A small polygon is a polygon of unit diameter. The maximal width of an equilateral small polygon with $n=2^s$ vertices is not known when $s \ge 3$. This paper solves the first open case and finds the optimal equilateral small octagon. Its width is approximately $3.24\%$ larger than the width of the regular octagon: $\cos(π/8)$. In addition, the paper proposes a family of equilateral small $n$-gons, for $n=2^s$ with $s\ge 4$, whose widths are within $O(1/n^4)$ of the maximal width.
△ Less
Submitted 3 February, 2022; v1 submitted 30 September, 2021;
originally announced October 2021.
-
Quantifying uncertainty with ensembles of surrogates for blackbox optimization
Authors:
Charles Audet,
Sébastien Le Digabel,
Renaud Saltet
Abstract:
This work is in the context of blackbox optimization where the functions defining the problem are expensive to evaluate and where no derivatives are available. A tried and tested technique is to build surrogates of the objective and the constraints in order to conduct the optimization at a cheaper computational cost. This work proposes different uncertainty measures when using ensembles of surroga…
▽ More
This work is in the context of blackbox optimization where the functions defining the problem are expensive to evaluate and where no derivatives are available. A tried and tested technique is to build surrogates of the objective and the constraints in order to conduct the optimization at a cheaper computational cost. This work proposes different uncertainty measures when using ensembles of surrogates. The resulting combination of an ensemble of surrogates with our measures behaves as a stochastic model and allows the use of efficient Bayesian optimization tools. The method is incorporated in the search step of the mesh adaptive direct search (MADS) algorithm to improve the exploration of the search space. Computational experiments are conducted on seven analytical problems, two multi-disciplinary optimization problems and two simulation problems. The results show that the proposed approach solves expensive simulation-based problems at a greater precision and with a lower computational effort than stochastic models.
△ Less
Submitted 9 July, 2021;
originally announced July 2021.
-
Tight bounds on the maximal perimeter of convex equilateral small polygons
Authors:
Christian Bingane,
Charles Audet
Abstract:
A small polygon is a polygon that has diameter one. The maximal perimeter of a convex equilateral small polygon with $n=2^s$ sides is not known when $s \ge 4$. In this paper, we construct a family of convex equilateral small $n$-gons, $n=2^s$ and $s \ge 4$, and show that their perimeters are within $O(1/n^4)$ of the maximal perimeter and exceed the previously best known values from the literature.…
▽ More
A small polygon is a polygon that has diameter one. The maximal perimeter of a convex equilateral small polygon with $n=2^s$ sides is not known when $s \ge 4$. In this paper, we construct a family of convex equilateral small $n$-gons, $n=2^s$ and $s \ge 4$, and show that their perimeters are within $O(1/n^4)$ of the maximal perimeter and exceed the previously best known values from the literature. In particular, for the first open case $n=16$, our result proves that Mossinghoff's equilateral hexadecagon is suboptimal.
△ Less
Submitted 25 May, 2022; v1 submitted 21 May, 2021;
originally announced May 2021.
-
NOMAD version 4: Nonlinear optimization with the MADS algorithm
Authors:
Charles Audet,
Sébastien Le Digabel,
Viviane Rochon Montplaisir,
Christophe Tribes
Abstract:
NOMAD is software for optimizing blackbox problems. In continuous development since 2001, it constantly evolved with the integration of new algorithmic features published in scientific publications. These features are motivated by real applications encountered by industrial partners. The latest major release of NOMAD, version 3, dates from 2008. Minor releases are produced as new features are inco…
▽ More
NOMAD is software for optimizing blackbox problems. In continuous development since 2001, it constantly evolved with the integration of new algorithmic features published in scientific publications. These features are motivated by real applications encountered by industrial partners. The latest major release of NOMAD, version 3, dates from 2008. Minor releases are produced as new features are incorporated. The present work describes NOMAD 4, a complete redesign of the previous version, with a new architecture providing more flexible code, added functionalities and reusable code. We introduce algorithmic components, which are building blocks for more complex algorithms, and can initiate other components, launch nested algorithms, or perform specialized tasks. They facilitate the implementation of new ideas, including the MegaSearchPoll component, warm and hot restarts, and a revised version of the PSD-MADS algorithm. Another main improvement of NOMAD 4 is the usage of parallelism, to simultaneously compute multiple blackbox evaluations, and to maximize usage of available cores. Running different algorithms, tuning their parameters, and comparing their performance for optimization is simpler than before, while overall optimization performance is maintained between versions 3 and 4. NOMAD is freely available at www.gerad.ca/nomad and the whole project is visible at github.com/bbopt/nomad.
△ Less
Submitted 3 May, 2021; v1 submitted 23 April, 2021;
originally announced April 2021.
-
Combining Cross Entropy and MADS methods for inequality constrained global optimization
Authors:
Charles Audet,
Romain Couderc,
Jean Bigeon
Abstract:
This paper proposes a way to combine the Mesh Adaptive Direct Search (MADS) algorithm with the Cross-Entropy (CE) method for non smooth constrained optimization. The CE method is used as a Search step by the MADS algorithm. The result of this combination retains the convergence properties of MADS and allows an efficient exploration in order to move away from local minima. The CE method samples tri…
▽ More
This paper proposes a way to combine the Mesh Adaptive Direct Search (MADS) algorithm with the Cross-Entropy (CE) method for non smooth constrained optimization. The CE method is used as a Search step by the MADS algorithm. The result of this combination retains the convergence properties of MADS and allows an efficient exploration in order to move away from local minima. The CE method samples trial points according to a multivariate normal distribution whose mean and standard deviation are calculated from the best points found so far. Numerical experiments show an important improvement of this method to reach the feasible region and to escape local minima.
△ Less
Submitted 11 August, 2023; v1 submitted 18 December, 2020;
originally announced December 2020.
-
Optimization of noisy blackboxes with adaptive precision
Authors:
Stéphane Alarie,
Charles Audet,
Pierre-Yves Bouchet,
Sébastien Le Digabel
Abstract:
In derivative-free and blackbox optimization, the objective function is often evaluated through the execution of a computer program seen as a blackbox. It can be noisy, in the sense that its outputs are contaminated by random errors. Sometimes, the source of these errors is identified and controllable, in the sense that it is possible to reduce the standard deviation of the stochastic noise it gen…
▽ More
In derivative-free and blackbox optimization, the objective function is often evaluated through the execution of a computer program seen as a blackbox. It can be noisy, in the sense that its outputs are contaminated by random errors. Sometimes, the source of these errors is identified and controllable, in the sense that it is possible to reduce the standard deviation of the stochastic noise it generates. A common strategy to deal with such a situation is to monotonically diminish this standard deviation, to asymptotically make it converge to zero and ensure convergence of algorithms because the noise is dismantled. This work presents MpMads, an algorithm which follows this approach. However, in practice a reduction of the standard deviation increases the computation time, and makes the optimization process long. Therefore, a second algorithm called DpMads is introduced to explore another strategy, which does not force the standard deviation to monotonically diminish. Although these strategies are proved to be theoretically equivalents, tests on analytical problems and an industrial blackbox are presented to illustrate practical differences.
△ Less
Submitted 13 November, 2019;
originally announced November 2019.
-
StoMADS: Stochastic blackbox optimization using probabilistic estimates
Authors:
Charles Audet,
Kwassi Joseph Dzahini,
Michael Kokkolaras,
Sébastien Le Digabel
Abstract:
This work introduces StoMADS, a stochastic variant of the mesh adaptive direct-search (MADS) algorithm originally developed for deterministic blackbox optimization. StoMADS considers the unconstrained optimization of an objective function f whose values can be computed only through a blackbox corrupted by some random noise following an unknown distribution. The proposed method is based on an algor…
▽ More
This work introduces StoMADS, a stochastic variant of the mesh adaptive direct-search (MADS) algorithm originally developed for deterministic blackbox optimization. StoMADS considers the unconstrained optimization of an objective function f whose values can be computed only through a blackbox corrupted by some random noise following an unknown distribution. The proposed method is based on an algorithmic framework similar to that of MADS and uses random estimates of function values obtained from stochastic observations since the exact deterministic computable version of f is not available. Such estimates are required to be accurate with a sufficiently large but fixed probability and satisfy a variance condition. The ability of the proposed algorithm to generate an asymptotically dense set of search directions is then exploited to show convergence to a Clarke stationary point of f with probability one, using martingale theory.
△ Less
Submitted 3 November, 2019;
originally announced November 2019.
-
Algorithmic construction of the subdifferential from directional derivatives
Authors:
Charles Audet,
Warren Hare
Abstract:
The subdifferential of a function is a generalization for nonsmooth functions of the concept of gradient. It is frequently used in variational analysis, particularly in the context of nonsmooth optimization. The present work proposes algorithms to reconstruct a polyhedral subdifferential of a function from the computation of finitely many directional derivatives. We provide upper bounds on the req…
▽ More
The subdifferential of a function is a generalization for nonsmooth functions of the concept of gradient. It is frequently used in variational analysis, particularly in the context of nonsmooth optimization. The present work proposes algorithms to reconstruct a polyhedral subdifferential of a function from the computation of finitely many directional derivatives. We provide upper bounds on the required number of directional derivatives when the space is $\R^1$ and $\R^2$, as well as in $\R^n$ where subdifferential is known to possess at most three vertices.
△ Less
Submitted 9 September, 2016;
originally announced September 2016.
