-
LineWalker: Line Search for Black Box Derivative-Free Optimization and Surrogate Model Construction
Authors:
Dimitri J. Papageorgiou,
Jan Kronqvist,
Krishnan Kumaran
Abstract:
This paper describes a simple, but effective sampling method for optimizing and learning a discrete approximation (or surrogate) of a multi-dimensional function along a one-dimensional line segment of interest. The method does not rely on derivative information and the function to be learned can be a computationally-expensive ``black box'' function that must be queried via simulation or other mean…
▽ More
This paper describes a simple, but effective sampling method for optimizing and learning a discrete approximation (or surrogate) of a multi-dimensional function along a one-dimensional line segment of interest. The method does not rely on derivative information and the function to be learned can be a computationally-expensive ``black box'' function that must be queried via simulation or other means. It is assumed that the underlying function is noise-free and smooth, although the algorithm can still be effective when the underlying function is piecewise smooth. The method constructs a smooth surrogate on a set of equally-spaced grid points by evaluating the true function at a sparse set of judiciously chosen grid points. At each iteration, the surrogate's non-tabu local minima and maxima are identified as candidates for sampling. Tabu search constructs are also used to promote diversification. If no non-tabu extrema are identified, a simple exploration step is taken by sampling the midpoint of the largest unexplored interval. The algorithm continues until a user-defined function evaluation limit is reached. Numerous examples are shown to illustrate the algorithm's efficacy and superiority relative to state-of-the-art methods, including Bayesian optimization and NOMAD, on primarily nonconvex test functions.
△ Less
Submitted 19 July, 2023;
originally announced July 2023.
-
The Machine Learning for Combinatorial Optimization Competition (ML4CO): Results and Insights
Authors:
Maxime Gasse,
Quentin Cappart,
Jonas Charfreitag,
Laurent Charlin,
Didier Chételat,
Antonia Chmiela,
Justin Dumouchelle,
Ambros Gleixner,
Aleksandr M. Kazachkov,
Elias Khalil,
Pawel Lichocki,
Andrea Lodi,
Miles Lubin,
Chris J. Maddison,
Christopher Morris,
Dimitri J. Papageorgiou,
Augustin Parjadis,
Sebastian Pokutta,
Antoine Prouvost,
Lara Scavuzzo,
Giulia Zarpellon,
Linxin Yang,
Sha Lai,
Akang Wang,
Xiaodong Luo
, et al. (16 additional authors not shown)
Abstract:
Combinatorial optimization is a well-established area in operations research and computer science. Until recently, its methods have focused on solving problem instances in isolation, ignoring that they often stem from related data distributions in practice. However, recent years have seen a surge of interest in using machine learning as a new approach for solving combinatorial problems, either dir…
▽ More
Combinatorial optimization is a well-established area in operations research and computer science. Until recently, its methods have focused on solving problem instances in isolation, ignoring that they often stem from related data distributions in practice. However, recent years have seen a surge of interest in using machine learning as a new approach for solving combinatorial problems, either directly as solvers or by enhancing exact solvers. Based on this context, the ML4CO aims at improving state-of-the-art combinatorial optimization solvers by replacing key heuristic components. The competition featured three challenging tasks: finding the best feasible solution, producing the tightest optimality certificate, and giving an appropriate solver configuration. Three realistic datasets were considered: balanced item placement, workload apportionment, and maritime inventory routing. This last dataset was kept anonymous for the contestants.
△ Less
Submitted 17 March, 2022; v1 submitted 4 March, 2022;
originally announced March 2022.
-
Pooling problems under perfect and imperfect competition
Authors:
Dimitri J. Papageorgiou,
Stuart M. Harwood,
Francisco Trespalacios
Abstract:
We investigate pooling problems in which multiple players vie with one another to maximize individual profit in a non-cooperative competitive market. This competitive setting is interesting and worthy of study because the majority of prevailing process systems engineering models largely overlook the non-cooperative strategies that exist in real-world markets. In this work, each player controls a p…
▽ More
We investigate pooling problems in which multiple players vie with one another to maximize individual profit in a non-cooperative competitive market. This competitive setting is interesting and worthy of study because the majority of prevailing process systems engineering models largely overlook the non-cooperative strategies that exist in real-world markets. In this work, each player controls a processing network involving intermediate tanks (or pools) where raw materials are blended together before being further combined into final products. Each player then solves a pure or mixed-integer bilinear optimization problem whose profit is influenced by other players. We present several bilevel formulations and numerical results of a novel decomposition algorithm.
△ Less
Submitted 23 November, 2022; v1 submitted 6 October, 2021;
originally announced October 2021.
-
A Note on Solving Discretely-Constrained Nash-Cournot Games via Complementarity
Authors:
Dimitri J. Papageorgiou,
Francisco Trespalacios,
Stuart Harwood
Abstract:
Discretely-constrained Nash-Cournot games have attracted attention as they arise in various competitive energy production settings in which players must make one or more discrete decisions. Gabriel et al. ["Solving discretely-constrained Nash-Cournot games with an application to power markets." Networks and Spatial Economics 13(3), 2013] claim that the set of equilibria to a discretely-constrained…
▽ More
Discretely-constrained Nash-Cournot games have attracted attention as they arise in various competitive energy production settings in which players must make one or more discrete decisions. Gabriel et al. ["Solving discretely-constrained Nash-Cournot games with an application to power markets." Networks and Spatial Economics 13(3), 2013] claim that the set of equilibria to a discretely-constrained Nash-Cournot game coincides with the set of solutions to a corresponding discretely-constrained mixed complementarity problem. We show that this claim is false.
△ Less
Submitted 28 February, 2020;
originally announced March 2020.
-
A note on semi-infinite program bounding methods
Authors:
Stuart M. Harwood,
Dimitri J. Papageorgiou,
Francisco Trespalacios
Abstract:
Semi-infinite programs are a class of mathematical optimization problems with a finite number of decision variables and infinite constraints. As shown by Blankenship and Falk (Blankenship and Falk. "Infinitely constrained optimization problems." Journal of Optimization Theory and Applications 19.2 (1976): 261-281.), a sequence of lower bounds which converges to the optimal objective value may be o…
▽ More
Semi-infinite programs are a class of mathematical optimization problems with a finite number of decision variables and infinite constraints. As shown by Blankenship and Falk (Blankenship and Falk. "Infinitely constrained optimization problems." Journal of Optimization Theory and Applications 19.2 (1976): 261-281.), a sequence of lower bounds which converges to the optimal objective value may be obtained with specially constructed finite approximations of the constraint set. In (Mitsos. "Global optimization of semi-infinite programs via restriction of the right-hand side." Optimization 60.10-11 (2011): 1291-1308.), it is claimed that a modification of this lower bounding method involving approximate solution of the lower-level program yields convergent lower bounds. We show with a counterexample that this claim is false, and discuss what kind of approximate solution of the lower-level program is sufficient for correct behavior.
△ Less
Submitted 3 December, 2019;
originally announced December 2019.
-
Hybrid Strategies using Linear and Piecewise-Linear Decision Rules for Multistage Adaptive Linear Optimization
Authors:
Said Rahal,
Dimitri J. Papageorgiou,
Zukui Li
Abstract:
Decision rules offer a rich and tractable framework for solving certain classes of multistage adaptive optimization problems. Recent literature has shown the promise of using linear and nonlinear decision rules in which wait-and-see decisions are represented as functions, whose parameters are decision variables to be optimized, of the underlying uncertain parameters. Despite this growing success,…
▽ More
Decision rules offer a rich and tractable framework for solving certain classes of multistage adaptive optimization problems. Recent literature has shown the promise of using linear and nonlinear decision rules in which wait-and-see decisions are represented as functions, whose parameters are decision variables to be optimized, of the underlying uncertain parameters. Despite this growing success, solving real-world stochastic optimization problems can become computationally prohibitive when using nonlinear decision rules, and in some cases, linear ones. Consequently, decision rules that offer a competitive trade-off between solution quality and computational time become more attractive. Whereas the extant research has always used homogeneous decision rules, the major contribution of this paper is a computational exploration of hybrid decision rules. We first verify empirically that having higher uncertainty resolution or more linear pieces in early stages is more significant than having it in late stages in terms of solution quality. Then we conduct a comprehensive computational study for non-increasing (i.e., higher uncertainty resolution in early stages) and non-decreasing (i.e., higher uncertainty resolution in late stages) hybrid decision rules to illustrate the trade-off between solution quality and computational cost. We also demonstrate a case where a linear decision rule is superior to a piecewise-linear decision rule within a simulator environment, which supports the need to assess the quality of decision rules obtained from a look-ahead model within a simulator rather than just using the look-ahead model's objective function value.
△ Less
Submitted 11 December, 2018;
originally announced December 2018.
