A comparison of optimisation algorithms for high-dimensional particle and astrophysics applications
Authors:
The DarkMachines High Dimensional Sampling Group,
Csaba Balázs,
Melissa van Beekveld,
Sascha Caron,
Barry M. Dillon,
Ben Farmer,
Andrew Fowlie,
Eduardo C. Garrido-Merchán,
Will Handley,
Luc Hendriks,
Guðlaugur Jóhannesson,
Adam Leinweber,
Judita Mamužić,
Gregory D. Martinez,
Sydney Otten,
Pat Scott,
Roberto Ruiz de Austri,
Zachary Searle,
Bob Stienen,
Joaquin Vanschoren,
Martin White
Abstract:
Optimisation problems are ubiquitous in particle and astrophysics, and involve locating the optimum of a complicated function of many parameters that may be computationally expensive to evaluate. We describe a number of global optimisation algorithms that are not yet widely used in particle astrophysics, benchmark them against random sampling and existing techniques, and perform a detailed compari…
▽ More
Optimisation problems are ubiquitous in particle and astrophysics, and involve locating the optimum of a complicated function of many parameters that may be computationally expensive to evaluate. We describe a number of global optimisation algorithms that are not yet widely used in particle astrophysics, benchmark them against random sampling and existing techniques, and perform a detailed comparison of their performance on a range of test functions. These include four analytic test functions of varying dimensionality, and a realistic example derived from a recent global fit of weak-scale supersymmetry. Although the best algorithm to use depends on the function being investigated, we are able to present general conclusions about the relative merits of random sampling, Differential Evolution, Particle Swarm Optimisation, the Covariance Matrix Adaptation Evolution Strategy, Bayesian Optimisation, Grey Wolf Optimisation, and the PyGMO Artificial Bee Colony, Gaussian Particle Filter and Adaptive Memory Programming for Global Optimisation algorithms.
△ Less
Submitted 1 April, 2021; v1 submitted 12 January, 2021;
originally announced January 2021.
