An adaptive approach to Bayesian Optimization with switching costs
Authors:
Stefan Pricopie,
Richard Allmendinger,
Manuel Lopez-Ibanez,
Clyde Fare,
Matt Benatan,
Joshua Knowles
Abstract:
We investigate modifications to Bayesian Optimization for a resource-constrained setting of sequential experimental design where changes to certain design variables of the search space incur a switching cost. This models the scenario where there is a trade-off between evaluating more while maintaining the same setup, or switching and restricting the number of possible evaluations due to the incurr…
▽ More
We investigate modifications to Bayesian Optimization for a resource-constrained setting of sequential experimental design where changes to certain design variables of the search space incur a switching cost. This models the scenario where there is a trade-off between evaluating more while maintaining the same setup, or switching and restricting the number of possible evaluations due to the incurred cost. We adapt two process-constrained batch algorithms to this sequential problem formulation, and propose two new methods: one cost-aware and one cost-ignorant. We validate and compare the algorithms using a set of 7 scalable test functions in different dimensionalities and switching-cost settings for 30 total configurations. Our proposed cost-aware hyperparameter-free algorithm yields comparable results to tuned process-constrained algorithms in all settings we considered, suggesting some degree of robustness to varying landscape features and cost trade-offs. This method starts to outperform the other algorithms with increasing switching-cost. Our work broadens out from other recent Bayesian Optimization studies in resource-constrained settings that consider a batch setting only. While the contributions of this work are relevant to the general class of resource-constrained problems, they are particularly relevant to problems where adaptability to varying resource availability is of high importance
△ Less
Submitted 14 May, 2024;
originally announced May 2024.
Genome of Descartes Folium via Normalization
Authors:
Adrian Constantinescu,
Constantin Udriste,
Steluta Pricopie
Abstract:
The Folium of Descartes in $\mathbb{K}\times\mathbb{K}$ carries group laws, defined entirely in terms of algebraic operations over the field $\mathbb{K}$. The problems discussed in this paper include: normalization of Descartes Folium, group laws and morphisms, exotic structures, exotic structures, second exotic structure, some topologies on Descartes Folium, differential structure on Descartes Fo…
▽ More
The Folium of Descartes in $\mathbb{K}\times\mathbb{K}$ carries group laws, defined entirely in terms of algebraic operations over the field $\mathbb{K}$. The problems discussed in this paper include: normalization of Descartes Folium, group laws and morphisms, exotic structures, exotic structures, second exotic structure, some topologies on Descartes Folium, differential structure on Descartes Folium, first isomorphism of algebraic Lie groups over $\mathbb{K}$, second isomorphism of algebraic Lie groups over $\mathbb{K}$, derived structures of algebraic Lie groups, a differential/complex analytic structure on Descartes Folium, Descartes Folium as a topological field, etc. For predicting these terms, we focus on methods that exploit diagram manipulation techniques (as alternatives to algebraic method of proofs). All our results confirm that the Descartes Folium stores natural group structures, unsuspected till now.
△ Less
Submitted 9 February, 2017;
originally announced February 2017.
