Showing 1–1 of 1 results for author: O'Meara, M
-
A Unified Stochastic Gradient Approach to Designing Bayesian-Optimal Experiments
Authors:
Adam Foster,
Martin Jankowiak,
Matthew O'Meara,
Yee Whye Teh,
Tom Rainforth
Abstract:
We introduce a fully stochastic gradient based approach to Bayesian optimal experimental design (BOED). Our approach utilizes variational lower bounds on the expected information gain (EIG) of an experiment that can be simultaneously optimized with respect to both the variational and design parameters. This allows the design process to be carried out through a single unified stochastic gradient as…
▽ More
We introduce a fully stochastic gradient based approach to Bayesian optimal experimental design (BOED). Our approach utilizes variational lower bounds on the expected information gain (EIG) of an experiment that can be simultaneously optimized with respect to both the variational and design parameters. This allows the design process to be carried out through a single unified stochastic gradient ascent procedure, in contrast to existing approaches that typically construct a pointwise EIG estimator, before passing this estimator to a separate optimizer. We provide a number of different variational objectives including the novel adaptive contrastive estimation (ACE) bound. Finally, we show that our gradient-based approaches are able to provide effective design optimization in substantially higher dimensional settings than existing approaches.
△ Less
Submitted 27 February, 2020; v1 submitted 1 November, 2019;
originally announced November 2019.
