Showing 1–1 of 1 results for author: Brack, S
-
Bayesian Metric Learning for Uncertainty Quantification in Image Retrieval
Authors:
Frederik Warburg,
Marco Miani,
Silas Brack,
Soren Hauberg
Abstract:
We propose the first Bayesian encoder for metric learning. Rather than relying on neural amortization as done in prior works, we learn a distribution over the network weights with the Laplace Approximation. We actualize this by first proving that the contrastive loss is a valid log-posterior. We then propose three methods that ensure a positive definite Hessian. Lastly, we present a novel decompos…
▽ More
We propose the first Bayesian encoder for metric learning. Rather than relying on neural amortization as done in prior works, we learn a distribution over the network weights with the Laplace Approximation. We actualize this by first proving that the contrastive loss is a valid log-posterior. We then propose three methods that ensure a positive definite Hessian. Lastly, we present a novel decomposition of the Generalized Gauss-Newton approximation. Empirically, we show that our Laplacian Metric Learner (LAM) estimates well-calibrated uncertainties, reliably detects out-of-distribution examples, and yields state-of-the-art predictive performance.
△ Less
Submitted 4 February, 2023; v1 submitted 2 February, 2023;
originally announced February 2023.
