-
Learning Adaptive Regularization for Image Labeling Using Geometric Assignment
Authors:
Ruben Hühnerbein,
Fabrizio Savarino,
Stefania Petra,
Christoph Schnörr
Abstract:
We study the inverse problem of model parameter learning for pixelwise image labeling, using the linear assignment flow and training data with ground truth. This is accomplished by a Riemannian gradient flow on the manifold of parameters that determine the regularization properties of the assignment flow. Using the symplectic partitioned Runge--Kutta method for numerical integration, it is shown t…
▽ More
We study the inverse problem of model parameter learning for pixelwise image labeling, using the linear assignment flow and training data with ground truth. This is accomplished by a Riemannian gradient flow on the manifold of parameters that determine the regularization properties of the assignment flow. Using the symplectic partitioned Runge--Kutta method for numerical integration, it is shown that deriving the sensitivity conditions of the parameter learning problem and its discretization commute. A convenient property of our approach is that learning is based on exact inference. Carefully designed experiments demonstrate the performance of our approach, the expressiveness of the mathematical model as well as its limitations, from the viewpoint of statistical learning and optimal control.
△ Less
Submitted 25 June, 2020; v1 submitted 22 October, 2019;
originally announced October 2019.
-
Continuous-Domain Assignment Flows
Authors:
Fabrizio Savarino,
Christoph Schnörr
Abstract:
Assignment flows denote a class of dynamical models for contextual data labeling (classification) on graphs. We derive a novel parametrization of assignment flows that reveals how the underlying information geometry induces two processes for assignment regularization and for gradually enforcing unambiguous decisions, respectively, that seamlessly interact when solving for the flow. Our result enab…
▽ More
Assignment flows denote a class of dynamical models for contextual data labeling (classification) on graphs. We derive a novel parametrization of assignment flows that reveals how the underlying information geometry induces two processes for assignment regularization and for gradually enforcing unambiguous decisions, respectively, that seamlessly interact when solving for the flow. Our result enables to characterize the dominant part of the assignment flow as a Riemannian gradient flow with respect to the underlying information geometry. We consider a continuous-domain formulation of the corresponding potential and develop a novel algorithm in terms of solving a sequence of linear elliptic PDEs subject to a simple convex constraint. Our result provides a basis for addressing learning problems by controlling such PDEs in future work.
△ Less
Submitted 16 October, 2019;
originally announced October 2019.
-
Image Labeling Based on Graphical Models Using Wasserstein Messages and Geometric Assignment
Authors:
Ruben Hühnerbein,
Fabrizio Savarino,
Freddie Åström,
Christoph Schnörr
Abstract:
We introduce a novel approach to Maximum A Posteriori inference based on discrete graphical models. By utilizing local Wasserstein distances for coupling assignment measures across edges of the underlying graph, a given discrete objective function is smoothly approximated and restricted to the assignment manifold. A corresponding multiplicative update scheme combines in a single process (i) geomet…
▽ More
We introduce a novel approach to Maximum A Posteriori inference based on discrete graphical models. By utilizing local Wasserstein distances for coupling assignment measures across edges of the underlying graph, a given discrete objective function is smoothly approximated and restricted to the assignment manifold. A corresponding multiplicative update scheme combines in a single process (i) geometric integration of the resulting Riemannian gradient flow and (ii) rounding to integral solutions that represent valid labelings. Throughout this process, local marginalization constraints known from the established LP relaxation are satisfied, whereas the smooth geometric setting results in rapidly converging iterations that can be carried out in parallel for every edge.
△ Less
Submitted 9 January, 2018; v1 submitted 4 October, 2017;
originally announced October 2017.