-
Neural-network-based regularization methods for inverse problems in imaging
Authors:
Andreas Habring,
Martin Holler
Abstract:
This review provides an introduction to - and overview of - the current state of the art in neural-network based regularization methods for inverse problems in imaging. It aims to introduce readers with a solid knowledge in applied mathematics and a basic understanding of neural networks to different concepts of applying neural networks for regularizing inverse problems in imaging. Distinguishing…
▽ More
This review provides an introduction to - and overview of - the current state of the art in neural-network based regularization methods for inverse problems in imaging. It aims to introduce readers with a solid knowledge in applied mathematics and a basic understanding of neural networks to different concepts of applying neural networks for regularizing inverse problems in imaging. Distinguishing features of this review are, among others, an easily accessible introduction to learned generators and learned priors, in particular diffusion models, for inverse problems, and a section focusing explicitly on existing results in function space analysis of neural-network-based approaches in this context.
△ Less
Submitted 22 December, 2023;
originally announced December 2023.
-
Subgradient Langevin Methods for Sampling from Non-smooth Potentials
Authors:
Andreas Habring,
Martin Holler,
Thomas Pock
Abstract:
This paper is concerned with sampling from probability distributions $π$ on $\mathbb{R}^d$ admitting a density of the form $π(x) \propto e^{-U(x)}$, where $U(x)=F(x)+G(Kx)$ with $K$ being a linear operator and $G$ being non-differentiable. Two different methods are proposed, both employing a subgradient step with respect to $G\circ K$, but, depending on the regularity of $F$, either an explicit or…
▽ More
This paper is concerned with sampling from probability distributions $π$ on $\mathbb{R}^d$ admitting a density of the form $π(x) \propto e^{-U(x)}$, where $U(x)=F(x)+G(Kx)$ with $K$ being a linear operator and $G$ being non-differentiable. Two different methods are proposed, both employing a subgradient step with respect to $G\circ K$, but, depending on the regularity of $F$, either an explicit or an implicit gradient step with respect to $F$ can be implemented. For both methods, non-asymptotic convergence proofs are provided, with improved convergence results for more regular $F$. Further, numerical experiments are conducted for simple 2D examples, illustrating the convergence rates, and for examples of Bayesian imaging, showing the practical feasibility of the proposed methods for high dimensional data.
△ Less
Submitted 25 May, 2024; v1 submitted 2 August, 2023;
originally announced August 2023.
-
Posterior-Variance-Based Error Quantification for Inverse Problems in Imaging
Authors:
Dominik Narnhofer,
Andreas Habring,
Martin Holler,
Thomas Pock
Abstract:
In this work, a method for obtaining pixel-wise error bounds in Bayesian regularization of inverse imaging problems is introduced. The proposed method employs estimates of the posterior variance together with techniques from conformal prediction in order to obtain coverage guarantees for the error bounds, without making any assumption on the underlying data distribution. It is generally applicable…
▽ More
In this work, a method for obtaining pixel-wise error bounds in Bayesian regularization of inverse imaging problems is introduced. The proposed method employs estimates of the posterior variance together with techniques from conformal prediction in order to obtain coverage guarantees for the error bounds, without making any assumption on the underlying data distribution. It is generally applicable to Bayesian regularization approaches, independent, e.g., of the concrete choice of the prior. Furthermore, the coverage guarantees can also be obtained in case only approximate sampling from the posterior is possible. With this in particular, the proposed framework is able to incorporate any learned prior in a black-box manner. Guaranteed coverage without assumptions on the underlying distributions is only achievable since the magnitude of the error bounds is, in general, unknown in advance. Nevertheless, experiments with multiple regularization approaches presented in the paper confirm that in practice, the obtained error bounds are rather tight. For realizing the numerical experiments, also a novel primal-dual Langevin algorithm for sampling from non-smooth distributions is introduced in this work.
△ Less
Submitted 23 December, 2022;
originally announced December 2022.
-
Unsupervised energy disaggregation via convolutional sparse coding
Authors:
Christian Aarset,
Andreas Habring,
Martin Holler,
Mario Mitter
Abstract:
In this work, a method for unsupervised energy disaggregation in private households equipped with smart meters is proposed. This method aims to classify power consumption as active or passive, granting the ability to report on the residents' activity and presence without direct interaction. This lays the foundation for applications like non-intrusive health monitoring of private homes.
The propo…
▽ More
In this work, a method for unsupervised energy disaggregation in private households equipped with smart meters is proposed. This method aims to classify power consumption as active or passive, granting the ability to report on the residents' activity and presence without direct interaction. This lays the foundation for applications like non-intrusive health monitoring of private homes.
The proposed method is based on minimizing a suitable energy functional, for which the iPALM (inertial proximal alternating linearized minimization) algorithm is employed, demonstrating that various conditions guaranteeing convergence are satisfied.
In order to confirm feasibility of the proposed method, experiments on semi-synthetic test data sets and a comparison to existing, supervised methods are provided.
△ Less
Submitted 24 October, 2023; v1 submitted 20 July, 2022;
originally announced July 2022.
-
A Note on the Regularity of Images Generated by Convolutional Neural Networks
Authors:
Andreas Habring,
Martin Holler
Abstract:
The regularity of images generated by convolutional neural networks, such as the U-net, generative networks, or the deep image prior, is analyzed. In a resolution-independent, infinite dimensional setting, it is shown that such images, represented as functions, are always continuous and, in some circumstances, even continuously differentiable, contradicting the widely accepted modeling of sharp ed…
▽ More
The regularity of images generated by convolutional neural networks, such as the U-net, generative networks, or the deep image prior, is analyzed. In a resolution-independent, infinite dimensional setting, it is shown that such images, represented as functions, are always continuous and, in some circumstances, even continuously differentiable, contradicting the widely accepted modeling of sharp edges in images via jump discontinuities. While such statements require an infinite dimensional setting, the connection to (discretized) neural networks used in practice is made by considering the limit as the resolution approaches infinity. As practical consequence, the results of this paper in particular provide analytical evidence that basic L2 regularization of network weights might lead to over-smoothed outputs.
△ Less
Submitted 27 March, 2023; v1 submitted 22 April, 2022;
originally announced April 2022.
-
A Generative Variational Model for Inverse Problems in Imaging
Authors:
Andreas Habring,
Martin Holler
Abstract:
This paper is concerned with the development, analysis and numerical realization of a novel variational model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative convolutional neural networks; it aims to generate the unknown from variables in a latent space via multi-layer convolutions and non-linear penalties, and penalizes an as…
▽ More
This paper is concerned with the development, analysis and numerical realization of a novel variational model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative convolutional neural networks; it aims to generate the unknown from variables in a latent space via multi-layer convolutions and non-linear penalties, and penalizes an associated cost. In contrast to conventional neural-network-based approaches, however, the convolution kernels are learned directly from the measured data such that no training is required. The present work provides a mathematical analysis of the proposed model in a function space setting, including proofs for regularity and existence/stability of solutions, and convergence for vanishing noise. Moreover, in a discretized setting, a numerical algorithm for solving various types of inverse problems with the proposed model is derived. Numerical results are provided for applications in inpainting, denoising, deblurring under noise, super-resolution and JPEG decompression with multiple test images.
△ Less
Submitted 9 November, 2021; v1 submitted 26 April, 2021;
originally announced April 2021.
