-
Inverse Problems with Learned Forward Operators
Authors:
Simon Arridge,
Andreas Hauptmann,
Yury Korolev
Abstract:
Solving inverse problems requires the knowledge of the forward operator, but accurate models can be computationally expensive and hence cheaper variants that do not compromise the reconstruction quality are desired. This chapter reviews reconstruction methods in inverse problems with learned forward operators that follow two different paradigms. The first one is completely agnostic to the forward…
▽ More
Solving inverse problems requires the knowledge of the forward operator, but accurate models can be computationally expensive and hence cheaper variants that do not compromise the reconstruction quality are desired. This chapter reviews reconstruction methods in inverse problems with learned forward operators that follow two different paradigms. The first one is completely agnostic to the forward operator and learns its restriction to the subspace spanned by the training data. The framework of regularisation by projection is then used to find a reconstruction. The second one uses a simplified model of the physics of the measurement process and only relies on the training data to learn a model correction. We present the theory of these two approaches and compare them numerically. A common theme emerges: both methods require, or at least benefit from, training data not only for the forward operator, but also for its adjoint.
△ Less
Submitted 18 March, 2024; v1 submitted 21 November, 2023;
originally announced November 2023.
-
A sparse optimization approach to infinite infimal convolution regularization
Authors:
Kristian Bredies,
Marcello Carioni,
Martin Holler,
Yury Korolev,
Carola-Bibiane Schönlieb
Abstract:
In this paper we introduce the class of infinite infimal convolution functionals and apply these functionals to the regularization of ill-posed inverse problems. The proposed regularization involves an infimal convolution of a continuously parametrized family of convex, positively one-homogeneous functionals defined on a common Banach space $X$. We show that, under mild assumptions, this functiona…
▽ More
In this paper we introduce the class of infinite infimal convolution functionals and apply these functionals to the regularization of ill-posed inverse problems. The proposed regularization involves an infimal convolution of a continuously parametrized family of convex, positively one-homogeneous functionals defined on a common Banach space $X$. We show that, under mild assumptions, this functional admits an equivalent convex lifting in the space of measures with values in $X$. This reformulation allows us to prove well-posedness of a Tikhonov regularized inverse problem and opens the door to a sparse analysis of the solutions. In the case of finite-dimensional measurements we prove a representer theorem, showing that there exists a solution of the inverse problem that is sparse, in the sense that it can be represented as a linear combination of the extremal points of the ball of the lifted infinite infimal convolution functional. Then, we design a generalized conditional gradient method for computing solutions of the inverse problem without relying on an a priori discretization of the parameter space and of the Banach space $X$. The iterates are constructed as linear combinations of the extremal points of the lifted infinite infimal convolution functional. We prove a sublinear rate of convergence for our algorithm and apply it to denoising of signals and images using, as regularizer, infinite infimal convolutions of fractional-Laplacian-type operators with adaptive orders of smoothness and anisotropies.
△ Less
Submitted 17 April, 2023;
originally announced April 2023.
-
Unsupervised Learning of the Total Variation Flow
Authors:
Tamara G. Grossmann,
Sören Dittmer,
Yury Korolev,
Carola-Bibiane Schönlieb
Abstract:
The total variation (TV) flow generates a scale-space representation of an image based on the TV functional. This gradient flow observes desirable features for images, such as sharp edges and enables spectral, scale, and texture analysis. Solving the TV flow is challenging; one reason is the the non-uniqueness of the subgradients. The standard numerical approach for TV flow requires solving multip…
▽ More
The total variation (TV) flow generates a scale-space representation of an image based on the TV functional. This gradient flow observes desirable features for images, such as sharp edges and enables spectral, scale, and texture analysis. Solving the TV flow is challenging; one reason is the the non-uniqueness of the subgradients. The standard numerical approach for TV flow requires solving multiple non-smooth optimisation problems. Even with state-of-the-art convex optimisation techniques, this is often prohibitively expensive and strongly motivates the use of alternative, faster approaches. Inspired by and extending the framework of physics-informed neural networks (PINNs), we propose the TVflowNET, an unsupervised neural network approach, to approximate the solution of the TV flow given an initial image and a time instance. The TVflowNET requires no ground truth data but rather makes use of the PDE for optimisation of the network parameters. We circumvent the challenges related to the non-uniqueness of the subgradients by additionally learning the related diffusivity term. Our approach significantly speeds up the computation time and we show that the TVflowNET approximates the TV flow solution with high fidelity for different image sizes and image types. Additionally, we give a full comparison of different network architecture designs as well as training regimes to underscore the effectiveness of our approach.
△ Less
Submitted 22 April, 2024; v1 submitted 9 June, 2022;
originally announced June 2022.
-
Gaussian random fields on non-separable Banach spaces
Authors:
Yury Korolev,
Jonas Latz,
Carola-Bibiane Schönlieb
Abstract:
We study Gaussian random fields on certain Banach spaces and investigate conditions for their existence. Our results apply inter alia to spaces of Radon measures and Hölder functions. In the former case, we are able to define Gaussian white noise on the space of measures directly, avoiding, e.g., an embedding into a negative-order Sobolev space. In the latter case, we demonstrate how Hölder regula…
▽ More
We study Gaussian random fields on certain Banach spaces and investigate conditions for their existence. Our results apply inter alia to spaces of Radon measures and Hölder functions. In the former case, we are able to define Gaussian white noise on the space of measures directly, avoiding, e.g., an embedding into a negative-order Sobolev space. In the latter case, we demonstrate how Hölder regularity of the samples is controlled by that of the covariance kernel and, thus, show a connection to the Theorem of Kolmogorov-Chentsov.
△ Less
Submitted 9 March, 2022;
originally announced March 2022.
-
Image reconstruction in light-sheet microscopy: spatially varying deconvolution and mixed noise
Authors:
Bogdan Toader,
Jerome Boulanger,
Yury Korolev,
Martin O. Lenz,
James Manton,
Carola-Bibiane Schonlieb,
Leila Muresan
Abstract:
We study the problem of deconvolution for light-sheet microscopy, where the data is corrupted by spatially varying blur and a combination of Poisson and Gaussian noise. The spatial variation of the point spread function (PSF) of a light-sheet microscope is determined by the interaction between the excitation sheet and the detection objective PSF. First, we introduce a model of the image formation…
▽ More
We study the problem of deconvolution for light-sheet microscopy, where the data is corrupted by spatially varying blur and a combination of Poisson and Gaussian noise. The spatial variation of the point spread function (PSF) of a light-sheet microscope is determined by the interaction between the excitation sheet and the detection objective PSF. First, we introduce a model of the image formation process that incorporates this interaction, therefore capturing the main characteristics of this imaging modality. Then, we formulate a variational model that accounts for the combination of Poisson and Gaussian noise through a data fidelity term consisting of the infimal convolution of the single noise fidelities, first introduced in L. Calatroni et al. "Infimal convolution of data discrepancies for mixed noise removal", SIAM Journal on Imaging Sciences 10.3 (2017), 1196-1233. We establish convergence rates in a Bregman distance under a source condition for the infimal convolution fidelity and a discrepancy principle for choosing the value of the regularisation parameter. The inverse problem is solved by applying the primal-dual hybrid gradient (PDHG) algorithm in a novel way. Finally, numerical experiments performed on both simulated and real data show superior reconstruction results in comparison with other methods.
△ Less
Submitted 8 August, 2021;
originally announced August 2021.
-
Eigenvalue Problems in $\mathrm{L}^\infty$: Optimality Conditions, Duality, and Relations with Optimal Transport
Authors:
Leon Bungert,
Yury Korolev
Abstract:
In this article we characterize the $\mathrm{L}^\infty$ eigenvalue problem associated to the Rayleigh quotient $\left.{\|\nabla u\|_{\mathrm{L}^\infty}}\middle/{\|u\|_\infty}\right.$ and relate it to a divergence-form PDE, similarly to what is known for $\mathrm{L}^p$ eigenvalue problems and the $p$-Laplacian for $p<\infty$. Contrary to existing methods, which study $\mathrm{L}^\infty$-problems as…
▽ More
In this article we characterize the $\mathrm{L}^\infty$ eigenvalue problem associated to the Rayleigh quotient $\left.{\|\nabla u\|_{\mathrm{L}^\infty}}\middle/{\|u\|_\infty}\right.$ and relate it to a divergence-form PDE, similarly to what is known for $\mathrm{L}^p$ eigenvalue problems and the $p$-Laplacian for $p<\infty$. Contrary to existing methods, which study $\mathrm{L}^\infty$-problems as limits of $\mathrm{L}^p$-problems for $p\to\infty$, we develop a novel framework for analyzing the limiting problem directly using convex analysis and geometric measure theory. For this, we derive a novel fine characterization of the subdifferential of the Lipschitz-constant-functional $u\mapsto\|\nabla u\|_{\mathrm{L}^\infty}$. We show that the eigenvalue problem takes the form $λνu =-\operatorname{div}(τ\nabla_τu)$, where $ν$ and $τ$ are non-negative measures concentrated where $|u|$ respectively $|\nabla u|$ are maximal, and $\nabla_τu$ is the tangential gradient of $u$ with respect to $τ$. Lastly, we investigate a dual Rayleigh quotient whose minimizers solve an optimal transport problem associated to a generalized Kantorovich--Rubinstein norm. Our results apply to all stationary points of the Rayleigh quotient, including infinity ground states, infinity harmonic potentials, distance functions, etc., and generalize known results in the literature.
△ Less
Submitted 21 October, 2022; v1 submitted 26 July, 2021;
originally announced July 2021.
-
Two-layer neural networks with values in a Banach space
Authors:
Yury Korolev
Abstract:
We study two-layer neural networks whose domain and range are Banach spaces with separable preduals. In addition, we assume that the image space is equipped with a partial order, i.e. it is a Riesz space. As the nonlinearity we choose the lattice operation of taking the positive part; in case of $\mathbb R^d$-valued neural networks this corresponds to the ReLU activation function. We prove inverse…
▽ More
We study two-layer neural networks whose domain and range are Banach spaces with separable preduals. In addition, we assume that the image space is equipped with a partial order, i.e. it is a Riesz space. As the nonlinearity we choose the lattice operation of taking the positive part; in case of $\mathbb R^d$-valued neural networks this corresponds to the ReLU activation function. We prove inverse and direct approximation theorems with Monte-Carlo rates for a certain class of functions, extending existing results for the finite-dimensional case. In the second part of the paper, we study, from the regularisation theory viewpoint, the problem of finding optimal representations of such functions via signed measures on a latent space from a finite number of noisy observations. We discuss regularity conditions known as source conditions and obtain convergence rates in a Bregman distance for the representing measure in the regime when both the noise level goes to zero and the number of samples goes to infinity at appropriate rates.
△ Less
Submitted 9 November, 2022; v1 submitted 5 May, 2021;
originally announced May 2021.
-
Data driven reconstruction using frames and Riesz bases
Authors:
Andrea Aspri,
Leon Frischauf,
Yury Korolev,
Otmar Scherzer
Abstract:
We study the problem of regularization of inverse problems adopting a purely data driven approach, by using the similarity to the method of regularization by projection. We provide an application of a projection algorithm, utilized and applied in frames theory, as a data driven reconstruction procedure in inverse problems, generalizing the algorithm proposed by the authors in Inverse Problems 36 (…
▽ More
We study the problem of regularization of inverse problems adopting a purely data driven approach, by using the similarity to the method of regularization by projection. We provide an application of a projection algorithm, utilized and applied in frames theory, as a data driven reconstruction procedure in inverse problems, generalizing the algorithm proposed by the authors in Inverse Problems 36 (2020), n. 12, 125009, based on an orthonormalization procedure for the training pairs. We show some numerical experiments, comparing the different methods.
△ Less
Submitted 9 March, 2021;
originally announced March 2021.
-
Deeply Learned Spectral Total Variation Decomposition
Authors:
Tamara G. Grossmann,
Yury Korolev,
Guy Gilboa,
Carola-Bibiane Schönlieb
Abstract:
Non-linear spectral decompositions of images based on one-homogeneous functionals such as total variation have gained considerable attention in the last few years. Due to their ability to extract spectral components corresponding to objects of different size and contrast, such decompositions enable filtering, feature transfer, image fusion and other applications. However, obtaining this decomposit…
▽ More
Non-linear spectral decompositions of images based on one-homogeneous functionals such as total variation have gained considerable attention in the last few years. Due to their ability to extract spectral components corresponding to objects of different size and contrast, such decompositions enable filtering, feature transfer, image fusion and other applications. However, obtaining this decomposition involves solving multiple non-smooth optimisation problems and is therefore computationally highly intensive. In this paper, we present a neural network approximation of a non-linear spectral decomposition. We report up to four orders of magnitude ($\times 10,000$) speedup in processing of mega-pixel size images, compared to classical GPU implementations. Our proposed network, TVSpecNET, is able to implicitly learn the underlying PDE and, despite being entirely data driven, inherits invariances of the model based transform. To the best of our knowledge, this is the first approach towards learning a non-linear spectral decomposition of images. Not only do we gain a staggering computational advantage, but this approach can also be seen as a step towards studying neural networks that can decompose an image into spectral components defined by a user rather than a handcrafted functional.
△ Less
Submitted 21 October, 2020; v1 submitted 17 June, 2020;
originally announced June 2020.
-
Variational regularisation for inverse problems with imperfect forward operators and general noise models
Authors:
Leon Bungert,
Martin Burger,
Yury Korolev,
Carola-Bibiane Schoenlieb
Abstract:
We study variational regularisation methods for inverse problems with imperfect forward operators whose errors can be modelled by order intervals in a partial order of a Banach lattice. We carry out analysis with respect to existence and convex duality for general data fidelity terms and regularisation functionals. Both for a-priori and a-posteriori parameter choice rules, we obtain convergence ra…
▽ More
We study variational regularisation methods for inverse problems with imperfect forward operators whose errors can be modelled by order intervals in a partial order of a Banach lattice. We carry out analysis with respect to existence and convex duality for general data fidelity terms and regularisation functionals. Both for a-priori and a-posteriori parameter choice rules, we obtain convergence rates of the regularized solutions in terms of Bregman distances. Our results apply to fidelity terms such as Wasserstein distances, f-divergences, norms, as well as sums and infimal convolutions of those.
△ Less
Submitted 23 October, 2020; v1 submitted 28 May, 2020;
originally announced May 2020.
-
Structural analysis of an $L$-infinity variational problem and relations to distance functions
Authors:
Leon Bungert,
Yury Korolev,
Martin Burger
Abstract:
In this work we analyse the functional ${\cal J}(u)=\|\nabla u\|_\infty$ defined on Lipschitz functions with homogeneous Dirichlet boundary conditions. Our analysis is performed directly on the functional without the need to approximate with smooth $p$-norms. We prove that its ground states coincide with multiples of the distance function to the boundary of the domain. Furthermore, we compute the…
▽ More
In this work we analyse the functional ${\cal J}(u)=\|\nabla u\|_\infty$ defined on Lipschitz functions with homogeneous Dirichlet boundary conditions. Our analysis is performed directly on the functional without the need to approximate with smooth $p$-norms. We prove that its ground states coincide with multiples of the distance function to the boundary of the domain. Furthermore, we compute the $L^2$-subdifferential of ${\cal J}$ and characterize the distance function as unique non-negative eigenfunction of the subdifferential operator. We also study properties of general eigenfunctions, in particular their nodal sets. Furthermore, we prove that the distance function can be computed as asymptotic profile of the gradient flow of ${\cal J}$ and construct analytic solutions of fast marching type. In addition, we give a geometric characterization of the extreme points of the unit ball of ${\cal J}$.
Finally, we transfer many of these results to a discrete version of the functional defined on a finite weighted graph. Here, we analyze properties of distance functions on graphs and their gradients. The main difference between the continuum and discrete setting is that the distance function is not the unique non-negative eigenfunction on a graph.
△ Less
Submitted 13 July, 2020; v1 submitted 21 January, 2020;
originally announced January 2020.
-
Total Variation Regularisation with Spatially Variable Lipschitz Constraints
Authors:
Martin Burger,
Yury Korolev,
Simone Parisotto,
Carola-Bibiane Schönlieb
Abstract:
We introduce a first order Total Variation type regulariser that decomposes a function into a part with a given Lipschitz constant (which is also allowed to vary spatially) and a jump part. The kernel of this regulariser contains all functions whose Lipschitz constant does not exceed a given value, hence by locally adjusting this value one can determine how much variation is the reconstruction all…
▽ More
We introduce a first order Total Variation type regulariser that decomposes a function into a part with a given Lipschitz constant (which is also allowed to vary spatially) and a jump part. The kernel of this regulariser contains all functions whose Lipschitz constant does not exceed a given value, hence by locally adjusting this value one can determine how much variation is the reconstruction allowed to have. We prove regularising properties of this functional, study its connections to other Total Variation type regularisers and propose a primal dual optimisation scheme. Our numerical experiments demonstrate that the proposed first order regulariser can achieve reconstruction quality similar to that of second order regularisers such as Total Generalised Variation, while requiring significantly less computational time.
△ Less
Submitted 5 December, 2019;
originally announced December 2019.
-
Data driven regularization by projection
Authors:
Andrea Aspri,
Yury Korolev,
Otmar Scherzer
Abstract:
We study linear inverse problems under the premise that the forward operator is not at hand but given indirectly through some input-output training pairs. We demonstrate that regularization by projection and variational regularization can be formulated by using the training data only and without making use of the forward operator. We study convergence and stability of the regularized solutions in…
▽ More
We study linear inverse problems under the premise that the forward operator is not at hand but given indirectly through some input-output training pairs. We demonstrate that regularization by projection and variational regularization can be formulated by using the training data only and without making use of the forward operator. We study convergence and stability of the regularized solutions in view of T. I. Seidman. "Nonconvergence Results for the Application of Least-Squares Estimation to Ill-Posed Problems". Journal of Optimization Theory and Applications 30.4 (1980), pp. 535-547, who showed that regularization by projection is not convergent in general, by giving some insight on the generality of Seidman's nonconvergence example. Moreover, we show, analytically and numerically, that regularization by projection is indeed capable of learning linear operators, such as the Radon transform.
△ Less
Submitted 5 August, 2020; v1 submitted 25 September, 2019;
originally announced September 2019.
-
A total variation based regularizer promoting piecewise-Lipschitz reconstructions
Authors:
Martin Burger,
Yury Korolev,
Carola-Bibiane Schönlieb,
Christiane Stollenwerk
Abstract:
We introduce a new regularizer in the total variation family that promotes reconstructions with a given Lipschitz constant (which can also vary spatially). We prove regularizing properties of this functional and investigate its connections to total variation and infimal convolution type regularizers TVLp and, in particular, establish topological equivalence. Our numerical experiments show that the…
▽ More
We introduce a new regularizer in the total variation family that promotes reconstructions with a given Lipschitz constant (which can also vary spatially). We prove regularizing properties of this functional and investigate its connections to total variation and infimal convolution type regularizers TVLp and, in particular, establish topological equivalence. Our numerical experiments show that the proposed regularizer can achieve similar performance as total generalized variation while having the advantage of a very intuitive interpretation of its free parameter, which is just a local estimate of the norm of the gradient. It also provides a natural approach to spatially adaptive regularization.
△ Less
Submitted 12 March, 2019;
originally announced March 2019.
-
On mixture representations for the generalized Linnik distribution and their applications in limit theorems
Authors:
V. Yu. Korolev,
A. K. Gorshenin,
A. I. Zeifman
Abstract:
We present new mixture representations for the generalized Linnik distribution in terms of normal, Laplace, exponential and stable laws and establish the relationship between the mixing distributions in these representations. Based on these representations, we prove some limit theorems for a wide class of rather simple statistics constructed from samples with random sized including, e. g., random…
▽ More
We present new mixture representations for the generalized Linnik distribution in terms of normal, Laplace, exponential and stable laws and establish the relationship between the mixing distributions in these representations. Based on these representations, we prove some limit theorems for a wide class of rather simple statistics constructed from samples with random sized including, e. g., random sums of independent random variables with finite variances and maximum random sums, in which the generalized Linnik distribution plays the role of the limit law. Thus we demonstrate that the scheme of geometric (or, in general, negative binomial) summation is far not the only asymptotic setting (even for sums of independent random variables) in which the generalized Linnik law appears as the limit distribution.
△ Less
Submitted 6 July, 2019; v1 submitted 12 October, 2018;
originally announced October 2018.
-
On the Rate of Convergence for a Characteristic of Multidimensional Birth-Death Process
Authors:
A. I. Zeifman,
Y. A. Satin,
K. M. Kiseleva,
V. Yu. Korolev
Abstract:
We consider a multidimensional inhomogeneous birth-death process (BDP) and obtain bounds on the rate of convergence for the corresponding one-dimensional processes.
We consider a multidimensional inhomogeneous birth-death process (BDP) and obtain bounds on the rate of convergence for the corresponding one-dimensional processes.
△ Less
Submitted 7 March, 2019; v1 submitted 13 October, 2018;
originally announced October 2018.
-
A functional approach to estimation of the parameters of generalized negative binomial and gamma distributions
Authors:
Andrey K. Gorshenin,
Victor Yu. Korolev
Abstract:
The generalized negative binomial distribution (GNB) is a new flexible family of discrete distributions that are mixed Poisson laws with the mixing generalized gamma (GG) distributions. This family of discrete distributions is very wide and embraces Poisson distributions, negative binomial distributions, Sichel distributions, Weibull--Poisson distributions and many other types of distributions sup…
▽ More
The generalized negative binomial distribution (GNB) is a new flexible family of discrete distributions that are mixed Poisson laws with the mixing generalized gamma (GG) distributions. This family of discrete distributions is very wide and embraces Poisson distributions, negative binomial distributions, Sichel distributions, Weibull--Poisson distributions and many other types of distributions supplying descriptive statistics with many flexible models. These distributions seem to be very promising for the statistical description of many real phenomena. GG distributions are widely applied in signal and image processing and other practical problems. The statistical estimation of the parameters of GNB and GG distributions is quite complicated. To find estimates, the methods of moments or maximum likelihood can be used as well as two-stage grid EM-algorithms. The paper presents a methodology based on the search for the best distribution using the minimization of $\ell^p$-distances and $L^p$-metrics for GNB and GG distributions, respectively. This approach, first, allows to obtain parameter estimates without using grid methods and solving systems of nonlinear equations and, second, yields not point estimates as the methods of moments or maximum likelihood do, but the estimate for the density function. In other words, within this approach the set of decisions is not a Euclidean space, but a functional space.
△ Less
Submitted 27 June, 2018;
originally announced June 2018.
-
Convergence rates and structure of solutions of inverse problems with imperfect forward models
Authors:
Martin Burger,
Yury Korolev,
Julian Rasch
Abstract:
The goal of this paper is to further develop an approach to inverse problems with imperfect forward operators that is based on partially ordered spaces. Studying the dual problem yields useful insights into the convergence of the regularised solutions and allow us to obtain convergence rates in terms of Bregman distances - as usual in inverse problems, under an additional assumption on the exact s…
▽ More
The goal of this paper is to further develop an approach to inverse problems with imperfect forward operators that is based on partially ordered spaces. Studying the dual problem yields useful insights into the convergence of the regularised solutions and allow us to obtain convergence rates in terms of Bregman distances - as usual in inverse problems, under an additional assumption on the exact solution called the source condition. These results are obtained for general absolutely one-homogeneous functionals. In the special case of TV-based regularisation we also study the structure of regularised solutions and prove convergence of their level sets to those of an exact solution. Finally, using the developed theory, we adapt the concept of debiasing to inverse problems with imperfect operators and propose an approach to pointwise error estimation in TV-based regularisation.
△ Less
Submitted 20 November, 2018; v1 submitted 26 June, 2018;
originally announced June 2018.
-
Statistical tests for extreme precipitation volumes
Authors:
V. Yu. Korolev,
A. K. Gorshenin,
K. P. Belyaev
Abstract:
The approaches, based on the negative binomial model for the distribution of duration of the wet periods measured in days, are proposed to the definition of extreme precipitation. This model demonstrates excellent fit with real data and provides a theoretical base for the determination of asymptotic approximations to the distributions of the maximum daily precipitation volume within a wet period a…
▽ More
The approaches, based on the negative binomial model for the distribution of duration of the wet periods measured in days, are proposed to the definition of extreme precipitation. This model demonstrates excellent fit with real data and provides a theoretical base for the determination of asymptotic approximations to the distributions of the maximum daily precipitation volume within a wet period as well as the total precipitation volume over a wet period. The first approach to the definition (and determination) of extreme precipitation is based on the tempered Snedecor-Fisher distribution of the maximum daily precipitation. According to this approach, a daily precipitation volume is considered to be extreme, if it exceeds a certain (pre-defined) quantile of the tempered Snedecor--Fisher distribution. The second approach is based on that the total precipitation volume for a wet period has the gamma distribution. Hence, the hypothesis that the total precipitation volume during a certain wet period is extremely large can be formulated as the homogeneity hypothesis of a sample from the gamma distribution. Two equivalent tests are proposed for testing this hypothesis. Both of these tests deal with the relative contribution of the total precipitation volume for a wet period to the considered set (sample) of successive wet periods. Within the second approach it is possible to introduce the notions of relatively and absolutely extreme precipitation volumes. The results of the application of these tests to real data are presented yielding the conclusion that the intensity of wet periods with extreme large precipitation volume increases.
△ Less
Submitted 29 November, 2018; v1 submitted 7 February, 2018;
originally announced February 2018.
-
Image reconstruction with imperfect forward models and applications in deblurring
Authors:
Yury Korolev,
Jan Lellmann
Abstract:
We present and analyse an approach to image reconstruction problems with imperfect forward models based on partially ordered spaces - Banach lattices. In this approach, errors in the data and in the forward models are described using order intervals. The method can be characterised as the lattice analogue of the residual method, where the feasible set is defined by linear inequality constraints. T…
▽ More
We present and analyse an approach to image reconstruction problems with imperfect forward models based on partially ordered spaces - Banach lattices. In this approach, errors in the data and in the forward models are described using order intervals. The method can be characterised as the lattice analogue of the residual method, where the feasible set is defined by linear inequality constraints. The study of this feasible set is the main contribution of this paper. Convexity of this feasible set is examined in several settings and modifications for introducing additional information about the forward operator are considered. Numerical examples demonstrate the performance of the method in deblurring with errors in the blurring kernel.
△ Less
Submitted 23 October, 2017; v1 submitted 3 August, 2017;
originally announced August 2017.
-
On the asymptotic approximation to the probability distribution of extremal precipitation
Authors:
V. Yu. Korolev,
A. K. Gorshenin
Abstract:
Based on the negative binomial model for the duration of wet periods measured in days, an asymptotic approximation is proposed for the distribution of the maximum daily precipitation volume within a wet period. This approximation has the form of a scale mixture of the Frechet distribution with the gamma mixing distribution and coincides with the distribution of a positive power of a random variabl…
▽ More
Based on the negative binomial model for the duration of wet periods measured in days, an asymptotic approximation is proposed for the distribution of the maximum daily precipitation volume within a wet period. This approximation has the form of a scale mixture of the Frechet distribution with the gamma mixing distribution and coincides with the distribution of a positive power of a random variable having the Snedecor-Fisher distribution. The proof of this result is based on the representation of the negative binomial distribution as a mixed geometric (and hence, mixed Poisson) distribution and limit theorems for extreme order statistics in samples with random sizes having mixed Poisson distributions. Some analytic properties of the obtained limit distribution are described. In particular, it is demonstrated that under certain conditions the limit distribution is mixed exponential and hence, is infinitely divisible. It is shown that under the same conditions the limit distribution can be represented as a scale mixture of stable or Weibull or Pareto or folded normal laws. The corresponding product representations for the limit random variable can be used for its computer simulation. Several methods are proposed for the estimation of the parameters of the distribution of the maximum daily precipitation volume. The results of fitting this distribution to real data are presented illustrating high adequacy of the proposed model. The obtained mixture representations for the limit laws and the corresponding asymptotic approximations provide better insight into the nature of mixed probability ("Bayesian") models.
△ Less
Submitted 4 June, 2017; v1 submitted 31 May, 2017;
originally announced June 2017.
-
Statistical Analysis of Precipitation Events
Authors:
V. Yu. Korolev,
A. K. Gorshenin,
S. K. Gulev,
K. P. Belyaev,
A. A. Grusho
Abstract:
In the present paper we demonstrate the results of a statistical analysis of some characteristics of precipitation events and propose a kind of a theoretical explanation of the proposed models in terms of mixed Poisson and mixed exponential distributions based on the information-theoretical entropy reasoning. The proposed models can be also treated as the result of following the popular Bayesian a…
▽ More
In the present paper we demonstrate the results of a statistical analysis of some characteristics of precipitation events and propose a kind of a theoretical explanation of the proposed models in terms of mixed Poisson and mixed exponential distributions based on the information-theoretical entropy reasoning. The proposed models can be also treated as the result of following the popular Bayesian approach.
△ Less
Submitted 31 May, 2017;
originally announced May 2017.
-
Generalized negative binomial distributions as mixed geometric laws and related limit theorems
Authors:
V. Yu. Korolev,
A. I. Zeifman
Abstract:
In this paper we study a wide and flexible family of discrete distributions, the so-called generalized negative binomial (GNB) distributions that are mixed Poisson distributions in which the mixing laws belong to the class of generalized gamma (GG) distributions. The latter was introduced by E. W. Stacy as a special family of lifetime distributions containing gamma, exponential power and Weibull d…
▽ More
In this paper we study a wide and flexible family of discrete distributions, the so-called generalized negative binomial (GNB) distributions that are mixed Poisson distributions in which the mixing laws belong to the class of generalized gamma (GG) distributions. The latter was introduced by E. W. Stacy as a special family of lifetime distributions containing gamma, exponential power and Weibull distributions. These distributions seem to be very promising in the statistical description of many real phenomena being very convenient and almost universal models for the description of statistical regularities in discrete data. Analytic properties of GNB distributions are studied. A GG distribution is proved to be a mixed exponential distribution if and only if the shape and exponent power parameters are no greater than one. The mixing distribution is written out explicitly as a scale mixture of strictly stable laws concentrated on the nonnegative halfline. As a corollary, the representation is obtained for the GNB distribution as a mixed geometric distribution. The corresponding scheme of Bernoulli trials with random probability of success is considered. Within this scheme, a random analog of the Poisson theorem is proved establishing the convergence of mixed binomial distributions to mixed Poisson laws. Limit theorems are proved for random sums of independent random variables in which the number of summands has the GNB distribution and the summands have both light- and heavy-tailed distributions. The class of limit laws is wide enough and includes the so-called generalized variance gamma distributions. Various representations for the limit laws are obtained in terms of mixtures of Mittag-Leffler, Linnik or Laplace distributions. Some applications of GNB distributions in meteorology are discussed.
△ Less
Submitted 23 June, 2018; v1 submitted 21 March, 2017;
originally announced March 2017.
-
Bounds for the concentration functions of random sums under relaxed moment conditions
Authors:
V. Yu. Korolev,
A. V. Dorofeeva
Abstract:
Estimates are constructed for the deviation of the concentration functions of sums of independent random variables with finite variances from the folded normal distribution function without any assumptions concerning the existence of the moments of summands of higher orders. The obtained results are extended to Poisson-binomial, binomial and Poisson random sums. Under the same assumptions, the bou…
▽ More
Estimates are constructed for the deviation of the concentration functions of sums of independent random variables with finite variances from the folded normal distribution function without any assumptions concerning the existence of the moments of summands of higher orders. The obtained results are extended to Poisson-binomial, binomial and Poisson random sums. Under the same assumptions, the bounds are obtained for the approximation of the concentration functions of mixed Poisson random sums by the corresponding limit distributions. In particular, bounds are obtained for the accuracy of approximation of the concentration functions of geometric, negative binomial and Sichel random sums by the exponential, the folded variance gamma and the folded Student distribution. Numerical estimates of all the constants involved are written out explicitly.
△ Less
Submitted 9 August, 2016;
originally announced August 2016.
-
Convergence of random sums and statistics constructed from samples with random sizes to the Linnik and Mittag-Leffler distributions and their generalizations
Authors:
V. Yu. Korolev,
A. I. Zeifman
Abstract:
We present some product representations for random variables with the Linnik, Mittag-Leffler and Weibull distributions and establish the relationship between the mixing distributions in these representations. Based on these representations, we prove some limit theorems for a wide class of rather simple statistics constructed from samples with random sized including, e. g., random sums of independe…
▽ More
We present some product representations for random variables with the Linnik, Mittag-Leffler and Weibull distributions and establish the relationship between the mixing distributions in these representations. Based on these representations, we prove some limit theorems for a wide class of rather simple statistics constructed from samples with random sized including, e. g., random sums of independent random variables with finite variances, maximum random sums, extreme order statistics, in which the Linnik and Mittag-Leffler distributions play the role of limit laws. Thus we demonstrate that the scheme of geometric summation is far not the only asymptotic setting (even for sums of independent random variables) in which the Mittag-Leffler and Linnik laws appear as limit distributions. The two-sided Mittag-Leffler and one-sided Linnik distribution are introduced and also proved to be limit laws for some statistics constructed from samples with random sizes.
△ Less
Submitted 8 February, 2016;
originally announced February 2016.
-
Diffusion tensor imaging with deterministic error bounds
Authors:
Artur Gorokh,
Yury Korolev,
Tuomo Valkonen
Abstract:
Errors in the data and the forward operator of an inverse problem can be handily modelled using partial order in Banach lattices. We present some existing results of the theory of regularisation in this novel framework, where errors are represented as bounds by means of the appropriate partial order.
We apply the theory to Diffusion Tensor Imaging, where correct noise modelling is challenging: i…
▽ More
Errors in the data and the forward operator of an inverse problem can be handily modelled using partial order in Banach lattices. We present some existing results of the theory of regularisation in this novel framework, where errors are represented as bounds by means of the appropriate partial order.
We apply the theory to Diffusion Tensor Imaging, where correct noise modelling is challenging: it involves the Rician distribution and the nonlinear Stejskal-Tanner equation. Linearisation of the latter in the statistical framework would complicate the noise model even further. We avoid this using the error bounds approach, which preserves simple error structure under monotone transformations.
△ Less
Submitted 26 January, 2016; v1 submitted 7 September, 2015;
originally announced September 2015.
-
A note on functional limit theorems for compound Cox processes
Authors:
V. Yu. Korolev,
A. V. Chertok,
A. Yu. Korchagin,
E. V. Kossova,
A. I. Zeifman
Abstract:
An improved version of the functional limit theorem is proved establishing weak convergence of random walks generated by compound doubly stochastic Poisson processes (compound Cox processes) to L{é}vy processes in the Skorokhod space under more realistic moment conditions. As corollaries, theorems are proved on convergence of random walks with jumps having finite variances to L{é}vy processes with…
▽ More
An improved version of the functional limit theorem is proved establishing weak convergence of random walks generated by compound doubly stochastic Poisson processes (compound Cox processes) to L{é}vy processes in the Skorokhod space under more realistic moment conditions. As corollaries, theorems are proved on convergence of random walks with jumps having finite variances to L{é}vy processes with variance-mean mixed normal distributions, in particular, to stable L{é}vy processes, generalized hyperbolic and generalized variance-gamma L{é}vy processes.
△ Less
Submitted 9 July, 2015;
originally announced July 2015.
-
Bounds of the accuracy of the normal approximation to the distributions of random sums under relaxed moment conditions
Authors:
V. Yu. Korolev,
A. V. Dorofeeva
Abstract:
Bounds of the accuracy of the normal approximation to the distribution of a sum of independent random variables are improved under relaxed moment conditions, in particular, under the absence of moments of orders higher than the second. These results are extended to Poisson-binomial, binomial and Poisson random sums. Under the same conditions, bounds are obtained for the accuracy of the approximati…
▽ More
Bounds of the accuracy of the normal approximation to the distribution of a sum of independent random variables are improved under relaxed moment conditions, in particular, under the absence of moments of orders higher than the second. These results are extended to Poisson-binomial, binomial and Poisson random sums. Under the same conditions, bounds are obtained for the accuracy of the approximation of the distributions of mixed Poisson random sums by the corresponding limit law. In particular, these bounds are constructed for the accuracy of approximation of the distributions of geometric, negative binomial and Poisson-inverse gamma (Sichel) random sums by the Laplace, variance gamma and Student distributions, respectively. All absolute constants are written out explicitly.
△ Less
Submitted 3 July, 2015;
originally announced July 2015.
-
Statistical detection of movement activities in a human brain by separation of mixture distributions
Authors:
A. K. Gorshenin,
V. Yu. Korolev,
A. Yu. Korchagin,
T. V. Zakharova,
A. I. Zeifman
Abstract:
One of most popular experimental techniques for investigation of brain activity is the so-called method of evoked potentials: the subject repeatedly makes some movements (by his/her finger) whereas brain activity and some auxiliary signals are recorded for further analysis. The key problem is the detection of points in the myogram which correspond to the beginning of the movements. The more precis…
▽ More
One of most popular experimental techniques for investigation of brain activity is the so-called method of evoked potentials: the subject repeatedly makes some movements (by his/her finger) whereas brain activity and some auxiliary signals are recorded for further analysis. The key problem is the detection of points in the myogram which correspond to the beginning of the movements. The more precisely the points are detected, the more successfully the magnetoencephalogram is processed aiming at the identification of sensors which are closest to the activity areas. The paper proposes a statistical approach to this problem based on mixtures models which uses a specially modified method of moving separation of mixtures of probability distributions (MSM-method) to detect the start points of the finger's movements. We demonstrate the correctness of the new procedure and its advantages as compared with the method based on the notion of the myogram window variance.
△ Less
Submitted 1 March, 2015;
originally announced March 2015.
-
Modeling high-frequency order flow imbalance by functional limit theorems for two-sided risk processes
Authors:
V. Yu. Korolev,
A. V. Chertok,
A. Yu. Korchagin,
A. I. Zeifman
Abstract:
A micro-scale model is proposed for the evolution of the limit order book. Within this model, the flows of orders (claims) are described by doubly stochastic Poisson processes taking account of the stochastic character of intensities of bid and ask orders that determine the price discovery mechanism in financial markets. The process of {\it order flow imbalance} (OFI) is studied. This process is a…
▽ More
A micro-scale model is proposed for the evolution of the limit order book. Within this model, the flows of orders (claims) are described by doubly stochastic Poisson processes taking account of the stochastic character of intensities of bid and ask orders that determine the price discovery mechanism in financial markets. The process of {\it order flow imbalance} (OFI) is studied. This process is a sensitive indicator of the current state of the limit order book since time intervals between events in a limit order book are usually so short that price changes are relatively infrequent events. Therefore price changes provide a very coarse and limited description of market dynamics at time micro-scales. The OFI process tracks best bid and ask queues and change much faster than prices. It incorporates information about build-ups and depletions of order queues so that it can be used to interpolate market dynamics between price changes and to track the toxicity of order flows. The {\it two-sided risk processes} are suggested as mathematical models of the OFI process.
△ Less
Submitted 8 December, 2014; v1 submitted 6 October, 2014;
originally announced October 2014.
-
On convergence of the distributions of statistics with random sample sizes to normal variance-mean mixtures
Authors:
V. Yu. Korolev,
A. I. Zeifman
Abstract:
We prove a general transfer theorem for multivariate random sequences with independent random indexes in the double array limit setting. We also prove its partial inverse providing necessary and sufficient conditions for the convergence of randomly indexed random sequences. Special attention is paid to the case where the elements of the basic double array are formed as statistics constructed from…
▽ More
We prove a general transfer theorem for multivariate random sequences with independent random indexes in the double array limit setting. We also prove its partial inverse providing necessary and sufficient conditions for the convergence of randomly indexed random sequences. Special attention is paid to the case where the elements of the basic double array are formed as statistics constructed from samples with random sizes. Under rather natural conditions we prove the theorem on convergence of the distributions of such statistics to normal variance-mean mixtures.
△ Less
Submitted 18 February, 2015; v1 submitted 4 October, 2014;
originally announced October 2014.
-
On convergence of the distributions of random sequences with independent random indexes to variance-mean mixtures
Authors:
V. Yu. Korolev,
A. I. Zeifman
Abstract:
We prove a version of a general transfer theorem for random sequences with independent random indexes in the double array limit setting under relaxed conditions. We also prove its partial inverse providing the necessary and sufficient conditions for the convergence of randomly indexed random sequences. Special attention is paid to the case where the elements of the basic double array are formed as…
▽ More
We prove a version of a general transfer theorem for random sequences with independent random indexes in the double array limit setting under relaxed conditions. We also prove its partial inverse providing the necessary and sufficient conditions for the convergence of randomly indexed random sequences. Special attention is paid to the case where the elements of the basic double array are formed as cumulative sums of independent not necessarily identically distributed random variables. Using simple moment-type conditions we prove the theorem on convergence of the distributions of such sums to normal variance-mean mixtures.
△ Less
Submitted 6 September, 2015; v1 submitted 4 October, 2014;
originally announced October 2014.
-
On the kinetic equation approach to pair production by time-dependent electric field
Authors:
A. M. Fedotov,
E. G. Gelfer,
K. Yu. Korolev,
S. A. Smolyansky
Abstract:
We investigate the quantum kinetic approach to pair production from vacuum by time-dependent electric field. Equivalence between this approach and the more familiar S-matrix approach is explicitly established for both scalar and fermion cases. For the particular case of a constant electric field exact solution for kinetic equations is provided and the accuracy of low-density approximation is estim…
▽ More
We investigate the quantum kinetic approach to pair production from vacuum by time-dependent electric field. Equivalence between this approach and the more familiar S-matrix approach is explicitly established for both scalar and fermion cases. For the particular case of a constant electric field exact solution for kinetic equations is provided and the accuracy of low-density approximation is estimated.
△ Less
Submitted 12 August, 2010;
originally announced August 2010.
-
Exact analytical expression for the electromagnetic field in a focused laser beam or pulse
Authors:
Alexander M. Fedotov,
Konstantin Yu. Korolev,
Maxim V. Legkov
Abstract:
We present a new class of exact nonsingular solutions for the Maxwell equations in vacuum, which describe the electromagnetic field of the counterpropagating focused laser beams and the subperiod focused laser pulse. These solutions are derived by the use of a modification of the "complex source method", investigated and visualized.
We present a new class of exact nonsingular solutions for the Maxwell equations in vacuum, which describe the electromagnetic field of the counterpropagating focused laser beams and the subperiod focused laser pulse. These solutions are derived by the use of a modification of the "complex source method", investigated and visualized.
△ Less
Submitted 18 May, 2007;
originally announced May 2007.
