-
Probability-graphons: Limits of large dense weighted graphs
Authors:
Romain Abraham,
Jean-François Delmas,
Julien Weibel
Abstract:
We introduce probability-graphons which are probability kernels that generalize graphons to the case of weighted graphs. Probability-graphons appear as the limit objects to study sequences of large weighted graphs whose distribution of subgraph sampling converge. The edge-weights are taken from a general Polish space, which also covers the case of decorated graphs. Here, graphs can be either direc…
▽ More
We introduce probability-graphons which are probability kernels that generalize graphons to the case of weighted graphs. Probability-graphons appear as the limit objects to study sequences of large weighted graphs whose distribution of subgraph sampling converge. The edge-weights are taken from a general Polish space, which also covers the case of decorated graphs. Here, graphs can be either directed or undirected. Starting from a distance $d_m$ inducing the weak topology on measures, we define a cut distance on probability-graphons, making it a Polish space, and study the properties of this cut distance. In particular, we exhibit a tightness criterion for probability-graphons related to relative compactness in the cut distance. We also prove that under some conditions on the distance $d_m$, which are satisfied for some well-know distances like the Prohorov distance, and the Fortet-Mourier and Kantorovitch-Rubinstein norms, the topology induced by the cut distance on the spaceof probability-graphons is independent from the choice of $d_m$. Eventually, we prove that this topology coincides with the topology induced by the convergence in distribution of the sampled subgraphs.
△ Less
Submitted 26 December, 2023;
originally announced December 2023.
-
Simultaneous off-the-grid learning of mixtures issued from a continuous dictionary
Authors:
Cristina Butucea,
Jean-François Delmas,
Anne Dutfoy,
Clément Hardy
Abstract:
In this paper we observe a set, possibly a continuum, of signals corrupted by noise. Each signal is a finite mixture of an unknown number of features belonging to a continuous dictionary. The continuous dictionary is parametrized by a real non-linear parameter. We shall assume that the signals share an underlying structure by assuming that each signal has its active features included in a finite a…
▽ More
In this paper we observe a set, possibly a continuum, of signals corrupted by noise. Each signal is a finite mixture of an unknown number of features belonging to a continuous dictionary. The continuous dictionary is parametrized by a real non-linear parameter. We shall assume that the signals share an underlying structure by assuming that each signal has its active features included in a finite and sparse set. We formulate regularized optimization problem to estimate simultaneously the linear coefficients in the mixtures and the non-linear parameters of the features. The optimization problem is composed of a data fidelity term and a $(\ell_1,L^p)$-penalty. We call its solution the Group-Nonlinear-Lasso and provide high probability bounds on the prediction error using certificate functions. Following recent works on the geometry of off-the-grid methods, we show that such functions can be constructed provided the parameters of the active features are pairwise separated by a constant with respect to a Riemannian metric.When the number of signals is finite and the noise is assumed Gaussian, we give refinements of our results for $p=1$ and $p=2$ using tail bounds on suprema of Gaussian and $χ^2$ random processes. When $p=2$, our prediction error reaches the rates obtained by the Group-Lasso estimator in the multi-task linear regression model. Furthermore, for $p=2$ these prediction rates are faster than for $p=1$ when all signals share most of the non-linear parameters.
△ Less
Submitted 23 February, 2024; v1 submitted 27 October, 2022;
originally announced October 2022.
-
Off-the-grid learning of sparse mixtures from a continuous dictionary
Authors:
Cristina Butucea,
Jean-François Delmas,
Anne Dutfoy,
Clément Hardy
Abstract:
We consider a general non-linear model where the signal is a finite mixture of an unknown, possibly increasing, number of features issued from a continuous dictionary parameterized by a real nonlinear parameter. The signal is observed with Gaussian (possibly correlated) noise in either a continuous or a discrete setup. We propose an off-the-grid optimization method, that is, a method which does no…
▽ More
We consider a general non-linear model where the signal is a finite mixture of an unknown, possibly increasing, number of features issued from a continuous dictionary parameterized by a real nonlinear parameter. The signal is observed with Gaussian (possibly correlated) noise in either a continuous or a discrete setup. We propose an off-the-grid optimization method, that is, a method which does not use any discretization scheme on the parameter space, to estimate both the non-linear parameters of the features and the linear parameters of the mixture. We use recent results on the geometry of off-the-grid methods to give minimal separation on the true underlying non-linear parameters such that interpolating certificate functions can be constructed. Using also tail bounds for suprema of Gaussian processes we bound the prediction error with high probability. Assuming that the certificate functions can be constructed, our prediction error bound is up to log --factors similar to the rates attained by the Lasso predictor in the linear regression model. We also establish convergence rates that quantify with high probability the quality of estimation for both the linear and the non-linear parameters.
△ Less
Submitted 29 June, 2022;
originally announced July 2022.
-
Slepian-Bangs formula and Cramer Rao bound for circular and non-circular complex elliptical symmetric distributions
Authors:
Habti Abeida,
Jean-Pierre Delmas
Abstract:
This paper is mainly dedicated to an extension of the Slepian-Bangs formula to non-circular complex elliptical symmetric (NC-CES) distributions, which is derived from a new stochastic representation theorem. This formula includes the non-circular complex Gaussian and the circular CES (CCES) distributions. Some general relations between the Cramer Rao bound (CRB) under CES and Gaussian distribution…
▽ More
This paper is mainly dedicated to an extension of the Slepian-Bangs formula to non-circular complex elliptical symmetric (NC-CES) distributions, which is derived from a new stochastic representation theorem. This formula includes the non-circular complex Gaussian and the circular CES (CCES) distributions. Some general relations between the Cramer Rao bound (CRB) under CES and Gaussian distributions are deduced. It is proved in particular that the Gaussian distribution does not always lead to the largest stochastic CRB (SCRB) as many authors tend to believe it. Finally a particular attention is paid to the noisy mixture where closedform expressions for the SCRBs of the parameters of interest are derived.
△ Less
Submitted 9 August, 2019;
originally announced August 2019.