Showing 1–33 of 33 results for author: Chainais, P

Bias versus variance when fitting multi-species molecular lines with a non-LTE radiative transfer model

Authors: Antoine Roueff, Jérôme Pety, Maryvonne Gerin, Léontine Ségal, Javier Goicoechea, Harvey Liszt, Pierre Gratier, Ivana Bešlić, Lucas Einig, M. Gaudel, Jan Orkisz, Pierre Palud, Miriam Santa-Maria, Victor de Souza Magalhaes, Antoine Zakardjian, Sebastien Bardeau, Emeric E. Bron, Pierre Chainais, Simon Coudé, Karine Demyk, Viviana Guzman Veloso, Annie Hughes, David Languignon, François Levrier, Dariusz C Lis , et al. (6 additional authors not shown)

Abstract: Robust radiative transfer techniques are requisite for efficiently extracting the physical and chemical information from molecular rotational lines.We study several hypotheses that enable robust estimations of the column densities and physical conditions when fitting one or two transitions per molecular species. We study the extent to which simplifying assumptions aimed at reducing the complexity… ▽ More Robust radiative transfer techniques are requisite for efficiently extracting the physical and chemical information from molecular rotational lines.We study several hypotheses that enable robust estimations of the column densities and physical conditions when fitting one or two transitions per molecular species. We study the extent to which simplifying assumptions aimed at reducing the complexity of the problem introduce estimation biases and how to detect them.We focus on the CO and HCO+ isotopologues and analyze maps of a 50 square arcminutes field. We used the RADEX escape probability model to solve the statistical equilibrium equations and compute the emerging line profiles, assuming that all species coexist. Depending on the considered set of species, we also fixed the abundance ratio between some species and explored different values. We proposed a maximum likelihood estimator to infer the physical conditions and considered the effect of both the thermal noise and calibration uncertainty. We analyzed any potential biases induced by model misspecifications by comparing the results on the actual data for several sets of species and confirmed with Monte Carlo simulations. The variance of the estimations and the efficiency of the estimator were studied based on the Cram{é}r-Rao lower bound.Column densities can be estimated with 30% accuracy, while the best estimations of the volume density are found to be within a factor of two. Under the chosen model framework, the peak 12CO(1--0) is useful for constraining the kinetic temperature. The thermal pressure is better and more robustly estimated than the volume density and kinetic temperature separately. Analyzing CO and HCO+ isotopologues and fitting the full line profile are recommended practices with respect to detecting possible biases.Combining a non-local thermodynamic equilibrium model with a rigorous analysis of the accuracy allows us to obtain an efficient estimator and identify where the model is misspecified. We note that other combinations of molecular lines could be studied in the future. △ Less

Submitted 29 March, 2024; originally announced March 2024.

Comments: Astronomy and Astrophysics - A\&A, In press

Benchmarking multi-component signal processing methods in the time-frequency plane

Authors: Juan M. Miramont, Rémi Bardenet, Pierre Chainais, Francois Auger

Abstract: Signal processing in the time-frequency plane has a long history and remains a field of methodological innovation. For instance, detection and denoising based on the zeros of the spectrogram have been proposed since 2015, contrasting with a long history of focusing on larger values of the spectrogram. Yet, unlike neighboring fields like optimization and machine learning, time-frequency signal proc… ▽ More Signal processing in the time-frequency plane has a long history and remains a field of methodological innovation. For instance, detection and denoising based on the zeros of the spectrogram have been proposed since 2015, contrasting with a long history of focusing on larger values of the spectrogram. Yet, unlike neighboring fields like optimization and machine learning, time-frequency signal processing lacks widely-adopted benchmarking tools. In this work, we contribute an open-source, Python-based toolbox termed MCSM-Benchs for benchmarking multi-component signal analysis methods, and we demonstrate our toolbox on three time-frequency benchmarks. First, we compare different methods for signal detection based on the zeros of the spectrogram, including unexplored variations of previously proposed detection tests. Second, we compare zero-based denoising methods to both classical and novel methods based on large values and ridges of the spectrogram. Finally, we compare the denoising performance of these methods against typical spectrogram thresholding strategies, in terms of post-processing artifacts commonly referred to as musical noise. At a low level, the obtained results provide new insight on the assessed approaches, and in particular research directions to further develop zero-based methods. At a higher level, our benchmarks exemplify the benefits of using a public, collaborative, common framework for benchmarking. △ Less

Submitted 13 February, 2024; originally announced February 2024.

Signal reconstruction using determinantal sampling

Authors: Ayoub Belhadji, Rémi Bardenet, Pierre Chainais

Abstract: We study the approximation of a square-integrable function from a finite number of evaluations on a random set of nodes according to a well-chosen distribution. This is particularly relevant when the function is assumed to belong to a reproducing kernel Hilbert space (RKHS). This work proposes to combine several natural finite-dimensional approximations based two possible probability distributions… ▽ More We study the approximation of a square-integrable function from a finite number of evaluations on a random set of nodes according to a well-chosen distribution. This is particularly relevant when the function is assumed to belong to a reproducing kernel Hilbert space (RKHS). This work proposes to combine several natural finite-dimensional approximations based two possible probability distributions of nodes. These distributions are related to determinantal point processes, and use the kernel of the RKHS to favor RKHS-adapted regularity in the random design. While previous work on determinantal sampling relied on the RKHS norm, we prove mean-square guarantees in $L^2$ norm. We show that determinantal point processes and mixtures thereof can yield fast convergence rates. Our results also shed light on how the rate changes as more smoothness is assumed, a phenomenon known as superconvergence. Besides, determinantal sampling generalizes i.i.d. sampling from the Christoffel function which is standard in the literature. More importantly, determinantal sampling guarantees the so-called instance optimality property for a smaller number of function evaluations than i.i.d. sampling. △ Less

Submitted 13 October, 2023; originally announced October 2023.

HCN emission from translucent gas and UV-illuminated cloud edges revealed by wide-field IRAM 30m maps of Orion B GMC: Revisiting its role as tracer of the dense gas reservoir for star formation

Authors: M. G. Santa-Maria, J. R. Goicoechea, J. Pety, M. Gerin, J. H. Orkisz, F. Le Petit, L. Einig, P. Palud, V. de Souza Magalhaes, I. Bešlić, L. Segal, S. Bardeau, E. Bron, P. Chainais, J. Chanussot, P. Gratier, V. V. Guzmán, A. Hughes, D. Languignon, F. Levrier, D. C. Lis, H. S. Liszt, J. Le Bourlot, Y. Oya, K. Öberg , et al. (6 additional authors not shown)

Abstract: We present 5 deg^2 (~250 pc^2) HCN, HNC, HCO+, and CO J=1-0 maps of the Orion B GMC, complemented with existing wide-field [CI] 492 GHz maps, as well as new pointed observations of rotationally excited HCN, HNC, H13CN, and HN13C lines. We detect anomalous HCN J=1-0 hyperfine structure line emission almost everywhere in the cloud. About 70% of the total HCN J=1-0 luminosity arises from gas at A_V <… ▽ More We present 5 deg^2 (~250 pc^2) HCN, HNC, HCO+, and CO J=1-0 maps of the Orion B GMC, complemented with existing wide-field [CI] 492 GHz maps, as well as new pointed observations of rotationally excited HCN, HNC, H13CN, and HN13C lines. We detect anomalous HCN J=1-0 hyperfine structure line emission almost everywhere in the cloud. About 70% of the total HCN J=1-0 luminosity arises from gas at A_V < 8 mag. The HCN/CO J=1-0 line intensity ratio shows a bimodal behavior with an inflection point at A_V < 3 mag typical of translucent gas and UV-illuminated cloud edges. We find that most of the HCN J=1-0 emission arises from extended gas with n(H2) ~< 10^4 cm^-3, even lower density gas if the ionization fraction is > 10^-5 and electron excitation dominates. This result explains the low-A_V branch of the HCN/CO J=1-0 intensity ratio distribution. Indeed, the highest HCN/CO ratios (~0.1) at A_V < 3 mag correspond to regions of high [CI] 492 GHz/CO J=1-0 intensity ratios (>1) characteristic of low-density PDRs. Enhanced FUV radiation favors the formation and excitation of HCN on large scales, not only in dense star-forming clumps. The low surface brightness HCN and HCO+ J=1-0 emission scale with I_FIR (a proxy of the stellar FUV radiation field) in a similar way. Together with CO J=1-0, these lines respond to increasing I_FIR up to G0~20. On the other hand, the bright HCN J=1-0 emission from dense gas in star-forming clumps weakly responds to I_FIR once the FUV radiation field becomes too intense (G0>1500). The different power law scalings (produced by different chemistries, densities, and line excitation regimes) in a single but spatially resolved GMC resemble the variety of Kennicutt-Schmidt law indexes found in galaxy averages. As a corollary for extragalactic studies, we conclude that high HCN/CO J=1-0 line intensity ratios do not always imply the presence of dense gas. △ Less

Submitted 18 September, 2023; v1 submitted 6 September, 2023; originally announced September 2023.

Comments: accepted for publication in A&A. 24 pages, 18 figures, plus Appendix. Abridged Abstract

Journal ref: A&A 679, A4 (2023)

Neural network-based emulation of interstellar medium models

Authors: Pierre Palud, Lucas Einig, Franck Le Petit, Emeric Bron, Pierre Chainais, Jocelyn Chanussot, Jérôme Pety, Pierre-Antoine Thouvenin, David Languignon, Ivana Bešlić, Miriam G. Santa-Maria, Jan H. Orkisz, Léontine E. Ségal, Antoine Zakardjian, Sébastien Bardeau, Maryvonne Gerin, Javier R. Goicoechea, Pierre Gratier, Viviana V. Guzman, Annie Hughes, François Levrier, Harvey S. Liszt, Jacques Le Bourlot, Antoine Roueff, Albrecht Sievers

Abstract: The interpretation of observations of atomic and molecular tracers in the galactic and extragalactic interstellar medium (ISM) requires comparisons with state-of-the-art astrophysical models to infer some physical conditions. Usually, ISM models are too time-consuming for such inference procedures, as they call for numerous model evaluations. As a result, they are often replaced by an interpolatio… ▽ More The interpretation of observations of atomic and molecular tracers in the galactic and extragalactic interstellar medium (ISM) requires comparisons with state-of-the-art astrophysical models to infer some physical conditions. Usually, ISM models are too time-consuming for such inference procedures, as they call for numerous model evaluations. As a result, they are often replaced by an interpolation of a grid of precomputed models. We propose a new general method to derive faster, lighter, and more accurate approximations of the model from a grid of precomputed models. These emulators are defined with artificial neural networks (ANNs) designed and trained to address the specificities inherent in ISM models. Indeed, such models often predict many observables (e.g., line intensities) from just a few input physical parameters and can yield outliers due to numerical instabilities or physical bistabilities. We propose applying five strategies to address these characteristics: 1) an outlier removal procedure; 2) a clustering method that yields homogeneous subsets of lines that are simpler to predict with different ANNs; 3) a dimension reduction technique that enables to adequately size the network architecture; 4) the physical inputs are augmented with a polynomial transform to ease the learning of nonlinearities; and 5) a dense architecture to ease the learning of simple relations. We compare the proposed ANNs with standard classes of interpolation methods to emulate the Meudon PDR code, a representative ISM numerical model. Combinations of the proposed strategies outperform all interpolation methods by a factor of 2 on the average error, reaching 4.5% on the Meudon PDR code. These networks are also 1000 times faster than accurate interpolation methods and require ten to forty times less memory. This work will enable efficient inferences on wide-field multiline observations of the ISM. △ Less

Submitted 4 September, 2023; originally announced September 2023.

Journal ref: A&A 678, A198 (2023)

Deep learning denoising by dimension reduction: Application to the ORION-B line cubes

Authors: Lucas Einig, Jérôme Pety, Antoine Roueff, Paul Vandame, Jocelyn Chanussot, Maryvonne Gerin, Jan H. Orkisz, Pierre Palud, Miriam Garcia Santa-Maria, Victor de Souza Magalhaes, Ivana Bešlić, Sébastien Bardeau, Emeric E. Bron, Pierre Chainais, Javier R Goicoechea, Pierre Gratier, Viviana Guzman Veloso, Annie Hughes, Jouni Kainulainen, David Languignon, Rosine Lallement, François Levrier, Dariuscz C. Lis, Harvey Liszt, Jacques Le Bourlot , et al. (7 additional authors not shown)

Abstract: Context. The availability of large bandwidth receivers for millimeter radio telescopes allows the acquisition of position-position-frequency data cubes over a wide field of view and a broad frequency coverage. These cubes contain much information on the physical, chemical, and kinematical properties of the emitting gas. However, their large size coupled with inhomogenous signal-to-noise ratio (SNR… ▽ More Context. The availability of large bandwidth receivers for millimeter radio telescopes allows the acquisition of position-position-frequency data cubes over a wide field of view and a broad frequency coverage. These cubes contain much information on the physical, chemical, and kinematical properties of the emitting gas. However, their large size coupled with inhomogenous signal-to-noise ratio (SNR) are major challenges for consistent analysis and interpretation.Aims. We search for a denoising method of the low SNR regions of the studied data cubes that would allow to recover the low SNR emission without distorting the signals with high SNR.Methods. We perform an in-depth data analysis of the 13 CO and C 17 O (1 -- 0) data cubes obtained as part of the ORION-B large program performed at the IRAM 30m telescope. We analyse the statistical properties of the noise and the evolution of the correlation of the signal in a given frequency channel with that of the adjacent channels. This allows us to propose significant improvements of typical autoassociative neural networks, often used to denoise hyperspectral Earth remote sensing data. Applying this method to the 13 CO (1 -- 0) cube, we compare the denoised data with those derived with the multiple Gaussian fitting algorithm ROHSA, considered as the state of the art procedure for data line cubes.Results. The nature of astronomical spectral data cubes is distinct from that of the hyperspectral data usually studied in the Earth remote sensing literature because the observed intensities become statistically independent beyond a short channel separation. This lack of redundancy in data has led us to adapt the method, notably by taking into account the sparsity of the signal along the spectral axis. The application of the proposed algorithm leads to an increase of the SNR in voxels with weak signal, while preserving the spectral shape of the data in high SNR voxels.Conclusions. The proposed algorithm that combines a detailed analysis of the noise statistics with an innovative autoencoder architecture is a promising path to denoise radio-astronomy line data cubes. In the future, exploring whether a better use of the spatial correlations of the noise may further improve the denoising performances seems a promising avenue. In addition, △ Less

Submitted 24 July, 2023; originally announced July 2023.

Journal ref: A&A 677, A158 (2023)

Normalizing flow sampling with Langevin dynamics in the latent space

Authors: Florentin Coeurdoux, Nicolas Dobigeon, Pierre Chainais

Abstract: Normalizing flows (NF) use a continuous generator to map a simple latent (e.g. Gaussian) distribution, towards an empirical target distribution associated with a training data set. Once trained by minimizing a variational objective, the learnt map provides an approximate generative model of the target distribution. Since standard NF implement differentiable maps, they may suffer from pathological… ▽ More Normalizing flows (NF) use a continuous generator to map a simple latent (e.g. Gaussian) distribution, towards an empirical target distribution associated with a training data set. Once trained by minimizing a variational objective, the learnt map provides an approximate generative model of the target distribution. Since standard NF implement differentiable maps, they may suffer from pathological behaviors when targeting complex distributions. For instance, such problems may appear for distributions on multi-component topologies or characterized by multiple modes with high probability regions separated by very unlikely areas. A typical symptom is the explosion of the Jacobian norm of the transformation in very low probability areas. This paper proposes to overcome this issue thanks to a new Markov chain Monte Carlo algorithm to sample from the target distribution in the latent domain before transporting it back to the target domain. The approach relies on a Metropolis adjusted Langevin algorithm (MALA) whose dynamics explicitly exploits the Jacobian of the transformation. Contrary to alternative approaches, the proposed strategy preserves the tractability of the likelihood and it does not require a specific training. Notably, it can be straightforwardly used with any pre-trained NF network, regardless of the architecture. Experiments conducted on synthetic and high-dimensional real data sets illustrate the efficiency of the method. △ Less

Submitted 20 May, 2023; originally announced May 2023.

Plug-and-Play split Gibbs sampler: embedding deep generative priors in Bayesian inference

Authors: Florentin Coeurdoux, Nicolas Dobigeon, Pierre Chainais

Abstract: This paper introduces a stochastic plug-and-play (PnP) sampling algorithm that leverages variable splitting to efficiently sample from a posterior distribution. The algorithm based on split Gibbs sampling (SGS) draws inspiration from the alternating direction method of multipliers (ADMM). It divides the challenging task of posterior sampling into two simpler sampling problems. The first problem de… ▽ More This paper introduces a stochastic plug-and-play (PnP) sampling algorithm that leverages variable splitting to efficiently sample from a posterior distribution. The algorithm based on split Gibbs sampling (SGS) draws inspiration from the alternating direction method of multipliers (ADMM). It divides the challenging task of posterior sampling into two simpler sampling problems. The first problem depends on the likelihood function, while the second is interpreted as a Bayesian denoising problem that can be readily carried out by a deep generative model. Specifically, for an illustrative purpose, the proposed method is implemented in this paper using state-of-the-art diffusion-based generative models. Akin to its deterministic PnP-based counterparts, the proposed method exhibits the great advantage of not requiring an explicit choice of the prior distribution, which is rather encoded into a pre-trained generative model. However, unlike optimization methods (e.g., PnP-ADMM) which generally provide only point estimates, the proposed approach allows conventional Bayesian estimators to be accompanied by confidence intervals at a reasonable additional computational cost. Experiments on commonly studied image processing problems illustrate the efficiency of the proposed sampling strategy. Its performance is compared to recent state-of-the-art optimization and sampling methods. △ Less

Submitted 21 April, 2023; originally announced April 2023.

Gas kinematics around filamentary structures in the Orion B cloud

Authors: Mathilde Gaudel, Jan H. Orkisz, Maryvonne Gerin, Jérôme Pety, Antoine Roueff, Antoine Marchal, François Levrier, Marc-Antoine Miville-Deschênes, Javier R. Goicoechea, Evelyne Roueff, Franck Le Petit, Victor de Souza Magalhaes, Pierre Palud, Miriam G. Santa-Maria, Maxime Vono, Sébastien Bardeau, Emeric Bron, Pierre Chainais, Jocelyn Chanussot, Pierre Gratier, Viviana Guzman, Annie Hughes, Jouni Kainulainen, David Languignon, Jacques Le Bourlot , et al. (5 additional authors not shown)

Abstract: Understanding the initial properties of star-forming material and how they affect the star formation process is key. From an observational point of view, the feedback from young high-mass stars on future star formation properties is still poorly constrained. In the framework of the IRAM 30m ORION-B large program, we obtained observations of the translucent and moderately dense gas, which we used t… ▽ More Understanding the initial properties of star-forming material and how they affect the star formation process is key. From an observational point of view, the feedback from young high-mass stars on future star formation properties is still poorly constrained. In the framework of the IRAM 30m ORION-B large program, we obtained observations of the translucent and moderately dense gas, which we used to analyze the kinematics over a field of 5 deg^2 around the filamentary structures. We used the ROHSA algorithm to decompose and de-noise the C18O(1-0) and 13CO(1-0) signals by taking the spatial coherence of the emission into account. We produced gas column density and mean velocity maps to estimate the relative orientation of their spatial gradients. We identified three cloud velocity layers at different systemic velocities and extracted the filaments in each velocity layer. The filaments are preferentially located in regions of low centroid velocity gradients. By comparing the relative orientation between the column density and velocity gradients of each layer from the ORION-B observations and synthetic observations from 3D kinematic toy models, we distinguish two types of behavior in the dynamics around filaments: (i) radial flows perpendicular to the filament axis that can be either inflows (increasing the filament mass) or outflows and (ii) longitudinal flows along the filament axis. The former case is seen in the Orion B data, while the latter is not identified. We have also identified asymmetrical flow patterns, usually associated with filaments located at the edge of an HII region. This is the first observational study to highlight feedback from HII regions on filament formation and, thus, on star formation in the Orion B cloud. This simple statistical method can be used for any molecular cloud to obtain coherent information on the kinematics. △ Less

Submitted 25 November, 2022; originally announced November 2022.

Comments: 45 pages. Abridged abstract. Accepted by Astronomy and Astrophysics

Journal ref: A&A 670, A59 (2023)

Efficient sampling of non log-concave posterior distributions with mixture of noises

Authors: Pierre Palud, Pierre-Antoine Thouvenin, Pierre Chainais, Emeric Bron, Franck Le Petit

Abstract: This paper focuses on a challenging class of inverse problems that is often encountered in applications. The forward model is a complex non-linear black-box, potentially non-injective, whose outputs cover multiple decades in amplitude. Observations are supposed to be simultaneously damaged by additive and multiplicative noises and censorship. As needed in many applications, the aim of this work is… ▽ More This paper focuses on a challenging class of inverse problems that is often encountered in applications. The forward model is a complex non-linear black-box, potentially non-injective, whose outputs cover multiple decades in amplitude. Observations are supposed to be simultaneously damaged by additive and multiplicative noises and censorship. As needed in many applications, the aim of this work is to provide uncertainty quantification on top of parameter estimates. The resulting log-likelihood is intractable and potentially non-log-concave. An adapted Bayesian approach is proposed to provide credibility intervals along with point estimates. An MCMC algorithm is proposed to deal with the multimodal posterior distribution, even in a situation where there is no global Lipschitz constant (or it is very large). It combines two kernels, namely an improved version of (Preconditioned Metropolis Adjusted Langevin) PMALA and a Multiple Try Metropolis (MTM) kernel. Whenever smooth, its gradient admits a Lipschitz constant too large to be exploited in the inference process. This sampler addresses all the challenges induced by the complex form of the likelihood. The proposed method is illustrated on classical test multimodal distributions as well as on a challenging and realistic inverse problem in astronomy. △ Less

Submitted 18 May, 2023; v1 submitted 23 November, 2022; originally announced November 2022.

A Distributed Block-Split Gibbs Sampler with Hypergraph Structure for High-Dimensional Inverse Problems

Authors: Pierre-Antoine Thouvenin, Audrey Repetti, Pierre Chainais

Abstract: Sampling-based algorithms are classical approaches to perform Bayesian inference in inverse problems. They provide estimators with the associated credibility intervals to quantify the uncertainty on the estimators. Although these methods hardly scale to high dimensional problems, they have recently been paired with optimization techniques, such as proximal and splitting approaches, to address this… ▽ More Sampling-based algorithms are classical approaches to perform Bayesian inference in inverse problems. They provide estimators with the associated credibility intervals to quantify the uncertainty on the estimators. Although these methods hardly scale to high dimensional problems, they have recently been paired with optimization techniques, such as proximal and splitting approaches, to address this issue. Such approaches pave the way to distributed samplers, splitting computations to make inference more scalable and faster. We introduce a distributed Split Gibbs sampler (SGS) to efficiently solve such problems involving distributions with multiple smooth and non-smooth functions composed with linear operators. The proposed approach leverages a recent approximate augmentation technique reminiscent of primal-dual optimization methods. It is further combined with a block-coordinate approach to split the primal and dual variables into blocks, leading to a distributed block-coordinate SGS. The resulting algorithm exploits the hypergraph structure of the involved linear operators to efficiently distribute the variables over multiple workers under controlled communication costs. It accommodates several distributed architectures, such as the Single Program Multiple Data and client-server architectures. Experiments on a large image deblurring problem show the performance of the proposed approach to produce high quality estimates with credibility intervals in a small amount of time. Supplementary material to reproduce the experiments is available online. △ Less

Submitted 26 November, 2023; v1 submitted 5 October, 2022; originally announced October 2022.

Sliced-Wasserstein normalizing flows: beyond maximum likelihood training

Authors: Florentin Coeurdoux, Nicolas Dobigeon, Pierre Chainais

Abstract: Despite their advantages, normalizing flows generally suffer from several shortcomings including their tendency to generate unrealistic data (e.g., images) and their failing to detect out-of-distribution data. One reason for these deficiencies lies in the training strategy which traditionally exploits a maximum likelihood principle only. This paper proposes a new training paradigm based on a hybri… ▽ More Despite their advantages, normalizing flows generally suffer from several shortcomings including their tendency to generate unrealistic data (e.g., images) and their failing to detect out-of-distribution data. One reason for these deficiencies lies in the training strategy which traditionally exploits a maximum likelihood principle only. This paper proposes a new training paradigm based on a hybrid objective function combining the maximum likelihood principle (MLE) and a sliced-Wasserstein distance. Results obtained on synthetic toy examples and real image data sets show better generative abilities in terms of both likelihood and visual aspects of the generated samples. Reciprocally, the proposed approach leads to a lower likelihood of out-of-distribution data, demonstrating a greater data fidelity of the resulting flows. △ Less

Submitted 12 July, 2022; originally announced July 2022.

Learning Optimal Transport Between two Empirical Distributions with Normalizing Flows

Authors: Florentin Coeurdoux, Nicolas Dobigeon, Pierre Chainais

Abstract: Optimal transport (OT) provides effective tools for comparing and map** probability measures. We propose to leverage the flexibility of neural networks to learn an approximate optimal transport map. More precisely, we present a new and original method to address the problem of transporting a finite set of samples associated with a first underlying unknown distribution towards another finite set… ▽ More Optimal transport (OT) provides effective tools for comparing and map** probability measures. We propose to leverage the flexibility of neural networks to learn an approximate optimal transport map. More precisely, we present a new and original method to address the problem of transporting a finite set of samples associated with a first underlying unknown distribution towards another finite set of samples drawn from another unknown distribution. We show that a particular instance of invertible neural networks, namely the normalizing flows, can be used to approximate the solution of this OT problem between a pair of empirical distributions. To this aim, we propose to relax the Monge formulation of OT by replacing the equality constraint on the push-forward measure by the minimization of the corresponding Wasserstein distance. The push-forward operator to be retrieved is then restricted to be a normalizing flow which is trained by optimizing the resulting cost function. This approach allows the transport map to be discretized as a composition of functions. Each of these functions is associated to one sub-flow of the network, whose output provides intermediate steps of the transport between the original and target measures. This discretization yields also a set of intermediate barycenters between the two measures of interest. Experiments conducted on toy examples as well as a challenging task of unsupervised translation demonstrate the interest of the proposed method. Finally, some experiments show that the proposed approach leads to a good approximation of the true OT. △ Less

Submitted 5 July, 2022; v1 submitted 4 July, 2022; originally announced July 2022.

High-dimensional Gaussian sampling: a review and a unifying approach based on a stochastic proximal point algorithm

Authors: Maxime Vono, Nicolas Dobigeon, Pierre Chainais

Abstract: Efficient sampling from a high-dimensional Gaussian distribution is an old but high-stake issue. Vanilla Cholesky samplers imply a computational cost and memory requirements which can rapidly become prohibitive in high dimension. To tackle these issues, multiple methods have been proposed from different communities ranging from iterative numerical linear algebra to Markov chain Monte Carlo (MCMC)… ▽ More Efficient sampling from a high-dimensional Gaussian distribution is an old but high-stake issue. Vanilla Cholesky samplers imply a computational cost and memory requirements which can rapidly become prohibitive in high dimension. To tackle these issues, multiple methods have been proposed from different communities ranging from iterative numerical linear algebra to Markov chain Monte Carlo (MCMC) approaches. Surprisingly, no complete review and comparison of these methods have been conducted. This paper aims at reviewing all these approaches by pointing out their differences, close relations, benefits and limitations. In addition to this state of the art, this paper proposes a unifying Gaussian simulation framework by deriving a stochastic counterpart of the celebrated proximal point algorithm in optimization. This framework offers a novel and unifying revisit of most of the existing MCMC approaches while extending them. Guidelines to choose the appropriate Gaussian simulation method for a given sampling problem in high dimension are proposed and illustrated with numerical examples. △ Less

Submitted 30 April, 2021; v1 submitted 4 October, 2020; originally announced October 2020.

Comments: 53 pages, 11 figures

Quantitative inference of the $H_2$ column densities from 3 mm molecular emission: A case study towards Orion B

Authors: Pierre Gratier, Jérôme Pety, Emeric Bron, Antoine Roueff, Jan H. Orkisz, Maryvonne Gerin, Victor de Souza Magalhaes, Mathilde Gaudel, Maxime Vono, Sébastien Bardeau, Jocelyn Chanussot, Pierre Chainais, Javier R. Goicoechea, Viviana V. Guzmán, Annie Hughes, Jouni Kainulainen, David Languignon, Jacques Le Bourlot, Franck Le Petit, François Levrier, Harvey Liszt, Nicolas Peretto, Evelyne Roueff, Albrecht Sievers

Abstract: Molecular hydrogen being unobservable in cold molecular clouds, the column density measurements of molecular gas currently rely either on dust emission observation in the far-IR or on star counting. (Sub-)millimeter observations of numerous trace molecules are effective from ground based telescopes, but the relationships between the emission of one molecular line and the H2 column density (NH2) is… ▽ More Molecular hydrogen being unobservable in cold molecular clouds, the column density measurements of molecular gas currently rely either on dust emission observation in the far-IR or on star counting. (Sub-)millimeter observations of numerous trace molecules are effective from ground based telescopes, but the relationships between the emission of one molecular line and the H2 column density (NH2) is non-linear and sensitive to excitation conditions, optical depths, abundance variations due to the underlying physico-chemistry. We aim to use multi-molecule line emission to infer NH2 from radio observations. We propose a data-driven approach to determine NH2 from radio molecular line observations. We use supervised machine learning methods (Random Forests) on wide-field hyperspectral IRAM-30m observations of the Orion B molecular cloud to train a predictor of NH2, using a limited set of molecular lines as input, and the Herschel-based dust-derived NH2 as ground truth output. For conditions similar to the Orion B molecular cloud, we obtain predictions of NH2 within a typical factor of 1.2 from the Herschel-based estimates. An analysis of the contributions of the different lines to the predictions show that the most important lines are $^{13}$CO(1-0), $^{12}$CO(1-0), C$^{18}$O(1-0), and HCO$^+$(1-0). A detailed analysis distinguishing between diffuse, translucent, filamentary, and dense core conditions show that the importance of these four lines depends on the regime, and that it is recommended to add the N$_2$H$^+$(1-0) and CH$_3$OH(20-10) lines for the prediction of NH2 in dense core conditions. This article opens a promising avenue to directly infer important physical parameters from the molecular line emission in the millimeter domain. The next step will be to try to infer several parameters simultaneously (e.g., NH2 and far-UV illumination field) to further test the method. [Abridged] △ Less

Submitted 31 August, 2020; originally announced August 2020.

Comments: Accepted for publication in A&A

Journal ref: A&A 645, A27 (2021)

Tracers of the ionization fraction in dense and translucent gas: I. Automated exploitation of massive astrochemical model grids

Authors: Emeric Bron, Evelyne Roueff, Maryvonne Gerin, Jérôme Pety, Pierre Gratier, Franck Le Petit, Viviana Guzman, Jan H. Orkisz, Victor de Souza Magalhaes, Mathilde Gaudel, Maxime Vono, Sébastien Bardeau, Pierre Chainais, Javier R. Goicoechea, Annie Hughes, Jouni Kainulainen, David Languignon, Jacques Le Bourlot, François Levrier, Harvey Liszt, Karin Öberg, Nicolas Peretto, Antoine Roueff, Albrecht Sievers

Abstract: The ionization fraction plays a key role in the physics and chemistry of the neutral interstellar medium, from controlling the coupling of the gas to the magnetic field to allowing fast ion-neutral reactions that drive interstellar chemistry. Most estimations of the ionization fraction have relied on deuterated species such as DCO+, whose detection is limited to dense cores representing an extreme… ▽ More The ionization fraction plays a key role in the physics and chemistry of the neutral interstellar medium, from controlling the coupling of the gas to the magnetic field to allowing fast ion-neutral reactions that drive interstellar chemistry. Most estimations of the ionization fraction have relied on deuterated species such as DCO+, whose detection is limited to dense cores representing an extremely small fraction of the volume of the giant molecular clouds they are part of. As large field-of-view hyperspectral maps become available, new tracers may be found. We search for the best observable tracers of the ionization fraction based on a grid of astrochemical models. We build grids of models that sample randomly a large space of physical conditions (unobservable quantities such as gas density, temperature, etc.) and compute the corresponding observables (line intensities, column densities) and the ionization fraction. We estimate the predictive power of each potential tracer by training a Random Forest model to predict the ionization fraction from that tracer, based on these model grids. In both translucent medium and cold dense medium conditions, several observable tracers with very good predictive power for the ionization fraction are found. Several tracers in cold dense medium conditions are found to be better and more widely applicable than the traditional DCO+/HCO+ ratio. We also provide simpler analytical fits for estimating the ionization fraction from the best tracers, and for estimating the associated uncertainties. We discuss the limitations of the present study and select a few recommended tracers in both types of conditions. The method presented here is very general and can be applied to the measurement of any other quantity of interest (cosmic ray flux, elemental abundances, etc.) from any type of model (PDR models, time-dependent chemical models, etc.). (abridged) △ Less

Submitted 27 July, 2020; originally announced July 2020.

Comments: 29 pages, 15 figures. Accepted for publication in A&A

Journal ref: A&A 645, A28 (2021)

C18O, 13CO, and 12CO abundances and excitation temperatures in the Orion B molecular cloud: An analysis of the precision achievable when modeling spectral line within the Local Thermodynamic Equilibrium approximation

Authors: Antoine Roueff, Maryvonne Gerin, Pierre Gratier, Francois Levrier, Jerome Pety, Mathilde Gaudel, Javier R. Goicoechea, Jan H. Orkisz, Victor de Souza Magalhaes, Maxime Vono, Sebastien Bardeau, Emeric Bron, Jocelyn Chanussot, Pierre Chainais, Viviana V. Guzman, Annie Hughes, Jouni Kainulainen, David Languignon, Jacques Le Bourlot, Franck Le Petit, Harvey S. Liszt, Antoine Marchal, Marc-Antoine Miville-Deschenes, Nicolas Peretto, Evelyne Roueff , et al. (1 additional authors not shown)

Abstract: CO isotopologue transitions are routinely observed in molecular clouds to probe the column density of the gas, the elemental ratios of carbon and oxygen, and to trace the kinematics of the environment. We aim at estimating the abundances, excitation temperatures, velocity field and velocity dispersions of the three main CO isotopologues towards a subset of the Orion B molecular cloud. We use the C… ▽ More CO isotopologue transitions are routinely observed in molecular clouds to probe the column density of the gas, the elemental ratios of carbon and oxygen, and to trace the kinematics of the environment. We aim at estimating the abundances, excitation temperatures, velocity field and velocity dispersions of the three main CO isotopologues towards a subset of the Orion B molecular cloud. We use the Cramer Rao Bound (CRB) technique to analyze and estimate the precision of the physical parameters in the framework of local-thermodynamic-equilibrium excitation and radiative transfer with an additive white Gaussian noise. We propose a maximum likelihood estimator to infer the physical conditions from the 1-0 and 2-1 transitions of CO isotopologues. Simulations show that this estimator is unbiased and efficient for a common range of excitation temperatures and column densities (Tex > 6 K, N > 1e14 - 1e15 cm-2). Contrary to the general assumptions, the different CO isotopologues have distinct excitation temperatures, and the line intensity ratios between different isotopologues do not accurately reflect the column density ratios. We find mean fractional abundances that are consistent with previous determinations towards other molecular clouds. However, significant local deviations are inferred, not only in regions exposed to UV radiation field but also in shielded regions. These deviations result from the competition between selective photodissociation, chemical fractionation, and depletion on grain surfaces. We observe that the velocity dispersion of the C18O emission is 10% smaller than that of 13CO. The substantial gain resulting from the simultaneous analysis of two different rotational transitions of the same species is rigorously quantified. The CRB technique is a promising avenue for analyzing the estimation of physical parameters from the fit of spectral lines. △ Less

Submitted 17 May, 2020; originally announced May 2020.

Comments: 27 pages, 23 PDF figures. Accepted for publication in A&A. Uses aa latex macro

Journal ref: A&A 645, A26 (2021)

Kernel interpolation with continuous volume sampling

Authors: Ayoub Belhadji, Rémi Bardenet, Pierre Chainais

Abstract: A fundamental task in kernel methods is to pick nodes and weights, so as to approximate a given function from an RKHS by the weighted sum of kernel translates located at the nodes. This is the crux of kernel density estimation, kernel quadrature, or interpolation from discrete samples. Furthermore, RKHSs offer a convenient mathematical and computational framework. We introduce and analyse continuo… ▽ More A fundamental task in kernel methods is to pick nodes and weights, so as to approximate a given function from an RKHS by the weighted sum of kernel translates located at the nodes. This is the crux of kernel density estimation, kernel quadrature, or interpolation from discrete samples. Furthermore, RKHSs offer a convenient mathematical and computational framework. We introduce and analyse continuous volume sampling (VS), the continuous counterpart -- for choosing node locations -- of a discrete distribution introduced in (Deshpande & Vempala, 2006). Our contribution is theoretical: we prove almost optimal bounds for interpolation and quadrature under VS. While similar bounds already exist for some specific RKHSs using ad-hoc node constructions, VS offers bounds that apply to any Mercer kernel and depend on the spectrum of the associated integration operator. We emphasize that, unlike previous randomized approaches that rely on regularized leverage scores or determinantal point processes, evaluating the pdf of VS only requires pointwise evaluations of the kernel. VS is thus naturally amenable to MCMC samplers. △ Less

Submitted 22 February, 2020; originally announced February 2020.

Kernel quadrature with DPPs

Authors: Ayoub Belhadji, Rémi Bardenet, Pierre Chainais

Abstract: We study quadrature rules for functions from an RKHS, using nodes sampled from a determinantal point process (DPP). DPPs are parametrized by a kernel, and we use a truncated and saturated version of the RKHS kernel. This link between the two kernels, along with DPP machinery, leads to relatively tight bounds on the quadrature error, that depends on the spectrum of the RKHS kernel. Finally, we expe… ▽ More We study quadrature rules for functions from an RKHS, using nodes sampled from a determinantal point process (DPP). DPPs are parametrized by a kernel, and we use a truncated and saturated version of the RKHS kernel. This link between the two kernels, along with DPP machinery, leads to relatively tight bounds on the quadrature error, that depends on the spectrum of the RKHS kernel. Finally, we experimentally compare DPPs to existing kernel-based quadratures such as herding, Bayesian quadrature, or leverage score sampling. Numerical results confirm the interest of DPPs, and even suggest faster rates than our bounds in particular cases. △ Less

Submitted 31 December, 2019; v1 submitted 18 June, 2019; originally announced June 2019.

Journal ref: Advances in Neural Information Processing Systems (NeurIPS), Dec 2019, Vancouver, Canada

Asymptotically exact data augmentation: models, properties and algorithms

Authors: Maxime Vono, Nicolas Dobigeon, Pierre Chainais

Abstract: Data augmentation, by the introduction of auxiliary variables, has become an ubiquitous technique to improve convergence properties, simplify the implementation or reduce the computational time of inference methods such as Markov chain Monte Carlo ones. Nonetheless, introducing appropriate auxiliary variables while preserving the initial target probability distribution and offering a computational… ▽ More Data augmentation, by the introduction of auxiliary variables, has become an ubiquitous technique to improve convergence properties, simplify the implementation or reduce the computational time of inference methods such as Markov chain Monte Carlo ones. Nonetheless, introducing appropriate auxiliary variables while preserving the initial target probability distribution and offering a computationally efficient inference cannot be conducted in a systematic way. To deal with such issues, this paper studies a unified framework, coined asymptotically exact data augmentation (AXDA), which encompasses both well-established and more recent approximate augmented models. In a broader perspective, this paper shows that AXDA models can benefit from interesting statistical properties and yield efficient inference algorithms. In non-asymptotic settings, the quality of the proposed approximation is assessed with several theoretical results. The latter are illustrated on standard statistical problems. Supplementary materials including computer code for this paper are available online. △ Less

Submitted 10 September, 2020; v1 submitted 15 February, 2019; originally announced February 2019.

Comments: 63 pages

A determinantal point process for column subset selection

Authors: Ayoub Belhadji, Rémi Bardenet, Pierre Chainais

Abstract: Dimensionality reduction is a first step of many machine learning pipelines. Two popular approaches are principal component analysis, which projects onto a small number of well chosen but non-interpretable directions, and feature selection, which selects a small number of the original features. Feature selection can be abstracted as a numerical linear algebra problem called the column subset selec… ▽ More Dimensionality reduction is a first step of many machine learning pipelines. Two popular approaches are principal component analysis, which projects onto a small number of well chosen but non-interpretable directions, and feature selection, which selects a small number of the original features. Feature selection can be abstracted as a numerical linear algebra problem called the column subset selection problem (CSSP). CSSP corresponds to selecting the best subset of columns of a matrix $X \in \mathbb{R}^{N \times d}$, where \emph{best} is often meant in the sense of minimizing the approximation error, i.e., the norm of the residual after projection of $X$ onto the space spanned by the selected columns. Such an optimization over subsets of $\{1,\dots,d\}$ is usually impractical. One workaround that has been vastly explored is to resort to polynomial-cost, random subset selection algorithms that favor small values of this approximation error. We propose such a randomized algorithm, based on sampling from a projection determinantal point process (DPP), a repulsive distribution over a fixed number $k$ of indices $\{1,\dots,d\}$ that favors diversity among the selected columns. We give bounds on the ratio of the expected approximation error for this DPP over the optimal error of PCA. These bounds improve over the state-of-the-art bounds of \emph{volume sampling} when some realistic structural assumptions are satisfied for $X$. Numerical experiments suggest that our bounds are tight, and that our algorithms have comparable performance with the \emph{double phase} algorithm, often considered to be the practical state-of-the-art. Column subset selection with DPPs thus inherits the best of both worlds: good empirical performance and tight error bounds. △ Less

Submitted 23 December, 2018; originally announced December 2018.

Split-and-augmented Gibbs sampler - Application to large-scale inference problems

Authors: Maxime Vono, Nicolas Dobigeon, Pierre Chainais

Abstract: This paper derives two new optimization-driven Monte Carlo algorithms inspired from variable splitting and data augmentation. In particular, the formulation of one of the proposed approaches is closely related to the alternating direction method of multipliers (ADMM) main steps. The proposed framework enables to derive faster and more efficient sampling schemes than the current state-of-the-art me… ▽ More This paper derives two new optimization-driven Monte Carlo algorithms inspired from variable splitting and data augmentation. In particular, the formulation of one of the proposed approaches is closely related to the alternating direction method of multipliers (ADMM) main steps. The proposed framework enables to derive faster and more efficient sampling schemes than the current state-of-the-art methods and can embed the latter. By sampling efficiently the parameter to infer as well as the hyperparameters of the problem, the generated samples can be used to approximate Bayesian estimators of the parameters to infer. Additionally, the proposed approach brings confidence intervals at a low cost contrary to optimization methods. Simulations on two often-studied signal processing problems illustrate the performance of the two proposed samplers. All results are compared to those obtained by recent state-of-the-art optimization and MCMC algorithms used to solve these problems. △ Less

Submitted 10 October, 2018; v1 submitted 16 April, 2018; originally announced April 2018.

A complete framework for linear filtering of bivariate signals

Authors: Julien Flamant, Pierre Chainais, Nicolas Le Bihan

Abstract: A complete framework for the linear time-invariant (LTI) filtering theory of bivariate signals is proposed based on a tailored quaternion Fourier transform. This framework features a direct description of LTI filters in terms of their eigenproperties enabling compact calculus and physically interpretable filtering relations in the frequency domain. The design of filters exhibiting fondamental prop… ▽ More A complete framework for the linear time-invariant (LTI) filtering theory of bivariate signals is proposed based on a tailored quaternion Fourier transform. This framework features a direct description of LTI filters in terms of their eigenproperties enabling compact calculus and physically interpretable filtering relations in the frequency domain. The design of filters exhibiting fondamental properties of polarization optics (birefringence, diattenuation) is straightforward. It yields an efficient spectral synthesis method and new insights on Wiener filtering for bivariate signals with prescribed frequency-dependent polarization properties. This generic framework facilitates original descriptions of bivariate signals in two components with specific geometric or statistical properties. Numerical experiments support our theoretical analysis and illustrate the relevance of the approach on synthetic data. △ Less

Submitted 7 February, 2018; originally announced February 2018.

Comments: 11 pages, 3 figures

Bayesian nonparametric Principal Component Analysis

Authors: Clément Elvira, Pierre Chainais, Nicolas Dobigeon

Abstract: Principal component analysis (PCA) is very popular to perform dimension reduction. The selection of the number of significant components is essential but often based on some practical heuristics depending on the application. Only few works have proposed a probabilistic approach able to infer the number of significant components. To this purpose, this paper introduces a Bayesian nonparametric princ… ▽ More Principal component analysis (PCA) is very popular to perform dimension reduction. The selection of the number of significant components is essential but often based on some practical heuristics depending on the application. Only few works have proposed a probabilistic approach able to infer the number of significant components. To this purpose, this paper introduces a Bayesian nonparametric principal component analysis (BNP-PCA). The proposed model projects observations onto a random orthogonal basis which is assigned a prior distribution defined on the Stiefel manifold. The prior on factor scores involves an Indian buffet process to model the uncertainty related to the number of components. The parameters of interest as well as the nuisance parameters are finally inferred within a fully Bayesian framework via Monte Carlo sampling. A study of the (in-)consistence of the marginal maximum a posteriori estimator of the latent dimension is carried out. A new estimator of the subspace dimension is proposed. Moreover, for sake of statistical significance, a Kolmogorov-Smirnov test based on the posterior distribution of the principal components is used to refine this estimate. The behaviour of the algorithm is first studied on various synthetic examples. Finally, the proposed BNP dimension reduction approach is shown to be easily yet efficiently coupled with clustering or latent factor models within a unique framework. △ Less

Submitted 17 September, 2017; originally announced September 2017.

On the zeros of the spectrogram of white noise

Authors: Rémi Bardenet, Julien Flamant, Pierre Chainais

Abstract: In a recent paper, Flandrin [2015] has proposed filtering based on the zeros of a spectrogram, using the short-time Fourier transform and a Gaussian window. His results are based on empirical observations on the distribution of the zeros of the spectrogram of white Gaussian noise. These zeros tend to be uniformly spread over the time-frequency plane, and not to clutter. Our contributions are three… ▽ More In a recent paper, Flandrin [2015] has proposed filtering based on the zeros of a spectrogram, using the short-time Fourier transform and a Gaussian window. His results are based on empirical observations on the distribution of the zeros of the spectrogram of white Gaussian noise. These zeros tend to be uniformly spread over the time-frequency plane, and not to clutter. Our contributions are threefold: we rigorously define the zeros of the spectrogram of continuous white Gaussian noise, we explicitly characterize their statistical distribution, and we investigate the computational and statistical underpinnings of the practical implementation of signal detection based on the statistics of spectrogram zeros. In particular, we stress that the zeros of spectrograms of white Gaussian noise correspond to zeros of Gaussian analytic functions, a topic of recent independent mathematical interest [Hough et al., 2009]. △ Less

Submitted 31 July, 2017; originally announced August 2017.

Spectral analysis of stationary random bivariate signals

Authors: Julien Flamant, Nicolas Le Bihan, Pierre Chainais

Abstract: A novel approach towards the spectral analysis of stationary random bivariate signals is proposed. Using the Quaternion Fourier Transform, we introduce a quaternion-valued spectral representation of random bivariate signals seen as complex-valued sequences. This makes possible the definition of a scalar quaternion-valued spectral density for bivariate signals. This spectral density can be meaningf… ▽ More A novel approach towards the spectral analysis of stationary random bivariate signals is proposed. Using the Quaternion Fourier Transform, we introduce a quaternion-valued spectral representation of random bivariate signals seen as complex-valued sequences. This makes possible the definition of a scalar quaternion-valued spectral density for bivariate signals. This spectral density can be meaningfully interpreted in terms of frequency-dependent polarization attributes. A natural decomposition of any random bivariate signal in terms of unpolarized and polarized components is introduced. Nonparametric spectral density estimation is investigated, and we introduce the polarization periodogram of a random bivariate signal. Numerical experiments support our theoretical analysis, illustrating the relevance of the approach on synthetic data. △ Less

Submitted 19 March, 2017; originally announced March 2017.

Comments: 11 pages, 3 figures

Time-frequency analysis of bivariate signals

Authors: Julien Flamant, Nicolas Le Bihan, Pierre Chainais

Abstract: Many phenomena are described by bivariate signals or bidimensional vectors in applications ranging from radar to EEG, optics and oceanography. The time-frequency analysis of bivariate signals is usually carried out by analyzing two separate quantities, e.g. rotary components. We show that an adequate quaternion Fourier transform permits to build relevant time-frequency representations of bivariate… ▽ More Many phenomena are described by bivariate signals or bidimensional vectors in applications ranging from radar to EEG, optics and oceanography. The time-frequency analysis of bivariate signals is usually carried out by analyzing two separate quantities, e.g. rotary components. We show that an adequate quaternion Fourier transform permits to build relevant time-frequency representations of bivariate signals that naturally identify geometrical or polarization properties. First, the quaternion embedding of bivariate signals is introduced, similar to the usual analytic signal of real signals. Then two fundamental theorems ensure that a quaternion short term Fourier transform and a quaternion continuous wavelet transform are well defined and obey desirable properties such as conservation laws and reconstruction formulas. The resulting spectrograms and scalograms provide meaningful representations of both the time-frequency and geometrical/polarization content of the signal. Moreover the numerical implementation remains simply based on the use of FFT. A toolbox is available for reproducibility. Synthetic and real-world examples illustrate the relevance and efficiency of the proposed approach. △ Less

Submitted 8 September, 2016; originally announced September 2016.

Comments: 31 pages, 8 figures

Bayesian anti-sparse coding

Authors: Clément Elvira, Pierre Chainais, Nicolas Dobigeon

Abstract: Sparse representations have proven their efficiency in solving a wide class of inverse problems encountered in signal and image processing. Conversely, enforcing the information to be spread uniformly over representation coefficients exhibits relevant properties in various applications such as digital communications. Anti-sparse regularization can be naturally expressed through an $\ell_{\infty}$-… ▽ More Sparse representations have proven their efficiency in solving a wide class of inverse problems encountered in signal and image processing. Conversely, enforcing the information to be spread uniformly over representation coefficients exhibits relevant properties in various applications such as digital communications. Anti-sparse regularization can be naturally expressed through an $\ell_{\infty}$-norm penalty. This paper derives a probabilistic formulation of such representations. A new probability distribution, referred to as the democratic prior, is first introduced. Its main properties as well as three random variate generators for this distribution are derived. Then this probability distribution is used as a prior to promote anti-sparsity in a Gaussian linear inverse problem, yielding a fully Bayesian formulation of anti-sparse coding. Two Markov chain Monte Carlo (MCMC) algorithms are proposed to generate samples according to the posterior distribution. The first one is a standard Gibbs sampler. The second one uses Metropolis-Hastings moves that exploit the proximity map** of the log-posterior distribution. These samples are used to approximate maximum a posteriori and minimum mean square error estimators of both parameters and hyperparameters. Simulations on synthetic data illustrate the performances of the two proposed samplers, for both complete and over-complete dictionaries. All results are compared to the recent deterministic variational FITRA algorithm. △ Less

Submitted 18 December, 2015; originally announced December 2015.

A Bayesian fusion model for space-time reconstruction of finely resolved velocities in turbulent flows from low resolution measurements

Authors: Linh Van Nguyen, Jean-Philippe Laval, Pierre Chainais

Abstract: The study of turbulent flows calls for measurements with high resolution both in space and in time. We propose a new approach to reconstruct High-Temporal-High-Spatial resolution velocity fields by combining two sources of information that are well-resolved either in space or in time, the Low-Temporal-High-Spatial (LTHS) and the High-Temporal-Low-Spatial (HTLS) resolution measurements. In the fram… ▽ More The study of turbulent flows calls for measurements with high resolution both in space and in time. We propose a new approach to reconstruct High-Temporal-High-Spatial resolution velocity fields by combining two sources of information that are well-resolved either in space or in time, the Low-Temporal-High-Spatial (LTHS) and the High-Temporal-Low-Spatial (HTLS) resolution measurements. In the framework of co-conception between sensing and data post-processing, this work extensively investigates a Bayesian reconstruction approach using a simulated database. A Bayesian fusion model is developed to solve the inverse problem of data reconstruction. The model uses a Maximum A Posteriori estimate, which yields the most probable field knowing the measurements. The DNS of a wall-bounded turbulent flow at moderate Reynolds number is used to validate and assess the performances of the present approach. Low resolution measurements are subsampled in time and space from the fully resolved data. Reconstructed velocities are compared to the reference DNS to estimate the reconstruction errors. The model is compared to other conventional methods such as Linear Stochastic Estimation and cubic spline interpolation. Results show the superior accuracy of the proposed method in all configurations. Further investigations of model performances on various range of scales demonstrate its robustness. Numerical experiments also permit to estimate the expected maximum information level corresponding to limitations of experimental instruments. △ Less

Submitted 8 June, 2015; originally announced June 2015.

Comments: 15 pages, 6 figures

Statistical performance analysis of a fast super-resolution technique using noisy translations

Authors: Pierre Chainais, Aymeric Leray

Abstract: It is well known that the registration process is a key step for super-resolution reconstruction. In this work, we propose to use a piezoelectric system that is easily adaptable on all microscopes and telescopes for controlling accurately their motion (down to nanometers) and therefore acquiring multiple images of the same scene at different controlled positions. Then a fast super-resolution algor… ▽ More It is well known that the registration process is a key step for super-resolution reconstruction. In this work, we propose to use a piezoelectric system that is easily adaptable on all microscopes and telescopes for controlling accurately their motion (down to nanometers) and therefore acquiring multiple images of the same scene at different controlled positions. Then a fast super-resolution algorithm \cite{eh01} can be used for efficient super-resolution reconstruction. In this case, the optimal use of $r^2$ images for a resolution enhancement factor $r$ is generally not enough to obtain satisfying results due to the random inaccuracy of the positioning system. Thus we propose to take several images around each reference position. We study the error produced by the super-resolution algorithm due to spatial uncertainty as a function of the number of images per position. We obtain a lower bound on the number of images that is necessary to ensure a given error upper bound with probability higher than some desired confidence level. △ Less

Submitted 3 November, 2014; originally announced November 2014.

Comments: 15 pages, submitted

Proceedings of the second "international Traveling Workshop on Interactions between Sparse models and Technology" (iTWIST'14)

Authors: L. Jacques, C. De Vleeschouwer, Y. Boursier, P. Sudhakar, C. De Mol, A. Pizurica, S. Anthoine, P. Vandergheynst, P. Frossard, C. Bilen, S. Kitic, N. Bertin, R. Gribonval, N. Boumal, B. Mishra, P. -A. Absil, R. Sepulchre, S. Bundervoet, C. Schretter, A. Dooms, P. Schelkens, O. Chabiron, F. Malgouyres, J. -Y. Tourneret, N. Dobigeon , et al. (42 additional authors not shown)

Abstract: The implicit objective of the biennial "international - Traveling Workshop on Interactions between Sparse models and Technology" (iTWIST) is to foster collaboration between international scientific teams by disseminating ideas through both specific oral/poster presentations and free discussions. For its second edition, the iTWIST workshop took place in the medieval and picturesque town of Namur in… ▽ More The implicit objective of the biennial "international - Traveling Workshop on Interactions between Sparse models and Technology" (iTWIST) is to foster collaboration between international scientific teams by disseminating ideas through both specific oral/poster presentations and free discussions. For its second edition, the iTWIST workshop took place in the medieval and picturesque town of Namur in Belgium, from Wednesday August 27th till Friday August 29th, 2014. The workshop was conveniently located in "The Arsenal" building within walking distance of both hotels and town center. iTWIST'14 has gathered about 70 international participants and has featured 9 invited talks, 10 oral presentations, and 14 posters on the following themes, all related to the theory, application and generalization of the "sparsity paradigm": Sparsity-driven data sensing and processing; Union of low dimensional subspaces; Beyond linear and convex inverse problem; Matrix/manifold/graph sensing/processing; Blind inverse problems and dictionary learning; Sparsity and computational neuroscience; Information theory, geometry and randomness; Complexity/accuracy tradeoffs in numerical methods; Sparsity? What's next?; Sparse machine learning and inference. △ Less

Submitted 9 October, 2014; v1 submitted 2 October, 2014; originally announced October 2014.

Comments: 69 pages, 24 extended abstracts, iTWIST'14 website: http://sites.google.com/site/itwist14

Distributed dictionary learning over a sensor network

Authors: Pierre Chainais, Cédric Richard

Abstract: We consider the problem of distributed dictionary learning, where a set of nodes is required to collectively learn a common dictionary from noisy measurements. This approach may be useful in several contexts including sensor networks. Diffusion cooperation schemes have been proposed to solve the distributed linear regression problem. In this work we focus on a diffusion-based adaptive dictionary l… ▽ More We consider the problem of distributed dictionary learning, where a set of nodes is required to collectively learn a common dictionary from noisy measurements. This approach may be useful in several contexts including sensor networks. Diffusion cooperation schemes have been proposed to solve the distributed linear regression problem. In this work we focus on a diffusion-based adaptive dictionary learning strategy: each node records observations and cooperates with its neighbors by sharing its local dictionary. The resulting algorithm corresponds to a distributed block coordinate descent (alternate optimization). Beyond dictionary learning, this strategy could be adapted to many matrix factorization problems and generalized to various settings. This article presents our approach and illustrates its efficiency on some numerical examples. △ Less

Submitted 12 April, 2013; originally announced April 2013.

Comments: 6 pages, 1 figure

Quantifying and containing the curse of high resolution coronal imaging

Authors: Véronique Delouille, Pierre Chainais, Jean-François Hochedez

Abstract: Future missions such as Solar Orbiter (SO), InterHelioprobe, or Solar Probe aim at approaching the Sun closer than ever before, with on board some high resolution imagers (HRI) having a subsecond cadence and a pixel area of about $(80km)^2$ at the Sun during perihelion. In order to guarantee their scientific success, it is necessary to evaluate if the photon counts available at these resolution… ▽ More Future missions such as Solar Orbiter (SO), InterHelioprobe, or Solar Probe aim at approaching the Sun closer than ever before, with on board some high resolution imagers (HRI) having a subsecond cadence and a pixel area of about $(80km)^2$ at the Sun during perihelion. In order to guarantee their scientific success, it is necessary to evaluate if the photon counts available at these resolution and cadence will provide a sufficient signal-to-noise ratio (SNR). We perform a first step in this direction by analyzing and characterizing the spatial intermittency of Quiet Sun images thanks to a multifractal analysis. We identify the parameters that specify the scale-invariance behavior. This identification allows next to select a family of multifractal processes, namely the Compound Poisson Cascades, that can synthesize artificial images having some of the scale-invariance properties observed on the recorded images. The prevalence of self-similarity in Quiet Sun coronal images makes it relevant to study the ratio between the SNR present at SoHO/EIT images and in coarsened images. SoHO/EIT images thus play the role of 'high resolution' images, whereas the 'low-resolution' coarsened images are rebinned so as to simulate a smaller angular resolution and/or a larger distance to the Sun. For a fixed difference in angular resolution and in Spacecraft-Sun distance, we determine the proportion of pixels having a SNR preserved at high resolution given a particular increase in effective area. If scale-invariance continues to prevail at smaller scales, the conclusion reached with SoHO/EIT images can be transposed to the situation where the resolution is increased from SoHO/EIT to SO/HRI resolution at perihelion. △ Less

Submitted 22 August, 2008; originally announced August 2008.

Comments: 25 pages, 1 table, 7 figures