-
PAVI: Plate-Amortized Variational Inference
Authors:
Louis Rouillard,
Thomas Moreau,
Demian Wassermann
Abstract:
Given some observed data and a probabilistic generative model, Bayesian inference aims at obtaining the distribution of a model's latent parameters that could have yielded the data. This task is challenging for large population studies where thousands of measurements are performed over a cohort of hundreds of subjects, resulting in a massive latent parameter space. This large cardinality renders o…
▽ More
Given some observed data and a probabilistic generative model, Bayesian inference aims at obtaining the distribution of a model's latent parameters that could have yielded the data. This task is challenging for large population studies where thousands of measurements are performed over a cohort of hundreds of subjects, resulting in a massive latent parameter space. This large cardinality renders off-the-shelf Variational Inference (VI) computationally impractical. In this work, we design structured VI families that can efficiently tackle large population studies. To this end, our main idea is to share the parameterization and learning across the different i.i.d. variables in a generative model -symbolized by the model's plates. We name this concept plate amortization, and illustrate the powerful synergies it entitles, resulting in expressive, parsimoniously parameterized and orders of magnitude faster to train large scale hierarchical variational distributions. We illustrate the practical utility of PAVI through a challenging Neuroimaging example featuring a million latent parameters, demonstrating a significant step towards scalable and expressive Variational Inference.
△ Less
Submitted 10 June, 2022;
originally announced June 2022.
-
Inverting brain grey matter models with likelihood-free inference: a tool for trustable cytoarchitecture measurements
Authors:
Maëliss Jallais,
Pedro Luiz Coelho Rodrigues,
Alexandre Gramfort,
Demian Wassermann
Abstract:
Effective characterisation of the brain grey matter cytoarchitecture with quantitative sensitivity to soma density and volume remains an unsolved challenge in diffusion MRI (dMRI). Solving the problem of relating the dMRI signal with cytoarchitectural characteristics calls for the definition of a mathematical model that describes brain tissue via a handful of physiologically-relevant parameters an…
▽ More
Effective characterisation of the brain grey matter cytoarchitecture with quantitative sensitivity to soma density and volume remains an unsolved challenge in diffusion MRI (dMRI). Solving the problem of relating the dMRI signal with cytoarchitectural characteristics calls for the definition of a mathematical model that describes brain tissue via a handful of physiologically-relevant parameters and an algorithm for inverting the model. To address this issue, we propose a new forward model, specifically a new system of equations, requiring a few relatively sparse b-shells. We then apply modern tools from Bayesian analysis known as likelihood-free inference (LFI) to invert our proposed model. As opposed to other approaches from the literature, our algorithm yields not only an estimation of the parameter vector $θ$ that best describes a given observed data point $x_0$, but also a full posterior distribution $p(θ|x_0)$ over the parameter space. This enables a richer description of the model inversion, providing indicators such as credible intervals for the estimated parameters and a complete characterization of the parameter regions where the model may present indeterminacies. We approximate the posterior distribution using deep neural density estimators, known as normalizing flows, and fit them using a set of repeated simulations from the forward model. We validate our approach on simulations using dmipy and then apply the whole pipeline on two publicly available datasets.
△ Less
Submitted 4 May, 2022; v1 submitted 15 November, 2021;
originally announced November 2021.
-
Inferring the Localization of White-Matter Tracts using Diffusion Driven Label Fusion
Authors:
Guillermo Gallardo,
Gaston Zanitti,
Mat Higger,
Sylvain Bouix,
Demian Wassermann
Abstract:
Inferring which pathways are affected by a brain lesion is key for both pre and post-treatment planning. However, many disruptive lesions cause changes in the tissue that interrupt tractography algorithms. In such cases, aggregating information from healthy subjects can provide a solution to inferring the affected pathways. In this paper, we introduce a novel label fusion technique that leverages…
▽ More
Inferring which pathways are affected by a brain lesion is key for both pre and post-treatment planning. However, many disruptive lesions cause changes in the tissue that interrupt tractography algorithms. In such cases, aggregating information from healthy subjects can provide a solution to inferring the affected pathways. In this paper, we introduce a novel label fusion technique that leverages diffusion information to locate brain pathways. Through simulations and experiments in publicly available data we show that our method is able to correctly reconstruct brain pathways, even if they are affected by a focal lesion.
△ Less
Submitted 4 October, 2021;
originally announced October 2021.
-
ADAVI: Automatic Dual Amortized Variational Inference Applied To Pyramidal Bayesian Models
Authors:
Louis Rouillard,
Demian Wassermann
Abstract:
Frequently, population studies feature pyramidally-organized data represented using Hierarchical Bayesian Models (HBM) enriched with plates. These models can become prohibitively large in settings such as neuroimaging, where a sample is composed of a functional MRI signal measured on 300 brain locations, across 4 measurement sessions, and 30 subjects, resulting in around 1 million latent parameter…
▽ More
Frequently, population studies feature pyramidally-organized data represented using Hierarchical Bayesian Models (HBM) enriched with plates. These models can become prohibitively large in settings such as neuroimaging, where a sample is composed of a functional MRI signal measured on 300 brain locations, across 4 measurement sessions, and 30 subjects, resulting in around 1 million latent parameters.Such high dimensionality hampers the usage of modern, expressive flow-based techniques.To infer parameter posterior distributions in this challenging class of problems, we designed a novel methodology that automatically produces a variational family dual to a target HBM. This variational family, represented as a neural network, consists in the combination of an attention-based hierarchical encoder feeding summary statistics to a set of normalizing flows. Our automatically-derived neural network exploits exchangeability in the plate-enriched HBM and factorizes its parameter space. The resulting architecture reduces by orders of magnitude its parameterization with respect to that of a typical flow-based representation, while maintaining expressivity.Our method performs inference on the specified HBM in an amortized setup: once trained, it can readily be applied to a new data sample to compute the parameters' full posterior.We demonstrate the capability and scalability of our method on simulated data, as well as a challenging high-dimensional brain parcellation experiment. We also open up several questions that lie at the intersection between normalizing flows, SBI, structured Variational Inference, and inference amortization.
△ Less
Submitted 8 March, 2022; v1 submitted 23 June, 2021;
originally announced June 2021.
-
Fine-grain atlases of functional modes for fMRI analysis
Authors:
Kamalaker Dadi,
Gaël Varoquaux,
Antonia Machlouzarides-Shalit,
Krzysztof J. Gorgolewski,
Demian Wassermann,
Bertrand Thirion,
Arthur Mensch
Abstract:
Population imaging markedly increased the size of functional-imaging datasets, shedding new light on the neural basis of inter-individual differences. Analyzing these large data entails new scalability challenges, computational and statistical. For this reason, brain images are typically summarized in a few signals, for instance reducing voxel-level measures with brain atlases or functional modes.…
▽ More
Population imaging markedly increased the size of functional-imaging datasets, shedding new light on the neural basis of inter-individual differences. Analyzing these large data entails new scalability challenges, computational and statistical. For this reason, brain images are typically summarized in a few signals, for instance reducing voxel-level measures with brain atlases or functional modes. A good choice of the corresponding brain networks is important, as most data analyses start from these reduced signals. We contribute finely-resolved atlases of functional modes, comprising from 64 to 1024 networks. These dictionaries of functional modes (DiFuMo) are trained on millions of fMRI functional brain volumes of total size 2.4TB, spanned over 27 studies and many research groups. We demonstrate the benefits of extracting reduced signals on our fine-grain atlases for many classic functional data analysis pipelines: stimuli decoding from 12,334 brain responses, standard GLM analysis of fMRI across sessions and individuals, extraction of resting-state functional-connectomes biomarkers for 2,500 individuals, data compression and meta-analysis over more than 15,000 statistical maps. In each of these analysis scenarii, we compare the performance of our functional atlases with that of other popular references, and to a simple voxel-level analysis. Results highlight the importance of using high-dimensional "soft" functional atlases, to represent and analyse brain activity while capturing its functional gradients. Analyses on high-dimensional modes achieve similar statistical performance as at the voxel level, but with much reduced computational cost and higher interpretability. In addition to making them available, we provide meaningful names for these modes, based on their anatomical location. It will facilitate reporting of results.
△ Less
Submitted 5 March, 2020;
originally announced March 2020.
-
Diffusion MRI simulation of realistic neurons with SpinDoctor and the Neuron Module
Authors:
Chengran Fang,
Van-Dang Nguyen,
Demian Wassermann,
**g-Rebecca Li
Abstract:
In this paper we present the Neuron Module that we implemented within the Matlab-based diffusion MRI simulation toolbox SpinDoctor. SpinDoctor uses finite element discretization and adaptive time integration to solve the Bloch-Torrey partial differential equation for general diffusion-encoding sequences, at multiple b-values and in multiple diffusion directions. In order to facilitate the diffusio…
▽ More
In this paper we present the Neuron Module that we implemented within the Matlab-based diffusion MRI simulation toolbox SpinDoctor. SpinDoctor uses finite element discretization and adaptive time integration to solve the Bloch-Torrey partial differential equation for general diffusion-encoding sequences, at multiple b-values and in multiple diffusion directions. In order to facilitate the diffusion MRI simulation of realistic neurons by the research community, we constructed finite element meshes for a group of 36 pyramidal neurons and a group of 29 spindle neurons whose morphological descriptions were found in the publicly available neuron repository NeuroMorpho. We also broke the neurons into the soma and dendrite branches and created finite elements meshes for these cell components. Through the Neuron Module, these neuron and cell components finite element meshes can be seamlessly coupled with the functionalities of SpinDoctor. To illustrate some potential uses of the Neuron Module, we show numerical examples of the simulated diffusion MRI signals in multiple diffusion directions from whole neurons as well as from the soma and dendrite branches, and include a comparison of the high b-value behavior between dendrite branches and whole neurons. In addition, we demonstrate that the neuron meshes can be used to perform Monte-Carlo diffusion MRI simulations as well. We show that at equivalent accuracy, if only one gradient direction needs to be simulated, SpinDoctor is faster than a GPU implementation of Monte-Carlo. Finally, we numerically compute the eigenfunctions and the eigenvalues of the Bloch-Torrey and the Laplace operators on the neuron geometries using a finite elements discretization, in order to give guidance in the choice of the space and time discretization parameters for both finite elements and Monte-Carlo approaches.
△ Less
Submitted 21 July, 2020; v1 submitted 16 October, 2019;
originally announced October 2019.
-
Machine learning based white matter models with permeability: An experimental study in cuprizone treated in-vivo mouse model of axonal demyelination
Authors:
Ioana Hill,
Marco Palombo,
Mathieu Santin,
Francesca Branzoli,
Anne-Charlotte Philippe,
Demian Wassermann,
Marie-Stephane Aigrot,
Bruno Stankoff,
Anne Baron-Van Evercooren,
Mehdi Felfi,
Dominique Langui,
Hui Zhang,
Stephane Lehericy,
Alexandra Petiet,
Daniel C. Alexander,
Olga Ciccarelli,
Ivana Drobnjak
Abstract:
The intra-axonal water exchange time τi, a parameter associated with axonal permeability, could be an important biomarker for understanding demyelinating pathologies such as Multiple Sclerosis. Diffusion-Weighted MRI is sensitive to changes in permeability, however, the parameter has remained elusive due to the intractability of the mathematical models that incorporate it. Machine learning based c…
▽ More
The intra-axonal water exchange time τi, a parameter associated with axonal permeability, could be an important biomarker for understanding demyelinating pathologies such as Multiple Sclerosis. Diffusion-Weighted MRI is sensitive to changes in permeability, however, the parameter has remained elusive due to the intractability of the mathematical models that incorporate it. Machine learning based computational models can potentially be used to estimate such parameters, and recently, a theoretical framework using a random forest (RF) suggests this is a promising approach. In this study, we adopt such an RF approach and experimentally investigate its suitability as a biomarker for demyelinating pathologies through direct comparison with histology. For this, we use an in-vivo cuprizone (CPZ) mouse model of demyelination with available ex-vivo electron microscopy (EM) data. We test our model on noise-free simulations and find very strong correlations between the predicted and ground truth parameters. For realistic noise levels as in our in-vivo data, the performance is affected, however, the parameters are still well estimated. We apply our RF model on in-vivo data from 8 CPZ and 8 wild-type (WT) mice and validate the RF estimates using histology. We find a strong correlation between the in-vivo RF estimates of τi and the EM measurements of myelin thickness ({ρ_τ}i = 0.82), and between RF estimates and EM measurements of intra-axonal volume fraction ({ρ_f} = 0.98). When comparing τi in CPZ and WT mice we find a statistically significant decrease in the corpus callosum of the CPZ compared to the WT mice, in line with our expectations that τi is lower in regions where the myelin sheath is damaged. Overall, these results demonstrate the suitability of machine learning compartment models with permeability as a potential biomarker for demyelinating pathologies.
△ Less
Submitted 4 July, 2019;
originally announced July 2019.
-
Groupwise Structural Parcellation of the Cortex: A Sound Approach Based on Logistic Models
Authors:
Guillermo Gallardo,
William Wells Iii,
Rachid Deriche,
Demian Wassermann
Abstract:
Current theories hold that brain function is highly related to long-range physical connections through axonal bundles, namely extrinsic connectiv-ity. However, obtaining a groupwise cortical parcellation based on extrinsic connectivity remains challenging. Current parcellation methods are compu-tationally expensive; need tuning of several parameters or rely on ad-hoc constraints. Furthermore, none…
▽ More
Current theories hold that brain function is highly related to long-range physical connections through axonal bundles, namely extrinsic connectiv-ity. However, obtaining a groupwise cortical parcellation based on extrinsic connectivity remains challenging. Current parcellation methods are compu-tationally expensive; need tuning of several parameters or rely on ad-hoc constraints. Furthermore, none of these methods present a model for the cortical extrinsic connectivity of the cortex. To tackle these problems, we propose a parsimonious model for the extrinsic connectivity and an efficient parceling technique based on clustering of tractograms. Our technique allows the creation of single subject and groupwise parcellations of the whole cortex. The parcellations obtained with our technique are in agreement with structural and functional parcellations in the literature. In particular, the motor and sensory cortex are subdivided in agreement with the human ho-munculus of Penfield. We illustrate this by comparing our resulting parcels with the motor strip map** included in the Human Connectome Project data.
△ Less
Submitted 5 January, 2017;
originally announced January 2017.
-
Extracting the Groupwise Core Structural Connectivity Network: Bridging Statistical and Graph-Theoretical Approaches
Authors:
Nahuel Lascano,
Guillermo Gallardo,
Rachid Deriche,
Dorian Mazauric,
Demian Wassermann
Abstract:
Finding the common structural brain connectivity network for a given population is an open problem, crucial for current neuro-science. Recent evidence suggests there's a tightly connected network shared between humans. Obtaining this network will, among many advantages , allow us to focus cognitive and clinical analyses on common connections, thus increasing their statistical power. In turn, knowl…
▽ More
Finding the common structural brain connectivity network for a given population is an open problem, crucial for current neuro-science. Recent evidence suggests there's a tightly connected network shared between humans. Obtaining this network will, among many advantages , allow us to focus cognitive and clinical analyses on common connections, thus increasing their statistical power. In turn, knowledge about the common network will facilitate novel analyses to understand the structure-function relationship in the brain. In this work, we present a new algorithm for computing the core structural connectivity network of a subject sample combining graph theory and statistics. Our algorithm works in accordance with novel evidence on brain topology. We analyze the problem theoretically and prove its complexity. Using 309 subjects, we show its advantages when used as a feature selection for connectivity analysis on populations, outperforming the current approaches.
△ Less
Submitted 9 January, 2017; v1 submitted 5 January, 2017;
originally announced January 2017.
-
The White Matter Query Language: A Novel Approach for Describing Human White Matter Anatomy
Authors:
Demian Wassermann,
Makris Nikos,
Yogesh Rathi,
Shenton Martha,
Ron Kikinis,
Marek Kubicki,
Carl-Fredrik Westin
Abstract:
We have developed a novel method to describe human white matter anatomy using an approach that is both intuitive and simple to use, and which automatically extracts white matter tracts from diffusion MRI volumes. Further, our method simplifies the quantification and statistical analysis of white matter tracts on large diffusion MRI databases. This work reflects the careful syntactical definition o…
▽ More
We have developed a novel method to describe human white matter anatomy using an approach that is both intuitive and simple to use, and which automatically extracts white matter tracts from diffusion MRI volumes. Further, our method simplifies the quantification and statistical analysis of white matter tracts on large diffusion MRI databases. This work reflects the careful syntactical definition of major white matter fiber tracts in the human brain based on a neuroanatomist's expert knowledge. The framework is based on a novel query language with a near-to-English textual syntax. This query language makes it possible to construct a dictionary of anatomical definitions that describe white matter tracts. The definitions include adjacent gray and white matter regions, and rules for spatial relations. This novel method makes it possible to automatically label white matter anatomy across subjects. After describing this method, we provide an example of its implementation where we encode anatomical knowledge in human white matter for 10 association and 15 projection tracts per hemisphere, along with 7 commissural tracts. Importantly, this novel method is comparable in accuracy to manual labeling. Finally, we present results applying this method to create a white matter atlas from 77 healthy subjects, and we use this atlas in a small proof-of-concept study to detect changes in association tracts that characterize schizophrenia.
△ Less
Submitted 23 December, 2015;
originally announced December 2015.