A Bayesian factor analysis model for high-dimensional microbiome count data
Authors:
Ismaïla Ba,
Maxime Turgeon,
Simona Veniamin,
Juan Joel,
Richard Miller,
Morag Graham,
Christine Bonner,
Charles N. Bernstein,
Douglas L. Arnold,
Amit Bar-Or,
Ruth Ann Marrie,
Julia O'Mahony,
E. Ann Yeh,
Brenda Banwell,
Emmanuelle Waubant,
Natalie Knox,
Gary Van Domselaar,
Ali I. Mirza,
Heather Armstrong,
Saman Muthukumarana,
Kevin McGregor
Abstract:
Dimension reduction techniques are among the most essential analytical tools in the analysis of high-dimensional data. Generalized principal component analysis (PCA) is an extension to standard PCA that has been widely used to identify low-dimensional features in high-dimensional discrete data, such as binary, multi-category and count data. For microbiome count data in particular, the multinomial…
▽ More
Dimension reduction techniques are among the most essential analytical tools in the analysis of high-dimensional data. Generalized principal component analysis (PCA) is an extension to standard PCA that has been widely used to identify low-dimensional features in high-dimensional discrete data, such as binary, multi-category and count data. For microbiome count data in particular, the multinomial PCA is a natural counterpart of the standard PCA. However, this technique fails to account for the excessive number of zero values, which is frequently observed in microbiome count data. To allow for sparsity, zero-inflated multivariate distributions can be used. We propose a zero-inflated probabilistic PCA model for latent factor analysis. The proposed model is a fully Bayesian factor analysis technique that is appropriate for microbiome count data analysis. In addition, we use the mean-field-type variational family to approximate the marginal likelihood and develop a classification variational approximation algorithm to fit the model. We demonstrate the efficiency of our procedure for predictions based on the latent factors and the model parameters through simulation experiments, showcasing its superiority over competing methods. This efficiency is further illustrated with two real microbiome count datasets. The method is implemented in R.
△ Less
Submitted 23 April, 2024; v1 submitted 3 April, 2024;
originally announced April 2024.
Layer-wise learning of deep generative models
Authors:
Ludovic Arnold,
Yann Ollivier
Abstract:
When using deep, multi-layered architectures to build generative models of data, it is difficult to train all layers at once. We propose a layer-wise training procedure admitting a performance guarantee compared to the global optimum. It is based on an optimistic proxy of future performance, the best latent marginal. We interpret auto-encoders in this setting as generative models, by showing that…
▽ More
When using deep, multi-layered architectures to build generative models of data, it is difficult to train all layers at once. We propose a layer-wise training procedure admitting a performance guarantee compared to the global optimum. It is based on an optimistic proxy of future performance, the best latent marginal. We interpret auto-encoders in this setting as generative models, by showing that they train a lower bound of this criterion. We test the new learning procedure against a state of the art method (stacked RBMs), and find it to improve performance. Both theory and experiments highlight the importance, when training deep architectures, of using an inference model (from data to hidden variables) richer than the generative model (from hidden variables to data).
△ Less
Submitted 16 February, 2013; v1 submitted 6 December, 2012;
originally announced December 2012.
