Showing 1–5 of 5 results for author: Zoltowski, D

Neural Latents Benchmark '21: Evaluating latent variable models of neural population activity

Authors: Felix Pei, Joel Ye, David Zoltowski, Anqi Wu, Raeed H. Chowdhury, Hansem Sohn, Joseph E. O'Doherty, Krishna V. Shenoy, Matthew T. Kaufman, Mark Churchland, Mehrdad Jazayeri, Lee E. Miller, Jonathan Pillow, Il Memming Park, Eva L. Dyer, Chethan Pandarinath

Abstract: Advances in neural recording present increasing opportunities to study neural activity in unprecedented detail. Latent variable models (LVMs) are promising tools for analyzing this rich activity across diverse neural systems and behaviors, as LVMs do not depend on known relationships between the activity and external experimental variables. However, progress with LVMs for neuronal population activ… ▽ More Advances in neural recording present increasing opportunities to study neural activity in unprecedented detail. Latent variable models (LVMs) are promising tools for analyzing this rich activity across diverse neural systems and behaviors, as LVMs do not depend on known relationships between the activity and external experimental variables. However, progress with LVMs for neuronal population activity is currently impeded by a lack of standardization, resulting in methods being developed and compared in an ad hoc manner. To coordinate these modeling efforts, we introduce a benchmark suite for latent variable modeling of neural population activity. We curate four datasets of neural spiking activity from cognitive, sensory, and motor areas to promote models that apply to the wide variety of activity seen across these areas. We identify unsupervised evaluation as a common framework for evaluating models across datasets, and apply several baselines that demonstrate benchmark diversity. We release this benchmark through EvalAI. http://neurallatents.github.io △ Less

Submitted 17 January, 2022; v1 submitted 9 September, 2021; originally announced September 2021.

Unifying and generalizing models of neural dynamics during decision-making

Authors: David M. Zoltowski, Jonathan W. Pillow, Scott W. Linderman

Abstract: An open question in systems and computational neuroscience is how neural circuits accumulate evidence towards a decision. Fitting models of decision-making theory to neural activity helps answer this question, but current approaches limit the number of these models that we can fit to neural data. Here we propose a unifying framework for modeling neural activity during decision-making tasks. The fr… ▽ More An open question in systems and computational neuroscience is how neural circuits accumulate evidence towards a decision. Fitting models of decision-making theory to neural activity helps answer this question, but current approaches limit the number of these models that we can fit to neural data. Here we propose a unifying framework for modeling neural activity during decision-making tasks. The framework includes the canonical drift-diffusion model and enables extensions such as multi-dimensional accumulators, variable and collapsing boundaries, and discrete jumps. Our framework is based on constraining the parameters of recurrent state-space models, for which we introduce a scalable variational Laplace-EM inference algorithm. We applied the modeling approach to spiking responses recorded from monkey parietal cortex during two decision-making tasks. We found that a two-dimensional accumulator better captured the trial-averaged responses of a set of parietal neurons than a single accumulator model. Next, we identified a variable lower boundary in the responses of an LIP neuron during a random dot motion task. △ Less

Submitted 13 January, 2020; originally announced January 2020.

Efficient non-conjugate Gaussian process factor models for spike count data using polynomial approximations

Authors: Stephen L. Keeley, David M. Zoltowski, Yiyi Yu, Jacob L. Yates, Spencer L. Smith, Jonathan W. Pillow

Abstract: Gaussian Process Factor Analysis (GPFA) has been broadly applied to the problem of identifying smooth, low-dimensional temporal structure underlying large-scale neural recordings. However, spike trains are non-Gaussian, which motivates combining GPFA with discrete observation models for binned spike count data. The drawback to this approach is that GPFA priors are not conjugate to count model like… ▽ More Gaussian Process Factor Analysis (GPFA) has been broadly applied to the problem of identifying smooth, low-dimensional temporal structure underlying large-scale neural recordings. However, spike trains are non-Gaussian, which motivates combining GPFA with discrete observation models for binned spike count data. The drawback to this approach is that GPFA priors are not conjugate to count model likelihoods, which makes inference challenging. Here we address this obstacle by introducing a fast, approximate inference method for non-conjugate GPFA models. Our approach uses orthogonal second-order polynomials to approximate the nonlinear terms in the non-conjugate log-likelihood, resulting in a method we refer to as \textit{polynomial approximate log-likelihood} (PAL) estimators. This approximation allows for accurate closed-form evaluation of marginal likelihoods and fast numerical optimization for parameters and hyperparameters. We derive PAL estimators for GPFA models with binomial, Poisson, and negative binomial observations and find the PAL estimation is highly accurate, and achieves faster convergence times compared to existing state-of-the-art inference methods. We also find that PAL hyperparameters can provide sensible initialization for black box variational inference (BBVI), which improves BBVI accuracy. We demonstrate that PAL estimators achieve fast and accurate extraction of latent structure from multi-neuron spike train data. △ Less

Submitted 5 October, 2020; v1 submitted 7 June, 2019; originally announced June 2019.

Training Sequence Design for Feedback Assisted Hybrid Beamforming in Massive MIMO Systems

Authors: Song Noh, Michael D. Zoltowski, David J. Love

Abstract: The use of large-scale antenna systems in future commercial wireless communications is an emerging technology that uses an excess of transmit antennas to realize high spectral efficiency. Achieving potential gains with large-scale antenna arrays in practice hinges on sufficient channel estimation accuracy. Much prior work focuses on TDD based networks, relying on reciprocity between the uplink and… ▽ More The use of large-scale antenna systems in future commercial wireless communications is an emerging technology that uses an excess of transmit antennas to realize high spectral efficiency. Achieving potential gains with large-scale antenna arrays in practice hinges on sufficient channel estimation accuracy. Much prior work focuses on TDD based networks, relying on reciprocity between the uplink and downlink channels. However, most currently deployed commercial wireless systems are FDD based, making it difficult to exploit channel reciprocity. In massive MIMO FDD systems, the problem of channel estimation becomes even more challenging due to the attendant substantial training resources and feedback requirements which scale with the number of antennas. In this paper, we consider the problem of training sequence design that employs a set of training signals and its map** to the training periods. We focus on reduced-dimension training sequence designs, along with transmit precoder designs, aimed at reducing both hardware complexity and power consumption. The resulting designs are extended to hybrid analog-digital beamforming systems, which employ a limited number of active RF chains for transmit precoding, by applying the Toeplitz distribution theorem to large-scale linear antenna systems. A practical guideline for training sequence parameter selection is presented along with performance analysis. △ Less

Submitted 17 July, 2015; v1 submitted 7 July, 2014; originally announced July 2014.

Comments: 16 pages, 9 figures, replaced with revised version

Pilot Beam Pattern Design for Channel Estimation in Massive MIMO Systems

Authors: Song Noh, Michael D. Zoltowski, Youngchul Sung, David J. Love

Abstract: In this paper, the problem of pilot beam pattern design for channel estimation in massive multiple-input multiple-output systems with a large number of transmit antennas at the base station is considered, and a new algorithm for pilot beam pattern design for optimal channel estimation is proposed under the assumption that the channel is a stationary Gauss-Markov random process. The proposed algori… ▽ More In this paper, the problem of pilot beam pattern design for channel estimation in massive multiple-input multiple-output systems with a large number of transmit antennas at the base station is considered, and a new algorithm for pilot beam pattern design for optimal channel estimation is proposed under the assumption that the channel is a stationary Gauss-Markov random process. The proposed algorithm designs the pilot beam pattern sequentially by exploiting the properties of Kalman filtering and the associated prediction error covariance matrices and also the channel statistics such as spatial and temporal channel correlation. The resulting design generates a sequentially-optimal sequence of pilot beam patterns with low complexity for a given set of system parameters. Numerical results show the effectiveness of the proposed algorithm. △ Less

Submitted 15 January, 2014; v1 submitted 28 September, 2013; originally announced September 2013.

Comments: 15 pages, 12 figures, Practical issues such as channel covariance matrix estimation are considered