Showing 1–20 of 20 results for author: Sajda, P

Circular Clustering with Polar Coordinate Reconstruction

Authors: Xiaoxiao Sun, Paul Sajda

Abstract: There is a growing interest in characterizing circular data found in biological systems. Such data are wide ranging and varied, from signal phase in neural recordings to nucleotide sequences in round genomes. Traditional clustering algorithms are often inadequate due to their limited ability to distinguish differences in the periodic component. Current clustering schemes that work in a polar coord… ▽ More There is a growing interest in characterizing circular data found in biological systems. Such data are wide ranging and varied, from signal phase in neural recordings to nucleotide sequences in round genomes. Traditional clustering algorithms are often inadequate due to their limited ability to distinguish differences in the periodic component. Current clustering schemes that work in a polar coordinate system have limitations, such as being only angle-focused or lacking generality. To overcome these limitations, we propose a new analysis framework that utilizes projections onto a cylindrical coordinate system to better represent objects in a polar coordinate system. Using the mathematical properties of circular data, we show our approach always finds the correct clustering result within the reconstructed dataset, given sufficient periodic repetitions of the data. Our approach is generally applicable and adaptable and can be incorporated into most state-of-the-art clustering algorithms. We demonstrate on synthetic and real data that our method generates more appropriate and consistent clustering results compared to standard methods. In summary, our proposed analysis framework overcomes the limitations of existing polar coordinate-based clustering methods and provides a more accurate and efficient way to cluster circular data. △ Less

Submitted 15 September, 2023; originally announced September 2023.

Comments: Manuscript is under review in IEEE Transactions on Computational Biology and Bioinformatics. Copyright holder is credited to IEEE

Fixating on Attention: Integrating Human Eye Tracking into Vision Transformers

Authors: Sharath Koorathota, Nikolas Papadopoulos, Jia Li Ma, Shruti Kumar, Xiaoxiao Sun, Arunesh Mittal, Patrick Adelman, Paul Sajda

Abstract: Modern transformer-based models designed for computer vision have outperformed humans across a spectrum of visual tasks. However, critical tasks, such as medical image interpretation or autonomous driving, still require reliance on human judgments. This work demonstrates how human visual input, specifically fixations collected from an eye-tracking device, can be integrated into transformer models… ▽ More Modern transformer-based models designed for computer vision have outperformed humans across a spectrum of visual tasks. However, critical tasks, such as medical image interpretation or autonomous driving, still require reliance on human judgments. This work demonstrates how human visual input, specifically fixations collected from an eye-tracking device, can be integrated into transformer models to improve accuracy across multiple driving situations and datasets. First, we establish the significance of fixation regions in left-right driving decisions, as observed in both human subjects and a Vision Transformer (ViT). By comparing the similarity between human fixation maps and ViT attention weights, we reveal the dynamics of overlap across individual heads and layers. This overlap is exploited for model pruning without compromising accuracy. Thereafter, we incorporate information from the driving scene with fixation data, employing a "joint space-fixation" (JSF) attention setup. Lastly, we propose a "fixation-attention intersection" (FAX) loss to train the ViT model to attend to the same regions that humans fixated on. We find that the ViT performance is improved in accuracy and number of training epochs when using JSF and FAX. These results hold significant implications for human-guided artificial intelligence. △ Less

Submitted 26 August, 2023; originally announced August 2023.

Comments: 25 pages, 9 figures, 3 tables

Bayesian Beta-Bernoulli Process Sparse Coding with Deep Neural Networks

Authors: Arunesh Mittal, Kai Yang, Paul Sajda, John Paisley

Abstract: Several approximate inference methods have been proposed for deep discrete latent variable models. However, non-parametric methods which have previously been successfully employed for classical sparse coding models have largely been unexplored in the context of deep models. We propose a non-parametric iterative algorithm for learning discrete latent representations in such deep models. Additionall… ▽ More Several approximate inference methods have been proposed for deep discrete latent variable models. However, non-parametric methods which have previously been successfully employed for classical sparse coding models have largely been unexplored in the context of deep models. We propose a non-parametric iterative algorithm for learning discrete latent representations in such deep models. Additionally, to learn scale invariant discrete features, we propose local data scaling variables. Lastly, to encourage sparsity in our representations, we propose a Beta-Bernoulli process prior on the latent factors. We evaluate our spare coding model coupled with different likelihood models. We evaluate our method across datasets with varying characteristics and compare our results to current amortized approximate inference methods. △ Less

Submitted 14 March, 2023; originally announced March 2023.

Inferring latent neural sources via deep transcoding of simultaneously acquired EEG and fMRI

Authors: Xueqing Liu, Tao Tu, Paul Sajda

Abstract: Simultaneous EEG-fMRI is a multi-modal neuroimaging technique that provides complementary spatial and temporal resolution. Challenging has been develo** principled and interpretable approaches for fusing the modalities, specifically approaches enabling inference of latent source spaces representative of neural activity. In this paper, we address this inference problem within the framework of tra… ▽ More Simultaneous EEG-fMRI is a multi-modal neuroimaging technique that provides complementary spatial and temporal resolution. Challenging has been develo** principled and interpretable approaches for fusing the modalities, specifically approaches enabling inference of latent source spaces representative of neural activity. In this paper, we address this inference problem within the framework of transcoding -- map** from a specific encoding (modality) to a decoding (the latent source space) and then encoding the latent source space to the other modality. Specifically, we develop a symmetric method consisting of a cyclic convolutional transcoder that transcodes EEG to fMRI and vice versa. Without any prior knowledge of either the hemodynamic response function or lead field matrix, the complete data-driven method exploits the temporal and spatial relationships between the modalities and latent source spaces to learn these map**s. We quantify, for both the simulated and real EEG-fMRI data, how well the modalities can be transcoded from one to another as well as the source spaces that are recovered, all evaluated on unseen data. In addition to enabling a new way to symmetrically infer a latent source space, the method can also be seen as low-cost computational neuroimaging -- i.e. generating an 'expensive' fMRI BOLD image from 'low cost' EEG data. △ Less

Submitted 27 November, 2022; originally announced December 2022.

Improving Prediction of Cognitive Performance using Deep Neural Networks in Sparse Data

Authors: Sharath Koorathota, Arunesh Mittal, Richard P. Sloan, Paul Sajda

Abstract: Cognition in midlife is an important predictor of age-related mental decline and statistical models that predict cognitive performance can be useful for predicting decline. However, existing models struggle to capture complex relationships between physical, sociodemographic, psychological and mental health factors that effect cognition. Using data from an observational, cohort study, Midlife in th… ▽ More Cognition in midlife is an important predictor of age-related mental decline and statistical models that predict cognitive performance can be useful for predicting decline. However, existing models struggle to capture complex relationships between physical, sociodemographic, psychological and mental health factors that effect cognition. Using data from an observational, cohort study, Midlife in the United States (MIDUS), we modeled a large number of variables to predict executive function and episodic memory measures. We used cross-sectional and longitudinal outcomes with varying sparsity, or amount of missing data. Deep neural network (DNN) models consistently ranked highest in all of the cognitive performance prediction tasks, as assessed with root mean squared error (RMSE) on out-of-sample data. RMSE differences between DNN and other model types were statistically significant (T(8) = -3.70; p < 0.05). The interaction effect between model type and sparsity was significant (F(9)=59.20; p < 0.01), indicating the success of DNNs can partly be attributed to their robustness and ability to model hierarchical relationships between health-related factors. Our findings underscore the potential of neural networks to model clinical datasets and allow better understanding of factors that lead to cognitive decline. △ Less

Submitted 28 December, 2021; originally announced December 2021.

Bayesian recurrent state space model for rs-fMRI

Authors: Arunesh Mittal, Scott Linderman, John Paisley, Paul Sajda

Abstract: We propose a hierarchical Bayesian recurrent state space model for modeling switching network connectivity in resting state fMRI data. Our model allows us to uncover shared network patterns across disease conditions. We evaluate our method on the ADNI2 dataset by inferring latent state patterns corresponding to altered neural circuits in individuals with Mild Cognitive Impairment (MCI). In additio… ▽ More We propose a hierarchical Bayesian recurrent state space model for modeling switching network connectivity in resting state fMRI data. Our model allows us to uncover shared network patterns across disease conditions. We evaluate our method on the ADNI2 dataset by inferring latent state patterns corresponding to altered neural circuits in individuals with Mild Cognitive Impairment (MCI). In addition to states shared across healthy and individuals with MCI, we discover latent states that are predominantly observed in individuals with MCI. Our model outperforms current state of the art deep learning method on ADNI2 dataset. △ Less

Submitted 14 November, 2020; originally announced November 2020.

Comments: Machine Learning for Health (ML4H) at NeurIPS 2020 - Extended Abstract

Deep Bayesian Nonparametric Factor Analysis

Authors: Arunesh Mittal, Paul Sajda, John Paisley

Abstract: We propose a deep generative factor analysis model with beta process prior that can approximate complex non-factorial distributions over the latent codes. We outline a stochastic EM algorithm for scalable inference in a specific instantiation of this model and present some preliminary results. We propose a deep generative factor analysis model with beta process prior that can approximate complex non-factorial distributions over the latent codes. We outline a stochastic EM algorithm for scalable inference in a specific instantiation of this model and present some preliminary results. △ Less

Submitted 9 November, 2020; originally announced November 2020.

Latent neural source recovery via transcoding of simultaneous EEG-fMRI

Authors: Xueqing Liu, Linbi Hong, Paul Sajda

Abstract: Simultaneous EEG-fMRI is a multi-modal neuroimaging technique that provides complementary spatial and temporal resolution for inferring a latent source space of neural activity. In this paper we address this inference problem within the framework of transcoding -- map** from a specific encoding (modality) to a decoding (the latent source space) and then encoding the latent source space to the ot… ▽ More Simultaneous EEG-fMRI is a multi-modal neuroimaging technique that provides complementary spatial and temporal resolution for inferring a latent source space of neural activity. In this paper we address this inference problem within the framework of transcoding -- map** from a specific encoding (modality) to a decoding (the latent source space) and then encoding the latent source space to the other modality. Specifically, we develop a symmetric method consisting of a cyclic convolutional transcoder that transcodes EEG to fMRI and vice versa. Without any prior knowledge of either the hemodynamic response function or lead field matrix, the method exploits the temporal and spatial relationships between the modalities and latent source spaces to learn these map**s. We show, for real EEG-fMRI data, how well the modalities can be transcoded from one to another as well as the source spaces that are recovered, all on unseen data. In addition to enabling a new way to symmetrically infer a latent source space, the method can also be seen as low-cost computational neuroimaging -- i.e. generating an 'expensive' fMRI BOLD image from 'low cost' EEG data. △ Less

Submitted 5 October, 2020; originally announced October 2020.

Unsupervised Sparse-view Backprojection via Convolutional and Spatial Transformer Networks

Authors: Xueqing Liu, Paul Sajda

Abstract: Many imaging technologies rely on tomographic reconstruction, which requires solving a multidimensional inverse problem given a finite number of projections. Backprojection is a popular class of algorithm for tomographic reconstruction, however it typically results in poor image reconstructions when the projection angles are sparse and/or if the sensors characteristics are not uniform. Several dee… ▽ More Many imaging technologies rely on tomographic reconstruction, which requires solving a multidimensional inverse problem given a finite number of projections. Backprojection is a popular class of algorithm for tomographic reconstruction, however it typically results in poor image reconstructions when the projection angles are sparse and/or if the sensors characteristics are not uniform. Several deep learning based algorithms have been developed to solve this inverse problem and reconstruct the image using a limited number of projections. However these algorithms typically require examples of the ground-truth (i.e. examples of reconstructed images) to yield good performance. In this paper, we introduce an unsupervised sparse-view backprojection algorithm, which does not require ground-truth. The algorithm consists of two modules in a generator-projector framework; a convolutional neural network and a spatial transformer network. We evaluated our algorithm using computed tomography (CT) images of the human chest. We show that our algorithm significantly out-performs filtered backprojection when the projection angles are very sparse, as well as when the sensor characteristics vary for different angles. Our approach has practical applications for medical imaging and other imaging modalities (e.g. radar) where sparse and/or non-uniform projections may be acquired due to time or sampling constraints. △ Less

Submitted 1 June, 2020; originally announced June 2020.

Scale-specific dynamics of large-amplitude bursts in EEG capture behaviorally meaningful variability

Authors: Kanika Bansal, Javier O. Garcia, Nina Lauharatanahirun, Sarah F. Muldoon, Paul Sajda, Jean M. Vettel

Abstract: Cascading large-amplitude bursts in neural activity, termed avalanches, are thought to provide insight into the complex spatially distributed interactions in neural systems. In human neuroimaging, for example, avalanches occurring during resting-state show scale-invariant dynamics, supporting the hypothesis that the brain operates near a critical point that enables long range spatial communication… ▽ More Cascading large-amplitude bursts in neural activity, termed avalanches, are thought to provide insight into the complex spatially distributed interactions in neural systems. In human neuroimaging, for example, avalanches occurring during resting-state show scale-invariant dynamics, supporting the hypothesis that the brain operates near a critical point that enables long range spatial communication. In fact, it has been suggested that such scale-invariant dynamics, characterized by a power-law distribution in these avalanches, are universal in neural systems and emerge through a common mechanism. While the analysis of avalanches and subsequent criticality is increasingly seen as a framework for using complex systems theory to understand brain function, it is unclear how the framework would account for the omnipresent cognitive variability, whether across individuals and/or tasks. To address this, we analyzed avalanches in the EEG activity of healthy humans during rest as well as two distinct task conditions that varied in cognitive demands and produced behavioral measures unique to each individual. In both rest and task conditions we observed that avalanche dynamics demonstrate scale-invariant characteristics, but differ in their specific features, demonstrating individual variability. Using a new metric we call normalized engagement, which estimates the likelihood for a brain region to produce high-amplitude bursts, we also investigated regional features of avalanche dynamics. Normalized engagement showed not only the expected individual and task dependent variability, but also scale-specificity that correlated with individual behavior. Our findings expand our understanding of avalanche features and are supportive of the emerging theoretical idea that the dynamics of an active human brain operate close to a critical-like region and not a singular critical-state. △ Less

Submitted 13 March, 2020; originally announced March 2020.

Estimation of phase in EEG rhythms for real-time applications

Authors: J. R. McIntosh, P. Sajda

Abstract: Objective. We identify two linked problems related to estimating the phase of the alpha rhythm when the signal after a specific event is unknown (real-time case), or corrupted (offline analysis). We propose methods to estimate the phase prior to such events. Approach. Machine learning is used to mimic a non-causal signal-processing chain with a purely causal one. Main results. We demonstrate the a… ▽ More Objective. We identify two linked problems related to estimating the phase of the alpha rhythm when the signal after a specific event is unknown (real-time case), or corrupted (offline analysis). We propose methods to estimate the phase prior to such events. Approach. Machine learning is used to mimic a non-causal signal-processing chain with a purely causal one. Main results. We demonstrate the ability of these methods to estimate instantaneous phase from an electroencephalography signal subjected to very minor pre-processing with higher accuracy than more standard signal-processing methods. Significance. Phase estimation of EEG-rhythms is a challenge due to non-stationarity and low signal to noise ratio. The methods presented enable scientists and engineers to achieve relatively low error by optimizing causal phase estimation on a non-causally processed signal for a real-time experiments and offline analysis. △ Less

Submitted 19 October, 2019; originally announced October 2019.

Ballistocardiogram artifact reduction in simultaneous EEG-fMRI using deep learning

Authors: J. R. McIntosh, J. Yao, Linbi Hong, J. Faller, P. Sajda

Abstract: Objective: The concurrent recording of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is a technique that has received much attention due to its potential for combined high temporal and spatial resolution. However, the ballistocardiogram (BCG), a large-amplitude artifact caused by cardiac induced movement contaminates the EEG during EEG-fMRI recordings. Removal of BC… ▽ More Objective: The concurrent recording of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is a technique that has received much attention due to its potential for combined high temporal and spatial resolution. However, the ballistocardiogram (BCG), a large-amplitude artifact caused by cardiac induced movement contaminates the EEG during EEG-fMRI recordings. Removal of BCG in software has generally made use of linear decompositions of the corrupted EEG. This is not ideal as the BCG signal is non-stationary and propagates in a manner which is non-linearly dependent on the electrocardiogram (ECG). In this paper, we present a novel method for BCG artifact suppression using recurrent neural networks (RNNs). Methods: EEG signals were recovered by training RNNs on the nonlinear map**s between ECG and the BCG corrupted EEG. We evaluated our model's performance against the commonly used Optimal Basis Set (OBS) method at the level of individual subjects, and investigated generalization across subjects. Results: We show that our algorithm can generate larger average power reduction of the BCG at critical frequencies, while simultaneously improving task relevant EEG based classification. Conclusion: The presented deep learning architecture can be used to reduce BCG related artifacts in EEG-fMRI recordings. Significance: We present a deep learning approach that can be used to suppress the BCG artifact in EEG-fMRI without the use of additional hardware. This method may have scope to be combined with current hardware methods, operate in real-time and be used for direct modeling of the BCG. △ Less

Submitted 15 October, 2019; originally announced October 2019.

Accelerated Robot Learning via Human Brain Signals

Authors: Iretiayo Akinola, Zizhao Wang, Junyao Shi, Xiaomin He, Pawan Lapborisuth, **gxi Xu, David Watkins-Valls, Paul Sajda, Peter Allen

Abstract: In reinforcement learning (RL), sparse rewards are a natural way to specify the task to be learned. However, most RL algorithms struggle to learn in this setting since the learning signal is mostly zeros. In contrast, humans are good at assessing and predicting the future consequences of actions and can serve as good reward/policy shapers to accelerate the robot learning process. Previous works ha… ▽ More In reinforcement learning (RL), sparse rewards are a natural way to specify the task to be learned. However, most RL algorithms struggle to learn in this setting since the learning signal is mostly zeros. In contrast, humans are good at assessing and predicting the future consequences of actions and can serve as good reward/policy shapers to accelerate the robot learning process. Previous works have shown that the human brain generates an error-related signal, measurable using electroencephelography (EEG), when the human perceives the task being done erroneously. In this work, we propose a method that uses evaluative feedback obtained from human brain signals measured via scalp EEG to accelerate RL for robotic agents in sparse reward settings. As the robot learns the task, the EEG of a human observer watching the robot attempts is recorded and decoded into noisy error feedback signal. From this feedback, we use supervised learning to obtain a policy that subsequently augments the behavior policy and guides exploration in the early stages of RL. This bootstraps the RL learning process to enable learning from sparse reward. Using a robotic navigation task as a test bed, we show that our method achieves a stable obstacle-avoidance policy with high success rate, outperforming learning from sparse rewards only that struggles to achieve obstacle avoidance behavior or fails to advance to the goal. △ Less

Submitted 11 August, 2020; v1 submitted 1 October, 2019; originally announced October 2019.

Comments: 2020 IEEE International Conference on Robotics and Automation - ICRA 2020

Compact Convolutional Neural Networks for Classification of Asynchronous Steady-state Visual Evoked Potentials

Authors: Nicholas R. Waytowich, Vernon Lawhern, Javier O. Garcia, Jennifer Cummings, Josef Faller, Paul Sajda, Jean M. Vettel

Abstract: Steady-State Visual Evoked Potentials (SSVEPs) are neural oscillations from the parietal and occipital regions of the brain that are evoked from flickering visual stimuli. SSVEPs are robust signals measurable in the electroencephalogram (EEG) and are commonly used in brain-computer interfaces (BCIs). However, methods for high-accuracy decoding of SSVEPs usually require hand-crafted approaches that… ▽ More Steady-State Visual Evoked Potentials (SSVEPs) are neural oscillations from the parietal and occipital regions of the brain that are evoked from flickering visual stimuli. SSVEPs are robust signals measurable in the electroencephalogram (EEG) and are commonly used in brain-computer interfaces (BCIs). However, methods for high-accuracy decoding of SSVEPs usually require hand-crafted approaches that leverage domain-specific knowledge of the stimulus signals, such as specific temporal frequencies in the visual stimuli and their relative spatial arrangement. When this knowledge is unavailable, such as when SSVEP signals are acquired asynchronously, such approaches tend to fail. In this paper, we show how a compact convolutional neural network (Compact-CNN), which only requires raw EEG signals for automatic feature extraction, can be used to decode signals from a 12-class SSVEP dataset without the need for any domain-specific knowledge or calibration data. We report across subject mean accuracy of approximately 80% (chance being 8.3%) and show this is substantially better than current state-of-the-art hand-crafted approaches using canonical correlation analysis (CCA) and Combined-CCA. Furthermore, we analyze our Compact-CNN to examine the underlying feature representation, discovering that the deep learner extracts additional phase and amplitude related features associated with the structure of the dataset. We discuss how our Compact-CNN shows promise for BCI applications that allow users to freely gaze/attend to any stimulus at any time (e.g., asynchronous BCI) as well as provides a method for analyzing SSVEP signals in a way that might augment our understanding about the basic processing in the visual cortex. △ Less

Submitted 9 October, 2018; v1 submitted 12 March, 2018; originally announced March 2018.

Comments: Accepted for publication at the Journal of Neural Engineering

Towards personalized human AI interaction - adapting the behavior of AI agents using neural signatures of subjective interest

Authors: Victor Shih, David C Jangraw, Paul Sajda, Sameer Saproo

Abstract: Reinforcement Learning AI commonly uses reward/penalty signals that are objective and explicit in an environment -- e.g. game score, completion time, etc. -- in order to learn the optimal strategy for task performance. However, Human-AI interaction for such AI agents should include additional reinforcement that is implicit and subjective -- e.g. human preferences for certain AI behavior -- in orde… ▽ More Reinforcement Learning AI commonly uses reward/penalty signals that are objective and explicit in an environment -- e.g. game score, completion time, etc. -- in order to learn the optimal strategy for task performance. However, Human-AI interaction for such AI agents should include additional reinforcement that is implicit and subjective -- e.g. human preferences for certain AI behavior -- in order to adapt the AI behavior to idiosyncratic human preferences. Such adaptations would mirror naturally occurring processes that increase trust and comfort during social interactions. Here, we show how a hybrid brain-computer-interface (hBCI), which detects an individual's level of interest in objects/events in a virtual environment, can be used to adapt the behavior of a Deep Reinforcement Learning AI agent that is controlling a virtual autonomous vehicle. Specifically, we show that the AI learns a driving strategy that maintains a safe distance from a lead vehicle, and most novelly, preferentially slows the vehicle when the human passengers of the vehicle encounter objects of interest. This adaptation affords an additional 20\% viewing time for subjectively interesting objects. This is the first demonstration of how an hBCI can be used to provide implicit reinforcement to an AI agent in a way that incorporates user preferences into the control system. △ Less

Submitted 13 September, 2017; originally announced September 2017.

Comments: 11 pages, 9 figures, 1 table, Submitted to IEEE Trans. on Neural Networks and Learning Systems

SigViewer: Visualizing Multimodal Signals Stored in XDF (Extensible Data Format) Files

Authors: Yida Lin, Clemens Brunner, Paul Sajda, Josef Faller

Abstract: Multimodal biosignal acquisition is facilitated by recently introduced software solutions such as LabStreaming Layer (LSL) and its associated data format XDF (Extensible Data Format). However, there are no stand-alone applications that can visualize multimodal time series stored in XDF files. We extended SigViewer, an open source cross-platform Qt C++ application with the capability of loading, re… ▽ More Multimodal biosignal acquisition is facilitated by recently introduced software solutions such as LabStreaming Layer (LSL) and its associated data format XDF (Extensible Data Format). However, there are no stand-alone applications that can visualize multimodal time series stored in XDF files. We extended SigViewer, an open source cross-platform Qt C++ application with the capability of loading, resampling, annotating, and visualizing signals stored in XDF files and successfully applied the tool for post-hoc visual verification of the accuracy of a system that aims to predict the phase of alpha oscillations within the electroencephalogram in real-time. △ Less

Submitted 11 August, 2017; originally announced August 2017.

Comments: 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society

A comparison of single-trial EEG classification and EEG-informed fMRI across three MR compatible EEG recording systems

Authors: Josef Faller, Linbi Hong, Jennifer Cummings, Paul Sajda

Abstract: Simultaneously recorded electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) can be used to non-invasively measure the spatiotemporal dynamics of the human brain. One challenge is dealing with the artifacts that each modality introduces into the other when the two are recorded concurrently, for example the ballistocardiogram (BCG). We conducted a preliminary comparison of… ▽ More Simultaneously recorded electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) can be used to non-invasively measure the spatiotemporal dynamics of the human brain. One challenge is dealing with the artifacts that each modality introduces into the other when the two are recorded concurrently, for example the ballistocardiogram (BCG). We conducted a preliminary comparison of three different MR compatible EEG recording systems and assessed their performance in terms of single-trial classification of the EEG when simultaneously collecting fMRI. We found tradeoffs across all three systems, for example varied ease of setup and improved classification accuracy with reference electrodes (REF) but not for pulse artifact subtraction (PAS) or reference layer adaptive filtering (RLAF). △ Less

Submitted 25 July, 2017; originally announced July 2017.

Comments: 1 Page, IEEE EMBS Conference 2017, Korea

Neural mechanisms underlying catastrophic failure in human-machine interaction during aerial navigation

Authors: Sameer Saproo, Victor Shih, David C. Jangraw, Paul Sajda

Abstract: Objective. We investigated the neural correlates of workload buildup in a fine visuomotor task called the boundary avoidance task (BAT). The BAT has been known to induce naturally occurring failures of human-machine coupling in high performance aircraft that can potentially lead to a crash; these failures are termed pilot induced oscillations (PIOs). Approach. We recorded EEG and pupillometry data… ▽ More Objective. We investigated the neural correlates of workload buildup in a fine visuomotor task called the boundary avoidance task (BAT). The BAT has been known to induce naturally occurring failures of human-machine coupling in high performance aircraft that can potentially lead to a crash; these failures are termed pilot induced oscillations (PIOs). Approach. We recorded EEG and pupillometry data from human subjects engaged in a flight BAT simulated within a virtual 3D environment. Main results. We find that workload buildup in a BAT can be successfully decoded from oscillatory features in the electroencephalogram (EEG). Information in delta, theta, alpha, beta, and gamma spectral bands of the EEG all contribute to successful decoding, however gamma band activity with a lateralized somatosensory topography has the highest contribution, while theta band activity with a frontocentral topography has the most robust contribution in terms of real world usability. We show that the output of the spectral decoder can be used to predict PIO susceptibility. We also find that workload buildup in the task induces pupil dilation, the magnitude of which is significantly correlated with the magnitude of the decoded EEG signals. These results suggest that PIOs may result from the dysregulation of cortical networks such as the locus coeruleus (LC) anterior cingulate cortex (ACC) circuit. Significance. Our findings may generalize to similar control failures in other cases of tight man machine coupling where gains and latencies in the control system must be inferred and compensated for by the human operators. A closed-loop intervention using neurophysiological decoding of workload buildup that targets the LC ACC circuit may positively impact operator performance in such situations. △ Less

Submitted 5 May, 2016; originally announced May 2016.

Comments: Manuscript as initially submitted to Journal of Neural Engineering in March, 2016

Fast Simultaneous Training of Generalized Linear Models (FaSTGLZ)

Authors: Bryan R. Conroy, Jennifer M. Walz, Brian Cheung, Paul Sajda

Abstract: We present an efficient algorithm for simultaneously training sparse generalized linear models across many related problems, which may arise from bootstrap**, cross-validation and nonparametric permutation testing. Our approach leverages the redundancies across problems to obtain significant computational improvements relative to solving the problems sequentially by a conventional algorithm. We… ▽ More We present an efficient algorithm for simultaneously training sparse generalized linear models across many related problems, which may arise from bootstrap**, cross-validation and nonparametric permutation testing. Our approach leverages the redundancies across problems to obtain significant computational improvements relative to solving the problems sequentially by a conventional algorithm. We demonstrate our fast simultaneous training of generalized linear models (FaSTGLZ) algorithm on a number of real-world datasets, and we run otherwise computationally intensive bootstrap** and permutation test analyses that are typically necessary for obtaining statistically rigorous classification results and meaningful interpretation. Code is freely available at http://liinc.bme.columbia.edu/fastglz. △ Less

Submitted 31 July, 2013; originally announced July 2013.

Extraclassical receptive field phenomena & short-range connectivity in V1

Authors: Jim Wielaard, Paul Sajda

Abstract: Neural mechanisms of extraclassical receptive field phenomena in V1 are commonly assumed to result from long-range lateral connections and/or extrastriate feedback. We address two such phenomena: surround suppression and contrast dependent receptive field size. We present rigorous computational support for the hypothesis that the phenomena largely result from local short-range (< 0.5 mm) cortica… ▽ More Neural mechanisms of extraclassical receptive field phenomena in V1 are commonly assumed to result from long-range lateral connections and/or extrastriate feedback. We address two such phenomena: surround suppression and contrast dependent receptive field size. We present rigorous computational support for the hypothesis that the phenomena largely result from local short-range (< 0.5 mm) cortical connections and LGN input. Surround suppression in our simulations results from (A) direct cortical inhibition or (B) suppression of recurrent cortical excitation, or (C) action of both these mechanisms simultaneously. Mechanisms B and C are substantially more prevalent than A. We observe an average growth in the range of spatial summation of excitatory and inhibitory synaptic inputs for low contrast. However, we find this is neither sufficient nor necessary to explain contrast dependent receptive field size, which usually involves additional changes in the relative gain of these inputs. △ Less

Submitted 20 April, 2005; v1 submitted 20 April, 2005; originally announced April 2005.

Report number: Submitted to Cerebral Cortex