-
Spin waves in doped graphene: a time-dependent spin-density-functional approach to collective excitations in paramagnetic two-dimensional Dirac fermion gases
Authors:
Matthew J. Anderson,
Florent Perez,
Carsten A. Ullrich
Abstract:
In spin-polarized itinerant electron systems, collective spin-wave modes arise from dynamical exchange and correlation (xc) effects. We here consider spin waves in doped paramagnetic graphene with adjustable Zeeman-type band splitting. The spin waves are described using time-dependent spin-density-functional response theory, treating dynamical xc effects within the Slater and Singwi-Tosi-Land-Sjol…
▽ More
In spin-polarized itinerant electron systems, collective spin-wave modes arise from dynamical exchange and correlation (xc) effects. We here consider spin waves in doped paramagnetic graphene with adjustable Zeeman-type band splitting. The spin waves are described using time-dependent spin-density-functional response theory, treating dynamical xc effects within the Slater and Singwi-Tosi-Land-Sjolander approximations. We obtain spin-wave dispersions and spin stiffnesses as a function of do** and spin polarization, and discuss prospects for their experimental observation.
△ Less
Submitted 30 September, 2021;
originally announced October 2021.
-
Clinically Deployed Distributed Magnetic Resonance Imaging Reconstruction: Application to Pediatric Knee Imaging
Authors:
Michael J. Anderson,
Jonathan I. Tamir,
Javier S. Turek,
Marcus T. Alley,
Theodore L. Willke,
Shreyas S. Vasanawala,
Michael Lustig
Abstract:
Magnetic resonance imaging is capable of producing volumetric images without ionizing radiation. Nonetheless, long acquisitions lead to prohibitively long exams. Compressed sensing (CS) can enable faster scanning via sub-sampling with reduced artifacts. However, CS requires significantly higher reconstruction computation, limiting current clinical applications to 2D/3D or limited-resolution dynami…
▽ More
Magnetic resonance imaging is capable of producing volumetric images without ionizing radiation. Nonetheless, long acquisitions lead to prohibitively long exams. Compressed sensing (CS) can enable faster scanning via sub-sampling with reduced artifacts. However, CS requires significantly higher reconstruction computation, limiting current clinical applications to 2D/3D or limited-resolution dynamic imaging. Here we analyze the practical limitations to T2 Shuffling, a four-dimensional CS-based acquisition, which provides sharp 3D-isotropic-resolution and multi-contrast images in a single scan. Our improvements to the pipeline on a single machine provide a 3x overall reconstruction speedup, which allowed us to add algorithmic changes improving image quality. Using four machines, we achieved additional 2.1x improvement through distributed parallelization. Our solution reduced the reconstruction time in the hospital to 90 seconds on a 4-node cluster, enabling its use clinically. To understand the implications of scaling this application, we simulated running our reconstructions with a multiple scanner setup typical in hospitals.
△ Less
Submitted 11 September, 2018;
originally announced September 2018.
-
Enabling Factor Analysis on Thousand-Subject Neuroimaging Datasets
Authors:
Michael J. Anderson,
Mihai Capotă,
Javier S. Turek,
Xia Zhu,
Theodore L. Willke,
Yida Wang,
Po-Hsuan Chen,
Jeremy R. Manning,
Peter J. Ramadge,
Kenneth A. Norman
Abstract:
The scale of functional magnetic resonance image data is rapidly increasing as large multi-subject datasets are becoming widely available and high-resolution scanners are adopted. The inherent low-dimensionality of the information in this data has led neuroscientists to consider factor analysis methods to extract and analyze the underlying brain activity. In this work, we consider two recent multi…
▽ More
The scale of functional magnetic resonance image data is rapidly increasing as large multi-subject datasets are becoming widely available and high-resolution scanners are adopted. The inherent low-dimensionality of the information in this data has led neuroscientists to consider factor analysis methods to extract and analyze the underlying brain activity. In this work, we consider two recent multi-subject factor analysis methods: the Shared Response Model and Hierarchical Topographic Factor Analysis. We perform analytical, algorithmic, and code optimization to enable multi-node parallel implementations to scale. Single-node improvements result in 99x and 1812x speedups on these two methods, and enables the processing of larger datasets. Our distributed implementations show strong scaling of 3.3x and 5.5x respectively with 20 nodes on real datasets. We also demonstrate weak scaling on a synthetic dataset with 1024 subjects, on up to 1024 nodes and 32,768 cores.
△ Less
Submitted 17 August, 2016; v1 submitted 16 August, 2016;
originally announced August 2016.
-
BlackOut: Speeding up Recurrent Neural Network Language Models With Very Large Vocabularies
Authors:
Shihao Ji,
S. V. N. Vishwanathan,
Nadathur Satish,
Michael J. Anderson,
Pradeep Dubey
Abstract:
We propose BlackOut, an approximation algorithm to efficiently train massive recurrent neural network language models (RNNLMs) with million word vocabularies. BlackOut is motivated by using a discriminative loss, and we describe a new sampling strategy which significantly reduces computation while improving stability, sample efficiency, and rate of convergence. One way to understand BlackOut is to…
▽ More
We propose BlackOut, an approximation algorithm to efficiently train massive recurrent neural network language models (RNNLMs) with million word vocabularies. BlackOut is motivated by using a discriminative loss, and we describe a new sampling strategy which significantly reduces computation while improving stability, sample efficiency, and rate of convergence. One way to understand BlackOut is to view it as an extension of the DropOut strategy to the output layer, wherein we use a discriminative training loss and a weighted sampling scheme. We also establish close connections between BlackOut, importance sampling, and noise contrastive estimation (NCE). Our experiments, on the recently released one billion word language modeling benchmark, demonstrate scalability and accuracy of BlackOut; we outperform the state-of-the art, and achieve the lowest perplexity scores on this dataset. Moreover, unlike other established methods which typically require GPUs or CPU clusters, we show that a carefully implemented version of BlackOut requires only 1-10 days on a single machine to train a RNNLM with a million word vocabulary and billions of parameters on one billion words. Although we describe BlackOut in the context of RNNLM training, it can be used to any networks with large softmax output layers.
△ Less
Submitted 31 March, 2016; v1 submitted 21 November, 2015;
originally announced November 2015.
