-
GPU-RANC: A CUDA Accelerated Simulation Framework for Neuromorphic Architectures
Authors:
Sahil Hassan,
Michael Inouye,
Miguel C. Gonzalez,
Ilkin Aliyev,
Joshua Mack,
Maisha Hafiz,
Ali Akoglu
Abstract:
Open-source simulation tools play a crucial role for neuromorphic application engineers and hardware architects to investigate performance bottlenecks and explore design optimizations before committing to silicon. Reconfigurable Architecture for Neuromorphic Computing (RANC) is one such tool that offers ability to execute pre-trained Spiking Neural Network (SNN) models within a unified ecosystem t…
▽ More
Open-source simulation tools play a crucial role for neuromorphic application engineers and hardware architects to investigate performance bottlenecks and explore design optimizations before committing to silicon. Reconfigurable Architecture for Neuromorphic Computing (RANC) is one such tool that offers ability to execute pre-trained Spiking Neural Network (SNN) models within a unified ecosystem through both software-based simulation and FPGA-based emulation. RANC has been utilized by the community with its flexible and highly parameterized design to study implementation bottlenecks, tune architectural parameters or modify neuron behavior based on application insights and study the trade space on hardware performance and network accuracy. In designing architectures for use in neuromorphic computing, there are an incredibly large number of configuration parameters such as number and precision of weights per neuron, neuron and axon counts per core, network topology, and neuron behavior. To accelerate such studies and provide users with a streamlined productive design space exploration, in this paper we introduce the GPU-based implementation of RANC. We summarize our parallelization approach and quantify the speedup gains achieved with GPU-based tick-accurate simulations across various use cases. We demonstrate up to 780 times speedup compared to serial version of the RANC simulator based on a 512 neuromorphic core MNIST inference application. We believe that the RANC ecosystem now provides a much more feasible avenue in the research of exploring different optimizations for accelerating SNNs and performing richer studies by enabling rapid convergence to optimized neuromorphic architectures.
△ Less
Submitted 24 April, 2024;
originally announced April 2024.
-
Known allosteric proteins have central roles in genetic disease
Authors:
Gyorgy Abrusan,
David B. Ascher,
Michael Inouye
Abstract:
Allostery is a form of protein regulation, where ligands that bind sites located apart from the active site can modify the activity of the protein. The molecular mechanisms of allostery have been extensively studied, because allosteric sites are less conserved than active sites, and drugs targeting them are more specific than drugs binding the active sites. Here we quantify the importance of allos…
▽ More
Allostery is a form of protein regulation, where ligands that bind sites located apart from the active site can modify the activity of the protein. The molecular mechanisms of allostery have been extensively studied, because allosteric sites are less conserved than active sites, and drugs targeting them are more specific than drugs binding the active sites. Here we quantify the importance of allostery in genetic disease. We show that 1) known allosteric proteins are central in disease networks, and contribute to genetic disease and comorbidities much more than non-allosteric proteins, in many major disease types like hematopoietic diseases, cardiovascular diseases, cancers, diabetes, or diseases of the central nervous system. 2) variants from cancer genome-wide association studies are enriched near allosteric proteins, indicating their importance to polygenic traits; and 3) the importance of allosteric proteins in disease is due, at least partly, to their central positions in protein-protein interaction networks, and probably not due to their dynamical properties.
△ Less
Submitted 9 July, 2021;
originally announced July 2021.
-
The language of race, ethnicity, and ancestry in human genetic research
Authors:
Ewan Birney,
Michael Inouye,
Jennifer Raff,
Adam Rutherford,
Aylwyn Scally
Abstract:
The language commonly used in human genetics can inadvertently pose problems for multiple reasons. Terms like "ancestry", "ethnicity", and other ways of grou** people can have complex, often poorly understood, or multiple meanings within the various fields of genetics, between different domains of biological sciences and medicine, and between scientists and the general public. Furthermore, some…
▽ More
The language commonly used in human genetics can inadvertently pose problems for multiple reasons. Terms like "ancestry", "ethnicity", and other ways of grou** people can have complex, often poorly understood, or multiple meanings within the various fields of genetics, between different domains of biological sciences and medicine, and between scientists and the general public. Furthermore, some categories in frequently used datasets carry scientifically misleading, outmoded or even racist perspectives derived from the history of science. Here, we discuss examples of problematic lexicon in genetics, and how commonly used statistical practices to control for the non-genetic environment may exacerbate difficulties in our terminology, and therefore understanding. Our intention is to stimulate a much-needed discussion about the language of genetics, to begin a process to clarify existing terminology, and in some cases adopt a new lexicon that both serves scientific insight, and cuts us loose from various aspects of a pernicious past.
△ Less
Submitted 18 June, 2021;
originally announced June 2021.
-
RANC: Reconfigurable Architecture for Neuromorphic Computing
Authors:
Joshua Mack,
Ruben Purdy,
Kris Rockowitz,
Michael Inouye,
Edward Richter,
Spencer Valancius,
Nirmal Kumbhare,
Md Sahil Hassan,
Kaitlin Fair,
John Mixter,
Ali Akoglu
Abstract:
Neuromorphic architectures have been introduced as platforms for energy efficient spiking neural network execution. The massive parallelism offered by these architectures has also triggered interest from non-machine learning application domains. In order to lift the barriers to entry for hardware designers and application developers we present RANC: a Reconfigurable Architecture for Neuromorphic C…
▽ More
Neuromorphic architectures have been introduced as platforms for energy efficient spiking neural network execution. The massive parallelism offered by these architectures has also triggered interest from non-machine learning application domains. In order to lift the barriers to entry for hardware designers and application developers we present RANC: a Reconfigurable Architecture for Neuromorphic Computing, an open-source highly flexible ecosystem that enables rapid experimentation with neuromorphic architectures in both software via C++ simulation and hardware via FPGA emulation. We present the utility of the RANC ecosystem by showing its ability to recreate behavior of the IBM's TrueNorth and validate with direct comparison to IBM's Compass simulation environment and published literature. RANC allows optimizing architectures based on application insights as well as prototy** future neuromorphic architectures that can support new classes of applications entirely. We demonstrate the highly parameterized and configurable nature of RANC by studying the impact of architectural changes on improving application map** efficiency with quantitative analysis based on Alveo U250 FPGA. We present post routing resource usage and throughput analysis across implementations of Synthetic Aperture Radar classification and Vector Matrix Multiplication applications, and demonstrate a neuromorphic architecture that scales to emulating 259K distinct neurons and 73.3M distinct synapses.
△ Less
Submitted 1 November, 2020;
originally announced November 2020.
-
Green Algorithms: Quantifying the carbon footprint of computation
Authors:
Loïc Lannelongue,
Jason Grealey,
Michael Inouye
Abstract:
Climate change is profoundly affecting nearly all aspects of life on earth, including human societies, economies and health. Various human activities are responsible for significant greenhouse gas emissions, including data centres and other sources of large-scale computation. Although many important scientific milestones have been achieved thanks to the development of high-performance computing, t…
▽ More
Climate change is profoundly affecting nearly all aspects of life on earth, including human societies, economies and health. Various human activities are responsible for significant greenhouse gas emissions, including data centres and other sources of large-scale computation. Although many important scientific milestones have been achieved thanks to the development of high-performance computing, the resultant environmental impact has been underappreciated. In this paper, we present a methodological framework to estimate the carbon footprint of any computational task in a standardised and reliable way, based on the processing time, type of computing cores, memory available and the efficiency and location of the computing facility. Metrics to interpret and contextualise greenhouse gas emissions are defined, including the equivalent distance travelled by car or plane as well as the number of tree-months necessary for carbon sequestration. We develop a freely available online tool, Green Algorithms (www.green-algorithms.org), which enables a user to estimate and report the carbon footprint of their computation. The Green Algorithms tool easily integrates with computational processes as it requires minimal information and does not interfere with existing code, while also accounting for a broad range of CPUs, GPUs, cloud computing, local servers and desktop computers. Finally, by applying Green Algorithms, we quantify the greenhouse gas emissions of algorithms used for particle physics simulations, weather forecasts and natural language processing. Taken together, this study develops a simple generalisable framework and freely available tool to quantify the carbon footprint of nearly any computation. Combined with a series of recommendations to minimise unnecessary CO2 emissions, we hope to raise awareness and facilitate greener computation.
△ Less
Submitted 17 December, 2020; v1 submitted 15 July, 2020;
originally announced July 2020.
-
FPGA Based Emulation Environment for Neuromorphic Architectures
Authors:
Spencer Valancius,
Edward Richter,
Ruben Purdy,
Kris Rockowitz,
Michael Inouye,
Joshua Mack,
Nirmal Kumbhare,
Kaitlin Fair,
John Mixter,
Ali Akoglu
Abstract:
Neuromorphic architectures such as IBM's TrueNorth and Intel's Loihi have been introduced as platforms for energy efficient spiking neural network execution. However, there is no framework that allows for rapidly experimenting with neuromorphic architectures and studying the trade space on hardware performance and network accuracy. Fundamentally, this creates a barrier to entry for hardware design…
▽ More
Neuromorphic architectures such as IBM's TrueNorth and Intel's Loihi have been introduced as platforms for energy efficient spiking neural network execution. However, there is no framework that allows for rapidly experimenting with neuromorphic architectures and studying the trade space on hardware performance and network accuracy. Fundamentally, this creates a barrier to entry for hardware designers looking to explore neuromorphic architectures. In this paper we present an open-source FPGA based emulation environment for neuromorphic computing research. We prototype IBM's TrueNorth architecture as a reference design and discuss FPGA specific design decisions made when implementing and integrating it's core components. We conduct resource utilization analysis and realize a streaming-enabled TrueNorth architecture on the Zynq UltraScale+ MPSoC. We then perform functional verification by implementing networks for MNIST dataset and vector matrix multiplication (VMM) in our emulation environment and present an accuracy-based comparison based on the same networks generated using IBM's Compass simulation environment. We demonstrate the utility of our emulation environment for hardware designers and application engineers by altering the neuron behavior for VMM map**, which is, to the best of our knowledge, not feasible with any other tool including IBM's Compass environment. The proposed parameterized and configurable emulation platform serves as a basis for expanding its features to support emerging architectures, studying hypothetical neuromorphic architectures, or rapidly converging to hardware configuration through incremental changes based on bottlenecks as they become apparent during application map** process.
△ Less
Submitted 8 April, 2020;
originally announced April 2020.
-
Accurate and robust genomic prediction of celiac disease using statistical learning
Authors:
Gad Abraham,
Jason A. Tye-Din,
Oneil G. Bhalala,
Adam Kowalczyk,
Justin Zobel,
Michael Inouye
Abstract:
Practical application of genomic-based risk stratification to clinical diagnosis is appealing yet performance varies widely depending on the disease and genomic risk score (GRS) method. Celiac disease (CD), a common immune-mediated illness, is strongly genetically determined and requires specific HLA haplotypes. HLA testing can exclude diagnosis but has low specificity, providing little informatio…
▽ More
Practical application of genomic-based risk stratification to clinical diagnosis is appealing yet performance varies widely depending on the disease and genomic risk score (GRS) method. Celiac disease (CD), a common immune-mediated illness, is strongly genetically determined and requires specific HLA haplotypes. HLA testing can exclude diagnosis but has low specificity, providing little information suitable for clinical risk stratification. Using six European CD cohorts, we provide a proof-of-concept that statistical learning approaches which simultaneously model all SNPs can generate robust and highly accurate predictive models based on genome-wide SNP profiles. The high predictive capacity replicated both in cross-validation within each cohort (AUC of 0.87-0.89) and in independent replication across cohorts (AUC of 0.86-0.9), despite differences in ethnicity. The models explained 30-35% of disease variance and up to $\sim43\%$ of heritability. The GRS's utility was assessed in different clinically relevant settings. Comparable to HLA ty**, the GRS can be used to identify individuals without CD with $\geq99.6\%$ negative predictive value however, unlike HLA ty**, patients can also be stratified into categories of higher-risk for CD who would benefit from more invasive and costly definitive testing. The GRS is flexible and its performance can be adapted to the clinical situation by adjusting the threshold cut-off. Despite explaining a minority of disease heritability, our findings indicate a predictive GRS provides clinically relevant information to improve upon current diagnostic pathways for CD, and support further studies evaluating the clinical utility of this approach in CD and other complex diseases.
△ Less
Submitted 20 December, 2013; v1 submitted 24 January, 2013;
originally announced January 2013.
-
The University of Hawaii Wide Field Imager (UHWFI)
Authors:
Klaus W. Hodapp,
Andreas Seifahrt,
Gerard A. Luppino,
Richard Wainscoat,
Ed Sousa,
Hubert Yamada,
Alan Ryan,
Richard Shelton,
Mel Inouye,
Andrew J. Pickles,
Yanko K. Ivanov
Abstract:
The University of Hawaii Wide-Field Imager (UHWFI) is a focal compressor system designed to project the full half-degree field of the UH 2.2 m telescope onto the refurbished UH 8Kx8K CCD camera. The optics use Ohara glasses and are mounted in an oil-filled cell to minimize light losses and ghost images from the large number of internal lens surfaces. The UHWFI is equipped with a six-position fil…
▽ More
The University of Hawaii Wide-Field Imager (UHWFI) is a focal compressor system designed to project the full half-degree field of the UH 2.2 m telescope onto the refurbished UH 8Kx8K CCD camera. The optics use Ohara glasses and are mounted in an oil-filled cell to minimize light losses and ghost images from the large number of internal lens surfaces. The UHWFI is equipped with a six-position filter wheel and a rotating sector blade shutter,both driven by stepper motors. The instrument saw first light in 2004 in an engineering mode. After filling the lens cell with index matching oil, integration of all software components into the user interface, tuning of the CCD performance, and the purchase of the final filter set, UHWFI is now fully commissioned at the UH 2.2 m telescope.
△ Less
Submitted 31 March, 2006;
originally announced April 2006.