Showing 1–22 of 22 results for author: Grollier, J

Training of Physical Neural Networks

Authors: Ali Momeni, Babak Rahmani, Benjamin Scellier, Logan G. Wright, Peter L. McMahon, Clara C. Wanjura, Yuhang Li, Anas Skalli, Natalia G. Berloff, Tatsuhiro Onodera, Ilker Oguz, Francesco Morichetti, Philipp del Hougne, Manuel Le Gallo, Abu Sebastian, Azalia Mirhoseini, Cheng Zhang, Danijela Marković, Daniel Brunner, Christophe Moser, Sylvain Gigan, Florian Marquardt, Aydogan Ozcan, Julie Grollier, Andrea J. Liu , et al. (3 additional authors not shown)

Abstract: Physical neural networks (PNNs) are a class of neural-like networks that leverage the properties of physical systems to perform computation. While PNNs are so far a niche research area with small-scale laboratory demonstrations, they are arguably one of the most underappreciated important opportunities in modern AI. Could we train AI models 1000x larger than current ones? Could we do this and also… ▽ More Physical neural networks (PNNs) are a class of neural-like networks that leverage the properties of physical systems to perform computation. While PNNs are so far a niche research area with small-scale laboratory demonstrations, they are arguably one of the most underappreciated important opportunities in modern AI. Could we train AI models 1000x larger than current ones? Could we do this and also have them perform inference locally and privately on edge devices, such as smartphones or sensors? Research over the past few years has shown that the answer to all these questions is likely "yes, with enough research": PNNs could one day radically change what is possible and practical for AI systems. To do this will however require rethinking both how AI models work, and how they are trained - primarily by considering the problems through the constraints of the underlying hardware physics. To train PNNs at large scale, many methods including backpropagation-based and backpropagation-free approaches are now being explored. These methods have various trade-offs, and so far no method has been shown to scale to the same scale and performance as the backpropagation algorithm widely used in deep learning today. However, this is rapidly changing, and a diverse ecosystem of training techniques provides clues for how PNNs may one day be utilized to create both more efficient realizations of current-scale AI models, and to enable unprecedented-scale models. △ Less

Submitted 5 June, 2024; originally announced June 2024.

Comments: 29 pages, 4 figures

Spiking Dynamics in Dual Free Layer Perpendicular Magnetic Tunnel Junctions

Authors: Louis Farcis, Bruno Teixeira, Philippe Talatchian, David Salomoni, Ursula Ebels, Stéphane Auffret, Bernard Dieny, Frank Mizrahi, Julie Grollier, Ricardo Sousa, Liliana Buda-Prejbeanu

Abstract: Spintronic devices have recently attracted a lot of attention in the field of unconventional computing due to their non-volatility for short and long term memory, non-linear fast response and relatively small footprint. Here we report how voltage driven magnetization dynamics of dual free layer perpendicular magnetic tunnel junctions enable to emulate spiking neurons in hardware. The output spikin… ▽ More Spintronic devices have recently attracted a lot of attention in the field of unconventional computing due to their non-volatility for short and long term memory, non-linear fast response and relatively small footprint. Here we report how voltage driven magnetization dynamics of dual free layer perpendicular magnetic tunnel junctions enable to emulate spiking neurons in hardware. The output spiking rate was controlled by varying the dc bias voltage across the device. The field-free operation of this two terminal device and its robustness against an externally applied magnetic field make it a suitable candidate to mimic neuron response in a dense Neural Network (NN). The small energy consumption of the device (4-16 pJ/spike) and its scalability are important benefits for embedded applications. This compact perpendicular magnetic tunnel junction structure could finally bring spiking neural networks (SNN) to sub-100nm size elements. △ Less

Submitted 14 September, 2023; originally announced September 2023.

Roadmap for Unconventional Computing with Nanotechnology

Authors: Giovanni Finocchio, Jean Anne C. Incorvia, Joseph S. Friedman, Qu Yang, Anna Giordano, Julie Grollier, Hyunsoo Yang, Florin Ciubotaru, Andrii Chumak, Azad J. Naeemi, Sorin D. Cotofana, Riccardo Tomasello, Christos Panagopoulos, Mario Carpentieri, Peng Lin, Gang Pan, J. Joshua Yang, Aida Todri-Sanial, Gabriele Boschetto, Kremena Makasheva, Vinod K. Sangwan, Amit Ranjan Trivedi, Mark C. Hersam, Kerem Y. Camsari, Peter L. McMahon , et al. (26 additional authors not shown)

Abstract: In the "Beyond Moore's Law" era, with increasing edge intelligence, domain-specific computing embracing unconventional approaches will become increasingly prevalent. At the same time, adopting a variety of nanotechnologies will offer benefits in energy cost, computational speed, reduced footprint, cyber resilience, and processing power. The time is ripe for a roadmap for unconventional computing w… ▽ More In the "Beyond Moore's Law" era, with increasing edge intelligence, domain-specific computing embracing unconventional approaches will become increasingly prevalent. At the same time, adopting a variety of nanotechnologies will offer benefits in energy cost, computational speed, reduced footprint, cyber resilience, and processing power. The time is ripe for a roadmap for unconventional computing with nanotechnologies to guide future research, and this collection aims to fill that need. The authors provide a comprehensive roadmap for neuromorphic computing using electron spins, memristive devices, two-dimensional nanomaterials, nanomagnets, and various dynamical systems. They also address other paradigms such as Ising machines, Bayesian inference engines, probabilistic computing with p-bits, processing in memory, quantum memories and algorithms, computing with skyrmions and spin waves, and brain-inspired computing for incremental learning and problem-solving in severely resource-constrained environments. These approaches have advantages over traditional Boolean computing based on von Neumann architecture. As the computational requirements for artificial intelligence grow 50 times faster than Moore's Law for electronics, more unconventional approaches to computing and signal processing will appear on the horizon, and this roadmap will help identify future needs and challenges. In a very fertile field, experts in the field aim to present some of the dominant and most promising technologies for unconventional computing that will be around for some time to come. Within a holistic approach, the goal is to provide pathways for solidifying the field and guiding future impactful discoveries. △ Less

Submitted 27 February, 2024; v1 submitted 17 January, 2023; originally announced January 2023.

Comments: 80 pages accepted in Nano Futures

Journal ref: Nano Futures (2024)

Characterization and modeling of spiking and bursting in experimental NbOx neuron

Authors: Marie Drouhin, Shuai Li, Matthieu Grelier, Sophie Collin, Florian Godel, Robert G. Elliman, Bruno Dlubak, Juan Trastoy, Damien Querlioz, Julie Grollier

Abstract: Hardware spiking neural networks hold the promise of realizing artificial intelligence with high energy efficiency. In this context, solid-state and scalable memristors can be used to mimic biological neuron characteristics. However, these devices show limited neuronal behaviors and have to be integrated in more complex circuits to implement the rich dynamics of biological neurons. Here we studied… ▽ More Hardware spiking neural networks hold the promise of realizing artificial intelligence with high energy efficiency. In this context, solid-state and scalable memristors can be used to mimic biological neuron characteristics. However, these devices show limited neuronal behaviors and have to be integrated in more complex circuits to implement the rich dynamics of biological neurons. Here we studied a NbOx memristor neuron that is capable of emulating numerous neuronal dynamics, including tonic spiking, stochastic spiking, leaky-integrate-and-fire features, spike latency, temporal integration. The device also exhibits phasic bursting, a property that has scarcely been observed and studied in solid-state nano-neurons. We show that we can reproduce and understand this particular response through simulations using non-linear dynamics. These results show that a single NbOx device is sufficient to emulate a collection of rich neuronal dynamics that paves a path forward for realizing scalable and energy-efficient neuromorphic computing paradigms. △ Less

Submitted 1 September, 2022; originally announced September 2022.

Quantum materials for energy-efficient neuromorphic computing

Authors: Axel Hoffmann, Shriram Ramanathan, Julie Grollier, Andrew D. Kent, Marcelo Rozenberg, Ivan K. Schuller, Oleg Shpyrko, Robert Dynes, Yeshaiahu Fainman, Alex Frano, Eric E. Fullerton, Giulia Galli, Vitaliy Lomakin, Shyue ** Ong, Amanda K. Petford-Long, Jonathan A. Schuller, Mark D. Stiles, Yayoi Takamura, Yimei Zhu

Abstract: Neuromorphic computing approaches become increasingly important as we address future needs for efficiently processing massive amounts of data. The unique attributes of quantum materials can help address these needs by enabling new energy-efficient device concepts that implement neuromorphic ideas at the hardware level. In particular, strong correlations give rise to highly non-linear responses, su… ▽ More Neuromorphic computing approaches become increasingly important as we address future needs for efficiently processing massive amounts of data. The unique attributes of quantum materials can help address these needs by enabling new energy-efficient device concepts that implement neuromorphic ideas at the hardware level. In particular, strong correlations give rise to highly non-linear responses, such as conductive phase transitions that can be harnessed for short and long-term plasticity. Similarly, magnetization dynamics are strongly non-linear and can be utilized for data classification. This paper discusses select examples of these approaches, and provides a perspective for the current opportunities and challenges for assembling quantum-material-based devices for neuromorphic functionalities into larger emergent complex network systems. △ Less

Submitted 4 April, 2022; originally announced April 2022.

Journal ref: APL Materials 10, 070904 (2022)

Convolutional Neural Networks with Radio-Frequency Spintronic Nano-Devices

Authors: Nathan Leroux, Arnaud De Riz, Dédalo Sanz-Hernández, Danijela Marković, Alice Mizrahi, Julie Grollier

Abstract: Convolutional neural networks are state-of-the-art and ubiquitous in modern signal processing and machine vision. Nowadays, hardware solutions based on emerging nanodevices are designed to reduce the power consumption of these networks. Spintronics devices are promising for information processing because of the various neural and synaptic functionalities they offer. However, due to their low OFF/O… ▽ More Convolutional neural networks are state-of-the-art and ubiquitous in modern signal processing and machine vision. Nowadays, hardware solutions based on emerging nanodevices are designed to reduce the power consumption of these networks. Spintronics devices are promising for information processing because of the various neural and synaptic functionalities they offer. However, due to their low OFF/ON ratio, performing all the multiplications required for convolutions in a single step with a crossbar array of spintronic memories would cause sneak-path currents. Here we present an architecture where synaptic communications have a frequency selectivity that prevents crosstalk caused by sneak-path currents. We first demonstrate how a chain of spintronic resonators can function as synapses and make convolutions by sequentially rectifying radio-frequency signals encoding consecutive sets of inputs. We show that a parallel implementation is possible with multiple chains of spintronic resonators to avoid storing intermediate computational steps in memory. We propose two different spatial arrangements for these chains. For each of them, we explain how to tune many artificial synapses simultaneously, exploiting the synaptic weight sharing specific to convolutions. We show how information can be transmitted between convolutional layers by using spintronic oscillators as artificial microwave neurons. Finally, we simulate a network of these radio-frequency resonators and spintronic oscillators to solve the MNIST handwritten digits dataset, and obtain results comparable to software convolutional neural networks. Since it can run convolutional neural networks fully in parallel in a single step with nano devices, the architecture proposed in this paper is promising for embedded applications requiring machine vision, such as autonomous driving. △ Less

Submitted 9 November, 2021; originally announced November 2021.

Forecasting the outcome of spintronic experiments with Neural Ordinary Differential Equations

Authors: Xing Chen, Flavio Abreu Araujo, Mathieu Riou, Jacob Torrejon, Dafiné Ravelosona, Wang Kang, Weisheng Zhao, Julie Grollier, Damien Querlioz

Abstract: Deep learning has an increasing impact to assist research, allowing, for example, the discovery of novel materials. Until now, however, these artificial intelligence techniques have fallen short of discovering the full differential equation of an experimental physical system. Here we show that a dynamical neural network, trained on a minimal amount of data, can predict the behavior of spintronic d… ▽ More Deep learning has an increasing impact to assist research, allowing, for example, the discovery of novel materials. Until now, however, these artificial intelligence techniques have fallen short of discovering the full differential equation of an experimental physical system. Here we show that a dynamical neural network, trained on a minimal amount of data, can predict the behavior of spintronic devices with high accuracy and an extremely efficient simulation time, compared to the micromagnetic simulations that are usually employed to model them. For this purpose, we re-frame the formalism of Neural Ordinary Differential Equations (ODEs) to the constraints of spintronics: few measured outputs, multiple inputs and internal parameters. We demonstrate with Spin-Neural ODEs an acceleration factor over 200 compared to micromagnetic simulations for a complex problem -- the simulation of a reservoir computer made of magnetic skyrmions (20 minutes compared to three days). In a second realization, we show that we can predict the noisy response of experimental spintronic nano-oscillators to varying inputs after training Spin-Neural ODEs on five milliseconds of their measured response to different excitations. Spin-Neural ODE is a disruptive tool for develo** spintronic applications in complement to micromagnetic simulations, which are time-consuming and cannot fit experiments when noise or imperfections are present. Spin-Neural ODE can also be generalized to other electronic devices involving dynamics. △ Less

Submitted 23 July, 2021; originally announced August 2021.

Comments: 16 pages, 4 figures

Mesoscopic magnetic systems: from fundamental properties to devices

Authors: Laura J. Heyderman, Julie Grollier, Christopher H. Marrows, Paolo Vavassori, Dirk Grundler, Denys Makarov, Salvador Pané

Abstract: Here we review various themes of current research within mesoscopic magnetic systems. Here we review various themes of current research within mesoscopic magnetic systems. △ Less

Submitted 20 July, 2021; originally announced July 2021.

Comments: APL Special Topic Guest Editorial

Spintronics for neuromorphic computing

Authors: J. Grollier, D. Querlioz, K. Y. Camsari, K. Everschor-Sitte, S. Fukami, M. D. Stiles

Abstract: Neuromorphic computing uses brain-inspired principles to design circuits that can perform computational tasks with superior power efficiency to conventional computers. Approaches that use traditional electronic devices to create artificial neurons and synapses are, however, currently limited by the energy and area requirements of these components. Spintronic nanodevices, which exploit both the mag… ▽ More Neuromorphic computing uses brain-inspired principles to design circuits that can perform computational tasks with superior power efficiency to conventional computers. Approaches that use traditional electronic devices to create artificial neurons and synapses are, however, currently limited by the energy and area requirements of these components. Spintronic nanodevices, which exploit both the magnetic and electrical properties of electrons, can increase the energy efficiency and decrease the area of these circuits, and magnetic tunnel junctions are of particular interest as neuromorphic computing elements because they are compatible with standard integrated circuits and can support multiple functionalities. Here we review the development of spintronic devices for neuromorphic computing. We examine how magnetic tunnel junctions can serve as synapses and neurons, and how magnetic textures, such as domain walls and skyrmions, can function as neurons. We also explore spintronics-based implementations of neuromorphic computing tasks, such as pattern recognition in an associative memory, and discuss the challenges that exist in scaling up these systems. △ Less

Submitted 12 July, 2020; originally announced July 2020.

Physics for Neuromorphic Computing

Authors: Danijela Markovic, Alice Mizrahi, Damien Querlioz, Julie Grollier

Abstract: Neuromorphic computing takes inspiration from the brain to create energy efficient hardware for information processing, capable of highly sophisticated tasks. In this article, we make the case that building this new hardware necessitates reinventing electronics. We show that research in physics and material science will be key to create artificial nano-neurons and synapses, to connect them togethe… ▽ More Neuromorphic computing takes inspiration from the brain to create energy efficient hardware for information processing, capable of highly sophisticated tasks. In this article, we make the case that building this new hardware necessitates reinventing electronics. We show that research in physics and material science will be key to create artificial nano-neurons and synapses, to connect them together in huge numbers, to organize them in complex systems, and to compute with them efficiently. We describe how some researchers choose to take inspiration from artificial intelligence to move forward in this direction, whereas others prefer taking inspiration from neuroscience, and we highlight recent striking results obtained with these two approaches. Finally, we discuss the challenges and perspectives in neuromorphic physics, which include develo** the algorithms and the hardware hand in hand, making significant advances with small toy systems, as well as building large scale networks. △ Less

Submitted 8 March, 2020; originally announced March 2020.

Binding events through the mutual synchronization of spintronic nano-neurons

Authors: Miguel Romera, Philippe Talatchian, Sumito Tsunegi, Kay Yakushiji, Akio Fukushima, Hitoshi Kubota, Shinji Yuasa, Vincent Cros, Paolo Bortolotti, Maxence Ernoult, Damien Querlioz, Julie Grollier

Abstract: The brain naturally binds events from different sources in unique concepts. It is hypothesized that this process occurs through the transient mutual synchronization of neurons located in different regions of the brain when the stimulus is presented. This mechanism of binding through synchronization can be directly implemented in neural networks composed of coupled oscillators. To do so, the oscill… ▽ More The brain naturally binds events from different sources in unique concepts. It is hypothesized that this process occurs through the transient mutual synchronization of neurons located in different regions of the brain when the stimulus is presented. This mechanism of binding through synchronization can be directly implemented in neural networks composed of coupled oscillators. To do so, the oscillators must be able to mutually synchronize for the range of inputs corresponding to a single class, and otherwise remain desynchronized. Here we show that the outstanding ability of spintronic nano-oscillators to mutually synchronize and the possibility to precisely control the occurrence of mutual synchronization by tuning the oscillator frequencies over wide ranges allows pattern recognition. We demonstrate experimentally on a simple task that three spintronic nano-oscillators can bind consecutive events and thus recognize and distinguish temporal sequences. This work is a step forward in the construction of neural networks that exploit the non-linear dynamic properties of their components to perform brain-inspired computations. △ Less

Submitted 22 January, 2020; originally announced January 2020.

Designing large arrays of interacting spin-torque nano-oscillators for microwave information processing

Authors: Philippe Talatchian, Miguel Romera, Flavio Abreu Araujo, Paolo Bortolotti, Vincent Cros, Damir Vodenicarevic, Nicolas Locatelli, Damien Querlioz, Julie Grollier

Abstract: Arrays of spin-torque nano-oscillators are promising for broadband microwave signal detection and processing, as well as for neuromorphic computing. In many of these applications, the oscillators should be engineered to have equally-spaced frequencies and equal sensitivity to microwave inputs. Here we design spin-torque nano-oscillator arrays with these rules and estimate their optimum size for a… ▽ More Arrays of spin-torque nano-oscillators are promising for broadband microwave signal detection and processing, as well as for neuromorphic computing. In many of these applications, the oscillators should be engineered to have equally-spaced frequencies and equal sensitivity to microwave inputs. Here we design spin-torque nano-oscillator arrays with these rules and estimate their optimum size for a given sensitivity, as well as the frequency range that they cover. For this purpose, we explore analytically and numerically conditions to obtain vortex spin-torque nano-oscillators with equally-spaced gyrotropic oscillation frequencies and having all similar synchronization bandwidths to input microwave signals. We show that arrays of hundreds of oscillators covering ranges of several hundred MHz can be built taking into account nanofabrication constraints. △ Less

Submitted 15 November, 2019; v1 submitted 26 August, 2019; originally announced August 2019.

Journal ref: Phys. Rev. Applied 13, 024073 (2020)

Temporal pattern recognition with delayed feedback spin-torque nano-oscillators

Authors: M. Riou, J. Torrejon, B. Garitaine, F. Abreu Araujo, P. Bortolotti, V. Cros, S. Tsunegi, K. Yakushiji, A. Fukushima, H. Kubota, S. Yuasa, D. Querlioz, M. D. Stiles, J. Grollier

Abstract: The recent demonstration of neuromorphic computing with spin-torque nano-oscillators has opened a path to energy efficient data processing. The success of this demonstration hinged on the intrinsic short-term memory of the oscillators. In this study, we extend the memory of the spin-torque nano-oscillators through time-delayed feedback. We leverage this extrinsic memory to increase the efficiency… ▽ More The recent demonstration of neuromorphic computing with spin-torque nano-oscillators has opened a path to energy efficient data processing. The success of this demonstration hinged on the intrinsic short-term memory of the oscillators. In this study, we extend the memory of the spin-torque nano-oscillators through time-delayed feedback. We leverage this extrinsic memory to increase the efficiency of solving pattern recognition tasks that require memory to discriminate different inputs. The large tunability of these non-linear oscillators allows us to control and optimize the delayed feedback memory using different operating conditions of applied current and magnetic field. △ Less

Submitted 7 May, 2019; originally announced May 2019.

Journal ref: Phys. Rev. Applied 12, 024049 (2019)

Microwave neural processing and broadcasting with spintronic nano-oscillators

Authors: P. Talatchian, M. Romera, S. Tsunegi, F. Abreu Araujo, V. Cros, P. Bortolotti, J. Trastoy, K. Yakushiji, A. Fukushima, H. Kubota, S. Yuasa, M. Ernoult, D. Vodenicarevic, T. Hirtzlin, N. Locatelli, D. Querlioz, J. Grollier

Abstract: Can we build small neuromorphic chips capable of training deep networks with billions of parameters? This challenge requires hardware neurons and synapses with nanometric dimensions, which can be individually tuned, and densely connected. While nanosynaptic devices have been pursued actively in recent years, much less has been done on nanoscale artificial neurons. In this paper, we show that spint… ▽ More Can we build small neuromorphic chips capable of training deep networks with billions of parameters? This challenge requires hardware neurons and synapses with nanometric dimensions, which can be individually tuned, and densely connected. While nanosynaptic devices have been pursued actively in recent years, much less has been done on nanoscale artificial neurons. In this paper, we show that spintronic nano-oscillators are promising to implement analog hardware neurons that can be densely interconnected through electromagnetic signals. We show how spintronic oscillators maps the requirements of artificial neurons. We then show experimentally how an ensemble of four coupled oscillators can learn to classify all twelve American vowels, realizing the most complicated tasks performed by nanoscale neurons. △ Less

Submitted 25 April, 2019; originally announced April 2019.

Neuromorphic Computing through Time-Multiplexing with a Spin-Torque Nano-Oscillator

Authors: M. Riou, F. Abreu Araujo, J. Torrejon, S. Tsunegi, G. Khalsa, D. Querlioz, P. Bortolotti, V. Cros, K. Yakushiji, A. Fukushima, H. Kubota, S. Yuasa, M. D. Stiles, J. Grollier

Abstract: Fabricating powerful neuromorphic chips the size of a thumb requires miniaturizing their basic units: synapses and neurons. The challenge for neurons is to scale them down to submicrometer diameters while maintaining the properties that allow for reliable information processing: high signal to noise ratio, endurance, stability, reproducibility. In this work, we show that compact spin-torque nano-o… ▽ More Fabricating powerful neuromorphic chips the size of a thumb requires miniaturizing their basic units: synapses and neurons. The challenge for neurons is to scale them down to submicrometer diameters while maintaining the properties that allow for reliable information processing: high signal to noise ratio, endurance, stability, reproducibility. In this work, we show that compact spin-torque nano-oscillators can naturally implement such neurons, and quantify their ability to realize an actual cognitive task. In particular, we show that they can naturally implement reservoir computing with high performance and detail the recipes for this capability. △ Less

Submitted 25 April, 2019; originally announced April 2019.

Reservoir computing with the frequency, phase and amplitude of spin-torque nano-oscillators

Authors: Danijela Marković, Nathan Leroux, Mathieu Riou, Flavio Abreu Araujo, Jacob Torrejon, Damien Querlioz, Akio Fukushima, Shinji Yuasa, Juan Trastoy, Paolo Bortolotti, Julie Grollier

Abstract: Spin-torque nano-oscillators can emulate neurons at the nanoscale. Recent works show that the non-linearity of their oscillation amplitude can be leveraged to achieve waveform classification for an input signal encoded in the amplitude of the input voltage. Here we show that the frequency and the phase of the oscillator can also be used to recognize waveforms. For this purpose, we phase-lock the o… ▽ More Spin-torque nano-oscillators can emulate neurons at the nanoscale. Recent works show that the non-linearity of their oscillation amplitude can be leveraged to achieve waveform classification for an input signal encoded in the amplitude of the input voltage. Here we show that the frequency and the phase of the oscillator can also be used to recognize waveforms. For this purpose, we phase-lock the oscillator to the input waveform, which carries information in its modulated frequency. In this way we considerably decrease amplitude, phase and frequency noise. We show that this method allows classifying sine and square waveforms with an accuracy above 99% when decoding the output from the oscillator amplitude, phase or frequency. We find that recognition rates are directly related to the noise and non-linearity of each variable. These results prove that spin-torque nano-oscillators offer an interesting platform to implement different computing schemes leveraging their rich dynamical features. △ Less

Submitted 1 November, 2018; originally announced November 2018.

Chaos and relaxation oscillations in spin-torque windmill neurons

Authors: Rie Matsumoto, Steven Lequeux, Hiroshi Imamura, Julie Grollier

Abstract: Spintronic neurons which emit sharp voltage spikes are required for the realization of hardware neural networks enabling fast data processing with low-power consumption. In many neuroscience and computer science models, neurons are abstracted as non-linear oscillators. Magnetic nano-oscillators called spin-torque nano-oscillators are interesting candidates for imitating neurons at nanoscale. These… ▽ More Spintronic neurons which emit sharp voltage spikes are required for the realization of hardware neural networks enabling fast data processing with low-power consumption. In many neuroscience and computer science models, neurons are abstracted as non-linear oscillators. Magnetic nano-oscillators called spin-torque nano-oscillators are interesting candidates for imitating neurons at nanoscale. These oscillators, however, emit sinusoidal waveforms without spiking while biological neurons are relaxation oscillators that emit sharp voltage spikes. Here we propose a simple way to imitate neuron spiking in high-magnetoresistance nanoscale spin valves where both magnetic layers are free and thin enough to be switched by spin torque. Our numerical-simulation results show that the windmill motion induced by spin torque in the proposed spintronic neurons gives rise to spikes whose shape and frequency, set by the charging and discharging times, can be tuned through the amplitude of injected dc current. We also found that these devices can exhibit chaotic oscillations. Chaotic-like neuron dynamics has been observed in the brain, and it is desirable in some neuromorphic computing applications whereas it should be avoided in others. We demonstrate that the degree of chaos can be tuned in a wide range by engineering the magnetic stack and anisotropies and by changing the dc current. The proposed spintronic neuron is a promising building block for hardware neuromorphic chips leveraging non-linear dynamics for computing. △ Less

Submitted 4 October, 2018; originally announced October 2018.

Journal ref: Phys. Rev. Applied 11, 044093 (2019)

Nano-oscillator-based classification with a machine learning-compatible architecture

Authors: Damir Vodenicarevic, Nicolas Locatelli, Julie Grollier, Damien Querlioz

Abstract: Pattern classification architectures leveraging the physics of coupled nano-oscillators have been demonstrated as promising alternative computing approaches, but lack effective learning algorithms. In this work, we propose a nano-oscillator based classification architecture where the natural frequencies of the oscillators are learned linear combinations of the inputs, and define an offline learnin… ▽ More Pattern classification architectures leveraging the physics of coupled nano-oscillators have been demonstrated as promising alternative computing approaches, but lack effective learning algorithms. In this work, we propose a nano-oscillator based classification architecture where the natural frequencies of the oscillators are learned linear combinations of the inputs, and define an offline learning algorithm based on gradient back-propagation. Our results show significant classification improvements over a related approach with online learning. We also compare our architecture with a standard neural network on a simple machine learning case, which suggests that our approach is economical in terms of numbers of adjustable parameters. The introduced architecture is also compatible with existing nano-technologies: the architecture does not require changes in the coupling between nano-oscillators, and it is tolerant to oscillator phase noise. △ Less

Submitted 25 August, 2018; originally announced August 2018.

Circuit-Level Evaluation of the Generation of Truly Random Bits with Superparamagnetic Tunnel Junctions

Authors: Damir Vodenicarevic, Nicolas Locatelli, Alice Mizrahi, Tifenn Hirtzlin, Joseph S. Friedman, Julie Grollier, Damien Querlioz

Abstract: Many emerging alternative models of computation require massive numbers of random bits, but their generation at low energy is currently a challenge. The superparamagnetic tunnel junction, a spintronic device based on the same technology as spin torque magnetoresistive random access memory has recently been proposed as a solution, as this device naturally switches between two easy to measure resist… ▽ More Many emerging alternative models of computation require massive numbers of random bits, but their generation at low energy is currently a challenge. The superparamagnetic tunnel junction, a spintronic device based on the same technology as spin torque magnetoresistive random access memory has recently been proposed as a solution, as this device naturally switches between two easy to measure resistance states, due only to thermal noise. Reading the state of the junction naturally provides random bits, without the need of write operations. In this work, we evaluate a circuit solution for reading the state of superparamagnetic tunnel junction. We see that the circuit may induce a small read disturb effect for scaled superparamagnetic tunnel junctions, but this effect is naturally corrected in the whitening process needed to ensure the quality of the generated random bits. These results suggest that superparamagnetic tunnel junctions could generate truly random bits at 20 fJ/bit, including overheads, orders of magnitudes below CMOS-based solutions. △ Less

Submitted 24 June, 2018; originally announced June 2018.

Overcoming device unreliability with continuous learning in a population coding based computing system

Authors: Alice Mizrahi, Julie Grollier, Damien Querlioz, M. D. Stiles

Abstract: The brain, which uses redundancy and continuous learning to overcome the unreliability of its components, provides a promising path to building computing systems that are robust to the unreliability of their constituent nanodevices. In this work, we illustrate this path by a computing system based on population coding with magnetic tunnel junctions that implement both neurons and synaptic weights.… ▽ More The brain, which uses redundancy and continuous learning to overcome the unreliability of its components, provides a promising path to building computing systems that are robust to the unreliability of their constituent nanodevices. In this work, we illustrate this path by a computing system based on population coding with magnetic tunnel junctions that implement both neurons and synaptic weights. We show that equip** such a system with continuous learning enables it to recover from the loss of neurons and makes it possible to use unreliable synaptic weights (i.e. low energy barrier magnetic memories). There is a tradeoff between power consumption and precision because low energy barrier memories consume less energy than high barrier ones. For a given precision, there is an optimal number of neurons and an optimal energy barrier for the weights that leads to minimum power consumption. △ Less

Submitted 1 June, 2018; originally announced June 2018.

Low-Energy Truly Random Number Generation with Superparamagnetic Tunnel Junctions for Unconventional Computing

Authors: Damir Vodenicarevic, Nicolas Locatelli, Alice Mizrahi, Joseph S. Friedman, Adrien F. Vincent, Miguel Romera, Akio Fukushima, Kay Yakushiji, Hitoshi Kubota, Shinji Yuasa, Sandip Tiwari, Julie Grollier, Damien Querlioz

Abstract: Low-energy random number generation is critical for many emerging computing schemes proposed to complement or replace von Neumann architectures. However, current random number generators are always associated with an energy cost that is prohibitive for these computing schemes. In this paper, we introduce random number bit generation based on specific nanodevices: superparamagnetic tunnel junctions… ▽ More Low-energy random number generation is critical for many emerging computing schemes proposed to complement or replace von Neumann architectures. However, current random number generators are always associated with an energy cost that is prohibitive for these computing schemes. In this paper, we introduce random number bit generation based on specific nanodevices: superparamagnetic tunnel junctions. We experimentally demonstrate high quality random bit generation that represents orders-of-magnitude improvements in energy efficiency compared to current solutions. We show that the random generation speed improves with nanodevice scaling, and investigate the impact of temperature, magnetic field and crosstalk. Finally, we show how alternative computing schemes can be implemented using superparamagentic tunnel junctions as random number generators. These results open the way for fabricating efficient hardware computing devices leveraging stochasticity, and highlight a novel use for emerging nanodevices. △ Less

Submitted 24 November, 2017; v1 submitted 16 June, 2017; originally announced June 2017.

Comments: Supplementary Materials provided

Journal ref: Phys. Rev. Applied 8, 054045 (2017)

Skyrmion Gas Manipulation for Probabilistic Computing

Authors: Daniele Pinna, Flavio Abreu Araujo, Joo-Von Kim, Vincent Cros, Damien Querlioz, Perre Bessiere, Jacques Droulez, Julie Grollier

Abstract: The topologically protected magnetic spin configurations known as skyrmions offer promising applications due to their stability, mobility and localization. In this work, we emphasize how to leverage the thermally driven dynamics of an ensemble of such particles to perform computing tasks. We propose a device employing a skyrmion gas to reshuffle a random signal into an uncorrelated copy of itself.… ▽ More The topologically protected magnetic spin configurations known as skyrmions offer promising applications due to their stability, mobility and localization. In this work, we emphasize how to leverage the thermally driven dynamics of an ensemble of such particles to perform computing tasks. We propose a device employing a skyrmion gas to reshuffle a random signal into an uncorrelated copy of itself. This is demonstrated by modelling the ensemble dynamics in a collective coordinate approach where skyrmion-skyrmion and skyrmion-boundary interactions are accounted for phenomenologically. Our numerical results are used to develop a proof-of-concept for an energy efficient ($\simμ\mathrm{W}$) device with a low area imprint ($\simμ\mathrm{m}^2$). Whereas its immediate application to stochastic computing circuit designs will be made apparent, we argue that its basic functionality, reminiscent of an integrate-and-fire neuron, qualifies it as a novel bio-inspired building block. △ Less

Submitted 19 September, 2017; v1 submitted 26 January, 2017; originally announced January 2017.

Comments: 41 pages, 20 figures

Journal ref: Phys. Rev. Applied 9, 064018 (2018)