-
Convolutional Neural Networks with Radio-Frequency Spintronic Nano-Devices
Authors:
Nathan Leroux,
Arnaud De Riz,
Dédalo Sanz-Hernández,
Danijela Marković,
Alice Mizrahi,
Julie Grollier
Abstract:
Convolutional neural networks are state-of-the-art and ubiquitous in modern signal processing and machine vision. Nowadays, hardware solutions based on emerging nanodevices are designed to reduce the power consumption of these networks. Spintronics devices are promising for information processing because of the various neural and synaptic functionalities they offer. However, due to their low OFF/O…
▽ More
Convolutional neural networks are state-of-the-art and ubiquitous in modern signal processing and machine vision. Nowadays, hardware solutions based on emerging nanodevices are designed to reduce the power consumption of these networks. Spintronics devices are promising for information processing because of the various neural and synaptic functionalities they offer. However, due to their low OFF/ON ratio, performing all the multiplications required for convolutions in a single step with a crossbar array of spintronic memories would cause sneak-path currents. Here we present an architecture where synaptic communications have a frequency selectivity that prevents crosstalk caused by sneak-path currents. We first demonstrate how a chain of spintronic resonators can function as synapses and make convolutions by sequentially rectifying radio-frequency signals encoding consecutive sets of inputs. We show that a parallel implementation is possible with multiple chains of spintronic resonators to avoid storing intermediate computational steps in memory. We propose two different spatial arrangements for these chains. For each of them, we explain how to tune many artificial synapses simultaneously, exploiting the synaptic weight sharing specific to convolutions. We show how information can be transmitted between convolutional layers by using spintronic oscillators as artificial microwave neurons. Finally, we simulate a network of these radio-frequency resonators and spintronic oscillators to solve the MNIST handwritten digits dataset, and obtain results comparable to software convolutional neural networks. Since it can run convolutional neural networks fully in parallel in a single step with nano devices, the architecture proposed in this paper is promising for embedded applications requiring machine vision, such as autonomous driving.
△ Less
Submitted 9 November, 2021;
originally announced November 2021.
-
Shelling with MoS$_2$ Functional CuS@MoS2 Hybrids as Electrocatalysts for the Oxygen Reduction and Hydrogen Evolution Reactions
Authors:
Avraham Bar-Hen,
Ronen Bar Ziv,
Tsion Ohaion-Raz,
Amir Mizrahi,
Simon Hettler,
Raul Arenal,
Maya Bar Sadan
Abstract:
The development of noble-metal free electrocatalysts is of high importance for clean energy conversion applications. MoS$_2$ has been considered as a promising low cost catalyst for the hydrogen evolution reaction (HER), however its activity is limited by poor conductivity and low abundance of active sites. Moreover, its suitability as an effective catalyst for other reactions, in particluar the o…
▽ More
The development of noble-metal free electrocatalysts is of high importance for clean energy conversion applications. MoS$_2$ has been considered as a promising low cost catalyst for the hydrogen evolution reaction (HER), however its activity is limited by poor conductivity and low abundance of active sites. Moreover, its suitability as an effective catalyst for other reactions, in particluar the oxygen reduction reaction (ORR), was hardly explored to date. Herein, we show hybrid nanostructures of shelled CuS particles with MoS$_2$ layers, which produces several outcomes: The MoS$_2$ shell is strained and defective, and charge transfer from the core to MoS$_2$ occurs, enabling activation of the basal plane of MoS$_2$. Changing the feed ratio of the precursors led to control over morphology, such that the wrap** of the cores with the shell was continuously varied and characterized. We found an optimal hybrid structure, which provided high electrochemical active surface area and fast charge transfer kinetics, leading to improved activity not only towards HER (overpotential of 225 mV at 10 mA cm$^{-1}$), but also for the sluggish ORR (onset potential 0.87 V vs RHE).
△ Less
Submitted 15 October, 2021;
originally announced October 2021.
-
Physics for Neuromorphic Computing
Authors:
Danijela Markovic,
Alice Mizrahi,
Damien Querlioz,
Julie Grollier
Abstract:
Neuromorphic computing takes inspiration from the brain to create energy efficient hardware for information processing, capable of highly sophisticated tasks. In this article, we make the case that building this new hardware necessitates reinventing electronics. We show that research in physics and material science will be key to create artificial nano-neurons and synapses, to connect them togethe…
▽ More
Neuromorphic computing takes inspiration from the brain to create energy efficient hardware for information processing, capable of highly sophisticated tasks. In this article, we make the case that building this new hardware necessitates reinventing electronics. We show that research in physics and material science will be key to create artificial nano-neurons and synapses, to connect them together in huge numbers, to organize them in complex systems, and to compute with them efficiently. We describe how some researchers choose to take inspiration from artificial intelligence to move forward in this direction, whereas others prefer taking inspiration from neuroscience, and we highlight recent striking results obtained with these two approaches. Finally, we discuss the challenges and perspectives in neuromorphic physics, which include develo** the algorithms and the hardware hand in hand, making significant advances with small toy systems, as well as building large scale networks.
△ Less
Submitted 8 March, 2020;
originally announced March 2020.
-
Energy-efficient stochastic computing with superparamagnetic tunnel junctions
Authors:
Matthew W. Daniels,
Advait Madhavan,
Philippe Talatchian,
Alice Mizrahi,
Mark D. Stiles
Abstract:
Superparamagnetic tunnel junctions (SMTJs) have emerged as a competitive, realistic nanotechnology to support novel forms of stochastic computation in CMOS-compatible platforms. One of their applications is to generate random bitstreams suitable for use in stochastic computing implementations. We describe a method for digitally programmable bitstream generation based on pre-charge sense amplifiers…
▽ More
Superparamagnetic tunnel junctions (SMTJs) have emerged as a competitive, realistic nanotechnology to support novel forms of stochastic computation in CMOS-compatible platforms. One of their applications is to generate random bitstreams suitable for use in stochastic computing implementations. We describe a method for digitally programmable bitstream generation based on pre-charge sense amplifiers. This generator is significantly more energy efficient than SMTJ-based bitstream generators that tune probabilities with spin currents and a factor of two more efficient than related CMOS-based implementations. The true randomness of this bitstream generator allows us to use them as the fundamental units of a novel neural network architecture. To take advantage of the potential savings, we codesign the algorithm with the circuit, rather than directly transcribing a classical neural network into hardware. The flexibility of the neural network mathematics allows us to adapt the network to the explicitly energy efficient choices we make at the device level. The result is a convolutional neural network design operating at $\approx$ 150 nJ per inference with 97 % performance on MNIST -- a factor of 1.4 to 7.7 improvement in energy efficiency over comparable proposals in the recent literature.
△ Less
Submitted 6 March, 2020; v1 submitted 25 November, 2019;
originally announced November 2019.
-
Circuit-Level Evaluation of the Generation of Truly Random Bits with Superparamagnetic Tunnel Junctions
Authors:
Damir Vodenicarevic,
Nicolas Locatelli,
Alice Mizrahi,
Tifenn Hirtzlin,
Joseph S. Friedman,
Julie Grollier,
Damien Querlioz
Abstract:
Many emerging alternative models of computation require massive numbers of random bits, but their generation at low energy is currently a challenge. The superparamagnetic tunnel junction, a spintronic device based on the same technology as spin torque magnetoresistive random access memory has recently been proposed as a solution, as this device naturally switches between two easy to measure resist…
▽ More
Many emerging alternative models of computation require massive numbers of random bits, but their generation at low energy is currently a challenge. The superparamagnetic tunnel junction, a spintronic device based on the same technology as spin torque magnetoresistive random access memory has recently been proposed as a solution, as this device naturally switches between two easy to measure resistance states, due only to thermal noise. Reading the state of the junction naturally provides random bits, without the need of write operations. In this work, we evaluate a circuit solution for reading the state of superparamagnetic tunnel junction. We see that the circuit may induce a small read disturb effect for scaled superparamagnetic tunnel junctions, but this effect is naturally corrected in the whitening process needed to ensure the quality of the generated random bits. These results suggest that superparamagnetic tunnel junctions could generate truly random bits at 20 fJ/bit, including overheads, orders of magnitudes below CMOS-based solutions.
△ Less
Submitted 24 June, 2018;
originally announced June 2018.
-
Overcoming device unreliability with continuous learning in a population coding based computing system
Authors:
Alice Mizrahi,
Julie Grollier,
Damien Querlioz,
M. D. Stiles
Abstract:
The brain, which uses redundancy and continuous learning to overcome the unreliability of its components, provides a promising path to building computing systems that are robust to the unreliability of their constituent nanodevices. In this work, we illustrate this path by a computing system based on population coding with magnetic tunnel junctions that implement both neurons and synaptic weights.…
▽ More
The brain, which uses redundancy and continuous learning to overcome the unreliability of its components, provides a promising path to building computing systems that are robust to the unreliability of their constituent nanodevices. In this work, we illustrate this path by a computing system based on population coding with magnetic tunnel junctions that implement both neurons and synaptic weights. We show that equip** such a system with continuous learning enables it to recover from the loss of neurons and makes it possible to use unreliable synaptic weights (i.e. low energy barrier magnetic memories). There is a tradeoff between power consumption and precision because low energy barrier memories consume less energy than high barrier ones. For a given precision, there is an optimal number of neurons and an optimal energy barrier for the weights that leads to minimum power consumption.
△ Less
Submitted 1 June, 2018;
originally announced June 2018.
-
Low-Energy Truly Random Number Generation with Superparamagnetic Tunnel Junctions for Unconventional Computing
Authors:
Damir Vodenicarevic,
Nicolas Locatelli,
Alice Mizrahi,
Joseph S. Friedman,
Adrien F. Vincent,
Miguel Romera,
Akio Fukushima,
Kay Yakushiji,
Hitoshi Kubota,
Shinji Yuasa,
Sandip Tiwari,
Julie Grollier,
Damien Querlioz
Abstract:
Low-energy random number generation is critical for many emerging computing schemes proposed to complement or replace von Neumann architectures. However, current random number generators are always associated with an energy cost that is prohibitive for these computing schemes. In this paper, we introduce random number bit generation based on specific nanodevices: superparamagnetic tunnel junctions…
▽ More
Low-energy random number generation is critical for many emerging computing schemes proposed to complement or replace von Neumann architectures. However, current random number generators are always associated with an energy cost that is prohibitive for these computing schemes. In this paper, we introduce random number bit generation based on specific nanodevices: superparamagnetic tunnel junctions. We experimentally demonstrate high quality random bit generation that represents orders-of-magnitude improvements in energy efficiency compared to current solutions. We show that the random generation speed improves with nanodevice scaling, and investigate the impact of temperature, magnetic field and crosstalk. Finally, we show how alternative computing schemes can be implemented using superparamagentic tunnel junctions as random number generators. These results open the way for fabricating efficient hardware computing devices leveraging stochasticity, and highlight a novel use for emerging nanodevices.
△ Less
Submitted 24 November, 2017; v1 submitted 16 June, 2017;
originally announced June 2017.
-
Thresholdless Nanoscale Coaxial Lasers
Authors:
M. Khajavikhan,
A. Simic,
M. Katz,
J. H. Lee,
B. Slutsky,
A. Mizrahi,
V. Lomakin,
Y. Fainman
Abstract:
The generation of coherent radiation in nanostructures has attracted considerable interest in recent years owing both to the quantum electrodynamical effects that emerge in small volumes, and to their potential for future applications. The progress towards exploring this size regime, however, has been hindered by the lack of a systematic approach to scaling down the mode as the structures shrink i…
▽ More
The generation of coherent radiation in nanostructures has attracted considerable interest in recent years owing both to the quantum electrodynamical effects that emerge in small volumes, and to their potential for future applications. The progress towards exploring this size regime, however, has been hindered by the lack of a systematic approach to scaling down the mode as the structures shrink in size and by the high threshold power required for lasing in small cavities. Here we present a new family of metamaterial-like nano-cavities consisting of metallic coaxial nanostructures that solves both of these problems. The proposed nanoscale coaxial cavities can operate as thresholdless lasers, and their size is not restricted by the mode cut-off. Using these new nano-cavities we have succeeded to demonstrate for the first time thresholdless lasing in a broadband gain medium, and the smallest room temperature, continuous wave, telecom laser to date. The nanoscale coaxial cavities are the first systematic step towards unveiling the potentials of ultra small quantum electrodynamical objects in which atom-field interactions generate new functionalities.
△ Less
Submitted 24 August, 2011;
originally announced August 2011.
-
Self alignment and instability of waveguides induced by optical forces
Authors:
Amit Mizrahi,
Kazuhiro Ikeda,
Fabio Bonomelli,
Vitaliy Lomakin,
Yeshaiahu Fainman
Abstract:
We introduce a new fundamental property of waveguides induced by the forces of the guided light, namely, the ability to self align or be in instability. A nanoscale waveguide broken by an offset and a gap may tend to self align to form a continuous waveguide. Conversely, depending on the geometry and light polarization, the two parts of the waveguide may be deflected away from each other, thus b…
▽ More
We introduce a new fundamental property of waveguides induced by the forces of the guided light, namely, the ability to self align or be in instability. A nanoscale waveguide broken by an offset and a gap may tend to self align to form a continuous waveguide. Conversely, depending on the geometry and light polarization, the two parts of the waveguide may be deflected away from each other, thus being in an unstable state. These effects are unique as they rely on the presence of both the guided mode and the scattered light. Strong self alignment forces may be facilitated by near field interaction with polarization surface charges.
△ Less
Submitted 20 May, 2009;
originally announced May 2009.
