-
Towards mutual synchronization of serially connected Spin Torque Oscillators based on magnetic tunnel junctions
Authors:
Piotr Rzeszut,
Jakub Mojsiejuk,
Witold SkowroĊski,
Sumito Tsunegi,
Hitoshi Kubota,
Shinji Yuasa
Abstract:
Multiple neuromorphic applications require the tuning of two or more devices to a common signal. Various types of neuromorphic computation can be realized using spintronic oscillators, where the DC current induces magnetization precession, which turns into an AC voltage generator. However, in spintronics, synchronization of two oscillators using a DC signal is still a challenging problem because i…
▽ More
Multiple neuromorphic applications require the tuning of two or more devices to a common signal. Various types of neuromorphic computation can be realized using spintronic oscillators, where the DC current induces magnetization precession, which turns into an AC voltage generator. However, in spintronics, synchronization of two oscillators using a DC signal is still a challenging problem because it requires a certain degree of similarity between devices that are to be synchronized, which may be difficult to achieve due to device parameter distribution during the fabrication process. In this work, we present experimental results on the mechanisms of synchronization of spin-torque oscillators. Devices are based on magnetic tunnel junction with a perpendicularly magnetized free layer and take advantage of a uniform magnetization precision in the presence of the magnetic field and a DC bias. By using an external microwave source, we show the optimal condition for the synchronization of the magnetic tunnel junctions. Finally, we present results on the in-series connection of two junctions and discuss the possible path towards improving oscillation power and linewidth. In addition, using numerical simulations of the coupled oscillators model, we aim to reproduce the conditions of the experiments and determine the tolerance for achieving synchronization.
△ Less
Submitted 21 June, 2023; v1 submitted 20 June, 2023;
originally announced June 2023.
-
Symbolic integration by integrating learning models with different strengths and weaknesses
Authors:
Hazumi Kubota,
Yuta Tokuoka,
Takahiro G. Yamada,
Akira Funahashi
Abstract:
Integration is indispensable, not only in mathematics, but also in a wide range of other fields. A deep learning method has recently been developed and shown to be capable of integrating mathematical functions that could not previously be integrated on a computer. However, that method treats integration as equivalent to natural language translation and does not reflect mathematical information. In…
▽ More
Integration is indispensable, not only in mathematics, but also in a wide range of other fields. A deep learning method has recently been developed and shown to be capable of integrating mathematical functions that could not previously be integrated on a computer. However, that method treats integration as equivalent to natural language translation and does not reflect mathematical information. In this study, we adjusted the learning model to take mathematical information into account and developed a wide range of learning models that learn the order of numerical operations more robustly. In this way, we achieved a 98.80% correct answer rate with symbolic integration, a higher rate than that of any existing method. We judged the correctness of the integration based on whether the derivative of the primitive function was consistent with the integrand. By building an integrated model based on this strategy, we achieved a 99.79% rate of correct answers with symbolic integration.
△ Less
Submitted 9 March, 2021;
originally announced March 2021.
-
Role of non-linear data processing on speech recognition task in the framework of reservoir computing
Authors:
Flavio Abreu Araujo,
Mathieu Riou,
Jacob Torrejon,
Sumito Tsunegi,
Damien Querlioz,
Kay Yakushiji,
Akio Fukushima,
Hitoshi Kubota,
Shinji Yuasa,
Mark D. Stiles,
Julie Grollier
Abstract:
The reservoir computing neural network architecture is widely used to test hardware systems for neuromorphic computing. One of the preferred tasks for bench-marking such devices is automatic speech recognition. However, this task requires acoustic transformations from sound waveforms with varying amplitudes to frequency domain maps that can be seen as feature extraction techniques. Depending on th…
▽ More
The reservoir computing neural network architecture is widely used to test hardware systems for neuromorphic computing. One of the preferred tasks for bench-marking such devices is automatic speech recognition. However, this task requires acoustic transformations from sound waveforms with varying amplitudes to frequency domain maps that can be seen as feature extraction techniques. Depending on the conversion method, these may obscure the contribution of the neuromorphic hardware to the overall speech recognition performance. Here, we quantify and separate the contributions of the acoustic transformations and the neuromorphic hardware to the speech recognition success rate. We show that the non-linearity in the acoustic transformation plays a critical role in feature extraction. We compute the gain in word success rate provided by a reservoir computing device compared to the acoustic transformation only, and show that it is an appropriate benchmark for comparing different hardware. Finally, we experimentally and numerically quantify the impact of the different acoustic transformations for neuromorphic hardware based on magnetic nano-oscillators.
△ Less
Submitted 19 December, 2019; v1 submitted 10 May, 2019;
originally announced June 2019.
-
Microwave neural processing and broadcasting with spintronic nano-oscillators
Authors:
P. Talatchian,
M. Romera,
S. Tsunegi,
F. Abreu Araujo,
V. Cros,
P. Bortolotti,
J. Trastoy,
K. Yakushiji,
A. Fukushima,
H. Kubota,
S. Yuasa,
M. Ernoult,
D. Vodenicarevic,
T. Hirtzlin,
N. Locatelli,
D. Querlioz,
J. Grollier
Abstract:
Can we build small neuromorphic chips capable of training deep networks with billions of parameters? This challenge requires hardware neurons and synapses with nanometric dimensions, which can be individually tuned, and densely connected. While nanosynaptic devices have been pursued actively in recent years, much less has been done on nanoscale artificial neurons. In this paper, we show that spint…
▽ More
Can we build small neuromorphic chips capable of training deep networks with billions of parameters? This challenge requires hardware neurons and synapses with nanometric dimensions, which can be individually tuned, and densely connected. While nanosynaptic devices have been pursued actively in recent years, much less has been done on nanoscale artificial neurons. In this paper, we show that spintronic nano-oscillators are promising to implement analog hardware neurons that can be densely interconnected through electromagnetic signals. We show how spintronic oscillators maps the requirements of artificial neurons. We then show experimentally how an ensemble of four coupled oscillators can learn to classify all twelve American vowels, realizing the most complicated tasks performed by nanoscale neurons.
△ Less
Submitted 25 April, 2019;
originally announced April 2019.
-
Neuromorphic Computing through Time-Multiplexing with a Spin-Torque Nano-Oscillator
Authors:
M. Riou,
F. Abreu Araujo,
J. Torrejon,
S. Tsunegi,
G. Khalsa,
D. Querlioz,
P. Bortolotti,
V. Cros,
K. Yakushiji,
A. Fukushima,
H. Kubota,
S. Yuasa,
M. D. Stiles,
J. Grollier
Abstract:
Fabricating powerful neuromorphic chips the size of a thumb requires miniaturizing their basic units: synapses and neurons. The challenge for neurons is to scale them down to submicrometer diameters while maintaining the properties that allow for reliable information processing: high signal to noise ratio, endurance, stability, reproducibility. In this work, we show that compact spin-torque nano-o…
▽ More
Fabricating powerful neuromorphic chips the size of a thumb requires miniaturizing their basic units: synapses and neurons. The challenge for neurons is to scale them down to submicrometer diameters while maintaining the properties that allow for reliable information processing: high signal to noise ratio, endurance, stability, reproducibility. In this work, we show that compact spin-torque nano-oscillators can naturally implement such neurons, and quantify their ability to realize an actual cognitive task. In particular, we show that they can naturally implement reservoir computing with high performance and detail the recipes for this capability.
△ Less
Submitted 25 April, 2019;
originally announced April 2019.
-
Neuromorphic computing with nanoscale spintronic oscillators
Authors:
Jacob Torrejon,
Mathieu Riou,
Flavio Abreu Araujo,
Sumito Tsunegi,
Guru Khalsa,
Damien Querlioz,
Paolo Bortolotti,
Vincent Cros,
Akio Fukushima,
Hitoshi Kubota,
Shinji Yuasa,
M. D. Stiles,
Julie Grollier
Abstract:
Neurons in the brain behave as non-linear oscillators, which develop rhythmic activity and interact to process information. Taking inspiration from this behavior to realize high density, low power neuromorphic computing will require huge numbers of nanoscale non-linear oscillators. Indeed, a simple estimation indicates that, in order to fit a hundred million oscillators organized in a two-dimensio…
▽ More
Neurons in the brain behave as non-linear oscillators, which develop rhythmic activity and interact to process information. Taking inspiration from this behavior to realize high density, low power neuromorphic computing will require huge numbers of nanoscale non-linear oscillators. Indeed, a simple estimation indicates that, in order to fit a hundred million oscillators organized in a two-dimensional array inside a chip the size of a thumb, their lateral dimensions must be smaller than one micrometer. However, despite multiple theoretical proposals, there is no proof of concept today of neuromorphic computing with nano-oscillators. Indeed, nanoscale devices tend to be noisy and to lack the stability required to process data in a reliable way. Here, we show experimentally that a nanoscale spintronic oscillator can achieve spoken digit recognition with accuracies similar to state of the art neural networks. We pinpoint the regime of magnetization dynamics leading to highest performance. These results, combined with the exceptional ability of these spintronic oscillators to interact together, their long lifetime, and low energy consumption, open the path to fast, parallel, on-chip computation based on networks of oscillators.
△ Less
Submitted 14 April, 2017; v1 submitted 25 January, 2017;
originally announced January 2017.
-
Neural-like computing with populations of superparamagnetic basis functions
Authors:
Alice Mizrahi,
Tifenn Hirtzlin,
Akio Fukushima,
Hitoshi Kubota,
Shinji Yuasa,
Julie Grollier,
Damien Querlioz
Abstract:
In neuroscience, population coding theory demonstrates that neural assemblies can achieve fault-tolerant information processing. Mapped to nanoelectronics, this strategy could allow for reliable computing with scaled-down, noisy, imperfect devices. Doing so requires that the population components form a set of basis functions in terms of their response functions to inputs, offering a physical subs…
▽ More
In neuroscience, population coding theory demonstrates that neural assemblies can achieve fault-tolerant information processing. Mapped to nanoelectronics, this strategy could allow for reliable computing with scaled-down, noisy, imperfect devices. Doing so requires that the population components form a set of basis functions in terms of their response functions to inputs, offering a physical substrate for calculating. For this purpose, the responses of the nanodevices should be non-linear, and each tuned to different values of the input. These strong requirements have prevented a demonstration of population coding with nanodevices. Here, we show that nanoscale magnetic tunnel junctions can be assembled to meet these requirements. We demonstrate experimentally that a population of nine junctions can implement a basis set of functions, providing the data to achieve, for example, the generation of cursive letters. We design hybrid magnetic-CMOS systems based on interlinked populations of junctions and show that they can learn to realize non-linear variability-resilient transformations with a low imprint area and low power.
△ Less
Submitted 15 March, 2018; v1 submitted 27 October, 2016;
originally announced October 2016.
