-
Role of non-linear data processing on speech recognition task in the framework of reservoir computing
Authors:
Flavio Abreu Araujo,
Mathieu Riou,
Jacob Torrejon,
Sumito Tsunegi,
Damien Querlioz,
Kay Yakushiji,
Akio Fukushima,
Hitoshi Kubota,
Shinji Yuasa,
Mark D. Stiles,
Julie Grollier
Abstract:
The reservoir computing neural network architecture is widely used to test hardware systems for neuromorphic computing. One of the preferred tasks for bench-marking such devices is automatic speech recognition. However, this task requires acoustic transformations from sound waveforms with varying amplitudes to frequency domain maps that can be seen as feature extraction techniques. Depending on th…
▽ More
The reservoir computing neural network architecture is widely used to test hardware systems for neuromorphic computing. One of the preferred tasks for bench-marking such devices is automatic speech recognition. However, this task requires acoustic transformations from sound waveforms with varying amplitudes to frequency domain maps that can be seen as feature extraction techniques. Depending on the conversion method, these may obscure the contribution of the neuromorphic hardware to the overall speech recognition performance. Here, we quantify and separate the contributions of the acoustic transformations and the neuromorphic hardware to the speech recognition success rate. We show that the non-linearity in the acoustic transformation plays a critical role in feature extraction. We compute the gain in word success rate provided by a reservoir computing device compared to the acoustic transformation only, and show that it is an appropriate benchmark for comparing different hardware. Finally, we experimentally and numerically quantify the impact of the different acoustic transformations for neuromorphic hardware based on magnetic nano-oscillators.
△ Less
Submitted 19 December, 2019; v1 submitted 10 May, 2019;
originally announced June 2019.
-
Microwave neural processing and broadcasting with spintronic nano-oscillators
Authors:
P. Talatchian,
M. Romera,
S. Tsunegi,
F. Abreu Araujo,
V. Cros,
P. Bortolotti,
J. Trastoy,
K. Yakushiji,
A. Fukushima,
H. Kubota,
S. Yuasa,
M. Ernoult,
D. Vodenicarevic,
T. Hirtzlin,
N. Locatelli,
D. Querlioz,
J. Grollier
Abstract:
Can we build small neuromorphic chips capable of training deep networks with billions of parameters? This challenge requires hardware neurons and synapses with nanometric dimensions, which can be individually tuned, and densely connected. While nanosynaptic devices have been pursued actively in recent years, much less has been done on nanoscale artificial neurons. In this paper, we show that spint…
▽ More
Can we build small neuromorphic chips capable of training deep networks with billions of parameters? This challenge requires hardware neurons and synapses with nanometric dimensions, which can be individually tuned, and densely connected. While nanosynaptic devices have been pursued actively in recent years, much less has been done on nanoscale artificial neurons. In this paper, we show that spintronic nano-oscillators are promising to implement analog hardware neurons that can be densely interconnected through electromagnetic signals. We show how spintronic oscillators maps the requirements of artificial neurons. We then show experimentally how an ensemble of four coupled oscillators can learn to classify all twelve American vowels, realizing the most complicated tasks performed by nanoscale neurons.
△ Less
Submitted 25 April, 2019;
originally announced April 2019.
-
Neuromorphic Computing through Time-Multiplexing with a Spin-Torque Nano-Oscillator
Authors:
M. Riou,
F. Abreu Araujo,
J. Torrejon,
S. Tsunegi,
G. Khalsa,
D. Querlioz,
P. Bortolotti,
V. Cros,
K. Yakushiji,
A. Fukushima,
H. Kubota,
S. Yuasa,
M. D. Stiles,
J. Grollier
Abstract:
Fabricating powerful neuromorphic chips the size of a thumb requires miniaturizing their basic units: synapses and neurons. The challenge for neurons is to scale them down to submicrometer diameters while maintaining the properties that allow for reliable information processing: high signal to noise ratio, endurance, stability, reproducibility. In this work, we show that compact spin-torque nano-o…
▽ More
Fabricating powerful neuromorphic chips the size of a thumb requires miniaturizing their basic units: synapses and neurons. The challenge for neurons is to scale them down to submicrometer diameters while maintaining the properties that allow for reliable information processing: high signal to noise ratio, endurance, stability, reproducibility. In this work, we show that compact spin-torque nano-oscillators can naturally implement such neurons, and quantify their ability to realize an actual cognitive task. In particular, we show that they can naturally implement reservoir computing with high performance and detail the recipes for this capability.
△ Less
Submitted 25 April, 2019;
originally announced April 2019.
