-
Performance enhancement of a spin-wave-based reservoir computing system utilizing different physical conditions
Authors:
Ryosho Nakane,
Akira Hirose,
Gouhei Tanaka
Abstract:
The authors have numerically studied how to enhance reservoir computing performance by thoroughly extracting their spin-wave device potential for higher-dimensional information generation. The reservoir device has a 1-input exciter and 120-output detectors on the top of a continuous magnetic garnet film for spin-wave transmission. For various nonlinear and fading-memory dynamic phenomena distribut…
▽ More
The authors have numerically studied how to enhance reservoir computing performance by thoroughly extracting their spin-wave device potential for higher-dimensional information generation. The reservoir device has a 1-input exciter and 120-output detectors on the top of a continuous magnetic garnet film for spin-wave transmission. For various nonlinear and fading-memory dynamic phenomena distributing in the film space, small in-plane magnetic fields were used to prepare stripe domain structures and various dam** constants at the film sides and bottom were explored. The ferromagnetic resonant frequency and relaxation time of spin precession clearly characterized the change in spin dynamics with the magnetic field and dam** constant. The common input signal for reservoir computing was a 1 GHz cosine wave with random 6-valued amplitude modulation. A basic 120-dimensional reservoir output vector was obtained from time-series signals at the 120 output detectors under each of the three magnetic field conditions. Then, 240- and 360-dimensional reservoir output vectors were also constructed by concatenating two and three basic ones, respectively. In nonlinear autoregressive moving average (NARMA) prediction tasks, the computational performance was enhanced as the dimension of the reservoir output vector becomes higher and a significantly low prediction error was achieved for the 10th-order NARMA using the 360-dimensional vector and optimum dam** constant. The results are clear evidence that the collection of diverse output signals efficiently increases the dimensionality effective for reservoir computing, i.e., reservoir-state richness. This paper demonstrates that performance enhancement through various configuration settings is a practical approach for on-chip reservoir computing devices with small numbers of real output nodes.
△ Less
Submitted 21 September, 2022;
originally announced September 2022.
-
Simulation platform for pattern recognition based on reservoir computing with memristor networks
Authors:
Gouhei Tanaka,
Ryosho Nakane
Abstract:
Memristive systems and devices are potentially available for implementing reservoir computing (RC) systems applied to pattern recognition. However, the computational ability of memristive RC systems depends on intertwined factors such as system architectures and physical properties of memristive elements, which complicates identifying the key factor for system performance. Here we develop a simula…
▽ More
Memristive systems and devices are potentially available for implementing reservoir computing (RC) systems applied to pattern recognition. However, the computational ability of memristive RC systems depends on intertwined factors such as system architectures and physical properties of memristive elements, which complicates identifying the key factor for system performance. Here we develop a simulation platform for RC with memristor device networks, which enables testing different system designs for performance improvement. Numerical simulations show that the memristor-network-based RC systems can yield high computational performance comparable to that of state-of-the-art methods in three time series classification tasks. We demonstrate that the excellent and robust computation under device-to-device variability can be achieved by appropriately setting network structures, nonlinearity of memristors, and pre/post-processing, which increases the potential for reliable computation with unreliable component devices. Our results contribute to an establishment of a design guide for memristive reservoirs toward a realization of energy-efficient machine learning hardware.
△ Less
Submitted 18 June, 2022; v1 submitted 30 November, 2021;
originally announced December 2021.
-
A numerical exploration of signal detector arrangement in a spin-wave reservoir computing device
Authors:
Takehiro Ichimura,
Ryosho Nakane,
Gouhei Tanaka,
Akira Hirose
Abstract:
This paper studies numerically how the signal detector arrangement influences the performance of reservoir computing using spin waves excited in a ferrimagnetic garnet film. This investigation is essentially important since the input information is not only conveyed but also transformed by the spin waves into high-dimensional information space when the waves propagate in the film in a spatially di…
▽ More
This paper studies numerically how the signal detector arrangement influences the performance of reservoir computing using spin waves excited in a ferrimagnetic garnet film. This investigation is essentially important since the input information is not only conveyed but also transformed by the spin waves into high-dimensional information space when the waves propagate in the film in a spatially distributed manner. This spatiotemporal dynamics realizes a rich reservoir-computational functionality. First, we simulate spin waves in a rectangular garnet film with two input electrodes to obtain spatial distributions of the reservoir states in response to input signals, which are represented as spin vectors and used for a machine-learning waveform classification task. The detected reservoir states are combined through readout connection weights to generate a final output. We visualize the spatial distribution of the weights after training to discuss the number and positions of the output electrodes by arranging them at grid points, equiangularly circular points or at random. We evaluate the classification accuracy by changing the number of the output electrodes, and find that a high accuracy ($>$ 90\%) is achieved with only several tens of output electrodes regardless of grid, circular or random arrangement. These results suggest that the spin waves possess sufficiently complex and rich dynamics for this type of tasks. Then we investigate in which area useful information is distributed more by arranging the electrodes locally on the chip. Finally, we show that this device has generalization ability for input wave-signal frequency in a certain frequency range. These results will lead to practical design of spin-wave reservoir devices for low-power intelligent computing in the near future.
△ Less
Submitted 30 April, 2021;
originally announced April 2021.
-
Recent Advances in Physical Reservoir Computing: A Review
Authors:
Gouhei Tanaka,
Toshiyuki Yamane,
Jean Benoit Héroux,
Ryosho Nakane,
Naoki Kanazawa,
Seiji Takeda,
Hidetoshi Numata,
Daiju Nakano,
Akira Hirose
Abstract:
Reservoir computing is a computational framework suited for temporal/sequential data processing. It is derived from several recurrent neural network models, including echo state networks and liquid state machines. A reservoir computing system consists of a reservoir for map** inputs into a high-dimensional space and a readout for pattern analysis from the high-dimensional states in the reservoir…
▽ More
Reservoir computing is a computational framework suited for temporal/sequential data processing. It is derived from several recurrent neural network models, including echo state networks and liquid state machines. A reservoir computing system consists of a reservoir for map** inputs into a high-dimensional space and a readout for pattern analysis from the high-dimensional states in the reservoir. The reservoir is fixed and only the readout is trained with a simple method such as linear regression and classification. Thus, the major advantage of reservoir computing compared to other recurrent neural networks is fast learning, resulting in low training cost. Another advantage is that the reservoir without adaptive updating is amenable to hardware implementation using a variety of physical systems, substrates, and devices. In fact, such physical reservoir computing has attracted increasing attention in diverse fields of research. The purpose of this review is to provide an overview of recent advances in physical reservoir computing by classifying them according to the type of the reservoir. We discuss the current issues and perspectives related to physical reservoir computing, in order to further expand its practical applications and develop next-generation machine learning systems.
△ Less
Submitted 15 April, 2019; v1 submitted 15 August, 2018;
originally announced August 2018.
