-
A high-performance deep reservoir computing experimentally demonstrated with ion-gating reservoirs
Authors:
Daiki Nishioka,
Takashi Tsuchiya,
Masataka Imura,
Yasuo Koide,
Tohru Higuchi,
Kazuya Terabe
Abstract:
While physical reservoir computing (PRC) is a promising way to achieve low power consumption neuromorphic computing, its computational performance is still insufficient at a practical level. One promising approach to improving PRC performance is deep reservoir computing (deep-RC), in which the component reservoirs are multi-layered. However, all of the deep-RC schemes reported so far have been eff…
▽ More
While physical reservoir computing (PRC) is a promising way to achieve low power consumption neuromorphic computing, its computational performance is still insufficient at a practical level. One promising approach to improving PRC performance is deep reservoir computing (deep-RC), in which the component reservoirs are multi-layered. However, all of the deep-RC schemes reported so far have been effective only for simulation reservoirs and limited PRCs, and there have been no reports of nanodevice implementations. Here, as the first nanodevice implementation of Deep-RC, we report a demonstration of deep physical reservoir computing using an ion gating reservoir (IGR), which is a small and high-performance physical reservoir. While previously reported Deep-RC scheme did not improve the performance of IGR, our Deep-IGR achieved a normalized mean squared error of 0.0092 on a second-order nonlinear autoregressive moving average task, with is the best performance of any physical reservoir so far reported. More importantly, the device outperformed full simulation reservoir computing. The dramatic performance improvement of the IGR with our deep-RC architecture paves the way for high-performance, large-scale, physical neural network devices.
△ Less
Submitted 11 September, 2023; v1 submitted 6 September, 2023;
originally announced September 2023.
-
Experimental Demonstration of High-Performance Physical Reservoir Computing with Nonlinear Interfered Spin Wave Multi-Detection
Authors:
Wataru Namiki,
Daiki Nishioka,
Yu Yamaguchi,
Takashi Tsuchiya,
Tohru Higuchi,
Kazuya Terabe
Abstract:
Physical reservoir computing, which is a promising method for the implementation of highly efficient artificial intelligence devices, requires a physical system with nonlinearity, fading memory, and the ability to map in high dimensions. Although it is expected that spin wave interference can perform as highly efficient reservoir computing in some micromagnetic simulations, there has been no exper…
▽ More
Physical reservoir computing, which is a promising method for the implementation of highly efficient artificial intelligence devices, requires a physical system with nonlinearity, fading memory, and the ability to map in high dimensions. Although it is expected that spin wave interference can perform as highly efficient reservoir computing in some micromagnetic simulations, there has been no experimental verification to date. Herein, we demonstrate reservoir computing that utilizes multidetected nonlinear spin wave interference in an yttrium iron garnet single crystal. The subject computing system achieved excellent performance when used for hand-written digit recognition, second-order nonlinear dynamical tasks, and nonlinear autoregressive moving average (NARMA). It is of particular note that normalized mean square errors (NMSEs) for NARMA2 and second-order nonlinear dynamical tasks were 1.81x10-2 and 8.37x10-5, respectively, which are the lowest figures for any experimental physical reservoir so far reported. Said high performance was achieved with higher nonlinearity and the large memory capacity of interfered spin wave multi-detection.
△ Less
Submitted 7 July, 2022;
originally announced July 2022.
-
Edge-Of-Chaos Learning Achieved by Ion-Electron Coupled Dynamics in an Ion-Gating Reservoir
Authors:
Daiki Nishioka,
Takashi Tsuchiya,
Wataru Namiki,
Makoto Takayanagi,
Masataka Imura,
Yasuo Koide,
Tohru Higuchi,
Kazuya Terabe
Abstract:
Physical reservoir computing has recently been attracting attention for its ability to significantly reduce the computational resources required to process time-series data. However, the physical reservoirs that have been reported to date have had insufficient expression power, and most of them have a large volume, which makes their practical application difficult. Herein we describe the developme…
▽ More
Physical reservoir computing has recently been attracting attention for its ability to significantly reduce the computational resources required to process time-series data. However, the physical reservoirs that have been reported to date have had insufficient expression power, and most of them have a large volume, which makes their practical application difficult. Herein we describe the development of a Li+-electrolyte based ion-gating reservoir (IGR), with ion-electron coupled dynamics, for use in high performance physical reservoir computing. A variety of synaptic responses were obtained in response to past experience, which responses were stored as transient charge density patterns in an electric double layer, at the Li+-electrolyte/diamond interface. Performance, which was tested using a nonlinear autoregressive moving-average (NARMA) task, was found to be excellent, with a NMSE of 0.023 for NARMA2, which is the highest for any physical reservoir reported to date. The maximum Lyapunov exponent of the IGR was 0.0083: the edge of chaos state enabling the best computational capacity. The IGR described herein opens the way for high-performance and integrated neural network devices.
△ Less
Submitted 6 July, 2022;
originally announced July 2022.
-
Towards Informative Tagging of Code Fragments to Support the Investigation of Code Clones
Authors:
Daisuke Nishioka,
Toshihiro Kamiya
Abstract:
Investigating the code fragments of code clones detected by code clone detection tools is a time-consuming task, especially when a large number of reference source files are available. This paper proposes (i) a method for clustering a clone class, which is detected by code clone detection tools using syntactic similarity, based on topic similarity by considering its code fragments as sequences of…
▽ More
Investigating the code fragments of code clones detected by code clone detection tools is a time-consuming task, especially when a large number of reference source files are available. This paper proposes (i) a method for clustering a clone class, which is detected by code clone detection tools using syntactic similarity, based on topic similarity by considering its code fragments as sequences of words and (ii) a method for assigning short tags to clusters of the clustering result. We also report an experiment of applying the proposed method to packages of an open source operating system.
△ Less
Submitted 3 October, 2021;
originally announced October 2021.
