Showing 1–7 of 7 results for author: Akashi, N

Exploiting Chaotic Dynamics as Deep Neural Networks

Authors: Shuhong Liu, Nozomi Akashi, Qingyao Huang, Yasuo Kuniyoshi, Kohei Nakajima

Abstract: Chaos presents complex dynamics arising from nonlinearity and a sensitivity to initial states. These characteristics suggest a depth of expressivity that underscores their potential for advanced computational applications. However, strategies to effectively exploit chaotic dynamics for information processing have largely remained elusive. In this study, we reveal that the essence of chaos can be f… ▽ More Chaos presents complex dynamics arising from nonlinearity and a sensitivity to initial states. These characteristics suggest a depth of expressivity that underscores their potential for advanced computational applications. However, strategies to effectively exploit chaotic dynamics for information processing have largely remained elusive. In this study, we reveal that the essence of chaos can be found in various state-of-the-art deep neural networks. Drawing inspiration from this revelation, we propose a novel method that directly leverages chaotic dynamics for deep learning architectures. Our approach is systematically evaluated across distinct chaotic systems. In all instances, our framework presents superior results to conventional deep neural networks in terms of accuracy, convergence speed, and efficiency. Furthermore, we found an active role of transient chaos formation in our scheme. Collectively, this study offers a new path for the integration of chaos, which has long been overlooked in information processing, and provides insights into the prospective fusion of chaotic dynamics within the domains of machine learning and neuromorphic computation. △ Less

Submitted 29 May, 2024; originally announced June 2024.

Virtual reservoir acceleration for CPU and GPU: Case study for coupled spin-torque oscillator reservoir

Authors: Thomas Geert de Jong, Nozomi Akashi, Tomohiro Taniguchi, Hirofumi Notsu, Kohei Nakajima

Abstract: We provide high-speed implementations for simulating reservoirs described by $N$-coupled spin-torque oscillators. Here $N$ also corresponds to the number of reservoir nodes. We benchmark a variety of implementations based on CPU and GPU. Our new methods are at least 2.6 times quicker than the baseline for $N$ in range $1$ to $10^4$. More specifically, over all implementations the best factor is 78… ▽ More We provide high-speed implementations for simulating reservoirs described by $N$-coupled spin-torque oscillators. Here $N$ also corresponds to the number of reservoir nodes. We benchmark a variety of implementations based on CPU and GPU. Our new methods are at least 2.6 times quicker than the baseline for $N$ in range $1$ to $10^4$. More specifically, over all implementations the best factor is 78.9 for $N=1$ which decreases to 2.6 for $N=10^3$ and finally increases to 23.8 for $N=10^4$. GPU outperforms CPU significantly at $N=2500$. Our results show that GPU implementations should be tested for reservoir simulations. The implementations considered here can be used for any reservoir with evolution that can be approximated using an explicit method. △ Less

Submitted 2 December, 2023; originally announced December 2023.

Embedding bifurcations into pneumatic artificial muscle

Authors: Nozomi Akashi, Yasuo Kuniyoshi, Taketomo Jo, Mitsuhiro Nishida, Ryo Sakurai, Yasumichi Wakao, Kohei Nakajima

Abstract: Harnessing complex body dynamics has been a long-standing challenge in robotics. Soft body dynamics is a typical example of high complexity in interacting with the environment. An increasing number of studies have reported that these dynamics can be used as a computational resource. This includes the McKibben pneumatic artificial muscle, which is a typical soft actuator. This study demonstrated th… ▽ More Harnessing complex body dynamics has been a long-standing challenge in robotics. Soft body dynamics is a typical example of high complexity in interacting with the environment. An increasing number of studies have reported that these dynamics can be used as a computational resource. This includes the McKibben pneumatic artificial muscle, which is a typical soft actuator. This study demonstrated that various dynamics, including periodic and chaotic dynamics, could be embedded into the pneumatic artificial muscle, with the entire bifurcation structure using the framework of physical reservoir computing. These results suggest that dynamics that are not presented in training data could be embedded by using this capability of bifurcation embeddment. This implies that it is possible to embed various qualitatively different patterns into pneumatic artificial muscle by learning specific patterns, without the need to design and learn all patterns required for the purpose. Thus, this study sheds new light on a novel pathway to simplify the robotic devices and training of the control by reducing the external pattern generators and the amount and types of training data for the control. △ Less

Submitted 10 May, 2023; v1 submitted 6 May, 2023; originally announced May 2023.

ACM Class: I.2.9

Step-like dependence of memory function on pulse width in spintronics reservoir computing

Authors: Terufumi Yamaguchi, Nozomi Akashi, Kohei Nakajima, Hitoshi Kubota, Sumito Tsunegi, Tomohiro Taniguchi

Abstract: Physical reservoir computing is a type of recurrent neural network that applies the dynamical response from physical systems to information processing. However, the relation between computation performance and physical parameters/phenomena still remains unclear. This study reports our progress regarding the role of current-dependent magnetic dam** in the computational performance of reservoir co… ▽ More Physical reservoir computing is a type of recurrent neural network that applies the dynamical response from physical systems to information processing. However, the relation between computation performance and physical parameters/phenomena still remains unclear. This study reports our progress regarding the role of current-dependent magnetic dam** in the computational performance of reservoir computing. The current-dependent relaxation dynamics of a magnetic vortex core results in an asymmetric memory function with respect to binary inputs. A fast relaxation caused by a large input leads to a fast fading of the input memory, whereas a slow relaxation by a small input enables the reservoir to keep the input memory for a relatively long time. As a result, a step-like dependence is found for the short-term memory and parity-check capacities on the pulse width of input data, where the capacities remain at 1.5 for a certain range of the pulse width, and drop to 1.0 for a long pulse-width limit. Both analytical and numerical analyses clarify that the step-like behavior can be attributed to the current-dependent relaxation time of the vortex core to a limit-cycle state. } △ Less

Submitted 11 November, 2020; originally announced November 2020.

Comments: 9 pages, 5 figures

Journal ref: Scientific Reports 10, 19536 (2020)

Periodic structure of memory function in spintronics reservoir with feedback current

Authors: Terufumi Yamaguchi, Nozomi Akashi, Sumito Tsunegi, Hitoshi Kubota, Kohei Nakajima, Tomohiro Taniguchi

Abstract: The role of the feedback effect on physical reservoir computing is studied theoretically by solving the vortex-core dynamics in a nanostructured ferromagnet. Although the spin-transfer torque due to the feedback current makes the vortex dynamics complex, it is clarified that the feedback effect does not always contribute to the enhancement of the memory function in a physical reservoir. The memory… ▽ More The role of the feedback effect on physical reservoir computing is studied theoretically by solving the vortex-core dynamics in a nanostructured ferromagnet. Although the spin-transfer torque due to the feedback current makes the vortex dynamics complex, it is clarified that the feedback effect does not always contribute to the enhancement of the memory function in a physical reservoir. The memory function, characterized by the correlation coefficient between the input data and the dynamical response of the vortex core, becomes large when the delay time of the feedback current is not an integral multiple of the pulse width. On the other hand, the memory function remains small when the delay time is an integral multiple of the pulse width. As a result, a periodic behavior for the short-term memory capacity is observed with respect to the delay time, the phenomenon of which can be attributed to correlations between the virtual neurons via the feedback current. △ Less

Submitted 23 June, 2020; originally announced June 2020.

Comments: 10 pages, 9 figures

Journal ref: Phys. Rev. Research 2, 023389 (2020)

Synchronization and chaos in a spin-torque oscillator with a perpendicularly magnetized free layer

Authors: Terufumi Yamaguchi, Nozomi Akashi, Kohei Naka jima, Sumito Tsunegi, Hitoshi Kubota, Tomohiro Taniguchi

Abstract: Synchronization and chaos caused by alternating current and microwave field in a spin torque oscillator consisting of a perpendicularly magnetized free layer and an in-plane magnetized reference layer is comprehensively studied theoretically. A forced synchronization by the alternating current is observed in numerical simulation over wide ranges of its amplitude and frequency. An analytical theory… ▽ More Synchronization and chaos caused by alternating current and microwave field in a spin torque oscillator consisting of a perpendicularly magnetized free layer and an in-plane magnetized reference layer is comprehensively studied theoretically. A forced synchronization by the alternating current is observed in numerical simulation over wide ranges of its amplitude and frequency. An analytical theory clarifies that the nonlinear frequency shift, as well as the spin-transfer torque asymmetry, plays a key role in determining locking range and phase difference between the oscillator and current. Chaos caused by the alternating current is identified for a region of large alternating current by evaluating the Lyapunov exponent. Similar results are also obtained for microwave field, although the parameter regions causing chaos are narrower than those by the alternating current. △ Less

Submitted 23 December, 2019; originally announced December 2019.

Journal ref: Phys. Rev. B 100, 224422 (2019)

Chaos in nanomagnet via feedback current

Authors: Tomohiro Taniguchi, Nozomi Akashi, Hirofumi Notsu, Masato Kimura, Hiroshi Tsukahara, Kohei Nakajima

Abstract: Nonlinear magnetization dynamics excited by spin-transfer effect with feedback current is studied both numerically and analytically. The numerical simulation of the Landau-Lifshitz-Gilbert equation indicates the positive Lyapunov exponent for a certain range of the feedback rate, which identifies the existence of chaos in a nanostructured ferromagnet. Transient behavior from chaotic to steady osci… ▽ More Nonlinear magnetization dynamics excited by spin-transfer effect with feedback current is studied both numerically and analytically. The numerical simulation of the Landau-Lifshitz-Gilbert equation indicates the positive Lyapunov exponent for a certain range of the feedback rate, which identifies the existence of chaos in a nanostructured ferromagnet. Transient behavior from chaotic to steady oscillation is also observed in another range of the feedback parameter. An analytical theory is also developed, which indicates the appearance of multiple attractors in a phase space due to the feedback current. An instantaneous imbalance between the spin-transfer torque and dam** torque causes a transition between the attractors, and results in the complex dynamics. △ Less

Submitted 22 November, 2019; v1 submitted 11 September, 2019; originally announced September 2019.

Journal ref: Phys. Rev. B 100, 174425 (2019)