-
Quantized Non-Volatile Nanomagnetic Synapse based Autoencoder for Efficient Unsupervised Network Anomaly Detection
Authors:
Muhammad Sabbir Alam,
Walid Al Misba,
Jayasimha Atulasimha
Abstract:
In the autoencoder based anomaly detection paradigm, implementing the autoencoder in edge devices capable of learning in real-time is exceedingly challenging due to limited hardware, energy, and computational resources. We show that these limitations can be addressed by designing an autoencoder with low-resolution non-volatile memory-based synapses and employing an effective quantized neural netwo…
▽ More
In the autoencoder based anomaly detection paradigm, implementing the autoencoder in edge devices capable of learning in real-time is exceedingly challenging due to limited hardware, energy, and computational resources. We show that these limitations can be addressed by designing an autoencoder with low-resolution non-volatile memory-based synapses and employing an effective quantized neural network learning algorithm. We propose a ferromagnetic racetrack with engineered notches hosting a magnetic domain wall (DW) as the autoencoder synapses, where limited state (5-state) synaptic weights are manipulated by spin orbit torque (SOT) current pulses. The performance of anomaly detection of the proposed autoencoder model is evaluated on the NSL-KDD dataset. Limited resolution and DW device stochasticity aware training of the autoencoder is performed, which yields comparable anomaly detection performance to the autoencoder having floating-point precision weights. While the limited number of quantized states and the inherent stochastic nature of DW synaptic weights in nanoscale devices are known to negatively impact the performance, our hardware-aware training algorithm is shown to leverage these imperfect device characteristics to generate an improvement in anomaly detection accuracy (90.98%) compared to accuracy obtained with floating-point trained weights. Furthermore, our DW-based approach demonstrates a remarkable reduction of at least three orders of magnitude in weight updates during training compared to the floating-point approach, implying substantial energy savings for our method. This work could stimulate the development of extremely energy efficient non-volatile multi-state synapse-based processors that can perform real-time training and inference on the edge with unsupervised data.
△ Less
Submitted 11 September, 2023;
originally announced September 2023.
-
Spintronic Physical Reservoir for Autonomous Prediction and Long-Term Household Energy Load Forecasting
Authors:
Walid Al Misba,
Harindra S. Mavikumbure,
Md Mahadi Rajib,
Daniel L. Marino,
Victor Cobilean,
Milos Manic,
Jayasimha Atulasimha
Abstract:
In this study, we have shown autonomous long-term prediction with a spintronic physical reservoir. Due to the short-term memory property of the magnetization dynamics, non-linearity arises in the reservoir states which could be used for long-term prediction tasks using simple linear regression for online training. During the prediction stage, the output is directly fed to the input of the reservoi…
▽ More
In this study, we have shown autonomous long-term prediction with a spintronic physical reservoir. Due to the short-term memory property of the magnetization dynamics, non-linearity arises in the reservoir states which could be used for long-term prediction tasks using simple linear regression for online training. During the prediction stage, the output is directly fed to the input of the reservoir for autonomous prediction. We employ our proposed reservoir for the modeling of the chaotic time series such as Mackey-Glass and dynamic time-series data, such as household building energy loads. Since only the last layer of a RC needs to be trained with linear regression, it is well suited for learning in real time on edge devices. Here we show that a skyrmion based magnetic tunnel junction can potentially be used as a prototypical RC but any nanomagnetic magnetic tunnel junction with nonlinear magnetization behavior can implement such a RC. By comparing our spintronic physical RC approach with energy load forecasting algorithms, such as LSTMs and RNNs, we conclude that the proposed framework presents good performance in achieving high predictions accuracy, while also requiring low memory and energy both of which are at a premium in hardware resource and power constrained edge applications. Further, the proposed approach is shown to require very small training datasets and at the same time being at least 16X energy efficient compared to the sequence to sequence LSTM for accurate household load predictions.
△ Less
Submitted 19 February, 2024; v1 submitted 6 April, 2023;
originally announced April 2023.
-
Quantum Control of Spin Qubits Using Nanomagnets
Authors:
Mohamad Niknam,
Md Fahim F. Chowdhury,
Md Mahadi Rajib,
Walid Al Misba,
Robert N. Schwartz,
Kang L. Wang,
Jayasimha Atulasimha,
Louis-S. Bouchard
Abstract:
Single-qubit gates are essential components of a universal quantum computer. Without selective addressing of individual qubits, scalable implementation of quantum algorithms is not possible. When the qubits are discrete points or regions on a lattice, the selective addressing of magnetic spin qubits at the nanoscale remains a challenge due to the difficulty of localizing and confining a classical…
▽ More
Single-qubit gates are essential components of a universal quantum computer. Without selective addressing of individual qubits, scalable implementation of quantum algorithms is not possible. When the qubits are discrete points or regions on a lattice, the selective addressing of magnetic spin qubits at the nanoscale remains a challenge due to the difficulty of localizing and confining a classical divergence-free field to a small volume of space. Herein we propose a new technique for addressing spin qubits using voltage-control of nanoscale magnetism, exemplified by the use of voltage control of magnetic anisotropy (VCMA). We show that by tuning the frequency of the nanomagnet's electric field drive to the Larmor frequency of the spins confined to a nanoscale volume, and by modulating the phase of the drive, single-qubit quantum gates with fidelities approaching those for fault-tolerant quantum computing can be implemented. Such single-qubit gate operations have the advantage of remarkable energy efficiency, requiring only tens of femto-Joules per gate operation, and lossless, purely magnetic field control (no E-field over the target volume). Their physical realization is also straightforward using existing foundry manufacturing techniques.
△ Less
Submitted 30 March, 2022;
originally announced March 2022.
-
Skyrmion based energy efficient straintronic physical reservoir computing
Authors:
Md Mahadi Rajib,
Walid Al Misba,
Md. Fahim F. Chowdhury,
Muhammad Sabbir Alam,
Jayasimha Atulasimha
Abstract:
Physical Reservoir Computing (PRC) is an unconventional computing paradigm, which exploits nonlinear dynamics of reservoir blocks to perform recognition and classification tasks. Here we show with simulations that patterned thin films hosting several skyrmions, particularly one, two, four and nine skyrmions, can implement energy efficient reservoir computing. This reservoir computing (RC) block is…
▽ More
Physical Reservoir Computing (PRC) is an unconventional computing paradigm, which exploits nonlinear dynamics of reservoir blocks to perform recognition and classification tasks. Here we show with simulations that patterned thin films hosting several skyrmions, particularly one, two, four and nine skyrmions, can implement energy efficient reservoir computing. This reservoir computing (RC) block is based on nonlinear breathing dynamics of skyrmions, which are coupled to each other through dipole interaction and spin waves, in response to a voltage generated strain. This nonlinear and coupled magnetization dynamics is exploited to perform temporal pattern recognition. Two performance metrics, namely Short-Term Memory (STM) and Parity Check (PC) capacity are studied to demonstrate the potential of such skyrmion based PRC in addition to showing it can classify sine and square waves with 100% accuracy. Furthermore, our study demonstrates that nonlinear magnetization dynamics and interaction through spin waves and dipole coupling have a strong influence on STM and PC capacity, thus explaining the role of physical interactions in a dynamical system on its ability to perform Reservoir Computing (RC).
△ Less
Submitted 13 April, 2022; v1 submitted 27 December, 2021;
originally announced December 2021.
-
Focused Surface Acoustic Wave induced nano-oscillator based reservoir computing
Authors:
Md. Fahim F. Chowdhury,
Walid Al Misba,
Md Mahadi Rajib,
Alexander J. Edwards,
Dhritiman Bhattacharya,
Joseph S. Friedman,
Jayasimha Atulasimha
Abstract:
We demonstrate using micromagnetic simulations that a nanomagnet array excited by Surface Acoustic Waves (SAWs) can work as a reservoir that can classify sine and square waves with high accuracy. To evaluate memory effect and computing capability, we study the Short-Term Memory (STM) and Parity Check (PC) capacities respectively. The simulated nanomagnet array has an input nanomagnet that is excit…
▽ More
We demonstrate using micromagnetic simulations that a nanomagnet array excited by Surface Acoustic Waves (SAWs) can work as a reservoir that can classify sine and square waves with high accuracy. To evaluate memory effect and computing capability, we study the Short-Term Memory (STM) and Parity Check (PC) capacities respectively. The simulated nanomagnet array has an input nanomagnet that is excited with focused SAW and coupled to several nanomagnets, seven of which serve as output nanomagnets. The SAW has a carrier frequency of 4 GHz whose amplitude is modulated to provide different inputs of sine and square waves of 100 MHz frequency. The responses of the selected output nanomagnets are processed by reading the envelope of their magnetization state, which is used to train the output weights using regression method (e.g. Moore-Penrose pseudoinverse operation). For classification, a random sequence of 100 square and sine wave samples are used, of which 80 % are used for training, and the rest of the samples used for testing. We achieve 100 % training accuracy and 100 % testing accuracy for different combination of nanomagnets as outputs. Further, the STM and PC is calculated to be ~ 5.5 bits and ~ 5.3 bits respectively, which is indicative of the proposed acoustically driven nanomagnet oscillator array being well suited for physical reservoir computing applications. Finally, the ability to use high frequency (4GHz, wavelength ~1 micron) SAW makes the device scalable to small dimensions, while the ability to modulate the envelope at lower frequency (100 MHz) adds flexibility to encode different signals beyond the sine and square waves demonstrated here.
△ Less
Submitted 9 April, 2022; v1 submitted 7 December, 2021;
originally announced December 2021.
-
Energy Efficient Learning with Low Resolution Stochastic Domain Wall Synapse Based Deep Neural Networks
Authors:
Walid A. Misba,
Mark Lozano,
Damien Querlioz,
Jayasimha Atulasimha
Abstract:
We demonstrate that extremely low resolution quantized (nominally 5-state) synapses with large stochastic variations in Domain Wall (DW) position can be both energy efficient and achieve reasonably high testing accuracies compared to Deep Neural Networks (DNNs) of similar sizes using floating precision synaptic weights. Specifically, voltage controlled DW devices demonstrate stochastic behavior as…
▽ More
We demonstrate that extremely low resolution quantized (nominally 5-state) synapses with large stochastic variations in Domain Wall (DW) position can be both energy efficient and achieve reasonably high testing accuracies compared to Deep Neural Networks (DNNs) of similar sizes using floating precision synaptic weights. Specifically, voltage controlled DW devices demonstrate stochastic behavior as modeled rigorously with micromagnetic simulations and can only encode limited states; however, they can be extremely energy efficient during both training and inference. We show that by implementing suitable modifications to the learning algorithms, we can address the stochastic behavior as well as mitigate the effect of their low-resolution to achieve high testing accuracies. In this study, we propose both in-situ and ex-situ training algorithms, based on modification of the algorithm proposed by Hubara et al. [1] which works well with quantization of synaptic weights. We train several 5-layer DNNs on MNIST dataset using 2-, 3- and 5-state DW device as synapse. For in-situ training, a separate high precision memory unit is adopted to preserve and accumulate the weight gradients, which are then quantized to program the low precision DW devices. Moreover, a sizeable noise tolerance margin is used during the training to address the intrinsic programming noise. For ex-situ training, a precursor DNN is first trained based on the characterized DW device model and a noise tolerance margin, which is similar to the in-situ training. Remarkably, for in-situ inference the energy dissipation to program the devices is only 13 pJ per inference given that the training is performed over the entire MNIST dataset for 10 epochs.
△ Less
Submitted 14 November, 2021;
originally announced November 2021.
-
Passive frustrated nanomagnet reservoir computing
Authors:
Alexander J. Edwards,
Dhritiman Bhattacharya,
Peng Zhou,
Nathan R. McDonald,
Walid Al Misba,
Lisa Loomis,
Felipe Garcia-Sanchez,
Naimul Hassan,
Xuan Hu,
Md. Fahim Chowdhury,
Clare D. Thiem,
Jayasimha Atulasimha,
Joseph S. Friedman
Abstract:
Reservoir computing (RC) has received recent interest because reservoir weights do not need to be trained, enabling extremely low-resource consumption implementations, which could have a transformative impact on edge computing and in-situ learning where resources are severely constrained. Ideally, a natural hardware reservoir should be passive, minimal, expressive, and feasible; to date, proposed…
▽ More
Reservoir computing (RC) has received recent interest because reservoir weights do not need to be trained, enabling extremely low-resource consumption implementations, which could have a transformative impact on edge computing and in-situ learning where resources are severely constrained. Ideally, a natural hardware reservoir should be passive, minimal, expressive, and feasible; to date, proposed hardware reservoirs have had difficulty meeting all of these criteria. We therefore propose a reservoir that meets all of these criteria by leveraging the passive interactions of dipole-coupled, frustrated nanomagnets. The frustration significantly increases the number of stable reservoir states, enriching reservoir dynamics, and as such these frustrated nanomagnets fulfill all of the criteria for a natural hardware reservoir. We likewise propose a complete frustrated nanomagnet reservoir computing (NMRC) system with low-power complementary metal-oxide semiconductor (CMOS) circuitry to interface with the reservoir, and initial experimental results demonstrate the reservoir's feasibility. The reservoir is verified with micromagnetic simulations on three separate tasks demonstrating expressivity. The proposed system is compared with a CMOS echo-state-network (ESN), demonstrating an overall resource decrease by a factor of over 10,000,000, demonstrating that because NMRC is naturally passive and minimal it has the potential to be extremely resource efficient.
△ Less
Submitted 16 September, 2022; v1 submitted 16 March, 2021;
originally announced March 2021.
-
Robust skyrmion mediated reversal of ferromagnetic nanodots of 20 nm lateral dimension with high Ms and moderate DMI
Authors:
Md Mahadi Rajib,
Walid Al Misba,
Dhritiman Bhattacharya,
Jayasimha Atulasimha
Abstract:
Implementation of skyrmion based energy efficient and high-density data storage devices requires aggressive scaling of skyrmion size. Ferrimagnetic materials are considered to be a suitable platform for this purpose due to their low saturation magnetization (i.e. smaller stray field). However, we show by performing rigorous micromagnetic simulation that such scaling of skyrmion size by lowering sa…
▽ More
Implementation of skyrmion based energy efficient and high-density data storage devices requires aggressive scaling of skyrmion size. Ferrimagnetic materials are considered to be a suitable platform for this purpose due to their low saturation magnetization (i.e. smaller stray field). However, we show by performing rigorous micromagnetic simulation that such scaling of skyrmion size by lowering saturation magnetization while applicable in infinite films or where the skyrmion size is very small compared to the film's lateral dimension, does not hold in confined geometries. We also found in confined geometries, where skyrmion occupies the whole volume of a nanodot, high saturation magnetization helps form stable skyrmions. Specifically, such skyrmions can be formed in 20 nm lateral dimension nanodots with high saturation magnetization (1.6-1.71 MA/m) and moderate DMI (3 mJ/m2). This result could stimulate experiments on implementation of highly dense skyrmion devices. In particular, we show that Voltage Controlled Magnetic Anisotropy (VCMA) based switching mediated by an intermediate skyrmion state can be achieved in the soft layer of a ferromagnetic p-MTJ of lateral dimensions 20 nm with sub 1fJ/bit energy in the presence of room temperature thermal noise with reasonable DMI ~3 mJ/m2.
△ Less
Submitted 21 February, 2021;
originally announced February 2021.
-
Voltage Controlled Energy Efficient Domain Wall Synapses with Stochastic Distribution of Quantized Weights in the Presence of Thermal Noise and Edge Roughness
Authors:
Walid Al Misba,
Tahmid Kaisar,
Dhritiman Bhattacharya,
Jayasimha Atulasimha
Abstract:
We propose energy efficient strain control of domain wall (DW) in a perpendicularly magnetized nanoscale racetrack on a piezoelectric substrate that can implement multi state synapse to be utilized in neuromorphic computing platforms. In conjunction with SOT from to a current flowing in the heavy metal layer, strain is generated by applying a voltage across the piezoelectric. Such a strain is mech…
▽ More
We propose energy efficient strain control of domain wall (DW) in a perpendicularly magnetized nanoscale racetrack on a piezoelectric substrate that can implement multi state synapse to be utilized in neuromorphic computing platforms. In conjunction with SOT from to a current flowing in the heavy metal layer, strain is generated by applying a voltage across the piezoelectric. Such a strain is mechanically transferred to the racetrack and modulates the Perpendicular Magnetic Anisotropy (PMA). When different voltages are applied (i.e. different strains are generated), it can translate the DW to different distances for the same current which implements different synaptic weights. We have shown using micromagnetic simulations that 5-state and 3-state synapse can be implemented in a racetrack that is modeled with natural edge roughness and room temperature thermal noise. Such strain-controlled synapse has an energy consumption of few fJs and could thus be very attractive to implement energy-efficient quantized neural networks, which has been shown recently to achieve near equivalent classification accuracy to the full-precision neural networks.
△ Less
Submitted 20 October, 2020;
originally announced October 2020.
-
Dynamic Skyrmion-Mediated Switching of Perpendicular MTJs: Scaling to 20 nm with Thermal Noise
Authors:
Md Mahadi Rajib,
Walid Al Misba,
Dhritiman Bhattacharya,
Felipe Garcia-Sanchez,
Jayasimha Atulasimha
Abstract:
One method of creating and annihilating skyrmions in confined geometries is to use Voltage-Controlled Magnetic Anisotropy (VCMA) [1, 2, 3]. Previous study shows that robust voltage controlled ferromagnetic reversal from up to down state in the soft layer of a perpendicular Magnetic Tunnel Junction (p-MTJ) can be achieved by creating and subsequently annihilating an intermediate skyrmion state [4]…
▽ More
One method of creating and annihilating skyrmions in confined geometries is to use Voltage-Controlled Magnetic Anisotropy (VCMA) [1, 2, 3]. Previous study shows that robust voltage controlled ferromagnetic reversal from up to down state in the soft layer of a perpendicular Magnetic Tunnel Junction (p-MTJ) can be achieved by creating and subsequently annihilating an intermediate skyrmion state [4] in the presence of room temperature thermal noise and anisotropy variation across grains [4]. However, when scaling to 20 nm, thermal noise can annihilate the skyrmions, for example, by randomly moving the core towards the boundary of the nanostructure. In this work, we study three p-MTJs of different dimensions, particularly lateral dimensions of 100nm, 50nm and 20 nm and investigate the change in switching behavior as the dimension is decreased. Particularly, our focus is to investigate to what extent skyrmion mediated switching scheme can be employed below ~50nm lateral dimensions in the presence of thermal perturbation.
△ Less
Submitted 28 March, 2020;
originally announced March 2020.
-
Acoustic Wave Induced FMR Assisted Spin-Torque Switching of Perpendicular MTJs with Anisotropy Variation
Authors:
Walid Al Misba,
Md. Mahadi Rajib,
Dhritiman Bhattacharya,
Jayasimha Atulasimha
Abstract:
We have investigated Surface Acoustic Wave (SAW) induced ferromagnetic resonance (FMR) assisted Spin Transfer Torque (STT) switching of perpendicular MTJ (p-MTJ) with inhomogeneities using micromagnetic simulations that include the effect of thermal noise. With suitable frequency excitation, the SAW can induce ferromagnetic resonance in magnetostrictive materials, and the magnetization can precess…
▽ More
We have investigated Surface Acoustic Wave (SAW) induced ferromagnetic resonance (FMR) assisted Spin Transfer Torque (STT) switching of perpendicular MTJ (p-MTJ) with inhomogeneities using micromagnetic simulations that include the effect of thermal noise. With suitable frequency excitation, the SAW can induce ferromagnetic resonance in magnetostrictive materials, and the magnetization can precesses in a cone with high deflection from the perpendicular direction. With incorporation of inhomogeneity via lateral anisotropy variation as well as room temperature thermal noise, the magnetization precession in different gains can be significantly incoherent. Interestingly, the precession in different grains are found to be in phase, even though the precession amplitude (angle of deflection from the perpendicular direction) vary across grains of different anisotropy. Nevertheless, the high mean deflection angle can complement the STT switching by reducing the STT current significantly; even though the applied stress induced change in anisotropy is much lower than the total anisotropy barrier. This work indicates that SAW assisted switching can improve energy efficiency while being scalable to very small dimensions, which is technologically important for STT-RAM and elucidates the physical mechanism for the potential robustness of this paradigm in realistic scenarios with thermal noise and material inhomogeneity
△ Less
Submitted 28 March, 2020;
originally announced March 2020.