-
Design Principles for Lifelong Learning AI Accelerators
Authors:
Dhireesha Kudithipudi,
Anurag Daram,
Abdullah M. Zyarah,
Fatima Tuz Zohora,
James B. Aimone,
Angel Yanguas-Gil,
Nicholas Soures,
Emre Neftci,
Matthew Mattina,
Vincenzo Lomonaco,
Clare D. Thiem,
Benjamin Epstein
Abstract:
Lifelong learning - an agent's ability to learn throughout its lifetime - is a hallmark of biological learning systems and a central challenge for artificial intelligence (AI). The development of lifelong learning algorithms could lead to a range of novel AI applications, but this will also require the development of appropriate hardware accelerators, particularly if the models are to be deployed…
▽ More
Lifelong learning - an agent's ability to learn throughout its lifetime - is a hallmark of biological learning systems and a central challenge for artificial intelligence (AI). The development of lifelong learning algorithms could lead to a range of novel AI applications, but this will also require the development of appropriate hardware accelerators, particularly if the models are to be deployed on edge platforms, which have strict size, weight, and power constraints. Here, we explore the design of lifelong learning AI accelerators that are intended for deployment in untethered environments. We identify key desirable capabilities for lifelong learning accelerators and highlight metrics to evaluate such accelerators. We then discuss current edge AI accelerators and explore the future design of lifelong learning accelerators, considering the role that different emerging technologies could play.
△ Less
Submitted 5 October, 2023;
originally announced October 2023.
-
Passive frustrated nanomagnet reservoir computing
Authors:
Alexander J. Edwards,
Dhritiman Bhattacharya,
Peng Zhou,
Nathan R. McDonald,
Walid Al Misba,
Lisa Loomis,
Felipe Garcia-Sanchez,
Naimul Hassan,
Xuan Hu,
Md. Fahim Chowdhury,
Clare D. Thiem,
Jayasimha Atulasimha,
Joseph S. Friedman
Abstract:
Reservoir computing (RC) has received recent interest because reservoir weights do not need to be trained, enabling extremely low-resource consumption implementations, which could have a transformative impact on edge computing and in-situ learning where resources are severely constrained. Ideally, a natural hardware reservoir should be passive, minimal, expressive, and feasible; to date, proposed…
▽ More
Reservoir computing (RC) has received recent interest because reservoir weights do not need to be trained, enabling extremely low-resource consumption implementations, which could have a transformative impact on edge computing and in-situ learning where resources are severely constrained. Ideally, a natural hardware reservoir should be passive, minimal, expressive, and feasible; to date, proposed hardware reservoirs have had difficulty meeting all of these criteria. We therefore propose a reservoir that meets all of these criteria by leveraging the passive interactions of dipole-coupled, frustrated nanomagnets. The frustration significantly increases the number of stable reservoir states, enriching reservoir dynamics, and as such these frustrated nanomagnets fulfill all of the criteria for a natural hardware reservoir. We likewise propose a complete frustrated nanomagnet reservoir computing (NMRC) system with low-power complementary metal-oxide semiconductor (CMOS) circuitry to interface with the reservoir, and initial experimental results demonstrate the reservoir's feasibility. The reservoir is verified with micromagnetic simulations on three separate tasks demonstrating expressivity. The proposed system is compared with a CMOS echo-state-network (ESN), demonstrating an overall resource decrease by a factor of over 10,000,000, demonstrating that because NMRC is naturally passive and minimal it has the potential to be extremely resource efficient.
△ Less
Submitted 16 September, 2022; v1 submitted 16 March, 2021;
originally announced March 2021.
-
Reservoir Computing with Planar Nanomagnet Arrays
Authors:
Peng Zhou,
Nathan R. McDonald,
Alexander J. Edwards,
Lisa Loomis,
Clare D. Thiem,
Joseph S. Friedman
Abstract:
Reservoir computing is an emerging methodology for neuromorphic computing that is especially well-suited for hardware implementations in size, weight, and power (SWaP) constrained environments. This work proposes a novel hardware implementation of a reservoir computer using a planar nanomagnet array. A small nanomagnet reservoir is demonstrated via micromagnetic simulations to be able to identify…
▽ More
Reservoir computing is an emerging methodology for neuromorphic computing that is especially well-suited for hardware implementations in size, weight, and power (SWaP) constrained environments. This work proposes a novel hardware implementation of a reservoir computer using a planar nanomagnet array. A small nanomagnet reservoir is demonstrated via micromagnetic simulations to be able to identify simple waveforms with 100% accuracy. Planar nanomagnet reservoirs are a promising new solution to the growing need for dedicated neuromorphic hardware.
△ Less
Submitted 24 March, 2020;
originally announced March 2020.