Reservoir Computing Benchmarks: a review, a taxonomy, some best practices
Authors:
Chester Wringe,
Martin Trefzer,
Susan Stepney
Abstract:
Reservoir Computing is an Unconventional Computation model to perform computation on various different substrates, such as RNNs or physical materials. The method takes a "black-box" approach, training only the outputs of the system it is built on. As such, evaluating the computational capacity of these systems can be challenging. We review and critique the evaluation methods used in the field of R…
▽ More
Reservoir Computing is an Unconventional Computation model to perform computation on various different substrates, such as RNNs or physical materials. The method takes a "black-box" approach, training only the outputs of the system it is built on. As such, evaluating the computational capacity of these systems can be challenging. We review and critique the evaluation methods used in the field of Reservoir Computing. We introduce a categorisation of benchmark tasks. We review multiple examples of benchmarks from the literature as applied to reservoir computing, and note their strengths and shortcomings. We suggest ways in which benchmarks and their uses may be improved to the benefit of the reservoir computing community
△ Less
Submitted 10 May, 2024;
originally announced May 2024.
A perspective on physical reservoir computing with nanomagnetic devices
Authors:
Dan A Allwood,
Matthew O A Ellis,
David Griffin,
Thomas J Hayward,
Luca Manneschi,
Mohammad F KH Musameh,
Simon O'Keefe,
Susan Stepney,
Charles Swindells,
Martin A Trefzer,
Eleni Vasilaki,
Guru Venkat,
Ian Vidamour,
Chester Wringe
Abstract:
Neural networks have revolutionized the area of artificial intelligence and introduced transformative applications to almost every scientific field and industry. However, this success comes at a great price; the energy requirements for training advanced models are unsustainable. One promising way to address this pressing issue is by develo** low-energy neuromorphic hardware that directly support…
▽ More
Neural networks have revolutionized the area of artificial intelligence and introduced transformative applications to almost every scientific field and industry. However, this success comes at a great price; the energy requirements for training advanced models are unsustainable. One promising way to address this pressing issue is by develo** low-energy neuromorphic hardware that directly supports the algorithm's requirements. The intrinsic non-volatility, non-linearity, and memory of spintronic devices make them appealing candidates for neuromorphic devices. Here we focus on the reservoir computing paradigm, a recurrent network with a simple training algorithm suitable for computation with spintronic devices since they can provide the properties of non-linearity and memory. We review technologies and methods for develo** neuromorphic spintronic devices and conclude with critical open issues to address before such devices become widely used.
△ Less
Submitted 9 December, 2022;
originally announced December 2022.