NeuroBench: A Framework for Benchmarking Neuromorphic Computing Algorithms and Systems
Authors:
Jason Yik,
Korneel Van den Berghe,
Douwe den Blanken,
Younes Bouhadjar,
Maxime Fabre,
Paul Hueber,
Denis Kleyko,
Noah Pacik-Nelson,
Pao-Sheng Vincent Sun,
Guangzhi Tang,
Shenqi Wang,
Biyan Zhou,
Soikat Hasan Ahmed,
George Vathakkattil Joseph,
Benedetto Leto,
Aurora Micheli,
Anurag Kumar Mishra,
Gregor Lenz,
Tao Sun,
Zergham Ahmed,
Mahmoud Akl,
Brian Anderson,
Andreas G. Andreou,
Chiara Bartolozzi,
Arindam Basu
, et al. (73 additional authors not shown)
Abstract:
Neuromorphic computing shows promise for advancing computing efficiency and capabilities of AI applications using brain-inspired principles. However, the neuromorphic research field currently lacks standardized benchmarks, making it difficult to accurately measure technological advancements, compare performance with conventional methods, and identify promising future research directions. Prior neu…
▽ More
Neuromorphic computing shows promise for advancing computing efficiency and capabilities of AI applications using brain-inspired principles. However, the neuromorphic research field currently lacks standardized benchmarks, making it difficult to accurately measure technological advancements, compare performance with conventional methods, and identify promising future research directions. Prior neuromorphic computing benchmark efforts have not seen widespread adoption due to a lack of inclusive, actionable, and iterative benchmark design and guidelines. To address these shortcomings, we present NeuroBench: a benchmark framework for neuromorphic computing algorithms and systems. NeuroBench is a collaboratively-designed effort from an open community of nearly 100 co-authors across over 50 institutions in industry and academia, aiming to provide a representative structure for standardizing the evaluation of neuromorphic approaches. The NeuroBench framework introduces a common set of tools and systematic methodology for inclusive benchmark measurement, delivering an objective reference framework for quantifying neuromorphic approaches in both hardware-independent (algorithm track) and hardware-dependent (system track) settings. In this article, we present initial performance baselines across various model architectures on the algorithm track and outline the system track benchmark tasks and guidelines. NeuroBench is intended to continually expand its benchmarks and features to foster and track the progress made by the research community.
△ Less
Submitted 17 January, 2024; v1 submitted 10 April, 2023;
originally announced April 2023.
Effective Bounds on Network-Size for Anti-phase Synchronization
Authors:
George Vathakkattil Joseph,
Vikram Pakrashi
Abstract:
We consider anti-phase synchronization of coupled oscillators using the Stuart-Landau model and explore its relative infrequency in occurrence compared to in-phase synchronization. We report effective limits in number of oscillators which can anti-phase synchronize for general configurations of real-world networks. We link anti-phase synchronization to the Ising model and consequently to combinato…
▽ More
We consider anti-phase synchronization of coupled oscillators using the Stuart-Landau model and explore its relative infrequency in occurrence compared to in-phase synchronization. We report effective limits in number of oscillators which can anti-phase synchronize for general configurations of real-world networks. We link anti-phase synchronization to the Ising model and consequently to combinatorial optimization problems, thereby explaining experimentally observed limits in self-organization of natural systems. We illustrate this using the Steiner-tree problem.
△ Less
Submitted 20 August, 2019;
originally announced August 2019.
Extreme Value Estimates using Vibration Energy Harvesting
Authors:
George Vathakkattil Joseph,
Guangbo Hao,
Vikram Pakrashi
Abstract:
This paper establishes the possibility of utilising energy harvesting from mechanical vibrations to estimate extreme value responses of the host structure and demonstrates the calibration of these estimates for excitation spectra typical to natural systems. For illustrative purposes, a cantilever type energy harvester is considered for wind excitation. The extreme value estimates are established t…
▽ More
This paper establishes the possibility of utilising energy harvesting from mechanical vibrations to estimate extreme value responses of the host structure and demonstrates the calibration of these estimates for excitation spectra typical to natural systems. For illustrative purposes, a cantilever type energy harvester is considered for wind excitation. The extreme value estimates are established through a Generalised Pareto Distribution (GPD). Classically well-known Kaimal and Davenport spectra for wind have been considered in this paper for comparison purposes. The work also demonstrates how return levels can be mapped using energy harvesting levels and indicates that vibration energy harvesting, in its own right has the potential to be used for extreme value analysis and estimates. The work has impact on health monitoring and assessment of built infrastructure in various stages of repair or disrepair and exposed to nature throughout their lifetime.
△ Less
Submitted 7 September, 2017;
originally announced September 2017.
