-
Predictive Coding Networks and Inference Learning: Tutorial and Survey
Authors:
Björn van Zwol,
Ro Jefferson,
Egon L. van den Broek
Abstract:
Recent years have witnessed a growing call for renewed emphasis on neuroscience-inspired approaches in artificial intelligence research, under the banner of $\textit{NeuroAI}$. This is exemplified by recent attention gained by predictive coding networks (PCNs) within machine learning (ML). PCNs are based on the neuroscientific framework of predictive coding (PC), which views the brain as a hierarc…
▽ More
Recent years have witnessed a growing call for renewed emphasis on neuroscience-inspired approaches in artificial intelligence research, under the banner of $\textit{NeuroAI}$. This is exemplified by recent attention gained by predictive coding networks (PCNs) within machine learning (ML). PCNs are based on the neuroscientific framework of predictive coding (PC), which views the brain as a hierarchical Bayesian inference model that minimizes prediction errors from feedback connections. PCNs trained with inference learning (IL) have potential advantages to traditional feedforward neural networks (FNNs) trained with backpropagation. While historically more computationally intensive, recent improvements in IL have shown that it can be more efficient than backpropagation with sufficient parallelization, making PCNs promising alternatives for large-scale applications and neuromorphic hardware. Moreover, PCNs can be mathematically considered as a superset of traditional FNNs, which substantially extends the range of possible architectures for both supervised and unsupervised learning. In this work, we provide a comprehensive review as well as a formal specification of PCNs, in particular placing them in the context of modern ML methods, and positioning PC as a versatile and promising framework worthy of further study by the ML community.
△ Less
Submitted 4 July, 2024;
originally announced July 2024.
-
The human factor: results of a small-angle scattering data analysis Round Robin
Authors:
Brian R. Pauw,
Glen J. Smales,
Andy S. Anker,
Daniel M. Balazs,
Frederick L. Beyer,
Ralf Bienert,
Wim G. Bouwman,
Ingo Breßler,
Joachim Breternitz,
Erik S Brok,
Gary Bryant,
Andrew J. Clulow,
Erin R. Crater,
Frédéric De Geuser,
Alessandra Del Giudice,
Jérôme Deumer,
Sabrina Disch,
Shankar Dutt,
Kilian Frank,
Emiliano Fratini,
Elliot P. Gilbert,
Marc Benjamin Hahn,
James Hallett,
Max Hohenschutz,
Martin Hollamby
, et al. (24 additional authors not shown)
Abstract:
A Round Robin study has been carried out to estimate the impact of the human element in small-angle scattering data analysis. Four corrected datasets were provided to participants ready for analysis. All datasets were measured on samples containing spherical scatterers, with two datasets in dilute dispersions, and two from powders. Most of the 46 participants correctly identified the number of pop…
▽ More
A Round Robin study has been carried out to estimate the impact of the human element in small-angle scattering data analysis. Four corrected datasets were provided to participants ready for analysis. All datasets were measured on samples containing spherical scatterers, with two datasets in dilute dispersions, and two from powders. Most of the 46 participants correctly identified the number of populations in the dilute dispersions, with half of the population mean entries within 1.5% and half of the population width entries within 40%, respectively. Due to the added complexity of the structure factor, much fewer people submitted answers on the powder datasets. For those that did, half of the entries for the means and widths were within 44% and 86% respectively. This Round Robin experiment highlights several causes for the discrepancies, for which solutions are proposed.
△ Less
Submitted 7 March, 2023;
originally announced March 2023.
-
Nanocriticality in the magnetic phase transition of CoO nanoparticles
Authors:
Machteld E. Kamminga,
Jonas Okkels Birk,
Jari í Hjøllum,
Henrik Jacobsen,
Jakob Lass,
Thorbjørn L. Koch,
Niels B. Christensen,
Christof Niedermayer,
Lukas Keller,
Luise Theil Kuhn,
Elisabeth T. Ulrikkeholm,
Erik Brok,
Cathrine Frandsen,
Kim Lefmann
Abstract:
The universal theory of critical phase transitions describes the critical behavior at second-order phase transitions in infinitely large systems. With the increased contemporary interest in nanoscale materials, we investigated CoO nanoparticles by means of neutron scattering and found how the theory of critical phenomena breaks down in the nanoscale regime. Using CoO as a model system, we have ide…
▽ More
The universal theory of critical phase transitions describes the critical behavior at second-order phase transitions in infinitely large systems. With the increased contemporary interest in nanoscale materials, we investigated CoO nanoparticles by means of neutron scattering and found how the theory of critical phenomena breaks down in the nanoscale regime. Using CoO as a model system, we have identified a size-dependent nanocritical temperature region close to the antiferromagnetic phase transition where the magnetic correlation length of the nanoparticles converges to a constant value, which is significantly smaller than that of the saturated state found at low temperatures. This is in clear contrast to the divergence around $T_{\rm N}$ observed for bulk systems. Our findings of nanocriticality in the magnetic phase transition is of great importance for the understanding of phase transitions at the nanoscale.
△ Less
Submitted 30 May, 2022; v1 submitted 27 May, 2022;
originally announced May 2022.
-
Integrating superfluids with superconducting qubit systems
Authors:
J. R. Lane,
D. Tan,
N. R. Beysengulov,
K. Nasyedkin,
E. Brook,
L. Zhang,
T. Stefanski,
H. Byeon,
K. W. Murch,
J. Pollanen
Abstract:
Superfluid helium's low-loss dielectric properties, excellent thermal conductivity, and unique collective excitations make it an attractive candidate to incorporate into superconducting qubit systems. We controllably immerse a three-dimensional superconducting transmon qubit in superfluid helium-4 and measure the spectroscopic and coherence properties of the system. We find that the cavity, the qu…
▽ More
Superfluid helium's low-loss dielectric properties, excellent thermal conductivity, and unique collective excitations make it an attractive candidate to incorporate into superconducting qubit systems. We controllably immerse a three-dimensional superconducting transmon qubit in superfluid helium-4 and measure the spectroscopic and coherence properties of the system. We find that the cavity, the qubit, and their coupling are all modified by the superfluid, which we analyze within the framework of circuit quantum electrodynamics (cQED). At at temperatures relevant to quantum computing experiments, the energy relaxation time of the qubit is not significantly changed by the presence of the superfluid, while the pure dephasing time modestly increases, which we attribute to improved thermalization of the microwave environment via the superfluid.
△ Less
Submitted 18 November, 2019; v1 submitted 17 July, 2019;
originally announced July 2019.
-
A dataset of continuous affect annotations and physiological signals for emotion analysis
Authors:
Karan Sharma,
Claudio Castellini,
Egon L. van den Broek,
Alin Albu-Schaeffer,
Friedhelm Schwenker
Abstract:
From a computational viewpoint, emotions continue to be intriguingly hard to understand. In research, direct, real-time inspection in realistic settings is not possible. Discrete, indirect, post-hoc recordings are therefore the norm. As a result, proper emotion assessment remains a problematic issue. The Continuously Annotated Signals of Emotion (CASE) dataset provides a solution as it focusses on…
▽ More
From a computational viewpoint, emotions continue to be intriguingly hard to understand. In research, direct, real-time inspection in realistic settings is not possible. Discrete, indirect, post-hoc recordings are therefore the norm. As a result, proper emotion assessment remains a problematic issue. The Continuously Annotated Signals of Emotion (CASE) dataset provides a solution as it focusses on real-time continuous annotation of emotions, as experienced by the participants, while watching various videos. For this purpose, a novel, intuitive joystick-based annotation interface was developed, that allowed for simultaneous reporting of valence and arousal, that are instead often annotated independently. In parallel, eight high quality, synchronized physiological recordings (1000 Hz, 16-bit ADC) were made of ECG, BVP, EMG (3x), GSR (or EDA), respiration and skin temperature. The dataset consists of the physiological and annotation data from 30 participants, 15 male and 15 female, who watched several validated video-stimuli. The validity of the emotion induction, as exemplified by the annotation and physiological data, is also presented.
△ Less
Submitted 6 December, 2018;
originally announced December 2018.
-
Radiometric 81Kr dating identifies 120,000 year old ice at Taylor Glacier, Antarctica
Authors:
Christo Buizert,
Daniel Baggenstos,
Wei Jiang,
Roland Purtschert,
Vasilii V. Petrenko,
Zheng-Tian Lu,
Peter Mueller,
Tanner Kuhl,
James Lee,
Jeffrey P. Severinghaus,
Edward J. Brook
Abstract:
We present the first successful 81Kr-Kr radiometric dating of ancient polar ice. Krypton was extracted from the air bubbles in four ~350 kg polar ice samples from Taylor Glacier in the McMurdo Dry Valleys, Antarctica, and dated using Atom Trap Trace Analysis (ATTA). The 81Kr radiometric ages agree with independent age estimates obtained from stratigraphic dating techniques with a mean absolute age…
▽ More
We present the first successful 81Kr-Kr radiometric dating of ancient polar ice. Krypton was extracted from the air bubbles in four ~350 kg polar ice samples from Taylor Glacier in the McMurdo Dry Valleys, Antarctica, and dated using Atom Trap Trace Analysis (ATTA). The 81Kr radiometric ages agree with independent age estimates obtained from stratigraphic dating techniques with a mean absolute age offset of 6 +/- 2.5 ka. Our experimental methods and sampling strategy are validated by 1) 85Kr and 39Ar analyses that show the samples to be free of modern air contamination, and 2) air content measurements that show the ice did not experience gas loss. We estimate the error in the 81Kr ages due to past geomagnetic variability to be below 3 ka. We show that ice from the previous interglacial period (MIS 5e, 130-115 ka before present) can be found in abundance near the surface of Taylor Glacier. Our study paves the way for reliable radiometric dating of ancient ice in blue ice areas and margin sites where large samples are available, greatly enhancing their scientific value as archives of old ice and meteorites. At present, ATTA 81Kr analysis requires a 40-80 kg ice sample; as sample requirements continue to decrease 81Kr dating of ice cores is a future possibility.
△ Less
Submitted 24 March, 2014;
originally announced March 2014.
