-
Relating Human Perception of Musicality to Prediction in a Predictive Coding Model
Authors:
Nikolas McNeal,
Jennifer Huang,
Aniekan Umoren,
Shuqi Dai,
Roger Dannenberg,
Richard Randall,
Tai Sing Lee
Abstract:
We explore the use of a neural network inspired by predictive coding for modeling human music perception. This network was developed based on the computational neuroscience theory of recurrent interactions in the hierarchical visual cortex. When trained with video data using self-supervised learning, the model manifests behaviors consistent with human visual illusions. Here, we adapt this network…
▽ More
We explore the use of a neural network inspired by predictive coding for modeling human music perception. This network was developed based on the computational neuroscience theory of recurrent interactions in the hierarchical visual cortex. When trained with video data using self-supervised learning, the model manifests behaviors consistent with human visual illusions. Here, we adapt this network to model the hierarchical auditory system and investigate whether it will make similar choices to humans regarding the musicality of a set of random pitch sequences. When the model is trained with a large corpus of instrumental classical music and popular melodies rendered as mel spectrograms, it exhibits greater prediction errors for random pitch sequences that are rated less musical by human subjects. We found that the prediction error depends on the amount of information regarding the subsequent note, the pitch interval, and the temporal context. Our findings suggest that predictability is correlated with human perception of musicality and that a predictive coding neural network trained on music can be used to characterize the features and motifs contributing to human perception of music.
△ Less
Submitted 29 October, 2022;
originally announced October 2022.
-
Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Again
Authors:
Bernal Jiménez Gutiérrez,
Nikolas McNeal,
Clay Washington,
You Chen,
Lang Li,
Huan Sun,
Yu Su
Abstract:
The strong few-shot in-context learning capability of large pre-trained language models (PLMs) such as GPT-3 is highly appealing for application domains such as biomedicine, which feature high and diverse demands of language technologies but also high data annotation costs. In this paper, we present the first systematic and comprehensive study to compare the few-shot performance of GPT-3 in-contex…
▽ More
The strong few-shot in-context learning capability of large pre-trained language models (PLMs) such as GPT-3 is highly appealing for application domains such as biomedicine, which feature high and diverse demands of language technologies but also high data annotation costs. In this paper, we present the first systematic and comprehensive study to compare the few-shot performance of GPT-3 in-context learning with fine-tuning smaller (i.e., BERT-sized) PLMs on two highly representative biomedical information extraction tasks, named entity recognition and relation extraction. We follow the true few-shot setting to avoid overestimating models' few-shot performance by model selection over a large validation set. We also optimize GPT-3's performance with known techniques such as contextual calibration and dynamic in-context example retrieval. However, our results show that GPT-3 still significantly underperforms compared to simply fine-tuning a smaller PLM. In addition, GPT-3 in-context learning also yields smaller gains in accuracy when more training data becomes available. Our in-depth analyses further reveal issues of the in-context learning setting that may be detrimental to information extraction tasks in general. Given the high cost of experimenting with GPT-3, we hope our study provides guidance for biomedical researchers and practitioners towards more promising directions such as fine-tuning small PLMs.
△ Less
Submitted 5 November, 2022; v1 submitted 16 March, 2022;
originally announced March 2022.
-
Study of the $K_L \!\to\! π^0 ν\overlineν$ Decay at the J-PARC KOTO Experiment
Authors:
KOTO Collaboration,
J. K. Ahn,
B. Beckford,
M. Campbell,
S. H. Chen,
J. Comfort,
K. Dona,
M. S. Farrington,
K. Hanai,
N. Hara,
H. Haraguchi,
Y. B. Hsiung,
M. Hutcheson,
T. Inagaki,
M. Isoe,
I. Kamiji,
T. Kato,
E. J. Kim,
J. L. Kim,
H. M. Kim,
T. K. Komatsubara,
K. Kotera,
S. K. Lee,
J. W. Lee,
G. Y. Lim
, et al. (46 additional authors not shown)
Abstract:
The rare decay $K_L \!\to\! π^0 ν\overlineν$ was studied with the dataset taken at the J-PARC KOTO experiment in 2016, 2017, and 2018. With a single event sensitivity of $( 7.20 \pm 0.05_{\rm stat} \pm 0.66_{\rm syst} ) \times 10^{-10}$, three candidate events were observed in the signal region. After unveiling them, contaminations from $K^{\pm}$ and scattered $K_L$ decays were studied, and the to…
▽ More
The rare decay $K_L \!\to\! π^0 ν\overlineν$ was studied with the dataset taken at the J-PARC KOTO experiment in 2016, 2017, and 2018. With a single event sensitivity of $( 7.20 \pm 0.05_{\rm stat} \pm 0.66_{\rm syst} ) \times 10^{-10}$, three candidate events were observed in the signal region. After unveiling them, contaminations from $K^{\pm}$ and scattered $K_L$ decays were studied, and the total number of background events was estimated to be $1.22 \pm 0.26$. We conclude that the number of observed events is statistically consistent with the background expectation. For this dataset, we set an upper limit of $4.9 \times 10^{-9}$ on the branching fraction of $K_L \!\to\! π^0 ν\overlineν$ at the 90% confidence level.
△ Less
Submitted 24 March, 2021; v1 submitted 14 December, 2020;
originally announced December 2020.
-
Search for $K_L \!\to\! π^0 ν\overlineν$ and $K_L \!\to\! π^0 X^0$ Decays at the J-PARC KOTO Experiment
Authors:
KOTO Collaboration,
J. K. Ahn,
B. Beckford,
J. Beechert,
K. Bryant,
M. Campbell,
S. H. Chen,
J. Comfort,
K. Dona,
N. Hara,
H. Haraguchi,
Y. B. Hsiung,
M. Hutcheson,
T. Inagaki,
I. Kamiji,
N. Kawasaki,
E. J. Kim,
J. L. Kim,
Y. J. Kim,
J. W. Ko,
T. K. Komatsubara,
K. Kotera,
A. S. Kurilin,
J. W. Lee,
G. Y. Lim
, et al. (45 additional authors not shown)
Abstract:
A search for the rare decay $K_L \!\to\! π^0 ν\overlineν$ was performed. With the data collected in 2015, corresponding to $2.2 \times 10^{19}$ protons on target, a single event sensitivity of $( 1.30 \pm 0.01_{\rm stat} \pm 0.14_{\rm syst} ) \times 10^{-9}$ was achieved and no candidate events were observed. We set an upper limit of $3.0 \times 10^{-9}$ for the branching fraction of…
▽ More
A search for the rare decay $K_L \!\to\! π^0 ν\overlineν$ was performed. With the data collected in 2015, corresponding to $2.2 \times 10^{19}$ protons on target, a single event sensitivity of $( 1.30 \pm 0.01_{\rm stat} \pm 0.14_{\rm syst} ) \times 10^{-9}$ was achieved and no candidate events were observed. We set an upper limit of $3.0 \times 10^{-9}$ for the branching fraction of $K_L \!\to\! π^0 ν\overlineν$ at the 90% confidence level (C.L.), which improved the previous limit by almost an order of magnitude. An upper limit for $K_L \!\to\! π^0 X^0$ was also set as $2.4 \times 10^{-9}$ at the 90% C.L., where $X^0$ is an invisible boson with a mass of $135~{\rm MeV}/c^2$.
△ Less
Submitted 26 February, 2019; v1 submitted 23 October, 2018;
originally announced October 2018.