-
Comparing in context: Improving cosine similarity measures with a metric tensor
Authors:
Isa M. Apallius de Vos,
Ghislaine L. van den Boogerd,
Mara D. Fennema,
Adriana D. Correia
Abstract:
Cosine similarity is a widely used measure of the relatedness of pre-trained word embeddings, trained on a language modeling goal. Datasets such as WordSim-353 and SimLex-999 rate how similar words are according to human annotators, and as such are often used to evaluate the performance of language models. Thus, any improvement on the word similarity task requires an improved word representation.…
▽ More
Cosine similarity is a widely used measure of the relatedness of pre-trained word embeddings, trained on a language modeling goal. Datasets such as WordSim-353 and SimLex-999 rate how similar words are according to human annotators, and as such are often used to evaluate the performance of language models. Thus, any improvement on the word similarity task requires an improved word representation. In this paper, we propose instead the use of an extended cosine similarity measure to improve performance on that task, with gains in interpretability. We explore the hypothesis that this approach is particularly useful if the word-similarity pairs share the same context, for which distinct contextualized similarity measures can be learned. We first use the dataset of Richie et al. (2020) to learn contextualized metrics and compare the results with the baseline values obtained using the standard cosine similarity measure, which consistently shows improvement. We also train a contextualized similarity measure for both SimLex-999 and WordSim-353, comparing the results with the corresponding baselines, and using these datasets as independent test sets for the all-context similarity measure learned on the contextualized dataset, obtaining positive results for a number of tests.
△ Less
Submitted 28 March, 2022;
originally announced March 2022.
-
Robust neuromorphic coupled oscillators for adaptive pacemakers
Authors:
Renate Krause,
Joanne J. A. van Bavel,
Chenxi Wu,
Marc A. Vos,
Alain Nogaret,
Giacomo Indiveri
Abstract:
Neural coupled oscillators are a useful building block in numerous models and applications. They were analyzed extensively in theoretical studies and more recently, in biologically realistic simulations of spiking neural networks. The advent of mixed-signal analog/digital neuromorphic electronic circuits provides new means for implementing neural coupled oscillators on compact low-power spiking ne…
▽ More
Neural coupled oscillators are a useful building block in numerous models and applications. They were analyzed extensively in theoretical studies and more recently, in biologically realistic simulations of spiking neural networks. The advent of mixed-signal analog/digital neuromorphic electronic circuits provides new means for implementing neural coupled oscillators on compact low-power spiking neural network hardware platforms. However, their implementation on this noisy, low-precision and inhomogeneous computing substrate raises new challenges with regards to stability and controllability. In this work, we present a robust, spiking neural network model of neural coupled oscillators and validate it with an implementation on a mixed-signal neuromorphic processor. We demonstrate its robustness showing how to reliably control and modulate the oscillator's frequency and phase shift, despite the variability of the silicon synapse and neuron properties. We show how this ultra-low power neural processing system can be used to build an adaptive cardiac pacemaker modulating the heart rate with respect to the respiration phases and compare it with surface ECG and respiratory signal recordings of dogs at rest. The implementation of our model in neuromorphic electronic hardware shows its robustness on a highly variable substrate and extends the toolbox for applications requiring rhythmic outputs such as pacemakers.
△ Less
Submitted 4 April, 2021;
originally announced April 2021.
-
Present criteria for prophylactic ICD implantation: Insights from the EU-CERT-ICD (Comparative Effectiveness Research to Assess the Use of Primary ProphylacTic Implantable Cardioverter Defibrillators in EUrope) project
Authors:
M. Zabel,
S. Schlögl,
A. Lubinski,
J. H. Svendsen,
A. Bauer,
E. Arbelo,
S. Brusich,
D. Conen,
I. Cygankiewicz,
M. Dommasch,
P. Flevari,
J. Galuszka,
J. Hansen,
G. Hasenfuß,
R. Hatala,
H. V. Huikuri,
T. Kenttä,
T. Kuczejko,
H. Haarmann,
M. Harden,
S. Iovev,
S. Kääb,
G. Kaliska,
A. Katsimardos,
J. D. Kasprzak
, et al. (23 additional authors not shown)
Abstract:
BACKGROUND. The clinical effectiveness of primary prevention implantable cardioverter defibrillator (ICD) therapy is under debate. It is urgently needed to better identify patients who benefit from prophylactic ICD therapy. The EUropean Comparative Effectiveness Research to Assess the Use of Primary ProphylacTic Implantable Cardioverter Defibrillators (EU-CERT-ICD) completed in 2019 will assess th…
▽ More
BACKGROUND. The clinical effectiveness of primary prevention implantable cardioverter defibrillator (ICD) therapy is under debate. It is urgently needed to better identify patients who benefit from prophylactic ICD therapy. The EUropean Comparative Effectiveness Research to Assess the Use of Primary ProphylacTic Implantable Cardioverter Defibrillators (EU-CERT-ICD) completed in 2019 will assess this issue.
SUMMARY. The EU-CERT-ICD is a prospective investigator-initiated non-randomized, controlled, multicenter observational cohort study done in 44 centers across 15 European countries. A total of 2327 patients with heart failure due to ischemic heart disease or dilated cardiomyopathy indicated for primary prophylactic ICD implantation were recruited between 2014 and 2018 (>1500 patients at first ICD implantation, >750 patients non-randomized non-ICD control group). The primary endpoint was all-cause mortality, first appropriate shock was co-primary endpoint. At baseline, all patients underwent 12-lead ECG and Holter-ECG analysis using multiple advanced methods for risk stratification as well as documentation of clinical characteristics and laboratory values. The EU-CERT-ICD data will provide much needed information on the survival benefit of preventive ICD therapy and expand on previous prospective risk stratification studies which showed very good applicability of clinical parameters and advanced risk stratifiers in order to define patient subgroups with above or below average ICD benefit.
CONCLUSION. The EU-CERT-ICD study will provide new and current data about effectiveness of primary prophylactic ICD implantation. The study also aims for improved risk stratification and patient selection using clinical risk markers in general, and advanced ECG risk markers in particular.
△ Less
Submitted 12 September, 2019;
originally announced September 2019.
