-
Wearable data from subjects playing Super Mario, sitting university exams, or performing physical exercise help detect acute mood episodes via self-supervised learning
Authors:
Filippo Corponi,
Bryan M. Li,
Gerard Anmella,
Clàudia Valenzuela-Pascual,
Ariadna Mas,
Isabella Pacchiarotti,
Marc Valentí,
Iria Grande,
Antonio Benabarre,
Marina Garriga,
Eduard Vieta,
Allan H Young,
Stephen M. Lawrie,
Heather C. Whalley,
Diego Hidalgo-Mazzei,
Antonio Vergari
Abstract:
Personal sensing, leveraging data passively and near-continuously collected with wearables from patients in their ecological environment, is a promising paradigm to monitor mood disorders (MDs), a major determinant of worldwide disease burden. However, collecting and annotating wearable data is very resource-intensive. Studies of this kind can thus typically afford to recruit only a couple dozens…
▽ More
Personal sensing, leveraging data passively and near-continuously collected with wearables from patients in their ecological environment, is a promising paradigm to monitor mood disorders (MDs), a major determinant of worldwide disease burden. However, collecting and annotating wearable data is very resource-intensive. Studies of this kind can thus typically afford to recruit only a couple dozens of patients. This constitutes one of the major obstacles to applying modern supervised machine learning techniques to MDs detection. In this paper, we overcome this data bottleneck and advance the detection of MDs acute episode vs stable state from wearables data on the back of recent advances in self-supervised learning (SSL). This leverages unlabelled data to learn representations during pre-training, subsequently exploited for a supervised task. First, we collected open-access datasets recording with an Empatica E4 spanning different, unrelated to MD monitoring, personal sensing tasks -- from emotion recognition in Super Mario players to stress detection in undergraduates -- and devised a pre-processing pipeline performing on-/off-body detection, sleep-wake detection, segmentation, and (optionally) feature extraction. With 161 E4-recorded subjects, we introduce E4SelfLearning, the largest to date open access collection, and its pre-processing pipeline. Second, we show that SSL confidently outperforms fully-supervised pipelines using either our novel E4-tailored Transformer architecture (E4mer) or classical baseline XGBoost: 81.23% against 75.35% (E4mer) and 72.02% (XGBoost) correctly classified recording segments from 64 (half acute, half stable) patients. Lastly, we illustrate that SSL performance is strongly associated with the specific surrogate task employed for pre-training as well as with unlabelled data availability.
△ Less
Submitted 7 November, 2023;
originally announced November 2023.
-
HarperValleyBank: A Domain-Specific Spoken Dialog Corpus
Authors:
Mike Wu,
Jonathan Nafziger,
Anthony Scodary,
Andrew Maas
Abstract:
We introduce HarperValleyBank, a free, public domain spoken dialog corpus. The data simulate simple consumer banking interactions, containing about 23 hours of audio from 1,446 human-human conversations between 59 unique speakers. We selected intents and utterance templates to allow realistic variation while controlling overall task complexity and limiting vocabulary size to about 700 unique words…
▽ More
We introduce HarperValleyBank, a free, public domain spoken dialog corpus. The data simulate simple consumer banking interactions, containing about 23 hours of audio from 1,446 human-human conversations between 59 unique speakers. We selected intents and utterance templates to allow realistic variation while controlling overall task complexity and limiting vocabulary size to about 700 unique words. We provide audio data along with transcripts and annotations for speaker identity, caller intent, dialog actions, and emotional valence. The data size and domain specificity makes for quick transcription experiments with modern end-to-end neural approaches. Further, we provide baselines for representation learning, adapting recent work to embed waveforms for downstream prediction tasks. Our experiments show that tasks using our annotations are sensitive to both the model choice and corpus size.
△ Less
Submitted 19 March, 2021; v1 submitted 26 October, 2020;
originally announced October 2020.
-
Prediction of Hilbertian autoregressive processes : a Recurrent Neural Network approach
Authors:
Cl\'{e]ment Carré,
André Mas
Abstract:
The autoregressive Hilbertian model (ARH) was introduced in the early 90's by Denis Bosq. It was the subject of a vast literature and gave birth to numerous extensions. The model generalizes the classical multidimensional autoregressive model, widely used in Time Series Analysis. It was successfully applied in numerous fields such as finance, industry, biology. We propose here to compare the class…
▽ More
The autoregressive Hilbertian model (ARH) was introduced in the early 90's by Denis Bosq. It was the subject of a vast literature and gave birth to numerous extensions. The model generalizes the classical multidimensional autoregressive model, widely used in Time Series Analysis. It was successfully applied in numerous fields such as finance, industry, biology. We propose here to compare the classical prediction methodology based on the estimation of the autocorrelation operator with a neural network learning approach. The latter is based on a popular version of Recurrent Neural Networks : the Long Short Term Memory networks. The comparison is carried out through simulations and real datasets.
△ Less
Submitted 25 August, 2020;
originally announced August 2020.
-
Learning spatiotemporal signals using a recurrent spiking network that discretizes time
Authors:
Amadeus Maes,
Mauricio Barahona,
Claudia Clopath
Abstract:
Learning to produce spatiotemporal sequences is a common task that the brain has to solve. The same neural substrate may be used by the brain to produce different sequential behaviours. The way the brain learns and encodes such tasks remains unknown as current computational models do not typically use realistic biologically-plausible learning. Here, we propose a model where a spiking recurrent net…
▽ More
Learning to produce spatiotemporal sequences is a common task that the brain has to solve. The same neural substrate may be used by the brain to produce different sequential behaviours. The way the brain learns and encodes such tasks remains unknown as current computational models do not typically use realistic biologically-plausible learning. Here, we propose a model where a spiking recurrent network of excitatory and inhibitory biophysical neurons drives a read-out layer: the dynamics of the driver recurrent network is trained to encode time which is then mapped through the read-out neurons to encode another dimension, such as space or a phase. Different spatiotemporal patterns can be learned and encoded through the synaptic weights to the read-out neurons that follow common Hebbian learning rules. We demonstrate that the model is able to learn spatiotemporal dynamics on time scales that are behaviourally relevant and we show that the learned sequences are robustly replayed during a regime of spontaneous activity.
△ Less
Submitted 19 December, 2019; v1 submitted 20 July, 2019;
originally announced July 2019.
-
Indy: a virtual reality multi-player game for navigation skills training
Authors:
Arnaud Mas,
Idriss Ismaël,
Nicolas Filliard
Abstract:
Working in complex industrial facilities requires spatial navigation skills that people build up with time and field experience. Training sessions consisting in guided tours help discover places but they are insufficient to become intimately familiar with their layout. They imply passive learning postures, are time-limited and can be experienced only once because of organization constraints and po…
▽ More
Working in complex industrial facilities requires spatial navigation skills that people build up with time and field experience. Training sessions consisting in guided tours help discover places but they are insufficient to become intimately familiar with their layout. They imply passive learning postures, are time-limited and can be experienced only once because of organization constraints and potential interferences with ongoing activities in the buildings. To overcome these limitations and improve the acquisition of navigation skills, we developed Indy, a virtual reality system consisting in a collaborative game of treasure hunting. It has several key advantages: it focuses learners' attention on navigation tasks, implies their active engagement and provides them with feedbacks on their achievements. Virtual reality makes it possible to multiply the number and duration of situations that learners can experience to better consolidate their skills. This paper discusses the main design principles and a typical usage scenario of Indy.
△ Less
Submitted 11 July, 2018;
originally announced July 2018.
-
Retrofitting Distributional Embeddings to Knowledge Graphs with Functional Relations
Authors:
Benjamin J. Lengerich,
Andrew L. Maas,
Christopher Potts
Abstract:
Knowledge graphs are a versatile framework to encode richly structured data relationships, but it can be challenging to combine these graphs with unstructured data. Methods for retrofitting pre-trained entity representations to the structure of a knowledge graph typically assume that entities are embedded in a connected space and that relations imply similarity. However, useful knowledge graphs of…
▽ More
Knowledge graphs are a versatile framework to encode richly structured data relationships, but it can be challenging to combine these graphs with unstructured data. Methods for retrofitting pre-trained entity representations to the structure of a knowledge graph typically assume that entities are embedded in a connected space and that relations imply similarity. However, useful knowledge graphs often contain diverse entities and relations (with potentially disjoint underlying corpora) which do not accord with these assumptions. To overcome these limitations, we present Functional Retrofitting, a framework that generalizes current retrofitting methods by explicitly modeling pairwise relations. Our framework can directly incorporate a variety of pairwise penalty functions previously developed for knowledge graph completion. Further, it allows users to encode, learn, and extract information about relation semantics. We present both linear and neural instantiations of the framework. Functional Retrofitting significantly outperforms existing retrofitting methods on complex knowledge graphs and loses no accuracy on simpler graphs (in which relations do imply similarity). Finally, we demonstrate the utility of the framework by predicting new drug--disease treatment pairs in a large, complex health knowledge graph.
△ Less
Submitted 16 June, 2018; v1 submitted 31 July, 2017;
originally announced August 2017.
-
Circle-based Eye Center Localization (CECL)
Authors:
Yustinus Eko Soelistio,
Eric Postma,
Alfons Maes
Abstract:
We propose an improved eye center localization method based on the Hough transform, called Circle-based Eye Center Localization (CECL) that is simple, robust, and achieves accuracy on a par with typically more complex state-of-the-art methods. The CECL method relies on color and shape cues that distinguish the iris from other facial structures. The accuracy of the CECL method is demonstrated throu…
▽ More
We propose an improved eye center localization method based on the Hough transform, called Circle-based Eye Center Localization (CECL) that is simple, robust, and achieves accuracy on a par with typically more complex state-of-the-art methods. The CECL method relies on color and shape cues that distinguish the iris from other facial structures. The accuracy of the CECL method is demonstrated through a comparison with 15 state-of-the-art eye center localization methods against five error thresholds, as reported in the literature. The CECL method achieved an accuracy of 80.8% to 99.4% and ranked first for 2 of the 5 thresholds. It is concluded that the CECL method offers an attractive alternative to existing methods for automatic eye center localization.
△ Less
Submitted 20 August, 2015; v1 submitted 15 June, 2015;
originally announced June 2015.
-
First-Pass Large Vocabulary Continuous Speech Recognition using Bi-Directional Recurrent DNNs
Authors:
Awni Y. Hannun,
Andrew L. Maas,
Daniel Jurafsky,
Andrew Y. Ng
Abstract:
We present a method to perform first-pass large vocabulary continuous speech recognition using only a neural network and language model. Deep neural network acoustic models are now commonplace in HMM-based speech recognition systems, but building such systems is a complex, domain-specific task. Recent work demonstrated the feasibility of discarding the HMM sequence modeling framework by directly p…
▽ More
We present a method to perform first-pass large vocabulary continuous speech recognition using only a neural network and language model. Deep neural network acoustic models are now commonplace in HMM-based speech recognition systems, but building such systems is a complex, domain-specific task. Recent work demonstrated the feasibility of discarding the HMM sequence modeling framework by directly predicting transcript text from audio. This paper extends this approach in two ways. First, we demonstrate that a straightforward recurrent neural network architecture can achieve a high level of accuracy. Second, we propose and evaluate a modified prefix-search decoding algorithm. This approach to decoding enables first-pass speech recognition with a language model, completely unaided by the cumbersome infrastructure of HMM-based systems. Experiments on the Wall Street Journal corpus demonstrate fairly competitive word error rates, and the importance of bi-directional network recurrence.
△ Less
Submitted 8 December, 2014; v1 submitted 12 August, 2014;
originally announced August 2014.
-
Building DNN Acoustic Models for Large Vocabulary Speech Recognition
Authors:
Andrew L. Maas,
Peng Qi,
Ziang Xie,
Awni Y. Hannun,
Christopher T. Lengerich,
Daniel Jurafsky,
Andrew Y. Ng
Abstract:
Deep neural networks (DNNs) are now a central component of nearly all state-of-the-art speech recognition systems. Building neural network acoustic models requires several design decisions including network architecture, size, and training loss function. This paper offers an empirical investigation on which aspects of DNN acoustic model design are most important for speech recognition system perfo…
▽ More
Deep neural networks (DNNs) are now a central component of nearly all state-of-the-art speech recognition systems. Building neural network acoustic models requires several design decisions including network architecture, size, and training loss function. This paper offers an empirical investigation on which aspects of DNN acoustic model design are most important for speech recognition system performance. We report DNN classifier performance and final speech recognizer word error rates, and compare DNNs using several metrics to quantify factors influencing differences in task performance. Our first set of experiments use the standard Switchboard benchmark corpus, which contains approximately 300 hours of conversational telephone speech. We compare standard DNNs to convolutional networks, and present the first experiments using locally-connected, untied neural networks for acoustic modeling. We additionally build systems on a corpus of 2,100 hours of training data by combining the Switchboard and Fisher corpora. This larger corpus allows us to more thoroughly examine performance of large DNN models -- with up to ten times more parameters than those typically used in speech recognition systems. Our results suggest that a relatively simple DNN architecture and optimization technique produces strong results. These findings, along with previous work, help establish a set of best practices for building DNN hybrid speech recognition systems with maximum likelihood training. Our experiments in DNN optimization additionally serve as a case study for training DNNs with discriminative loss functions for speech tasks, as well as DNN classifiers more generally.
△ Less
Submitted 20 January, 2015; v1 submitted 30 June, 2014;
originally announced June 2014.
-
A-infinity Persistence
Authors:
Francisco Belchí Guillamón,
Aniceto Murillo Mas
Abstract:
We introduce and study A-infinity persistence of a given homology filtration of topological spaces. This is a family, one for each n > 0, of homological invariants which provide information not readily available by the (persistent) Betti numbers of the given filtration. This may help to detect noise, not just in the simplicial structure of the filtration but in further geometrical properties in wh…
▽ More
We introduce and study A-infinity persistence of a given homology filtration of topological spaces. This is a family, one for each n > 0, of homological invariants which provide information not readily available by the (persistent) Betti numbers of the given filtration. This may help to detect noise, not just in the simplicial structure of the filtration but in further geometrical properties in which the higher codiagonals of the A-infinity structure are translated. Based in the classification of zigzag modules, a characterization of the A-infinity persistence in terms of its associated barcode is given.
△ Less
Submitted 17 March, 2014; v1 submitted 10 March, 2014;
originally announced March 2014.
