-
Accommodating Missing Modalities in Time-Continuous Multimodal Emotion Recognition
Authors:
Juan Vazquez-Rodriguez,
Grégoire Lefebvre,
Julien Cumin,
James L. Crowley
Abstract:
Decades of research indicate that emotion recognition is more effective when drawing information from multiple modalities. But what if some modalities are sometimes missing? To address this problem, we propose a novel Transformer-based architecture for recognizing valence and arousal in a time-continuous manner even with missing input modalities. We use a coupling of cross-attention and self-atten…
▽ More
Decades of research indicate that emotion recognition is more effective when drawing information from multiple modalities. But what if some modalities are sometimes missing? To address this problem, we propose a novel Transformer-based architecture for recognizing valence and arousal in a time-continuous manner even with missing input modalities. We use a coupling of cross-attention and self-attention mechanisms to emphasize relationships between modalities during time and enhance the learning process on weak salient inputs. Experimental results on the Ulm-TSST dataset show that our model exhibits an improvement of the concordance correlation coefficient evaluation of 37% when predicting arousal values and 30% when predicting valence values, compared to a late-fusion baseline approach.
△ Less
Submitted 16 November, 2023;
originally announced November 2023.
-
Experimental observation of exceptional points in coupled pendulums
Authors:
Nicolas Even,
Benoit Nennig,
Gautier Lefebvre,
Emmanuel Perrey-Debain
Abstract:
The concept of exceptional point (EP) is demonstrated experimentally in the case of a simple mechanical system consisting of two linearized coupled pendulums. Exceptional points correspond to specific values of the system parameters that yield defective eigenvalues. These spectral singularities which are typical of non-Hermitian system means that both the eigenvalues and their associated eigenvect…
▽ More
The concept of exceptional point (EP) is demonstrated experimentally in the case of a simple mechanical system consisting of two linearized coupled pendulums. Exceptional points correspond to specific values of the system parameters that yield defective eigenvalues. These spectral singularities which are typical of non-Hermitian system means that both the eigenvalues and their associated eigenvectors coalesce. The existence of an EP requires an adequate parameterization of the dynamical system. For this aim, the experimental device has been designed with two controllable parameters which are the length of one pendulum and a viscous-like dam** which is produced via electromagnetic induction. Thanks to the observation of the free response of the coupled pendulums, most EP properties are experimentally investigated, showing good agreements with theoretical considerations. In contrast with many studies on EPs, mainly in the field of physics, the novelty of the present work is that controllable parameters are restricted to be real-valued, and this requires the use of adequate search algorithms. Furthermore, it offers the possibility of exploiting the existence of EPs in time-domain dynamic problems.
△ Less
Submitted 7 February, 2024; v1 submitted 2 August, 2023;
originally announced August 2023.
-
Subwavelength pulse focusing and perfect absorption in the Maxwell fisheye
Authors:
Gautier Lefebvre,
Marc Dubois,
Younes Achaoui,
Ros Kiri Ing,
Mathias Fink,
Sébastien Guenneau,
Patrick Sebbah
Abstract:
Maxwell's fisheye is a paradigm for an absolute optical instrument with a refractive index deduced from the stereographic projection of a sphere on a plane. We investigate experimentally the dynamics of flexural waves in a thin plate with a thickness varying according to the Maxwell fisheye index profile and a clamped boundary. We demonstrate subwavelength focusing and temporal pulse compression a…
▽ More
Maxwell's fisheye is a paradigm for an absolute optical instrument with a refractive index deduced from the stereographic projection of a sphere on a plane. We investigate experimentally the dynamics of flexural waves in a thin plate with a thickness varying according to the Maxwell fisheye index profile and a clamped boundary. We demonstrate subwavelength focusing and temporal pulse compression at the image point. This is achieved by introducing a sink emitting a cancelling signal optimally shaped using a time-reversal procedure. Perfect absorption and outward going wave cancellation at the focus point are demonstrated. The time evolution of the kinetic energy stored inside the cavity reveals that the sink absorbs energy out of the plate ten times faster than the natural decay rate.
△ Less
Submitted 23 June, 2023;
originally announced June 2023.
-
Emotion Recognition with Pre-Trained Transformers Using Multimodal Signals
Authors:
Juan Vazquez-Rodriguez,
Grégoire Lefebvre,
Julien Cumin,
James L Crowley
Abstract:
In this paper, we address the problem of multimodal emotion recognition from multiple physiological signals. We demonstrate that a Transformer-based approach is suitable for this task. In addition, we present how such models may be pretrained in a multimodal scenario to improve emotion recognition performances. We evaluate the benefits of using multimodal inputs and pre-training with our approach…
▽ More
In this paper, we address the problem of multimodal emotion recognition from multiple physiological signals. We demonstrate that a Transformer-based approach is suitable for this task. In addition, we present how such models may be pretrained in a multimodal scenario to improve emotion recognition performances. We evaluate the benefits of using multimodal inputs and pre-training with our approach on a state-ofthe-art dataset.
△ Less
Submitted 22 December, 2022;
originally announced December 2022.
-
Status of the X17 search in Montreal
Authors:
G. Azuelos,
B. Broerman,
D. Bryman,
W. C. Chen,
H. N. da Luz,
L. Doria,
A. Gupta,
L-A. Hamel,
M. Laurin,
K. Leach,
G. Lefebvre,
J-P. Martin,
A. Robinson,
N. Starinski,
R. Sykora,
D. Tiwari,
U. Wichoski,
V. Zacek
Abstract:
At the Montreal Tandem accelerator, an experiment is being set up to measure internal pair creation from the decay of nuclear excited states using a multiwire proportional chamber and scintillator bars surrounding it from the DAPHNE experiment. The acceptance covers a solid angle of nearly 4$π$. Preamplifiers and the data acquisition hardware have been designed and tested. The water-cooled $^7$LiF…
▽ More
At the Montreal Tandem accelerator, an experiment is being set up to measure internal pair creation from the decay of nuclear excited states using a multiwire proportional chamber and scintillator bars surrounding it from the DAPHNE experiment. The acceptance covers a solid angle of nearly 4$π$. Preamplifiers and the data acquisition hardware have been designed and tested. The water-cooled $^7$LiF target, mounted on an Al foil is in a thin carbon fiber section of the beamline. The experiment will focus at first on a measurement of the internal pair creation from the 18.15 MeV state of $^8$Be. Assuming the ATOMKI evaluation of the electron-pair production rate from X17, a Geant4 simulation predicts observation of a clear signal after about two weeks of data taking with a 2 $μ$A proton beam. The IPC measurement could eventually be extended to the giant dipole resonance of $^8$Be, as well as to other nuclei, in particular to $^{10}$B.
△ Less
Submitted 21 November, 2022;
originally announced November 2022.
-
Transformer-Based Self-Supervised Learning for Emotion Recognition
Authors:
Juan Vazquez-Rodriguez,
Grégoire Lefebvre,
Julien Cumin,
James L. Crowley
Abstract:
In order to exploit representations of time-series signals, such as physiological signals, it is essential that these representations capture relevant information from the whole signal. In this work, we propose to use a Transformer-based model to process electrocardiograms (ECG) for emotion recognition. Attention mechanisms of the Transformer can be used to build contextualized representations for…
▽ More
In order to exploit representations of time-series signals, such as physiological signals, it is essential that these representations capture relevant information from the whole signal. In this work, we propose to use a Transformer-based model to process electrocardiograms (ECG) for emotion recognition. Attention mechanisms of the Transformer can be used to build contextualized representations for a signal, giving more importance to relevant parts. These representations may then be processed with a fully-connected network to predict emotions. To overcome the relatively small size of datasets with emotional labels, we employ self-supervised learning. We gathered several ECG datasets with no labels of emotion to pre-train our model, which we then fine-tuned for emotion recognition on the AMIGOS dataset. We show that our approach reaches state-of-the-art performances for emotion recognition using ECG signals on AMIGOS. More generally, our experiments show that transformers and pre-training are promising strategies for emotion recognition with physiological signals.
△ Less
Submitted 3 June, 2022; v1 submitted 8 April, 2022;
originally announced April 2022.
-
Network analyses reveal negative link between changes in adipose tissue GDF15 and BMI during dietary-induced weight loss
Authors:
Alyssa Imbert,
Nathalie Vialaneix,
Julien Marquis,
Julie Vion,
Aline Charpagne,
Sylviane Metairon,
Claire Laurens,
Cedric Moro,
Nathalie Boulet,
Ondine Walter,
Grégory Lefebvre,
Jörg Hager,
Dominique Langin,
Wim Saris,
Arne Astrup,
Nathalie Viguerie,
Armand Valsesia
Abstract:
Adipose tissue (AT) transcriptome studies provide holistic pictures of adaptation to weight and related bioclinical settings changes. Objective To implement AT gene expression profiling and investigate the link between changes in bioclinical parameters and AT gene expression during 3 steps of a 2-phase dietary intervention (DI). Methods AT transcriptome profiling was obtained from sequencing 1051…
▽ More
Adipose tissue (AT) transcriptome studies provide holistic pictures of adaptation to weight and related bioclinical settings changes. Objective To implement AT gene expression profiling and investigate the link between changes in bioclinical parameters and AT gene expression during 3 steps of a 2-phase dietary intervention (DI). Methods AT transcriptome profiling was obtained from sequencing 1051 samples, corresponding to 556 distinct individuals enrolled in a weight loss intervention (8-week low-calorie diet (LCD) at 800 kcal/day) followed with a 6-month ad libitum randomized DI. Transcriptome profiles obtained with QuantSeq sequencing were benchmarked against Illumina RNAseq. Reverse transcription quantitative polymerase chain reaction was used to further confirm associations. Cell specificity was assessed using freshly isolated cells and THP-1 cell line. Results During LCD, 5 modules were found, of which 3 included at least 1 bioclinical variable. Change in body mass index (BMI) connected with changes in mRNA level of genes with inflammatory response signature. In this module, change in BMI was negatively associated with changes in expression of genes encoding secreted protein (GDF15, CCL3, and SPP1). Through all phases of the DI, change in GDF15 was connected to changes in SPP1, CCL3, LIPA and CD68. Further characterization showed that these genes were specific to macrophages (with LIPA, CD68 and GDF15 expressed in anti-inflammatory macrophages) and GDF15 also expressed in preadipocytes. Conclusion Network analyses identified a novel AT feature with GDF15 upregulated with calorie restriction induced weight loss, concomitantly to macrophage markers. In AT, GDF15 was expressed in preadipocytes and macrophages where it was a hallmark of anti-inflammatory cells.
△ Less
Submitted 17 March, 2022;
originally announced March 2022.
-
Routine Modeling with Time Series Metric Learning
Authors:
Paul Compagnon,
Grégoire Lefebvre,
Stefan Duffner,
Christophe Garcia
Abstract:
Traditionally, the automatic recognition of human activities is performed with supervised learning algorithms on limited sets of specific activities. This work proposes to recognize recurrent activity patterns, called routines, instead of precisely defined activities. The modeling of routines is defined as a metric learning problem, and an architecture, called SS2S, based on sequence-to-sequence m…
▽ More
Traditionally, the automatic recognition of human activities is performed with supervised learning algorithms on limited sets of specific activities. This work proposes to recognize recurrent activity patterns, called routines, instead of precisely defined activities. The modeling of routines is defined as a metric learning problem, and an architecture, called SS2S, based on sequence-to-sequence models is proposed to learn a distance between time series. This approach only relies on inertial data and is thus non intrusive and preserves privacy. Experimental results show that a clustering algorithm provided with the learned distance is able to recover daily routines.
△ Less
Submitted 8 July, 2019;
originally announced July 2019.
-
Quantum revival for elastic waves in thin plate
Authors:
Marc Dubois,
Gautier Lefebvre,
Patrick Sebbah
Abstract:
Quantum revival is described as the time-periodic reconstruction of a wave packet initially localized in space and time. This effect is expected in finite-size systems which exhibits commensurable discrete spectrum such as the infinite quantum well. Here, we report on the experimental observation of full and fractional quantum revival for classical waves in a two dimensional cavity. We consider fl…
▽ More
Quantum revival is described as the time-periodic reconstruction of a wave packet initially localized in space and time. This effect is expected in finite-size systems which exhibits commensurable discrete spectrum such as the infinite quantum well. Here, we report on the experimental observation of full and fractional quantum revival for classical waves in a two dimensional cavity. We consider flexural waves propagating in thin plates, as their quadratic dispersion at low frequencies mimics the dispersion relation of quantum systems governed by Schrödinger equation. Time-dependent excitation and measurement are performed at ultrasonic frequencies and reveal a periodic reconstruction of the initial elastic wave packet.
△ Less
Submitted 13 January, 2017; v1 submitted 16 November, 2016;
originally announced November 2016.
-
Unveiling Extreme Anisotropy in Elastic Structured Media
Authors:
Gautier Lefebvre,
Tryfon Antonakakis,
Younes Achaoui,
Richard Craster,
Sebastien Guenneau,
Patrick Sebbah
Abstract:
Periodic structures can be engineered to exhibit unique properties observed at symmetry points, such as zero group velocity, Dirac cones and saddle points; identifying these, and the nature of the associated modes, from a direct reading of the dispersion surfaces is not straightforward, especially in three-dimensions or at high frequencies when several dispersion surfaces fold back in the Brilloui…
▽ More
Periodic structures can be engineered to exhibit unique properties observed at symmetry points, such as zero group velocity, Dirac cones and saddle points; identifying these, and the nature of the associated modes, from a direct reading of the dispersion surfaces is not straightforward, especially in three-dimensions or at high frequencies when several dispersion surfaces fold back in the Brillouin zone. A recently proposed asymptotic high frequency homogenisation theory is applied to a challenging time-domain experiment with elastic waves in a pinned metallic plate. The prediction of a narrow high-frequency spectral region where the effective medium tensor dramatically switches from positive definite to indefinite is confirmed experimentally; a small frequency shift of the pulse carrier results in two distinct types of highly anisotropic modes. The underlying effective equation mirrors this behaviour with a change in form from elliptic to hyperbolic exemplifying the high degree of wave control available and the importance of a simple and effective predictive model.
△ Less
Submitted 16 October, 2016;
originally announced October 2016.
-
One single static measurement predicts wave localization in complex structures
Authors:
Gautier Lefebvre,
Alexane Gondel,
Marc Dubois,
Michael Atlan,
Florian Feppon,
Aimé Labbé,
Camille Gillot,
Alix Garelli,
Maxence Ernoult,
Svitlana Mayboroda,
Marcel Filoche,
Patrick Sebbah
Abstract:
A recent theoretical breakthrough has brought a new tool, called \emph{localization landscape}, to predict the localization regions of vibration modes in complex or disordered systems. Here, we report on the first experiment which measures the localization landscape and demonstrates its predictive power. Holographic measurement of the static deformation under uniform load of a thin plate with comp…
▽ More
A recent theoretical breakthrough has brought a new tool, called \emph{localization landscape}, to predict the localization regions of vibration modes in complex or disordered systems. Here, we report on the first experiment which measures the localization landscape and demonstrates its predictive power. Holographic measurement of the static deformation under uniform load of a thin plate with complex geometry provides direct access to the landscape function. When put in vibration, this system shows modes precisely confined within the sub-regions delineated by the landscape function. Also the maxima of this function match the measured eigenfrequencies, while the minima of the valley network gives the frequencies at which modes become extended. This approach fully characterizes the low frequency spectrum of a complex structure from a single static measurement. It paves the way to the control and engineering of eigenmodes in any vibratory system, especially where a structural or microscopic description is not accessible.
△ Less
Submitted 11 April, 2016;
originally announced April 2016.
-
Erosion dynamics of a wet granular medium
Authors:
Gautier Lefebvre,
Pierre Jop
Abstract:
Liquid may give strong cohesion properties to a granular medium, and confer a solid-like behavior. We study the erosion of a fixed circular aggregate of wet granular matter subjected to a flow of dry grains inside a half-filled rotating drum. During the rotation, the dry grains flow around the fixed obstacle. We show that its diameter decreases linearly with time for low liquid content, as wet gra…
▽ More
Liquid may give strong cohesion properties to a granular medium, and confer a solid-like behavior. We study the erosion of a fixed circular aggregate of wet granular matter subjected to a flow of dry grains inside a half-filled rotating drum. During the rotation, the dry grains flow around the fixed obstacle. We show that its diameter decreases linearly with time for low liquid content, as wet grains are pulled-out of the aggregate. This erosion phenomenon is governed by the properties of the liquids. The erosion rate decreases exponentially with the surface tension while it depends on the viscosity to the power -1. We propose a model based on the force fluctuations arising inside the flow, explaining both dependencies: the capillary force acts as a threshold and the viscosity controls the erosion time scale. We also provide experiments using different flowing grains confirming our model.
△ Less
Submitted 8 December, 2014;
originally announced December 2014.
-
Experiments on Maxwell's Fish-eye dynamics in elastic plates
Authors:
Gautier Lefebvre,
Marc Dubois,
Romain Beauvais,
Younes Achaoui,
Ros Kiri Ing,
Patrick Sebbah
Abstract:
We experimentally demonstrate that a Duraluminium thin plate with a thickness profile varying radially in a piecewise constant fashion as h(r)=h(0)(1+(r/Rmax)), with h(0)=0.5 mm, h(Rmax)=2 mm and Rmax=10 cm behaves in many ways as Maxwell's fish-eye lens in optics, since its imaging properties for a Gaussian pulse with central frequencies 30~kHz and 60~kHz are very similar to those predicted by ra…
▽ More
We experimentally demonstrate that a Duraluminium thin plate with a thickness profile varying radially in a piecewise constant fashion as h(r)=h(0)(1+(r/Rmax)), with h(0)=0.5 mm, h(Rmax)=2 mm and Rmax=10 cm behaves in many ways as Maxwell's fish-eye lens in optics, since its imaging properties for a Gaussian pulse with central frequencies 30~kHz and 60~kHz are very similar to those predicted by ray trajectories (great circles) on a virtual sphere (rays emanating from the North pole meet at the South pole). However, refocusing time depends on the carrier frequency as a direct consequence of the dispersive nature of flexural waves in thin plates. Importantly, experimental results are in good agreement with Finite-Difference-Time-Domain simulations.
△ Less
Submitted 21 November, 2014;
originally announced November 2014.
-
Bayesian multinomial regression with class-specific predictor selection
Authors:
Paul Gustafson,
Geneviève Lefebvre
Abstract:
Consider a multinomial regression model where the response, which indicates a unit's membership in one of several possible unordered classes, is associated with a set of predictor variables. Such models typically involve a matrix of regression coefficients, with the $(j,k)$ element of this matrix modulating the effect of the $k$th predictor on the propensity of the unit to belong to the $j$th cl…
▽ More
Consider a multinomial regression model where the response, which indicates a unit's membership in one of several possible unordered classes, is associated with a set of predictor variables. Such models typically involve a matrix of regression coefficients, with the $(j,k)$ element of this matrix modulating the effect of the $k$th predictor on the propensity of the unit to belong to the $j$th class. Thus, a supposition that only a subset of the available predictors are associated with the response corresponds to some of the columns of the coefficient matrix being zero. Under the Bayesian paradigm, the subset of predictors which are associated with the response can be treated as an unknown parameter, leading to typical Bayesian model selection and model averaging procedures. As an alternative, we investigate model selection and averaging, whereby a subset of individual elements of the coefficient matrix are zero. That is, the subset of predictors associated with the propensity to belong to a class varies with the class. We refer to this as class-specific predictor selection. We argue that such a scheme can be attractive on both conceptual and computational grounds.
△ Less
Submitted 27 January, 2009;
originally announced January 2009.
