A Layer-Anchoring Strategy for Enhancing Cross-Lingual Speech Emotion Recognition
Authors:
Shreya G. Upadhyay,
Carlos Busso,
Chi-Chun Lee
Abstract:
Cross-lingual speech emotion recognition (SER) is important for a wide range of everyday applications. While recent SER research relies heavily on large pretrained models for emotion training, existing studies often concentrate solely on the final transformer layer of these models. However, given the task-specific nature and hierarchical architecture of these models, each transformer layer encapsu…
▽ More
Cross-lingual speech emotion recognition (SER) is important for a wide range of everyday applications. While recent SER research relies heavily on large pretrained models for emotion training, existing studies often concentrate solely on the final transformer layer of these models. However, given the task-specific nature and hierarchical architecture of these models, each transformer layer encapsulates different levels of information. Leveraging this hierarchical structure, our study focuses on the information embedded across different layers. Through an examination of layer feature similarity across different languages, we propose a novel strategy called a layer-anchoring mechanism to facilitate emotion transfer in cross-lingual SER tasks. Our approach is evaluated using two distinct language affective corpora (MSP-Podcast and BIIC-Podcast), achieving a best UAR performance of 60.21% on the BIIC-podcast corpus. The analysis uncovers interesting insights into the behavior of popular pretrained models.
△ Less
Submitted 6 July, 2024;
originally announced July 2024.
Density-contrast induced inertial forces on particles in oscillatory flows
Authors:
Siddhansh Agarwal,
Gaurav Upadhyay,
Yashraj Bhosale,
Mattia Gazzola,
Sascha Hilgenfeldt
Abstract:
Oscillatory flows have become an indispensable tool in microfluidics, inducing inertial effects for displacing and manipulating fluid-borne objects in a reliable, controllable, and label-free fashion. However, the quantitative description of such effects has been confined to limit cases and specialized scenarios. Here we develop an analytical formalism yielding the equation of motion of density-mi…
▽ More
Oscillatory flows have become an indispensable tool in microfluidics, inducing inertial effects for displacing and manipulating fluid-borne objects in a reliable, controllable, and label-free fashion. However, the quantitative description of such effects has been confined to limit cases and specialized scenarios. Here we develop an analytical formalism yielding the equation of motion of density-mismatched spherical particles in arbitrary background flows, generalizing previous work. Inertial force terms are systematically derived from the geometry of the flow field together with analytically known Stokes number dependences. Supported by independent, first-principles direct numerical simulations, we find that these forces are important even for nearly density-matched objects such as cells or bacteria, enabling their fast displacement and separation. Our formalism thus generalizes the Maxey--Riley equation, encompassing not only particle inertia, but consistently recovering, in the limit of large Stokes numbers, the Auton modification to added mass as well as the far-field acoustofluidic secondary radiation force.
△ Less
Submitted 8 August, 2023;
originally announced August 2023.
