-
Intuitive Control of Scra** and Rubbing Through Audio-tactile Synthesis
Authors:
Mitsuko Aramaki,
Corentin Bernard,
Richard Kronland-Martinet,
Samuel Poirot,
Sølvi Ystad
Abstract:
Intuitive control of synthesis processes is an ongoing challenge within the domain of auditory perception and cognition. Previous works on sound modelling combined with psychophysical tests have enabled our team to develop a synthesizer that provides intuitive control of actions and objects based on semantic descriptions for sound sources. In this demo we present an augmented version of the synthe…
▽ More
Intuitive control of synthesis processes is an ongoing challenge within the domain of auditory perception and cognition. Previous works on sound modelling combined with psychophysical tests have enabled our team to develop a synthesizer that provides intuitive control of actions and objects based on semantic descriptions for sound sources. In this demo we present an augmented version of the synthesizer in which we added tactile stimulations to increase the sensation of true continuous friction interactions (rubbing and scratching) with the simulated objects. This is of interest for several reasons. Firstly, it enables to evaluate the realism of our sound model in presence of stimulations from other modalities. Secondly it enables to compare tactile and auditory signal structures linked to the same evocation, and thirdly it provides a tool to investigate multimodal perception and how stimulations from different modalities should be combined to provide realistic user interfaces.
△ Less
Submitted 11 January, 2024;
originally announced January 2024.
-
The high/low frequency balance drives the perception of noisy vibrations
Authors:
Corentin Bernard,
Etienne Thoret,
Nicolas Huloux,
Sølvi Ystad
Abstract:
Noisy vibrotactile signals transmitted during tactile explorations of an object provide precious information on the nature of its surface. Linking the properties of such vibrotactile signals to the way they are interpreted by the haptic sensory system remains challenging. In this study, we investigated humans' perception of noisy, stationary vibrations recorded during exploration of textures and r…
▽ More
Noisy vibrotactile signals transmitted during tactile explorations of an object provide precious information on the nature of its surface. Linking the properties of such vibrotactile signals to the way they are interpreted by the haptic sensory system remains challenging. In this study, we investigated humans' perception of noisy, stationary vibrations recorded during exploration of textures and reproduced using a vibrotactile actuator. Since intensity is a well-established essential perceptual attribute, an intensity equalization was first conducted, providing a model for its estimation. The equalized stimuli were further used to identify the most salient spectral features in a second experiment using dissimilarity estimations between pairs of vibrations. Based on dimensionally reduced spectral representations, linear models of dissimilarity prediction showed that the balance between low and high frequencies was the most important cue. Formal validation of this result was achieved through a Mushra experiment, where participants assessed the fidelity of resynthesized vibrations with various distorted frequency balances. These findings offer valuable insights into human vibrotactile perception and establish a computational framework for analyzing vibrations as humans do. Moreover, they pave the way for signal synthesis and compression based on sparse representations, holding significance for applications involving complex vibratory feedback.
△ Less
Submitted 17 November, 2023;
originally announced November 2023.
-
Evaluation of a congruent auditory feedback for Motor Imagery BCI
Authors:
Emmanuel Christophe,
Jérémy Frey,
Richard Kronland-Martinet,
Jean-Arthur Micoulaud-Franchi,
Jelena Mladenović,
Gaëlle Mougin,
Jean Vion-Dury,
Solvi Ystad,
Mitsuko Aramaki
Abstract:
Designing a feedback that helps participants to achieve higher performances is an important concern in brain-computer interface (BCI) research. In a pilot study, we demonstrate how a congruent auditory feedback could improve classification in a electroencephalography (EEG) motor imagery BCI. This is a promising result for creating alternate feedback modality.
Designing a feedback that helps participants to achieve higher performances is an important concern in brain-computer interface (BCI) research. In a pilot study, we demonstrate how a congruent auditory feedback could improve classification in a electroencephalography (EEG) motor imagery BCI. This is a promising result for creating alternate feedback modality.
△ Less
Submitted 22 May, 2018; v1 submitted 18 May, 2018;
originally announced May 2018.
-
Perceptual analyses of action-related impact sounds
Authors:
Marie-Céline Bezat,
Vincent Roussarie,
Kronland-Martinet Richard,
Solvi Ystad,
Stephen Mcadams
Abstract:
Among environmental sounds, we have chosen to study a class of action-related impact sounds: automobile door closure sounds. We propose to describe these sounds using a model composed of perceptual properties. The development of the perceptual model was derived from the evaluation of many door closure sounds measured under controlled laboratory listening conditions. However, listening to such soun…
▽ More
Among environmental sounds, we have chosen to study a class of action-related impact sounds: automobile door closure sounds. We propose to describe these sounds using a model composed of perceptual properties. The development of the perceptual model was derived from the evaluation of many door closure sounds measured under controlled laboratory listening conditions. However, listening to such sounds normally occurs within a natural context, which probably modifies their perception. We therefore need to study differences between the real situation and the laboratory situation by following standard practices in order to specify the precise listening conditions and observe the influence of previous learning, expectations, action-perception interactions, and attention given to sounds. Our process consists in doing in situ experiments that are compared with specific laboratory experiments in order to isolate certain influential, context dependent components.
△ Less
Submitted 25 March, 2010;
originally announced March 2010.
