-
Investigating Human Response, Behaviour, and Preference in Joint-Task Interaction
Authors:
Alan Lindsay,
Bart Craenen,
Sara Dalzel-Job,
Robin L. Hill,
Ronald P. A. Petrick
Abstract:
Human interaction relies on a wide range of signals, including non-verbal cues. In order to develop effective Explainable Planning (XAIP) agents it is important that we understand the range and utility of these communication channels. Our starting point is existing results from joint task interaction and their study in cognitive science. Our intention is that these lessons can inform the design of…
▽ More
Human interaction relies on a wide range of signals, including non-verbal cues. In order to develop effective Explainable Planning (XAIP) agents it is important that we understand the range and utility of these communication channels. Our starting point is existing results from joint task interaction and their study in cognitive science. Our intention is that these lessons can inform the design of interaction agents -- including those using planning techniques -- whose behaviour is conditioned on the user's response, including affective measures of the user (i.e., explicitly incorporating the user's affective state within the planning model). We have identified several concepts at the intersection of plan-based agent behaviour and joint task interaction and have used these to design two agents: one reactive and the other partially predictive. We have designed an experiment in order to examine human behaviour and response as they interact with these agents. In this paper we present the designed study and the key questions that are being investigated. We also present the results from an empirical analysis where we examined the behaviour of the two agents for simulated users.
△ Less
Submitted 27 November, 2020;
originally announced November 2020.
-
MuMMER: Socially Intelligent Human-Robot Interaction in Public Spaces
Authors:
Mary Ellen Foster,
Bart Craenen,
Amol Deshmukh,
Oliver Lemon,
Emanuele Bastianelli,
Christian Dondrup,
Ioannis Papaioannou,
Andrea Vanzo,
Jean-Marc Odobez,
Olivier Canévet,
Yuanzhouhan Cao,
Weipeng He,
Angel Martínez-González,
Petr Motlicek,
Rémy Siegfried,
Rachid Alami,
Kathleen Belhassein,
Guilhem Buisan,
Aurélie Clodic,
Amandine Mayima,
Yoan Sallami,
Guillaume Sarthou,
Phani-Teja Singamaneni,
Jules Waldhart,
Alexandre Mazel
, et al. (5 additional authors not shown)
Abstract:
In the EU-funded MuMMER project, we have developed a social robot designed to interact naturally and flexibly with users in public spaces such as a shop** mall. We present the latest version of the robot system developed during the project. This system encompasses audio-visual sensing, social signal processing, conversational interaction, perspective taking, geometric reasoning, and motion plann…
▽ More
In the EU-funded MuMMER project, we have developed a social robot designed to interact naturally and flexibly with users in public spaces such as a shop** mall. We present the latest version of the robot system developed during the project. This system encompasses audio-visual sensing, social signal processing, conversational interaction, perspective taking, geometric reasoning, and motion planning. It successfully combines all these components in an overarching framework using the Robot Operating System (ROS) and has been deployed to a shop** mall in Finland interacting with customers. In this paper, we describe the system components, their interplay, and the resulting robot behaviours and scenarios provided at the shop** mall.
△ Less
Submitted 15 September, 2019;
originally announced September 2019.
-
TR02: State dependent oracle masks for improved dynamical features
Authors:
J. F. Gemmeke,
B. Cranen
Abstract:
Using the AURORA-2 digit recognition task, we show that recognition accuracies obtained with classical, SNR based oracle masks can be substantially improved by using a state-dependent mask estimation technique.
Using the AURORA-2 digit recognition task, we show that recognition accuracies obtained with classical, SNR based oracle masks can be substantially improved by using a state-dependent mask estimation technique.
△ Less
Submitted 18 March, 2009;
originally announced March 2009.
-
TR01: Time-continuous Sparse Imputation
Authors:
J. F. Gemmeke,
B. Cranen
Abstract:
An effective way to increase the noise robustness of automatic speech recognition is to label noisy speech features as either reliable or unreliable (missing) prior to decoding, and to replace the missing ones by clean speech estimates. We present a novel method to obtain such clean speech estimates. Unlike previous imputation frameworks which work on a frame-by-frame basis, our method focuses o…
▽ More
An effective way to increase the noise robustness of automatic speech recognition is to label noisy speech features as either reliable or unreliable (missing) prior to decoding, and to replace the missing ones by clean speech estimates. We present a novel method to obtain such clean speech estimates. Unlike previous imputation frameworks which work on a frame-by-frame basis, our method focuses on exploiting information from a large time-context. Using a sliding window approach, denoised speech representations are constructed using a sparse representation of the reliable features in an overcomplete basis of fixed-length exemplar fragments. We demonstrate the potential of our approach with experiments on the AURORA-2 connected digit database.
△ Less
Submitted 16 January, 2009;
originally announced January 2009.
