SealMates: Supporting Communication in Video Conferencing using a Collective Behavior-Driven Avatar
Authors:
Mark Armstrong,
Chi-Lan Yang,
Kinga Skiers,
Mengzhen Lim,
Tamil Selvan Gunasekaran,
Ziyue Wang,
Takuji Narumi,
Kouta Minamizawa,
Yun Suen Pai
Abstract:
The limited nonverbal cues and spatially distributed nature of remote communication make it challenging for unacquainted members to be expressive during social interactions over video conferencing. Though it enables seeing others' facial expressions, the visual feedback can instead lead to unexpected self-focus, resulting in users missing cues for others to engage in the conversation equally. To s…
▽ More
The limited nonverbal cues and spatially distributed nature of remote communication make it challenging for unacquainted members to be expressive during social interactions over video conferencing. Though it enables seeing others' facial expressions, the visual feedback can instead lead to unexpected self-focus, resulting in users missing cues for others to engage in the conversation equally. To support expressive communication and equal participation among unacquainted counterparts, we propose SealMates, a behavior-driven avatar in which the avatar infers the engagement level of the group based on collective gaze and speech patterns and then moves across interlocutors' windows in the video conferencing. By conducting a controlled experiment with 15 groups of triads, we found the avatar's movement encouraged people to experience more self-disclosure and made them perceive everyone was equally engaged in the conversation than when there was no behavior-driven avatar. We discuss how a behavior-driven avatar influences distributed members' perceptions and the implications of avatar-mediated communication for future platforms.
△ Less
Submitted 10 April, 2024;
originally announced April 2024.
The Empathic Metaverse: An Assistive Bioresponsive Platform For Emotional Experience Sharing
Authors:
Yun Suen Pai,
Mark Armstrong,
Kinga Skiers,
Anish Kundu,
Danyang Peng,
Yixin Wang,
Tamil Selvan Gunasekaran,
Chi-Lan Yang,
Kouta Minamizawa
Abstract:
The Metaverse is poised to be a future platform that redefines what it means to communicate, socialize, and interact with each other. Yet, it is important for us to consider avoiding the pitfalls of social media platforms we use today; cyberbullying, lack of transparency and an overall false mental model of society. In this paper, we propose the Empathic Metaverse, a virtual platform that prioriti…
▽ More
The Metaverse is poised to be a future platform that redefines what it means to communicate, socialize, and interact with each other. Yet, it is important for us to consider avoiding the pitfalls of social media platforms we use today; cyberbullying, lack of transparency and an overall false mental model of society. In this paper, we propose the Empathic Metaverse, a virtual platform that prioritizes emotional sharing for assistance. It aims to cultivate prosocial behaviour, either egoistically or altruistically, so that our future society can better feel for each other and assist one another. To achieve this, we propose the platform to be bioresponsive; it reacts and adapts to an individual's physiological and cognitive state and reflects this via carefully designed avatars, environments, and interactions. We explore this concept in terms of three research directions: bioresponsive avatars, mediated communications and assistive tools.
△ Less
Submitted 28 November, 2023;
originally announced November 2023.
