-
Applied User Research in Virtual Reality: Tools, Methods, and Challenges
Authors:
Leonie Bensch,
Andrea Casini,
Aidan Cowley,
Florian Dufresne,
Enrico Guerra,
Paul de Medeiros,
Tommy Nilsson,
Flavie Rometsch,
Andreas Treuer,
Anna Vock
Abstract:
This chapter explores the practice of conducting user research studies and design assessments in virtual reality (VR). An overview of key VR hardware and software tools is provided, including game engines, such as Unity and Unreal Engine. Qualitative and quantitative research methods, along with their various synergies with VR, are likewise discussed, and some of the challenges associated with VR,…
▽ More
This chapter explores the practice of conducting user research studies and design assessments in virtual reality (VR). An overview of key VR hardware and software tools is provided, including game engines, such as Unity and Unreal Engine. Qualitative and quantitative research methods, along with their various synergies with VR, are likewise discussed, and some of the challenges associated with VR, such as limited sensory stimulation, are reflected upon. VR is proving particularly useful in the context of space systems development, where its utilisation offers a cost-effective and secure method for simulating extraterrestrial environments, allowing for rapid prototy** and evaluation of innovative concepts under representative operational conditions. To illustrate this, we present a case study detailing the application of VR to aid aerospace engineers testing their ideas with end-users and stakeholders during early design stages of the European Space Agency's (ESA) prospective Argonaut lunar lander. This case study demonstrates the effectiveness of VR simulations in gathering important feedback concerning the operability of the Argonaut lander in poor lighting conditions as well as surfacing relevant ergonomics considerations and constraints. The chapter concludes by discussing the strengths and weaknesses associated with VR-based user studies and proposes future research directions, emphasising the necessity for novel VR interfaces to overcome existing technical limitations.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Touching the Moon: Leveraging Passive Haptics, Embodiment and Presence for Operational Assessments in Virtual Reality
Authors:
Florian Dufresne,
Tommy Nilsson,
Geoffrey Gorisse,
Enrico Guerra,
André Zenner,
Olivier Christmann,
Leonie Bensch,
Nikolai Anton Callus,
Aidan Cowley
Abstract:
Space agencies are in the process of drawing up carefully thought-out Concepts of Operations (ConOps) for future human missions on the Moon. These are typically assessed and validated through costly and logistically demanding analogue field studies. While interactive simulations in Virtual Reality (VR) offer a comparatively cost-effective alternative, they have faced criticism for lacking the fide…
▽ More
Space agencies are in the process of drawing up carefully thought-out Concepts of Operations (ConOps) for future human missions on the Moon. These are typically assessed and validated through costly and logistically demanding analogue field studies. While interactive simulations in Virtual Reality (VR) offer a comparatively cost-effective alternative, they have faced criticism for lacking the fidelity of real-world deployments. This paper explores the applicability of passive haptic interfaces in bridging the gap between simulated and real-world ConOps assessments. Leveraging passive haptic props (equipment mockup and astronaut gloves), we virtually recreated the Apollo 12 mission procedure and assessed it with experienced astronauts and other space experts. Quantitative and qualitative findings indicate that haptics increased presence and embodiment, thus improving perceived simulation fidelity and validity of user reflections. We conclude by discussing the potential role of passive haptic modalities in facilitating early-stage ConOps assessments for human endeavours on the Moon and beyond.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Designing for Human Operations on the Moon: Challenges and Opportunities of Navigational HUD Interfaces
Authors:
Leonie Bensch,
Tommy Nilsson,
Jan Wulkop,
Paul de Medeiros,
Nicolas Daniel Herzberger,
Michael Preutenborbeck,
Andreas Gerndt,
Frank Flemisch,
Florian Dufresne,
Georgia Albuquerque,
Aidan Cowley
Abstract:
Future crewed missions to the Moon will face significant environmental and operational challenges, posing risks to the safety and performance of astronauts navigating its inhospitable surface. Whilst head-up displays (HUDs) have proven effective in providing intuitive navigational support on Earth, the design of novel human-spaceflight solutions typically relies on costly and time-consuming analog…
▽ More
Future crewed missions to the Moon will face significant environmental and operational challenges, posing risks to the safety and performance of astronauts navigating its inhospitable surface. Whilst head-up displays (HUDs) have proven effective in providing intuitive navigational support on Earth, the design of novel human-spaceflight solutions typically relies on costly and time-consuming analogue deployments, leaving the potential use of lunar HUDs largely under-explored. This paper explores an alternative approach by simulating navigational HUD concepts in a high-fidelity Virtual Reality (VR) representation of the lunar environment. In evaluating these concepts with astronauts and other aerospace experts (n=25), our mixed methods study demonstrates the efficacy of simulated analogues in facilitating rapid design assessments of early-stage HUD solutions. We illustrate this by elaborating key design challenges and guidelines for future lunar HUDs. In reflecting on the limitations of our approach, we propose directions for future design exploration of human-machine interfaces for the Moon.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Well-being in isolation: Exploring artistic immersive virtual environments in a simulated lunar habitat to alleviate asthenia symptoms
Authors:
Grzegorz Pochwatko,
Wieslaw Kopec,
Justyna Swidrak,
Anna Jaskulska,
Kinga H. Skorupska,
Barbara Karpowicz,
Rafał Masłyk,
Maciej Grzeszczuk,
Steven Barnes,
Paulina Borkiewicz,
Paweł Kobyliński,
Michał Pabiś-Orzeszyna,
Robert Balas,
Jagoda Lazarek,
Florian Dufresne,
Leonie Bensch,
Tommy Nilsson
Abstract:
Revived interest in lunar and planetary exploration is heralding a new era for human spaceflight, characterized by frequent strain on astronaut's mental well-being, which stems from increased exposure to isolated, confined, and extreme (ICE) conditions. Whilst Immersive Virtual Reality (IVR) has been employed to facilitate self-help interventions to mitigate challenges caused by isolated environme…
▽ More
Revived interest in lunar and planetary exploration is heralding a new era for human spaceflight, characterized by frequent strain on astronaut's mental well-being, which stems from increased exposure to isolated, confined, and extreme (ICE) conditions. Whilst Immersive Virtual Reality (IVR) has been employed to facilitate self-help interventions to mitigate challenges caused by isolated environments in several domains, its applicability in support of future space expeditions remains largely unexplored. To address this limitation, we administered the use of distinct IVR environments to crew members (n=5) partaking in a simulated lunar habitat study. Utilizing a Bayesian approach to scrutinize small group data, we discovered a significant relationship between IVR usage and a reduction in perceived stress-related symptoms, particularly those associated with asthenia (syndrome often linked to chronic fatigue and weakness; a condition characterized by feelings of energy depletion or exhaustion that can be amplified in ICE conditions). The reductions were most prominent with the use of interactive virtual environments. The 'Aesthetic Realities' - virtual environments conceived as art exhibits - received exceptional praise from our participants. These environments mark a fascinating convergence of art and science, holding promise to mitigate effects related to isolation in spaceflight training and beyond.
△ Less
Submitted 15 November, 2023;
originally announced November 2023.
-
Augmented Reality in Service of Human Operations on the Moon: Insights from a Virtual Testbed
Authors:
Leonie Becker,
Tommy Nilsson,
Paul Topf Aguiar de Medeiros,
Flavie Rometsch
Abstract:
Future astronauts living and working on the Moon will face extreme environmental conditions impeding their operational safety and performance. While it has been suggested that Augmented Reality (AR) Head-Up Displays (HUDs) could potentially help mitigate some of these adversities, the applicability of AR in the unique lunar context remains underexplored. To address this limitation, we have produce…
▽ More
Future astronauts living and working on the Moon will face extreme environmental conditions impeding their operational safety and performance. While it has been suggested that Augmented Reality (AR) Head-Up Displays (HUDs) could potentially help mitigate some of these adversities, the applicability of AR in the unique lunar context remains underexplored. To address this limitation, we have produced an accurate representation of the lunar setting in virtual reality (VR) which then formed our testbed for the exploration of prospective operational scenarios with aerospace experts. Herein we present findings based on qualitative reflections made by the first 6 study participants. AR was found instrumental in several use cases, including the support of navigation and risk awareness. Major design challenges were likewise identified, including the importance of redundancy and contextual appropriateness. Drawing on these findings, we conclude by outlining directions for future research aimed at develo** AR-based assistive solutions tailored to the lunar setting.
△ Less
Submitted 19 March, 2023;
originally announced March 2023.
-
Using Virtual Reality to Shape Humanity's Return to the Moon: Key Takeaways from a Design Study
Authors:
Tommy Nilsson,
Flavie Rometsch,
Leonie Becker,
Florian Dufresne,
Paul de Medeiros,
Enrico Guerra,
Andrea E. M. Casini,
Anna Vock,
Florian Gaeremynck,
Aidan Cowley
Abstract:
Revived interest in lunar exploration is heralding a new generation of design solutions in support of human operations on the Moon. While space system design has traditionally been guided by prototype deployments in analogue studies, the resource-intensive nature of this approach has largely precluded application of proficient user-centered design (UCD) methods from human-computer interaction (HCI…
▽ More
Revived interest in lunar exploration is heralding a new generation of design solutions in support of human operations on the Moon. While space system design has traditionally been guided by prototype deployments in analogue studies, the resource-intensive nature of this approach has largely precluded application of proficient user-centered design (UCD) methods from human-computer interaction (HCI). This paper explores possible use of Virtual Reality (VR) to simulate analogue studies in lab settings and thereby bring to bear UCD in this otherwise engineering-dominated field. Drawing on the ongoing development of the European Large Logistics Lander, we have recreated a prospective lunar operational scenario in VR and evaluated it with a group of astronauts and space experts (n=20). Our qualitative findings demonstrate the efficacy of VR in facilitating UCD, enabling efficient contextual inquiries and improving project team coordination. We conclude by proposing future directions to further exploit VR in lunar systems design.
△ Less
Submitted 1 March, 2023;
originally announced March 2023.
-
Telerobotic Mars Mission for Lava Tube Exploration and Examination of Life
Authors:
Hanjo Schnellbaecher,
Florian Dufresne,
Tommy Nilsson,
Leonie Becker,
Oliver Bensch,
Enrico Guerra,
Wafa Sadri,
Vanessa Neumann
Abstract:
The general profile and overarching goal of this proposed mission is to pioneer potentially highly beneficial (even vital) and cost-effective techniques for the future human colonization of Mars. Adopting radically new and disruptive solutions untested in the Martian context, our approach is one of high risk and high reward. The real possibility of such a solution failing has prompted us to base o…
▽ More
The general profile and overarching goal of this proposed mission is to pioneer potentially highly beneficial (even vital) and cost-effective techniques for the future human colonization of Mars. Adopting radically new and disruptive solutions untested in the Martian context, our approach is one of high risk and high reward. The real possibility of such a solution failing has prompted us to base our mission architecture around a rover carrying a set of 6 distinct experimental payloads, each capable of operating independently on the others, thus substantially increasing the chances of the mission yielding some valuable findings. At the same time, we sought to exploit available synergies by assembling a combination of payloads that would together form a coherent experimental ecosystem, with each payload providing potential value to the others. Apart from providing such a testbed for evaluation of novel technological solutions, another aim of our proposed mission is to help generate scientific know-how enhancing our understanding of the Red Planet. To this end, our mission takes aim at the Nili-Fossae region, rich in natural resources (and carbonates in particular), past water repositories and signs of volcanic activity. With our proposed experimental payloads, we intend to explore existing lava-tubes, search for signs of past life and assess their potentially valuable geological features for future base building. We will evaluate biomatter in the form of plants and fungi as possible food and base-building materials respectively. Finally, we seek to explore a variety of novel power generation techniques using the Martian atmosphere and gravity. As detailed throughout the remainder of this chapter, this assemblage of experimental payloads, then, constitutes the backbone of our proposed telerobotic mission to Mars.
△ Less
Submitted 31 January, 2023;
originally announced February 2023.
-
Categorisation of future applications for Augmented Reality in human lunar exploration
Authors:
Paul Topf Aguiar de Medeiros,
Paul Njayou,
Flavie Rometsch,
Tommy Nilsson,
Leonie Becker,
Aidan Cowley
Abstract:
The European Space Agency (ESA) has a clear mission to go forward to the Moon in preparation of human presence on Mars. One of the technologies looked at to increase safety and efficiency of astronauts in this context is Augmented Reality (AR). This technology allows digital visual information to be overlaid onto the user's environment through some type of display or projector. In recent years sep…
▽ More
The European Space Agency (ESA) has a clear mission to go forward to the Moon in preparation of human presence on Mars. One of the technologies looked at to increase safety and efficiency of astronauts in this context is Augmented Reality (AR). This technology allows digital visual information to be overlaid onto the user's environment through some type of display or projector. In recent years separate studies have been conducted to test the potential value of AR for astronauts by implementing a few functionalities on an AR display followed by testing in terrestrial analogue environments. One of the groups contributing to these investigations is Spaceship EAC (SSEAC). SSEAC is a group of interns and trainees at the European Astronaut Centre (EAC) focusing on emerging technologies for human space exploration. This paper presents an outcome of SSEAC's activities related to AR for lunar extravehicular activities (EVAs), in which an approach similar to design thinking was used to explore, identify, and structure the opportunities offered by this technology. The resulting categorization of AR use cases can be used to identify new functionalities to test through prototy** and usability tests and can also be used to relate individual studies to each other to gain insight into the overall potential value AR has to offer to human lunar exploration. The approach adopted in this paper is based on the Fuzzy Front End (FFE) model from the innovation management domain. Utilising a user-driven instead of technology-driven method resulted in findings that are relevant irrespective of the hardware and software implementation. Instead, the outcome is an overview of use cases in which some type of AR system could provide value by contributing to increased astronaut safety, efficiency and/or efficacy.
△ Less
Submitted 19 November, 2022;
originally announced January 2023.
-
Electroencephalography (EEG), electromyography (EMG) and eye-tracking for astronaut training and space exploration
Authors:
Leonie Becker,
Tommy Nilsson,
Aidan Cowley
Abstract:
The ongoing push to send humans back to the Moon and to Mars is giving rise to a wide range of novel technical solutions in support of prospective astronaut expeditions. Against this backdrop, the European Space Agency (ESA) has recently launched an investigation into unobtrusive interface technologies as a potential answer to such challenges. Three particular technologies have shown promise in th…
▽ More
The ongoing push to send humans back to the Moon and to Mars is giving rise to a wide range of novel technical solutions in support of prospective astronaut expeditions. Against this backdrop, the European Space Agency (ESA) has recently launched an investigation into unobtrusive interface technologies as a potential answer to such challenges. Three particular technologies have shown promise in this regard: EEG-based brain-computer interfaces (BCI) provide a non-invasive method of utilizing recorded electrical activity of a user's brain, electromyography (EMG) enables monitoring of electrical signals generated by the user's muscle contractions, and finally, eye tracking enables, for instance, the tracking of user's gaze direction via camera recordings to convey commands. Beyond simply improving the usability of prospective technical solutions, our findings indicate that EMG, EEG, and eye-tracking could also serve to monitor and assess a variety of cognitive states, including attention, cognitive load, and mental fatigue of the user, while EMG could furthermore also be utilized to monitor the physical state of the astronaut. In this paper, we elaborate on the key strengths and challenges of these three enabling technologies, and in light of ESA's latest findings, we reflect on their applicability in the context of human space flight. Furthermore, a timeline of technological readiness is provided. In so doing, this paper feeds into the growing discourse on emerging technology and its role in paving the way for a human return to the Moon and expeditions beyond the Earth's orbit.
△ Less
Submitted 27 September, 2022;
originally announced December 2022.
-
Holistic Outpost Design for Lunar Lava Tubes
Authors:
Anna Vock,
Tommy Nilsson
Abstract:
As the space industry continues its rapid development, humanity is poised to expand beyond Low Earth Orbit (LEO), seeking to establish permanent presence on the Moon and beyond. While space travel has traditionally been the domain of a small number of highly specialized professionals, a new era of human exploration, involving non-space actors and stakeholders, is now becoming a reality. In spite o…
▽ More
As the space industry continues its rapid development, humanity is poised to expand beyond Low Earth Orbit (LEO), seeking to establish permanent presence on the Moon and beyond. While space travel has traditionally been the domain of a small number of highly specialized professionals, a new era of human exploration, involving non-space actors and stakeholders, is now becoming a reality. In spite of this development, most space habitats are still designed for a narrow target group. This paper seeks to address this deficit by rethinking the established design approaches, typically limited to tackling engineering and challenges of human space exploration (such as radiation or hypogravity), by instead adopting an interdisciplinary "big picture" perspective encompassing social, psychological and cultural aspects of future space habitats. By elaborating and reflecting on our concept, this paper seeks to demonstrate the importance of a trans-disciplinary approach to designing thriving sustainable colonies beyond LEO. We demonstrate the potentially key role of design as mediator in advancing macro-strategies promoting thriving existence and sustainable growth. With this approach we tackle big-picture questions about humanity's future and prospects amongst the stars.
△ Less
Submitted 19 October, 2022;
originally announced November 2022.
-
Using Virtual Reality to Design and Evaluate a Lunar Lander: The EL3 Case Study
Authors:
Tommy Nilsson,
Flavie Rometsch,
Andrea E. M. Casini,
Enrico Guerra,
Leonie Becker,
Andreas Treuer,
Paul de Medeiros,
Hanjo Schnellbaecher,
Anna Vock,
Aidan Cowley
Abstract:
The European Large Logistics Lander (EL3) is being designed to carry out cargo delivery missions in support of future lunar ground crews. The capacity of virtual reality (VR) to visualize and interactively simulate the unique lunar environment makes it a potentially powerful design tool during the early development stages of such solutions. Based on input from the EL3 development team, we have pro…
▽ More
The European Large Logistics Lander (EL3) is being designed to carry out cargo delivery missions in support of future lunar ground crews. The capacity of virtual reality (VR) to visualize and interactively simulate the unique lunar environment makes it a potentially powerful design tool during the early development stages of such solutions. Based on input from the EL3 development team, we have produced a VR-based operational scenario featuring a hypothetical configuration of the lander. Relying on HCI research methods, we have subsequently evaluated this scenario with relevant experts (n=10). Qualitative findings from this initial pilot study have demonstrated the usefulness of VR as a design tool in this context, but likewise surfaced a number of limitations in the form of potentially impaired validity and generalizability. We conclude by outlining our future research plan and reflect on the potential use of physical stimuli to improve the validity of VR-based simulations in forthcoming design activities.
△ Less
Submitted 25 March, 2022;
originally announced March 2022.
-
Visions, Values, and Videos: Revisiting Envisionings in Service of UbiComp Design for the Home
Authors:
Tommy Nilsson,
Joel E. Fischer,
Andy Crabtree,
Murray Goulden,
Jocelyn Spence,
Enrico Costanza
Abstract:
UbiComp has been envisioned to bring about a future dominated by calm computing technologies making our everyday lives ever more convenient. Yet the same vision has also attracted criticism for encouraging a solitary and passive lifestyle. The aim of this paper is to explore and elaborate these tensions further by examining the human values surrounding future domestic UbiComp solutions. Drawing on…
▽ More
UbiComp has been envisioned to bring about a future dominated by calm computing technologies making our everyday lives ever more convenient. Yet the same vision has also attracted criticism for encouraging a solitary and passive lifestyle. The aim of this paper is to explore and elaborate these tensions further by examining the human values surrounding future domestic UbiComp solutions. Drawing on envisioning and contravisioning, we probe members of the public (N=28) through the presentation and focus group discussion of two contrasting animated video scenarios, where one is inspired by "calm" and the other by "engaging" visions of future UbiComp technology. By analysing the reasoning of our participants, we identify and elaborate a number of relevant values involved in balancing the two perspectives. In conclusion, we articulate practically applicable takeaways in the form of a set of key design questions and challenges.
△ Less
Submitted 20 May, 2020; v1 submitted 16 May, 2020;
originally announced May 2020.
-
Immersive virtual worlds: Multi-sensory virtual environments for health and safety training
Authors:
Glyn Lawson,
Emily Shaw,
Tessa Roper,
Tommy Nilsson,
Laura Bajorunaite,
Ayesha Batool
Abstract:
Virtual environments (VEs) offer potential benefits to health and safety training: exposure to dangerous (virtual) environments; the opportunity for experiential learning; and a high level of control over the training, in that aspects can be repeated or reviewed based on the trainee's performance. However, VEs are typically presented as audiovisual (AV) systems, whereas engagement of other senses…
▽ More
Virtual environments (VEs) offer potential benefits to health and safety training: exposure to dangerous (virtual) environments; the opportunity for experiential learning; and a high level of control over the training, in that aspects can be repeated or reviewed based on the trainee's performance. However, VEs are typically presented as audiovisual (AV) systems, whereas engagement of other senses could increase the immersion in the virtual experience. Moreover, other senses play a key role in certain health and safety contexts, for example the feel of heat and smell in a fire or smell in a fuel leak. A multisensory (MS) VE was developed, which provided simulated heat and smell in accordance with events in a virtual world. As users approached a virtual fire, they felt heat from three 2 kW heaters and smelled smoke from a scent diffuser. Behaviours in the MS VE demonstrated higher validity than those in a comparable AV VE, which ratings and verbatim responses indicated was down to a greater belief that participants were in a real fire. However, a study of the effectiveness of the MS VE as a training tool demonstrated that it did not offer benefits over AV as measured by a written knowledge test and subjective ratings of engagement, attitude towards health and safety and desire to repeat. However, the study found further evidence for the use of AV VEs in health and safety training, particularly as the subjective ratings were generally better than for PowerPoint based training. Despite the lack of evidence for MS simulation on traditional measures of training, the different attitudes and experiences of users suggest that it may have value as a system for changing trainees' attitudes towards their personal safety and awareness. This view was supported by feedback from industrial partners.
△ Less
Submitted 1 October, 2019;
originally announced October 2019.
-
Breaching the Future: Understanding Human Challenges of Autonomous Systems for the Home
Authors:
Tommy Nilsson,
Andy Crabtree,
Joel Fischer,
Boriana Koleva
Abstract:
The domestic environment is a key area for the design and deployment of autonomous systems. Yet research indicates their adoption is already being hampered by a variety of critical issues including trust, privacy and security. This paper explores how potential users relate to the concept of autonomous systems in the home and elaborates further points of friction. It makes two contributions. One me…
▽ More
The domestic environment is a key area for the design and deployment of autonomous systems. Yet research indicates their adoption is already being hampered by a variety of critical issues including trust, privacy and security. This paper explores how potential users relate to the concept of autonomous systems in the home and elaborates further points of friction. It makes two contributions. One methodological, focusing on the use of provocative utopian and dystopian scenarios of future autonomous systems in the home. These are used to drive an innovative workshop-based approach to breaching experiments, which surfaces the usually tacit and unspoken background expectancies implicated in the organisation of everyday life that have a powerful impact on the acceptability of future and emerging technologies. The other contribution is substantive, produced through participants efforts to repair the incongruity or "reality disjuncture" created by utopian and dystopian visions, and highlights the need to build social as well as computational accountability into autonomous systems, and to enable coordination and control.
△ Less
Submitted 4 March, 2019;
originally announced March 2019.
-
The Heat is On: Exploring User Behaviour in a Multisensory Virtual Environment for Fire Evacuation
Authors:
Emily Shaw,
Tessa Roper,
Tommy Nilsson,
Glyn Lawson,
Sue V. G. Cobb,
Daniel Miller
Abstract:
Understanding validity of user behaviour in Virtual Environments (VEs) is critical as they are increasingly being used for serious Health and Safety applications such as predicting human behaviour and training in hazardous situations. This paper presents a comparative study exploring user behaviour in VE-based fire evacuation and investigates whether this is affected by the addition of thermal and…
▽ More
Understanding validity of user behaviour in Virtual Environments (VEs) is critical as they are increasingly being used for serious Health and Safety applications such as predicting human behaviour and training in hazardous situations. This paper presents a comparative study exploring user behaviour in VE-based fire evacuation and investigates whether this is affected by the addition of thermal and olfactory simulation. Participants (N=43) were exposed to a virtual fire in an office building. Quantitative and qualitative analyses of participant attitudes and behaviours found deviations from those we would expect in real life (e.g. pre-evacuation actions), but also valid behaviours like fire avoidance. Potentially important differences were found between multisensory and audiovisual-only conditions (e.g. perceived urgency). We conclude VEs have significant potential in safety-related applications, and that multimodality may afford additional uses in this context, but the identified limitations of behavioural validity must be carefully considered to avoid misapplication of the technology.
△ Less
Submitted 12 February, 2019;
originally announced February 2019.
-
I Probe, Therefore I Am: Designing a Virtual Journalist with Human Emotions
Authors:
Kevin K. Bowden,
Tommy Nilsson,
Christine P. Spencer,
Kubra Cengiz,
Alexandru Ghitulescu,
Jelte B. van Waterschoot
Abstract:
By utilizing different communication channels, such as verbal language, gestures or facial expressions, virtually embodied interactive humans hold a unique potential to bridge the gap between human-computer interaction and actual interhuman communication. The use of virtual humans is consequently becoming increasingly popular in a wide range of areas where such a natural communication might be ben…
▽ More
By utilizing different communication channels, such as verbal language, gestures or facial expressions, virtually embodied interactive humans hold a unique potential to bridge the gap between human-computer interaction and actual interhuman communication. The use of virtual humans is consequently becoming increasingly popular in a wide range of areas where such a natural communication might be beneficial, including entertainment, education, mental health research and beyond. Behind this development lies a series of technological advances in a multitude of disciplines, most notably natural language processing, computer vision, and speech synthesis. In this paper we discuss a Virtual Human Journalist, a project employing a number of novel solutions from these disciplines with the goal to demonstrate their viability by producing a humanoid conversational agent capable of naturally eliciting and reacting to information from a human user. A set of qualitative and quantitative evaluation sessions demonstrated the technical feasibility of the system whilst uncovering a number of deficits in its capacity to engage users in a way that would be perceived as natural and emotionally engaging. We argue that naturalness should not always be seen as a desirable goal and suggest that deliberately suppressing the naturalness of virtual human interactions, such as by altering its personality cues, might in some cases yield more desirable results.
△ Less
Submitted 18 May, 2017;
originally announced May 2017.
-
Smart Spaces: Challenges and Opportunities of BLE-Centered Mobile Systems for Public Environments
Authors:
Tommy Nilsson
Abstract:
The application of mobile computing is currently altering patterns of our behavior to a greater degree than perhaps any other invention. In combination with the introduction of BLE (Bluetooth Low Energy) and similar technologies enabling context-awareness, designers are today finding themselves empowered to build experiences and facilitate interactions with our physical surroundings in ways not po…
▽ More
The application of mobile computing is currently altering patterns of our behavior to a greater degree than perhaps any other invention. In combination with the introduction of BLE (Bluetooth Low Energy) and similar technologies enabling context-awareness, designers are today finding themselves empowered to build experiences and facilitate interactions with our physical surroundings in ways not possible before. The aim of this thesis is to present a research project, currently underway at the University of Cambridge, which is dealing with implementation of a BLE system into a museum environment. By assessing the technology, describing the design decisions as well as presenting a qualitative evaluation, this paper seeks to provide insight into some of the challenges and possible solutions connected to the process of develo** ubiquitous BLE computing systems for public spaces. The project outcome revealed the potential use of BLE to engage whole new groups of audiences as well as made me argue in favor of a more seamful approach to the design of these systems.
△ Less
Submitted 25 March, 2017;
originally announced March 2017.
-
Exploring the Pathways of Adaptation an Avatar 3D Animation Procedures and Virtual Reality Arenas in Research of Human Courtship Behaviour and Sexual Reactivity in Psychological Research
Authors:
Jakub Binter,
Kateřina Klapilová,
Tereza Zikánová,
Tommy Nilsson,
Klára Bártová,
Lucie Krejcová,
Renata Androvicová,
Jitka Lindová,
Denisa Prušová,
Timothy Wells,
Daniel Riha
Abstract:
There are many reasons for utilising 3D animation and virtual reality in sexuality research. Apart from providing a mean with which to (re)experience certain situations there are four main advantages: a) bespoke animated stimuli can be created and customized, which is especially important when researching paraphilia and sexual preferences, b) stimulus production is less expensive and easier to pro…
▽ More
There are many reasons for utilising 3D animation and virtual reality in sexuality research. Apart from providing a mean with which to (re)experience certain situations there are four main advantages: a) bespoke animated stimuli can be created and customized, which is especially important when researching paraphilia and sexual preferences, b) stimulus production is less expensive and easier to produce compared to real world stimuli, c) virtual reality allows us to capture data such as physiological reasons to stimuli, that we would not be able to otherwise (without resorting to self-report measures which are especially problematic in this research domain), d) ethical, legal, and health and safety issues are less complex since neither physical nor psychological harm is caused to animated characters allowing for the safe presentation of stimuli involving vulnerable targets. The animation sub-group has been exploring so far several production quality levels and various animation procedures in a number of available software. The aim is to develop static as well as dynamic, interactive sexual stimuli for sexual diagnostic and therapeutic purposes. We are aware of number of ethical issues related to the use of virtual reality in proposed research are analysed in this chapter.
△ Less
Submitted 6 November, 2016;
originally announced November 2016.
-
Ghosts! A Location-Based Bluetooth LE Mobile Game for Museum Exploration
Authors:
Tommy Nilsson,
Alan Blackwell,
Carl Hogsden,
David Scruton
Abstract:
BLE (Bluetooth Low Energy) is a new wireless communication technology that, thanks to reduced power consumption, promises to facilitate communication between computing devices and help us harness their power in environments and contexts previously untouched by information technology. Museums and other facilities housing various cultural content are a particularly interesting area of application. T…
▽ More
BLE (Bluetooth Low Energy) is a new wireless communication technology that, thanks to reduced power consumption, promises to facilitate communication between computing devices and help us harness their power in environments and contexts previously untouched by information technology. Museums and other facilities housing various cultural content are a particularly interesting area of application. The University of Cambridge Museums consortium has put considerable effort into researching the potential uses of emerging technologies such as BLE to unlock new experiences enriching the way we engage with cultural information. As a part of this research initiative, our ambition has been to examine the challenges and opportunities introduced by the introduction of a BLE-centred system into the museum context. We present an assessment of the potential offered by this technology and of the design approaches that might yield the best results when develo** BLE-centred experiences for museum environments. A pivotal part of our project consisted of designing, develo** and evaluating a prototype mobile location-based BLE-centred game. A number of technical problems, such as unstable and fluctuating signal strength, were encountered throughout the project lifecycle. Instead of attempting to eliminate such problems, we argued in favour of embracing them and turning them into a cornerstone of the gameplay. Our study suggested that this alternative seamful design approach yields particularly good results when deploying the technology in public environments. The project outcome also demonstrated the potential of BLE-centred solutions to reach out and engage new demographics, especially children, extending their interest in museum visits.
△ Less
Submitted 19 July, 2016;
originally announced July 2016.
-
Applying Seamful Design in Location-based Mobile Museum Applications
Authors:
Tommy Nilsson,
Carl Hogsden,
Charith Perera,
Saeed Aghaee,
David Scruton,
Andreas Lund,
Alan F. Blackwell
Abstract:
The application of mobile computing is currently altering patterns of our behavior to a greater degree than perhaps any other invention. In combination with the introduction of power efficient wireless communication technologies, such as Bluetooth Low Energy (BLE), designers are today increasingly empowered to shape the way we interact with our physical surroundings and thus build entirely new exp…
▽ More
The application of mobile computing is currently altering patterns of our behavior to a greater degree than perhaps any other invention. In combination with the introduction of power efficient wireless communication technologies, such as Bluetooth Low Energy (BLE), designers are today increasingly empowered to shape the way we interact with our physical surroundings and thus build entirely new experiences. However, our evaluations of BLE and its abilities to facilitate mobile location-based experiences in public environments revealed a number of potential problems. Most notably, the position and orientation of the user in combination with various environmental factors, such as crowds of people traversing the space, were found to cause major fluctuations of the received BLE signal strength. These issues are rendering a seamless functioning of any location-based application practically impossible. Instead of achieving seamlessness by eliminating these technical issues, we thus choose to advocate the use of a seamful approach, i.e. to reveal and exploit these problems and turn them into a part of the actual experience. In order to demonstrate the viability of this approach, we designed, implemented and evaluated the Ghost Detector - an educational location-based museum game for children. By presenting a qualitative evaluation of this game and by motivating our design decisions, this paper provides insight into some of the challenges and possible solutions connected to the process of develo** location-based BLE-enabled experiences for public cultural spaces.
△ Less
Submitted 8 June, 2016; v1 submitted 18 May, 2016;
originally announced May 2016.
