-
Field Notes on Deploying Research Robots in Public Spaces
Authors:
Fanjun Bu,
Alexandra Bremers,
Mark Colley,
Wendy Ju
Abstract:
Human-robot interaction requires to be studied in the wild. In the summers of 2022 and 2023, we deployed two trash barrel service robots through the wizard-of-oz protocol in public spaces to study human-robot interactions in urban settings. We deployed the robots at two different public plazas in downtown Manhattan and Brooklyn for a collective of 20 hours of field time. To date, relatively few lo…
▽ More
Human-robot interaction requires to be studied in the wild. In the summers of 2022 and 2023, we deployed two trash barrel service robots through the wizard-of-oz protocol in public spaces to study human-robot interactions in urban settings. We deployed the robots at two different public plazas in downtown Manhattan and Brooklyn for a collective of 20 hours of field time. To date, relatively few long-term human-robot interaction studies have been conducted in shared public spaces. To support researchers aiming to fill this gap, we would like to share some of our insights and learned lessons that would benefit both researchers and practitioners on how to deploy robots in public spaces. We share best practices and lessons learned with the HRI research community to encourage more in-the-wild research of robots in public spaces and call for the community to share their lessons learned to a GitHub repository.
△ Less
Submitted 28 April, 2024;
originally announced April 2024.
-
Portobello: Extending Driving Simulation from the Lab to the Road
Authors:
Fanjun Bu,
Stacey Li,
David Goedicke,
Mark Colley,
Gyanendra Sharma,
Hiroshi Yasuda,
Wendy Ju
Abstract:
In automotive user interface design, testing often starts with lab-based driving simulators and migrates toward on-road studies to mitigate risks. Mixed reality (XR) helps translate virtual study designs to the real road to increase ecological validity. However, researchers rarely run the same study in both in-lab and on-road simulators due to the challenges of replicating studies in both physical…
▽ More
In automotive user interface design, testing often starts with lab-based driving simulators and migrates toward on-road studies to mitigate risks. Mixed reality (XR) helps translate virtual study designs to the real road to increase ecological validity. However, researchers rarely run the same study in both in-lab and on-road simulators due to the challenges of replicating studies in both physical and virtual worlds. To provide a common infrastructure to port in-lab study designs on-road, we built a platform-portable infrastructure, Portobello, to enable us to run twinned physical-virtual studies. As a proof-of-concept, we extended the on-road simulator XR-OOM with Portobello. We ran a within-subjects, autonomous-vehicle crosswalk cooperation study (N=32) both in-lab and on-road to investigate study design portability and platform-driven influences on study outcomes. To our knowledge, this is the first system that enables the twinning of studies originally designed for in-lab simulators to be carried out in an on-road platform.
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
Towards Sustainable Research Data Management in Human-Computer Interaction
Authors:
David Goedicke,
Mark Colley,
Sebastian S. Feger,
Michael Goedicke,
Bastian Pfleging,
Wendy Ju
Abstract:
We discuss important aspects of HCI research regarding Research Data Management (RDM) to achieve better publication processes and higher reuse of HCI research results. Various context elements of RDM for HCI are discussed, including examples of existing and emerging infrastructures for RDM. We briefly discuss existing approaches and come up with additional aspects which need to be addressed. This…
▽ More
We discuss important aspects of HCI research regarding Research Data Management (RDM) to achieve better publication processes and higher reuse of HCI research results. Various context elements of RDM for HCI are discussed, including examples of existing and emerging infrastructures for RDM. We briefly discuss existing approaches and come up with additional aspects which need to be addressed. This is to apply the so-called FAIR principle fully, which -- besides being findable and accessible -- also includes interoperability and reusability. We also discuss briefly the kind of research data types that play a role here and propose to build on existing work and involve the HCI scientific community to improve current practices.
△ Less
Submitted 19 July, 2023;
originally announced July 2023.
-
AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction Studies
Authors:
Pascal Jansen,
Julian Britten,
Alexander Häusele,
Thilo Segschneider,
Mark Colley,
Enrico Rukzio
Abstract:
Automotive user interface (AUI) evaluation becomes increasingly complex due to novel interaction modalities, driving automation, heterogeneous data, and dynamic environmental contexts. Immersive analytics may enable efficient explorations of the resulting multilayered interplay between humans, vehicles, and the environment. However, no such tool exists for the automotive domain. With AutoVis, we a…
▽ More
Automotive user interface (AUI) evaluation becomes increasingly complex due to novel interaction modalities, driving automation, heterogeneous data, and dynamic environmental contexts. Immersive analytics may enable efficient explorations of the resulting multilayered interplay between humans, vehicles, and the environment. However, no such tool exists for the automotive domain. With AutoVis, we address this gap by combining a non-immersive desktop with a virtual reality view enabling mixed-immersive analysis of AUIs. We identify design requirements based on an analysis of AUI research and domain expert interviews (N=5). AutoVis supports analyzing passenger behavior, physiology, spatial interaction, and events in a replicated study environment using avatars, trajectories, and heatmaps. We apply context portals and driving-path events as automotive-specific visualizations. To validate AutoVis against real-world analysis tasks, we implemented a prototype, conducted heuristic walkthroughs using authentic data from a case study and public datasets, and leveraged a real vehicle in the analysis process.
△ Less
Submitted 21 February, 2023;
originally announced February 2023.
-
AutoTherm: A Dataset and Benchmark for Thermal Comfort Estimation Indoors and in Vehicles
Authors:
Mark Colley,
Sebastian Hartwig,
Albin Zeqiri,
Timo Ropinski,
Enrico Rukzio
Abstract:
Thermal comfort inside buildings is a well-studied field where human judgment for thermal comfort is collected and may be used for automatic thermal comfort estimation. However, indoor scenarios are rather static in terms of thermal state changes and, thus, cannot be applied to dynamic conditions, e.g., inside a vehicle. In this work, we present our findings of a gap between building and in-vehicl…
▽ More
Thermal comfort inside buildings is a well-studied field where human judgment for thermal comfort is collected and may be used for automatic thermal comfort estimation. However, indoor scenarios are rather static in terms of thermal state changes and, thus, cannot be applied to dynamic conditions, e.g., inside a vehicle. In this work, we present our findings of a gap between building and in-vehicle scenarios regarding thermal comfort estimation. We provide evidence by comparing deep neural classifiers for thermal comfort estimation for indoor and in-vehicle conditions. Further, we introduce a temporal dataset for indoor predictions incorporating 31 input signals and self-labeled user ratings by 18 subjects in a self-built climatic chamber. For in-vehicle scenarios, we acquired a second dataset featuring human judgments from 20 subjects in a BMW 3 Series. Our experimental results indicate superior performance for estimations from time series data over single vector input. Leveraging modern machine learning architectures enables us to recognize human thermal comfort states and estimate future states automatically. We provide details on training a recurrent network-based classifier and perform an initial performance benchmark of the proposed dataset. Ultimately, we compare our collected dataset to publicly available thermal comfort datasets.
△ Less
Submitted 21 May, 2024; v1 submitted 15 November, 2022;
originally announced November 2022.
-
A Design Space for Human Sensor and Actuator Focused In-Vehicle Interaction Based on a Systematic Literature Review
Authors:
Pascal Jansen,
Mark Colley,
Enrico Rukzio
Abstract:
Automotive user interfaces constantly change due to increasing automation, novel features, additional applications, and user demands. While in-vehicle interaction can utilize numerous promising modalities, no existing overview includes an extensive set of human sensors and actuators and interaction locations throughout the vehicle interior. We conducted a systematic literature review of 327 public…
▽ More
Automotive user interfaces constantly change due to increasing automation, novel features, additional applications, and user demands. While in-vehicle interaction can utilize numerous promising modalities, no existing overview includes an extensive set of human sensors and actuators and interaction locations throughout the vehicle interior. We conducted a systematic literature review of 327 publications leading to a design space for in-vehicle interaction that outlines existing and lack of work regarding input and output modalities, locations, and multimodal interaction. To investigate user acceptance of possible modalities and locations inferred from existing work and gaps unveiled in our design space, we conducted an online study (N=48). The study revealed users' general acceptance of novel modalities (e.g., brain or thermal activity) and interaction with locations other than the front (e.g., seat or table). Our work helps practitioners evaluate key design decisions, exploit trends, and explore new areas in the domain of in-vehicle interaction.
△ Less
Submitted 22 October, 2022;
originally announced October 2022.
-
Exploring the Social Context of Collaborative Driving
Authors:
Mark Colley,
Sebastian Pickl,
Frank Uhlig,
Enrico Rukzio
Abstract:
The automation of the driving task affects both the primary driving task and the automotive user interfaces. The liberation of user interface space and cognitive load on the driver allows for new ways to think about driving. Related work showed that activities such as slee**, watching TV, or working will become more prevalent in the future. However, social aspects according to Maslow's hierarchy…
▽ More
The automation of the driving task affects both the primary driving task and the automotive user interfaces. The liberation of user interface space and cognitive load on the driver allows for new ways to think about driving. Related work showed that activities such as slee**, watching TV, or working will become more prevalent in the future. However, social aspects according to Maslow's hierarchy of needs have not yet been accounted for. We provide insights of a focus group with N=5 experts in automotive user experience revealing current practices such as social need fulfillment on journeys and sharing practices via messengers and a user study with N=12 participants of a first prototype supporting these needs in various automation levels showing good usability and high potential to improve user experience.
△ Less
Submitted 26 January, 2022;
originally announced January 2022.
-
Towards Reducing Energy Waste through Usage of External Communication of Autonomous Vehicles
Authors:
Mark Colley,
Marcel Walch,
Enrico Rukzio
Abstract:
Automated vehicles can implement strategies to drive with optimized fuel efficiency. Therefore, automated driving is seen as a major advancement in tackling climate change. However, with automated vehicles driving in cities and other areas rife with other road users such as human drivers, pedestrians, or cyclists, there is the potential for "stop-and-go" traffic. This would greatly diminish the po…
▽ More
Automated vehicles can implement strategies to drive with optimized fuel efficiency. Therefore, automated driving is seen as a major advancement in tackling climate change. However, with automated vehicles driving in cities and other areas rife with other road users such as human drivers, pedestrians, or cyclists, there is the potential for "stop-and-go" traffic. This would greatly diminish the possibility of automated vehicles to drive fuel-efficient. We suggest using external communication of automated vehicles to aid in ecological driving by providing clues to other road users to show the intent and therefore ultimately enable smoother traffic.
△ Less
Submitted 27 December, 2020;
originally announced December 2020.
-
Maximum Production of Transmission Messages Rate for Service Discovery Protocols
Authors:
Intisar Al-Mejibli,
Martin Colley
Abstract:
Minimizing the number of dropped User Datagram Protocol (UDP) messages in a network is regarded as a challenge by researchers. This issue represents serious problems for many protocols particularly those that depend on sending messages as part of their strategy, such us service discovery protocols. This paper proposes and evaluates an algorithm to predict the minimum period of time required betwee…
▽ More
Minimizing the number of dropped User Datagram Protocol (UDP) messages in a network is regarded as a challenge by researchers. This issue represents serious problems for many protocols particularly those that depend on sending messages as part of their strategy, such us service discovery protocols. This paper proposes and evaluates an algorithm to predict the minimum period of time required between two or more consecutive messages and suggests the minimum queue sizes for the routers, to manage the traffic and minimise the number of dropped messages that has been caused by either congestion or queue overflow or both together. The algorithm has been applied to the Universal Plug and Play (UPnP) protocol using ns2 simulator. It was tested when the routers were connected in two configurations; as a centralized and de centralized. The message length and bandwidth of the links among the routers were taken in the consideration. The result shows Better improvement in number of dropped messages `among the routers.
△ Less
Submitted 11 December, 2011;
originally announced December 2011.
