-
Hell is Paved with Good Intentions: The Intricate Relationship Between Cognitive Biases and Dark Patterns
Authors:
Thomas Mildner,
Albert Inkoom,
Rainer Malaka,
Jasmin Niess
Abstract:
Throughout the past decade, research in HCI has identified numerous instances of dark patterns in digital interfaces. These efforts have led to a well-fostered typology describing harmful strategies users struggle to navigate. However, an in-depth understanding of the underlying mechanisms that deceive, coerce, or manipulate users is missing. We explore the interplay between cognitive biases and d…
▽ More
Throughout the past decade, research in HCI has identified numerous instances of dark patterns in digital interfaces. These efforts have led to a well-fostered typology describing harmful strategies users struggle to navigate. However, an in-depth understanding of the underlying mechanisms that deceive, coerce, or manipulate users is missing. We explore the interplay between cognitive biases and dark patterns to address this gap. To that end, we conducted four focus groups with experts (N=15) in psychology and dark pattern scholarship, inquiring how they conceptualise the relation between cognitive biases and dark patterns. Based on our results, we constructed the "Relationship Model of Cognitive Biases and Dark Patterns" which illustrates how cognitive bias and deceptive design patterns relate and identifies opportune moments for ethical reconsideration and user protection mechanisms. Our insights contribute to the current discourse by emphasising ethical design decisions and their implications in the field of HCI.
△ Less
Submitted 12 May, 2024;
originally announced May 2024.
-
Finding a Way Through the Social Media Labyrinth: Guiding Design Through User Expectations
Authors:
Thomas Mildner,
Gian-Luca Savino,
Susanne Putze,
Rainer Malaka
Abstract:
Social networking services (SNS) have become integral to modern life to create and maintain meaningful relationships. Nevertheless, their historic growth of features has led to labyrinthine user interfaces (UIs) that often result in frustration among users - for instance, when trying to control privacy-related settings. This paper aims to mitigate labyrinthine UIs by studying users' expectations (…
▽ More
Social networking services (SNS) have become integral to modern life to create and maintain meaningful relationships. Nevertheless, their historic growth of features has led to labyrinthine user interfaces (UIs) that often result in frustration among users - for instance, when trying to control privacy-related settings. This paper aims to mitigate labyrinthine UIs by studying users' expectations (N=21) through an online card sorting exercise based on 58 common SNS UI features, teaching us about their expectations regarding the importance of specific UI features and the frequency with which they use them. Our findings offer a valuable understanding of the relationship between the importance and frequency of UI features and provide design considerations for six identified UI feature groups. Through these findings, we inform the design and development of user-centred alternatives to current SNS interfaces that enable users to successfully navigate SNS and feel in control over their data by meeting their expectations.
△ Less
Submitted 12 May, 2024;
originally announced May 2024.
-
The Interaction Fidelity Model: A Taxonomy to Distinguish the Aspects of Fidelity in Virtual Reality
Authors:
Michael Bonfert,
Thomas Muender,
Ryan P. McMahan,
Frank Steinicke,
Doug Bowman,
Rainer Malaka,
Tanja Döring
Abstract:
Fidelity describes how closely a replication resembles the original. It can be helpful to analyze how faithful interactions in virtual reality (VR) are to a reference interaction. In prior research, fidelity has been restricted to the simulation of reality - also called realism. Our definition includes other reference interactions, such as superpowers or fiction. Interaction fidelity is a multilay…
▽ More
Fidelity describes how closely a replication resembles the original. It can be helpful to analyze how faithful interactions in virtual reality (VR) are to a reference interaction. In prior research, fidelity has been restricted to the simulation of reality - also called realism. Our definition includes other reference interactions, such as superpowers or fiction. Interaction fidelity is a multilayered concept. Unfortunately, different aspects of fidelity have either not been distinguished in scientific discourse or referred to with inconsistent terminology. Therefore, we present the Interaction Fidelity Model (IntFi Model). Based on the human-computer interaction loop, it systematically covers all stages of VR interactions. The conceptual model establishes a clear structure and precise definitions of eight distinct components. It was reviewed through interviews with fourteen VR experts. We provide guidelines, diverse examples, and educational material to universally apply the IntFi Model to any VR experience. We identify common patterns and propose foundational research opportunities.
△ Less
Submitted 26 February, 2024;
originally announced February 2024.
-
Listening to the Voices: Describing Ethical Caveats of Conversational User Interfaces According to Experts and Frequent Users
Authors:
Thomas Mildner,
Orla Cooney,
Anna-Maria Meck,
Marion Bartl,
Gian-Luca Savino,
Philip R. Doyle,
Diego Garaialde,
Leigh Clark,
John Sloan,
Nina Wenig,
Rainer Malaka,
Jasmin Niess
Abstract:
Advances in natural language processing and understanding have led to a rapid growth in the popularity of conversational user interfaces (CUIs). While CUIs introduce novel benefits, they also yield risks that may exploit people's trust. Although research looking at unethical design deployed through graphical user interfaces (GUIs) established a thorough understanding of so-called dark patterns, th…
▽ More
Advances in natural language processing and understanding have led to a rapid growth in the popularity of conversational user interfaces (CUIs). While CUIs introduce novel benefits, they also yield risks that may exploit people's trust. Although research looking at unethical design deployed through graphical user interfaces (GUIs) established a thorough understanding of so-called dark patterns, there is a need to continue this discourse within the CUI community to understand potentially problematic interactions. Addressing this gap, we interviewed 27 participants from three cohorts: researchers, practitioners, and frequent users of CUIs. Applying thematic analysis, we construct five themes reflecting each cohort's insights about ethical design challenges and introduce the CUI Expectation Cycle, bridging system capabilities and user expectations while considering each theme's ethical caveats. This research aims to inform future development of CUIs to consider ethical constraints while adopting a human-centred approach.
△ Less
Submitted 26 January, 2024;
originally announced January 2024.
-
Defending Against the Dark Arts: Recognising Dark Patterns in Social Media
Authors:
Thomas Mildner,
Merle Freye,
Gian-Luca Savino,
Philip R. Doyle,
Benjamin R. Cowan,
Rainer Malaka
Abstract:
Interest in unethical user interfaces has grown in HCI over recent years, with researchers identifying malicious design strategies referred to as ''dark patterns''. While such strategies have been described in numerous domains, we lack a thorough understanding of how they operate in social networking services (SNSs). Pivoting towards regulations against such practices, we address this gap by offer…
▽ More
Interest in unethical user interfaces has grown in HCI over recent years, with researchers identifying malicious design strategies referred to as ''dark patterns''. While such strategies have been described in numerous domains, we lack a thorough understanding of how they operate in social networking services (SNSs). Pivoting towards regulations against such practices, we address this gap by offering novel insights into the types of dark patterns deployed in SNSs and people's ability to recognise them across four widely used mobile SNS applications. Following a cognitive walkthrough, experts (N=6) could identify instances of dark patterns in all four SNSs, including co-occurrences. Based on the results, we designed a novel rating procedure for evaluating the malice of interfaces. Our evaluation shows that regular users (N=193) could differentiate between interfaces featuring dark patterns and those without. Such rating procedures could support policymakers' current moves to regulate deceptive and manipulative designs in online interfaces.
△ Less
Submitted 22 May, 2023;
originally announced May 2023.
-
About Engaging and Governing Strategies: A Thematic Analysis of Dark Patterns in Social Networking Services
Authors:
Thomas Mildner,
Gian-Luca Savino,
Philip R. Doyle,
Benjamin R. Cowan,
Rainer Malaka
Abstract:
Research in HCI has shown a growing interest in unethical design practices across numerous domains, often referred to as ``dark patterns''. There is, however, a gap in related literature regarding social networking services (SNSs). In this context, studies emphasise a lack of users' self-determination regarding control over personal data and time spent on SNSs. We collected over 16 hours of screen…
▽ More
Research in HCI has shown a growing interest in unethical design practices across numerous domains, often referred to as ``dark patterns''. There is, however, a gap in related literature regarding social networking services (SNSs). In this context, studies emphasise a lack of users' self-determination regarding control over personal data and time spent on SNSs. We collected over 16 hours of screen recordings from Facebook's, Instagram's, TikTok's, and Twitter's mobile applications to understand how dark patterns manifest in these SNSs. For this task, we turned towards HCI experts to mitigate possible difficulties of non-expert participants in recognising dark patterns, as prior studies have noticed. Supported by the recordings, two authors of this paper conducted a thematic analysis based on previously described taxonomies, manually classifying the recorded material while delivering two key findings: We observed which instances occur in SNSs and identified two strategies - engaging and governing - with five dark patterns undiscovered before.
△ Less
Submitted 1 March, 2023;
originally announced March 2023.
-
"Seeing the Faces Is So Important" -- Experiences From Online Team Meetings on Commercial Virtual Reality Platforms
Authors:
Michael Bonfert,
Anke V. Reinschluessel,
Susanne Putze,
Yenchin Lai,
Dmitry Alexandrovsky,
Rainer Malaka,
Tanja Döring
Abstract:
During the Covid-19 pandemic, online meetings became common for daily teamwork in the home office. To understand the opportunities and challenges of meeting in virtual reality (VR) compared to video conferences, we conducted the weekly team meetings of our human-computer interaction research lab on five off-the-shelf online meeting platforms over four months. After each of the 12 meetings, we aske…
▽ More
During the Covid-19 pandemic, online meetings became common for daily teamwork in the home office. To understand the opportunities and challenges of meeting in virtual reality (VR) compared to video conferences, we conducted the weekly team meetings of our human-computer interaction research lab on five off-the-shelf online meeting platforms over four months. After each of the 12 meetings, we asked the participants (N = 32) to share their experiences, resulting in 200 completed online questionnaires. We evaluated the ratings of the overall meeting experience and conducted an exploratory factor analysis of the quantitative data to compare VR meetings and video calls in terms of meeting involvement and co-presence. In addition, a thematic analysis of the qualitative data revealed genuine insights covering five themes: spatial aspects, meeting atmosphere, expression of emotions, meeting productivity, and user needs. We reflect on our findings gained under authentic working conditions, derive lessons learned for running successful team meetings in VR supporting different kinds of meeting formats, and discuss the team's long-term platform choice.
△ Less
Submitted 23 January, 2023; v1 submitted 12 October, 2022;
originally announced October 2022.
-
Nutzungsverhalten und Funktionsanforderungen digitaler Trainingsanwendungen während der Pandemie
Authors:
Freya Pfau,
Johannes Pfau,
Bastian Dänekas,
Robert Porzel,
Rainer Malaka,
Melanie Krüger
Abstract:
Due to contact restrictions, closure of fitness centers and quarantine measures, the SARS-CoV-2 pandemic led to a considerable decline of sporting activities. The first relaxation of these restrictions allowed German citizens to mostly return to their normal training and exercise behavior, yet the long-term impact of the recurring measures (i.e. the "Lockdown", "Lockdown light" as well as the "Cor…
▽ More
Due to contact restrictions, closure of fitness centers and quarantine measures, the SARS-CoV-2 pandemic led to a considerable decline of sporting activities. The first relaxation of these restrictions allowed German citizens to mostly return to their normal training and exercise behavior, yet the long-term impact of the recurring measures (i.e. the "Lockdown", "Lockdown light" as well as the "Corona Emergency Break" in the case of Germany) remain rather under-investigated. Using a survey of (n=108) German sportspersons, we measured a significant decline of sporting activities even within the intermediary phases without major pandemic constraints. To evaluate the capabilities of digital training applications in countering these effects, we additionally recorded the usage of, among others, apps, trackers, videos and conferencing systems and identified the most important as well as missing and/or essential features with regards to their capabilities of facilitating individual sport and training in times without access to facilities or social contacts. Effectively, the usage of smart watches, online videos and conferences increased significantly when compared to before the pandemic; and especially online videos and conferences contributed to higher training frequencies. Data-driven or individual feedback, motivation and collaboration revealed to be the most important or even necessary functions for users of digital training applications to counter the decline of social components of training.
△ Less
Submitted 27 July, 2022;
originally announced July 2022.
-
Rules Of Engagement: Levelling Up To Combat Unethical CUI Design
Authors:
Thomas Mildner,
Philip Doyle,
Gian-Luca Savino,
Rainer Malaka
Abstract:
While a central goal of HCI has always been to create and develop interfaces that are easy to use, a deeper focus has been set more recently on designing interfaces more ethically. However, the exact meaning and measurement of ethical design has yet to be established both within the CUI community and among HCI researchers more broadly. In this provocation paper we propose a simplified methodology…
▽ More
While a central goal of HCI has always been to create and develop interfaces that are easy to use, a deeper focus has been set more recently on designing interfaces more ethically. However, the exact meaning and measurement of ethical design has yet to be established both within the CUI community and among HCI researchers more broadly. In this provocation paper we propose a simplified methodology to assess interfaces based on five dimensions taken from prior research on so-called dark patterns. As a result, our approach offers a numeric score to its users representing the manipulative nature of evaluated interfaces. It is hoped that the approach - which draws a distinction between persuasion and manipulative design, and focuses on how the latter functions rather than how it manifests - will provide a viable way for quantifying instances of unethical interface design that will prove useful to researchers, regulators and potentially even users.
△ Less
Submitted 19 July, 2022;
originally announced July 2022.
-
Towards Low-burden Responses to Open Questions in VR
Authors:
Dmitry Alexandrovsky,
Susanne Putze,
Alexander Schülke,
Rainer Malaka
Abstract:
Subjective self-reports in VR user studies is a burdening and often tedious task for the participants. To minimize the disruption with the ongoing experience VR research has started to administer the surveying directly inside the virtual environments. However, due to the tedious nature of text-entry in VR, most VR surveying tools focus on closed questions with predetermined responses, while open q…
▽ More
Subjective self-reports in VR user studies is a burdening and often tedious task for the participants. To minimize the disruption with the ongoing experience VR research has started to administer the surveying directly inside the virtual environments. However, due to the tedious nature of text-entry in VR, most VR surveying tools focus on closed questions with predetermined responses, while open questions with free-text responses remain unexplored. This neglects a crucial part of UX research. To provide guidance on suitable self-reporting methods for open questions in VR user studies, this position paper presents a comparative study with three text-entry methods in VR and outlines future directions towards low-burden qualitative responding.
△ Less
Submitted 24 April, 2021;
originally announced April 2021.
-
Evaluating User Experiences in Mixed Reality
Authors:
Dmitry Alexandrovsky,
Susanne Putze,
Valentin Schwind,
Elisa D. Mekler,
Jan David Smeddinck,
Denise Kahl,
Antonio Krüger,
Rainer Malaka
Abstract:
Measure user experience in MR (i.e., AR/VR) user studies is essential. Researchers apply a wide range of measuring methods using objective (e.g., biosignals, time logging), behavioral (e.g., gaze direction, movement amplitude), and subjective (e.g., standardized questionnaires) metrics. Many of these measurement instruments were adapted from use-cases outside of MR but have not been validated for…
▽ More
Measure user experience in MR (i.e., AR/VR) user studies is essential. Researchers apply a wide range of measuring methods using objective (e.g., biosignals, time logging), behavioral (e.g., gaze direction, movement amplitude), and subjective (e.g., standardized questionnaires) metrics. Many of these measurement instruments were adapted from use-cases outside of MR but have not been validated for usage in MR experiments. However, researchers are faced with various challenges and design alternatives when measuring immersive experiences. These challenges become even more diverse when running out-of-the lab studies. Measurement methods of VR experience recently received much attention. For example, research has started embedding questionnaires in the VE for various applications, allowing users to stay closer to the ongoing experience while filling out the survey. However, there is a diversity in the interaction methods and practices on how the assessment procedure is conducted. This diversity in methods underlines a missing shared agreement of standardized measurement tools for VR experiences. AR research strongly orients on the research methods from VR, e.g., using the same type of subjective questionnaires. However, some crucial technical differences require careful considerations during the evaluation. This workshop at CHI 2021 provides a foundation to exchange expertise and address challenges and opportunities of research methods in MR user studies. By this, our workshop launches a discussion of research methods that should lead to standardizing assessment methods in MR user studies. The outcomes of the workshop will be aggregated into a collective special issue journal article.
△ Less
Submitted 16 January, 2021;
originally announced January 2021.
-
Foundations of the Socio-physical Model of Activities (SOMA) for Autonomous Robotic Agents
Authors:
Daniel Beßler,
Robert Porzel,
Mihai Pomarlan,
Abhijit Vyas,
Sebastian Höffner,
Michael Beetz,
Rainer Malaka,
John Bateman
Abstract:
In this paper, we present foundations of the Socio-physical Model of Activities (SOMA). SOMA represents both the physical as well as the social context of everyday activities. Such tasks seem to be trivial for humans, however, they pose severe problems for artificial agents. For starters, a natural language command requesting something will leave many pieces of information necessary for performing…
▽ More
In this paper, we present foundations of the Socio-physical Model of Activities (SOMA). SOMA represents both the physical as well as the social context of everyday activities. Such tasks seem to be trivial for humans, however, they pose severe problems for artificial agents. For starters, a natural language command requesting something will leave many pieces of information necessary for performing the task unspecified. Humans can solve such problems fast as we reduce the search space by recourse to prior knowledge such as a connected collection of plans that describe how certain goals can be achieved at various levels of abstraction. Rather than enumerating fine-grained physical contexts SOMA sets out to include socially constructed knowledge about the functions of actions to achieve a variety of goals or the roles objects can play in a given situation. As the human cognition system is capable of generalizing experiences into abstract knowledge pieces applicable to novel situations, we argue that both physical and social context need be modeled to tackle these challenges in a general manner. This is represented by the link between the physical and social context in SOMA where relationships are established between occurrences and generalizations of them, which has been demonstrated in several use cases that validate SOMA.
△ Less
Submitted 24 November, 2020;
originally announced November 2020.
-
Towards Generating Virtual Movement from Textual Instructions A Case Study in Quality Assessment
Authors:
Himangshu Sarma,
Robert Porzel,
Jan Smeddinck,
Rainer Malaka
Abstract:
Many application areas ranging from serious games for health to learning by demonstration in robotics, could benefit from large body movement datasets extracted from textual instructions accompanied by images. The interpretation of instructions for the automatic generation of the corresponding motions (e.g. exercises) and the validation of these movements are difficult tasks. In this article we de…
▽ More
Many application areas ranging from serious games for health to learning by demonstration in robotics, could benefit from large body movement datasets extracted from textual instructions accompanied by images. The interpretation of instructions for the automatic generation of the corresponding motions (e.g. exercises) and the validation of these movements are difficult tasks. In this article we describe a first step towards achieving automated extraction. We have recorded five different exercises in random order with the help of seven amateur performers using a Kinect. During the recording, we found that the same exercise was interpreted differently by each human performer even though they were given identical textual instructions. We performed a quality assessment study based on that data using a crowdsourcing approach and tested the inter-rater agreement for different types of visualizations, where the RGBbased visualization showed the best agreement among the annotators.
△ Less
Submitted 6 June, 2020;
originally announced June 2020.
-
Pharos: improving navigation instructions on smartwatches by including global landmarks
Authors:
N. Wenig,
D. Wenig,
S. Ernst,
R. Malaka,
B. Hecht,
J. Schöning
Abstract:
Landmark-based navigation systems have proven benefits relative to traditional turn-by-turn systems that use street names and distances. However, one obstacle to the implementation of landmark-based navigation systems is the complex challenge of selecting salient local landmarks at each decision point for each user. In this paper, we present Pharos, a novel system that extends turn-by-turn navigat…
▽ More
Landmark-based navigation systems have proven benefits relative to traditional turn-by-turn systems that use street names and distances. However, one obstacle to the implementation of landmark-based navigation systems is the complex challenge of selecting salient local landmarks at each decision point for each user. In this paper, we present Pharos, a novel system that extends turn-by-turn navigation instructions using a single global landmark (e.g. the Eiffel Tower, the Burj Khalifa, municipal TV towers) rather than multiple, hard-to-select local landmarks. We first show that our approach is feasible in a large number of cities around the world through the use of computer vision to select global landmarks. We then present the results of a study demonstrating that by including global landmarks in navigation instructions, users navigate more confidently and build a more accurate mental map of the navigated area than using turn-by-turn instructions.
△ Less
Submitted 2 April, 2019;
originally announced April 2019.
