-
Risk of Harm in VR Dating from the Perspective of Women and LGBTQIA+ Stakeholders
Authors:
Devin Tebbe,
Meryem Barkallah,
Braeden Burger,
Douglas Zytko
Abstract:
Virtual reality (VR) dating introduces novel opportunities for romantic interactions, but it also raises concerns about new harms that typically occur separately in traditional dating apps and general-purpose social VR environments. Given the subjectivity in which VR dating experiences can be considered harmful it is imperative to involve user stakeholders in anticipating harms and formulating pre…
▽ More
Virtual reality (VR) dating introduces novel opportunities for romantic interactions, but it also raises concerns about new harms that typically occur separately in traditional dating apps and general-purpose social VR environments. Given the subjectivity in which VR dating experiences can be considered harmful it is imperative to involve user stakeholders in anticipating harms and formulating preventative designs. Towards this goal with conducted participatory design workshops with 17 stakeholders identified as women and/or LGBTQIA+; demographics that are at elevated risk of harm in online dating and social VR. Findings reveal that participants are concerned with two categories of harm in VR dating: those that occur through the transition of interaction across virtual and physical modalities, and harms stemming from expectations of sexual interaction in VR.
△ Less
Submitted 23 April, 2024;
originally announced May 2024.
-
Learning to Poison Large Language Models During Instruction Tuning
Authors:
Yao Qiang,
Xiangyu Zhou,
Saleh Zare Zade,
Mohammad Amin Roshani,
Douglas Zytko,
Dongxiao Zhu
Abstract:
The advent of Large Language Models (LLMs) has marked significant achievements in language processing and reasoning capabilities. Despite their advancements, LLMs face vulnerabilities to data poisoning attacks, where adversaries insert backdoor triggers into training data to manipulate outputs for malicious purposes. This work further identifies additional security risks in LLMs by designing a new…
▽ More
The advent of Large Language Models (LLMs) has marked significant achievements in language processing and reasoning capabilities. Despite their advancements, LLMs face vulnerabilities to data poisoning attacks, where adversaries insert backdoor triggers into training data to manipulate outputs for malicious purposes. This work further identifies additional security risks in LLMs by designing a new data poisoning attack tailored to exploit the instruction tuning process. We propose a novel gradient-guided backdoor trigger learning approach to identify adversarial triggers efficiently, ensuring an evasion of detection by conventional defenses while maintaining content integrity. Through experimental validation across various LLMs and tasks, our strategy demonstrates a high success rate in compromising model outputs; poisoning only 1\% of 4,000 instruction tuning samples leads to a Performance Drop Rate (PDR) of around 80\%. Our work highlights the need for stronger defenses against data poisoning attack, offering insights into safeguarding LLMs against these more sophisticated attacks. The source code can be found on this GitHub repository: https://github.com/RookieZxy/GBTL/blob/main/README.md.
△ Less
Submitted 20 February, 2024;
originally announced February 2024.
-
Human-AI Interaction for User Safety in Social Matching Apps: Involving Marginalized Users in Design
Authors:
Douglas Zytko,
Nicholas Furlo,
Hanan Aljasim
Abstract:
In this position paper we intend to advocate for participatory design methods and mobile social matching apps as ripe contexts for exploring novel human-AI interactions that benefit marginalized groups. Mobile social matching apps like Tinder and Bumble use AI to introduce users to each other for rapid face-to-face meetings. These user discoveries and subsequent interactions pose disproportionate…
▽ More
In this position paper we intend to advocate for participatory design methods and mobile social matching apps as ripe contexts for exploring novel human-AI interactions that benefit marginalized groups. Mobile social matching apps like Tinder and Bumble use AI to introduce users to each other for rapid face-to-face meetings. These user discoveries and subsequent interactions pose disproportionate risk of sexual violence and other harms to marginalized user demographics, specifically women and the LGBTQIA+ community. We want to extend the role of AI in these apps to keep users safe while they interact with strangers across online and offline modalities. To do this, we are using participatory design methods to empower women and LGBTQIA+ individuals to envision future human-AI interactions that prioritize their safety during social matching app-use. In one study, stakeholders identifying as LGBTQIA+ or women are redesigning dating apps to mediate exchange of sexual consent and therefore mitigate sexual violence. In the other study, women are designing multi-purpose, opportunistic social matching apps that foreground women's safety.
△ Less
Submitted 1 April, 2022;
originally announced April 2022.
-
Designing AI for Online-to-Offline Safety Risks with Young Women: The Context of Social Matching
Authors:
Douglas Zytko,
Hanan Aljasim
Abstract:
In this position paper we draw attention to safety risks against youth and young adults that originate through the combination of online and in-person interaction, and opportunities for AI to address these risks. Our context of study is social matching systems (e.g., Tinder, Bumble), which are used by young adults for online-to-offline interaction with strangers, and which are correlated with sexu…
▽ More
In this position paper we draw attention to safety risks against youth and young adults that originate through the combination of online and in-person interaction, and opportunities for AI to address these risks. Our context of study is social matching systems (e.g., Tinder, Bumble), which are used by young adults for online-to-offline interaction with strangers, and which are correlated with sexual violence both online and in-person. The paper presents early insights from an ongoing participatory AI design study in which young women build directly explainable models for detecting risk associated with discovered social opportunities, and articulate what AI should do once risk has been detected. We seek to advocate for participatory AI design as a way to directly incorporate youth and young adults into the design of a safer Internet. We also draw attention to challenges with the method.
△ Less
Submitted 1 April, 2022;
originally announced April 2022.
-
The...Tinderverse?: Opportunities and Challenges for User Safety in Extended Reality (XR) Dating Apps
Authors:
Sarath S. Shanker,
Douglas Zytko
Abstract:
Dating apps such as Tinder have announced plans for a dating metaverse: the incorporation of XR technologies into the online dating process to augment interactions between potential sexual partners across virtual and physical worlds. While the dating metaverse is still in conceptual stages we can forecast significant harms that it may expose daters to given prior research into the frequency and se…
▽ More
Dating apps such as Tinder have announced plans for a dating metaverse: the incorporation of XR technologies into the online dating process to augment interactions between potential sexual partners across virtual and physical worlds. While the dating metaverse is still in conceptual stages we can forecast significant harms that it may expose daters to given prior research into the frequency and severity of sexual harms facilitated by dating apps as well as harms within social VR environments. In this workshop paper we envision how XR could enrich virtual-to-physical interaction between potential sexual partners and outline harms that it will likely perpetuate as well. We then introduce our ongoing research to preempt such harms: a participatory design study with sexual violence experts and demographics at disproportionate risk of sexual violence to produce mitigative solutions to sexual violence perpetuated by XR-enabled dating apps.
△ Less
Submitted 6 May, 2022; v1 submitted 28 March, 2022;
originally announced March 2022.
-
Ethical Considerations When Constructing Participatory Design Protocols for Social Robots
Authors:
Douglas Zytko,
Wing-Yue Geoffrey Louie
Abstract:
Participatory design has emerged as a popular approach to foreground ethical considerations in social robots by incorporating anticipated users and stakeholders as designers. Here we draw attention to the ethics of participatory design as a method, distinct from the ethical considerations of the social robot being co-designed. More specifically, we consider the ethical concerns posed by the act of…
▽ More
Participatory design has emerged as a popular approach to foreground ethical considerations in social robots by incorporating anticipated users and stakeholders as designers. Here we draw attention to the ethics of participatory design as a method, distinct from the ethical considerations of the social robot being co-designed. More specifically, we consider the ethical concerns posed by the act of stakeholder participation - the morals and values that should be explicitly considered when we, as researchers or practitioners, devise protocols for participatory design of social robots ("how" stakeholders participate). We use the case of robot-assisted sexual violence mitigation to exemplify ethical considerations of participatory design protocols such as risk of harm, exploitation, and reduction of stakeholder agency. To incorporate these and other ethical considerations in the creation of social robot participatory design protocols, we advocate letting stakeholders design their own form of participation by including them in the creation of participatory design sessions, structures, and processes.
△ Less
Submitted 1 April, 2022; v1 submitted 19 March, 2022;
originally announced March 2022.
-
Designing Social VR: A Collection of Design Choices Across Commercial and Research Applications
Authors:
Ryan Handley,
Bert Guerra,
Rukkmini Goli,
Douglas Zytko
Abstract:
Social VR has experienced tremendous growth in the commercial space recently as an emerging technology for rich interactions themed around leisure, work, and relationship building. As a result, the state of social VR application design has become rapidly obfuscated, which complicates identification of design trends and uncommon features that could inform future design, and hinders inclusion of new…
▽ More
Social VR has experienced tremendous growth in the commercial space recently as an emerging technology for rich interactions themed around leisure, work, and relationship building. As a result, the state of social VR application design has become rapidly obfuscated, which complicates identification of design trends and uncommon features that could inform future design, and hinders inclusion of new voices in this design space. To help address this problem, we present a taxonomy of social VR application design choices as informed by 44 commercial and prototypical applications. Our taxonomy was informed by multiple discovery strategies including literature review, search of VR-themed subreddits, and autobiographical landscape research. The taxonomy elucidates various features across three design areas: the self, interaction, and the environment.
△ Less
Submitted 6 May, 2022; v1 submitted 6 January, 2022;
originally announced January 2022.
-
Immersive Stories for Health Information: Design Considerations from Binge Drinking in VR
Authors:
Douglas Zytko,
Zexin Ma,
Jacob Gleason,
Nathaniel Lundquist,
Medina Taylor
Abstract:
Immersive stories for health are 360-degree videos that intend to alter viewer perceptions about behaviors detrimental to health. They have potential to inform public health at scale, however, immersive story design is still in early stages and largely devoid of best practices. This paper presents a focus group study with 147 viewers of an immersive story about binge drinking experienced through V…
▽ More
Immersive stories for health are 360-degree videos that intend to alter viewer perceptions about behaviors detrimental to health. They have potential to inform public health at scale, however, immersive story design is still in early stages and largely devoid of best practices. This paper presents a focus group study with 147 viewers of an immersive story about binge drinking experienced through VR headsets and mobile phones. The objective of the study is to identify aspects of immersive story design that influence attitudes towards the health issue exhibited, and to understand how health information is consumed in immersive stories. Findings emphasize the need for an immersive story to provide reasoning behind character engagement in the focal health behavior, to show the main character clearly engaging in the behavior, and to enable viewers to experience escalating symptoms of the behavior before the penultimate health consequence. Findings also show how the design of supporting characters can inadvertently distract viewers and lead them to justify the detrimental behavior being exhibited. The paper concludes with design considerations for enabling immersive stories to better inform public perception of health issues.
△ Less
Submitted 25 June, 2021;
originally announced June 2021.
-
Computer-Mediated Consent to Sex: The Context of Tinder
Authors:
Douglas Zytko,
Nicholas Furlo,
Bailey Carlin,
Matthew Archer
Abstract:
This paper reports an interview study about how consent to sexual activity is computer-mediated. The study's context of online dating is chosen due to the prevalence of sexual violence, or nonconsensual sexual activity, that is associated with dating app-use. Participants (n=19) represent a range of gender identities and sexual orientations, and predominantly used the dating app Tinder. Findings r…
▽ More
This paper reports an interview study about how consent to sexual activity is computer-mediated. The study's context of online dating is chosen due to the prevalence of sexual violence, or nonconsensual sexual activity, that is associated with dating app-use. Participants (n=19) represent a range of gender identities and sexual orientations, and predominantly used the dating app Tinder. Findings reveal two computer-mediated consent processes: consent signaling and affirmative consent. With consent signaling, users employed Tinder's interface to infer and imply agreement to sex without any explicit confirmation before making sexual advances in-person. With affirmative consent, users employed the interface to establish patterns of overt discourse around sex and consent across online and offline modalities. The paper elucidates shortcomings of both computer-mediated consent processes that leave users susceptible to sexual violence and envisions dating apps as potential sexual violence prevention solutions if deliberately designed to mediate consent exchange.
△ Less
Submitted 15 May, 2021;
originally announced May 2021.
