Showing 1–14 of 14 results for author: Shelby, R

Understanding Help-Seeking and Help-Giving on Social Media for Image-Based Sexual Abuse

Authors: Miranda Wei, Sunny Consolvo, Patrick Gage Kelley, Tadayoshi Kohno, Tara Matthews, Sarah Meiklejohn, Franziska Roesner, Renee Shelby, Kurt Thomas, Rebecca Umbach

Abstract: Image-based sexual abuse (IBSA), like other forms of technology-facilitated abuse, is a growing threat to people's digital safety. Attacks include unwanted solicitations for sexually explicit images, extorting people under threat of leaking their images, or purposefully leaking images to enact revenge or exert control. In this paper, we explore how people seek and receive help for IBSA on social m… ▽ More Image-based sexual abuse (IBSA), like other forms of technology-facilitated abuse, is a growing threat to people's digital safety. Attacks include unwanted solicitations for sexually explicit images, extorting people under threat of leaking their images, or purposefully leaking images to enact revenge or exert control. In this paper, we explore how people seek and receive help for IBSA on social media. Specifically, we identify over 100,000 Reddit posts that engage relationship and advice communities for help related to IBSA. We draw on a stratified sample of 261 posts to qualitatively examine how various types of IBSA unfold, including the map** of gender, relationship dynamics, and technology involvement to different types of IBSA. We also explore the support needs of victim-survivors experiencing IBSA and how communities help victim-survivors navigate their abuse through technical, emotional, and relationship advice. Finally, we highlight sociotechnical gaps in connecting victim-survivors with important care, regardless of whom they turn to for help. △ Less

Submitted 17 June, 2024; originally announced June 2024.

Comments: 18 pages, 4 figures, 8 tables, 103 references

ACM Class: K.4.2; H.4.3; J.4

Journal ref: Proceedings of the 33rd USENIX Security Symposium (USENIX Security 2024)

The Ethics of Advanced AI Assistants

Authors: Iason Gabriel, Arianna Manzini, Geoff Keeling, Lisa Anne Hendricks, Verena Rieser, Hasan Iqbal, Nenad Tomašev, Ira Ktena, Zachary Kenton, Mikel Rodriguez, Seliem El-Sayed, Sasha Brown, Canfer Akbulut, Andrew Trask, Edward Hughes, A. Stevie Bergman, Renee Shelby, Nahema Marchal, Conor Griffin, Juan Mateos-Garcia, Laura Weidinger, Winnie Street, Benjamin Lange, Alex Ingerman, Alison Lentz , et al. (32 additional authors not shown)

Abstract: This paper focuses on the opportunities and the ethical and societal risks posed by advanced AI assistants. We define advanced AI assistants as artificial agents with natural language interfaces, whose function is to plan and execute sequences of actions on behalf of a user, across one or more domains, in line with the user's expectations. The paper starts by considering the technology itself, pro… ▽ More This paper focuses on the opportunities and the ethical and societal risks posed by advanced AI assistants. We define advanced AI assistants as artificial agents with natural language interfaces, whose function is to plan and execute sequences of actions on behalf of a user, across one or more domains, in line with the user's expectations. The paper starts by considering the technology itself, providing an overview of AI assistants, their technical foundations and potential range of applications. It then explores questions around AI value alignment, well-being, safety and malicious uses. Extending the circle of inquiry further, we next consider the relationship between advanced AI assistants and individual users in more detail, exploring topics such as manipulation and persuasion, anthropomorphism, appropriate relationships, trust and privacy. With this analysis in place, we consider the deployment of advanced assistants at a societal scale, focusing on cooperation, equity and access, misinformation, economic impact, the environment and how best to evaluate advanced AI assistants. Finally, we conclude by providing a range of recommendations for researchers, developers, policymakers and public stakeholders. △ Less

Submitted 28 April, 2024; v1 submitted 24 April, 2024; originally announced April 2024.

Harm Amplification in Text-to-Image Models

Authors: Susan Hao, Renee Shelby, Yuchi Liu, Hansa Srinivasan, Mukul Bhutani, Burcu Karagol Ayan, Ryan Poplin, Shivani Poddar, Sarah Laszlo

Abstract: Text-to-image (T2I) models have emerged as a significant advancement in generative AI; however, there exist safety concerns regarding their potential to produce harmful image outputs even when users input seemingly safe prompts. This phenomenon, where T2I models generate harmful representations that were not explicit in the input, poses a potentially greater risk than adversarial prompts, leaving… ▽ More Text-to-image (T2I) models have emerged as a significant advancement in generative AI; however, there exist safety concerns regarding their potential to produce harmful image outputs even when users input seemingly safe prompts. This phenomenon, where T2I models generate harmful representations that were not explicit in the input, poses a potentially greater risk than adversarial prompts, leaving users unintentionally exposed to harms. Our paper addresses this issue by formalizing a definition for this phenomenon which we term harm amplification. We further contribute to the field by develo** a framework of methodologies to quantify harm amplification in which we consider the harm of the model output in the context of user input. We then empirically examine how to apply these different methodologies to simulate real-world deployment scenarios including a quantification of disparate impacts across genders resulting from harm amplification. Together, our work aims to offer researchers tools to comprehensively address safety challenges in T2I systems and contribute to the responsible deployment of generative AI models. △ Less

Submitted 17 May, 2024; v1 submitted 1 February, 2024; originally announced February 2024.

How Knowledge Workers Think Generative AI Will (Not) Transform Their Industries

Authors: Allison Woodruff, Renee Shelby, Patrick Gage Kelley, Steven Rousso-Schindler, Jamila Smith-Loud, Lauren Wilcox

Abstract: Generative AI is expected to have transformative effects in multiple knowledge industries. To better understand how knowledge workers expect generative AI may affect their industries in the future, we conducted participatory research workshops for seven different industries, with a total of 54 participants across three US cities. We describe participants' expectations of generative AI's impact, in… ▽ More Generative AI is expected to have transformative effects in multiple knowledge industries. To better understand how knowledge workers expect generative AI may affect their industries in the future, we conducted participatory research workshops for seven different industries, with a total of 54 participants across three US cities. We describe participants' expectations of generative AI's impact, including a dominant narrative that cut across the groups' discourse: participants largely envision generative AI as a tool to perform menial work, under human review. Participants do not generally anticipate the disruptive changes to knowledge industries currently projected in common media and academic narratives. Participants do however envision generative AI may amplify four social forces currently sha** their industries: deskilling, dehumanization, disconnection, and disinformation. We describe these forces, and then we provide additional detail regarding attitudes in specific knowledge industries. We conclude with a discussion of implications and research challenges for the HCI community. △ Less

Submitted 20 March, 2024; v1 submitted 10 October, 2023; originally announced October 2023.

Comments: 26 pages, 5 tables, 3 figures

ACM Class: K.4.1; K.4.2; K.4.3

Journal ref: ACM CHI Conference on Human Factors in Computing Systems, CHI '24, May 11-16, 2024, Honolulu, HI, USA

Beyond the ML Model: Applying Safety Engineering Frameworks to Text-to-Image Development

Authors: Shalaleh Rismani, Renee Shelby, Andrew Smart, Renelito Delos Santos, AJung Moon, Negar Rostamzadeh

Abstract: Identifying potential social and ethical risks in emerging machine learning (ML) models and their applications remains challenging. In this work, we applied two well-established safety engineering frameworks (FMEA, STPA) to a case study involving text-to-image models at three stages of the ML product development pipeline: data processing, integration of a T2I model with other models, and use. Resu… ▽ More Identifying potential social and ethical risks in emerging machine learning (ML) models and their applications remains challenging. In this work, we applied two well-established safety engineering frameworks (FMEA, STPA) to a case study involving text-to-image models at three stages of the ML product development pipeline: data processing, integration of a T2I model with other models, and use. Results of our analysis demonstrate the safety frameworks - both of which are not designed explicitly examine social and ethical risks - can uncover failure and hazards that pose social and ethical risks. We discovered a broad range of failures and hazards (i.e., functional, social, and ethical) by analyzing interactions (i.e., between different ML models in the product, between the ML product and user, and between development teams) and processes (i.e., preparation of training data or workflows for using an ML service/product). Our findings underscore the value and importance of examining beyond an ML model in examining social and ethical risks, especially when we have minimal information about an ML model. △ Less

Submitted 18 July, 2023; originally announced July 2023.

Safety and Fairness for Content Moderation in Generative Models

Authors: Susan Hao, Piyush Kumar, Sarah Laszlo, Shivani Poddar, Bhaktipriya Radharapu, Renee Shelby

Abstract: With significant advances in generative AI, new technologies are rapidly being deployed with generative components. Generative models are typically trained on large datasets, resulting in model behaviors that can mimic the worst of the content in the training data. Responsible deployment of generative technologies requires content moderation strategies, such as safety input and output filters. Her… ▽ More With significant advances in generative AI, new technologies are rapidly being deployed with generative components. Generative models are typically trained on large datasets, resulting in model behaviors that can mimic the worst of the content in the training data. Responsible deployment of generative technologies requires content moderation strategies, such as safety input and output filters. Here, we provide a theoretical framework for conceptualizing responsible content moderation of text-to-image generative technologies, including a demonstration of how to empirically measure the constructs we enumerate. We define and distinguish the concepts of safety, fairness, and metric equity, and enumerate example harms that can come in each domain. We then provide a demonstration of how the defined harms can be quantified. We conclude with a summary of how the style of harms quantification we demonstrate enables data-driven content moderation decisions. △ Less

Submitted 8 June, 2023; originally announced June 2023.

Comments: CVPR Workshop Paper

AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asia

Authors: Rida Qadri, Renee Shelby, Cynthia L. Bennett, Remi Denton

Abstract: This paper presents a community-centered study of cultural limitations of text-to-image (T2I) models in the South Asian context. We theorize these failures using scholarship on dominant media regimes of representations and locate them within participants' reporting of their existing social marginalizations. We thus show how generative AI can reproduce an outsiders gaze for viewing South Asian cu… ▽ More This paper presents a community-centered study of cultural limitations of text-to-image (T2I) models in the South Asian context. We theorize these failures using scholarship on dominant media regimes of representations and locate them within participants' reporting of their existing social marginalizations. We thus show how generative AI can reproduce an outsiders gaze for viewing South Asian cultures, shaped by global and regional power inequities. By centering communities as experts and soliciting their perspectives on T2I limitations, our study adds rich nuance into existing evaluative frameworks and deepens our understanding of the culturally-specific ways AI technologies can fail in non-Western and Global South settings. We distill lessons for responsible development of T2I models, recommending concrete pathways forward that can allow for recognition of structural inequalities. △ Less

Submitted 19 May, 2023; originally announced May 2023.

Journal ref: 2023 ACM Conference on Fairness, Accountability, and Transparency (FAccT '23)

PaLM 2 Technical Report

Authors: Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yan** Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yu**g Zhang, Gustavo Hernandez Abrego , et al. (103 additional authors not shown)

Abstract: We introduce PaLM 2, a new state-of-the-art language model that has better multilingual and reasoning capabilities and is more compute-efficient than its predecessor PaLM. PaLM 2 is a Transformer-based model trained using a mixture of objectives. Through extensive evaluations on English and multilingual language, and reasoning tasks, we demonstrate that PaLM 2 has significantly improved quality on… ▽ More We introduce PaLM 2, a new state-of-the-art language model that has better multilingual and reasoning capabilities and is more compute-efficient than its predecessor PaLM. PaLM 2 is a Transformer-based model trained using a mixture of objectives. Through extensive evaluations on English and multilingual language, and reasoning tasks, we demonstrate that PaLM 2 has significantly improved quality on downstream tasks across different model sizes, while simultaneously exhibiting faster and more efficient inference compared to PaLM. This improved efficiency enables broader deployment while also allowing the model to respond faster, for a more natural pace of interaction. PaLM 2 demonstrates robust reasoning capabilities exemplified by large improvements over PaLM on BIG-Bench and other reasoning tasks. PaLM 2 exhibits stable performance on a suite of responsible AI evaluations, and enables inference-time control over toxicity without additional overhead or impact on other capabilities. Overall, PaLM 2 achieves state-of-the-art performance across a diverse set of tasks and capabilities. When discussing the PaLM 2 family, it is important to distinguish between pre-trained models (of various sizes), fine-tuned variants of these models, and the user-facing products that use these models. In particular, user-facing products typically include additional pre- and post-processing steps. Additionally, the underlying models may evolve over time. Therefore, one should not expect the performance of user-facing products to exactly match the results reported in this report. △ Less

Submitted 13 September, 2023; v1 submitted 17 May, 2023; originally announced May 2023.

Sociotechnical Harms of Algorithmic Systems: Sco** a Taxonomy for Harm Reduction

Authors: Renee Shelby, Shalaleh Rismani, Kathryn Henne, AJung Moon, Negar Rostamzadeh, Paul Nicholas, N'Mah Yilla, Jess Gallegos, Andrew Smart, Emilio Garcia, Gurleen Virk

Abstract: Understanding the landscape of potential harms from algorithmic systems enables practitioners to better anticipate consequences of the systems they build. It also supports the prospect of incorporating controls to help minimize harms that emerge from the interplay of technologies and social and cultural dynamics. A growing body of scholarship has identified a wide range of harms across different a… ▽ More Understanding the landscape of potential harms from algorithmic systems enables practitioners to better anticipate consequences of the systems they build. It also supports the prospect of incorporating controls to help minimize harms that emerge from the interplay of technologies and social and cultural dynamics. A growing body of scholarship has identified a wide range of harms across different algorithmic technologies. However, computing research and practitioners lack a high level and synthesized overview of harms from algorithmic systems. Based on a sco** review of computing research $(n=172)$, we present an applied taxonomy of sociotechnical harms to support a more systematic surfacing of potential harms in algorithmic systems. The final taxonomy builds on and refers to existing taxonomies, classifications, and terminologies. Five major themes related to sociotechnical harms - representational, allocative, quality-of-service, interpersonal harms, and social system/societal harms - and sub-themes are presented along with a description of these categories. We conclude with a discussion of challenges and opportunities for future research. △ Less

Submitted 18 July, 2023; v1 submitted 11 October, 2022; originally announced October 2022.

From plane crashes to algorithmic harm: applicability of safety engineering frameworks for responsible ML

Authors: Shalaleh Rismani, Renee Shelby, Andrew Smart, Edgar Jatho, Joshua Kroll, AJung Moon, Negar Rostamzadeh

Abstract: Inappropriate design and deployment of machine learning (ML) systems leads to negative downstream social and ethical impact -- described here as social and ethical risks -- for users, society and the environment. Despite the growing need to regulate ML systems, current processes for assessing and mitigating risks are disjointed and inconsistent. We interviewed 30 industry practitioners on their cu… ▽ More Inappropriate design and deployment of machine learning (ML) systems leads to negative downstream social and ethical impact -- described here as social and ethical risks -- for users, society and the environment. Despite the growing need to regulate ML systems, current processes for assessing and mitigating risks are disjointed and inconsistent. We interviewed 30 industry practitioners on their current social and ethical risk management practices, and collected their first reactions on adapting safety engineering frameworks into their practice -- namely, System Theoretic Process Analysis (STPA) and Failure Mode and Effects Analysis (FMEA). Our findings suggest STPA/FMEA can provide appropriate structure toward social and ethical risk assessment and mitigation processes. However, we also find nontrivial challenges in integrating such frameworks in the fast-paced culture of the ML industry. We call on the ML research community to strengthen existing frameworks and assess their efficacy, ensuring that ML systems are safer for all people. △ Less

Submitted 5 October, 2022; originally announced October 2022.

Terms-we-Serve-with: a feminist-inspired social imaginary for improved transparency and engagement in AI

Authors: Bogdana Rakova, Megan Ma, Renee Shelby

Abstract: Power and information asymmetries between people and digital technology companies have predominantly been legitimized through contractual agreements that have failed to provide diverse people with meaningful consent and contestability. We offer an interdisciplinary multidimensional perspective on the future of regulatory frameworks - the Terms-we-Serve-with (TwSw) social, computational, and legal… ▽ More Power and information asymmetries between people and digital technology companies have predominantly been legitimized through contractual agreements that have failed to provide diverse people with meaningful consent and contestability. We offer an interdisciplinary multidimensional perspective on the future of regulatory frameworks - the Terms-we-Serve-with (TwSw) social, computational, and legal contract for restructuring power asymmetries and center-periphery dynamics to enable improved human agency in individual and collective experiences of algorithmic harms. △ Less

Submitted 6 June, 2022; originally announced June 2022.

Comments: 5 pages, to be presented at Connected Life 2022: Designing Digital Futures, Oxford Internet Institute

Quasiparticle tunneling as a probe of Josephson junction barrier and capacitor material in superconducting qubits

Authors: C. Kurter, C. E. Murray, R. T. Gordon, B. B. Wymore, M. Sandberg, R. M. Shelby, A. Eddins, V. P. Adiga, A. D. K. Finck, E. Rivera, A. A. Stabile, B. Trimm, B. Wacaser, K. Balakrishnan, A. Pyzyna, J. Sleight, M. Steffen, K. Rodbell

Abstract: Non-equilibrium quasiparticles are possible sources for decoherence in superconducting qubits because they can lead to energy decay or dephasing upon tunneling across Josephson junctions (JJs). Here, we investigate the impact of the intrinsic properties of two-dimensional transmon qubits on quasiparticle tunneling (QPT) and discuss how we can use quasiparticle dynamics to gain critical information… ▽ More Non-equilibrium quasiparticles are possible sources for decoherence in superconducting qubits because they can lead to energy decay or dephasing upon tunneling across Josephson junctions (JJs). Here, we investigate the impact of the intrinsic properties of two-dimensional transmon qubits on quasiparticle tunneling (QPT) and discuss how we can use quasiparticle dynamics to gain critical information about the quality of JJ barrier. We find the tunneling rate of the nonequilibrium quasiparticles to be sensitive to the choice of the shunting capacitor material and their geometry in qubits. In some devices, we observe an anomalous temperature dependence of the QPT rate below 100 mK that deviates from a constant background associated with non-equilibrium quasiparticles. We speculate that this behavior is caused by high transmission sites/defects within the oxide barriers of the JJs, leading to spatially localized subgap states. We model this by assuming that such defects generate regions with a smaller effective gap. Our results present a unique in situ characterization tool to assess the uniformity of tunnel barriers in qubit junctions and shed light on how quasiparticles can interact with various elements of the qubit circuit. △ Less

Submitted 4 February, 2022; v1 submitted 21 June, 2021; originally announced June 2021.

Journal ref: npj Quantum Inf 8, 31 (2022)

Environmental Radiation Impact on Lifetimes and Quasiparticle Tunneling Rates of Fixed-Frequency Transmon Qubits

Authors: R. T. Gordon, C. E. Murray, C. Kurter, M. Sandberg, S. A. Hall, K. Balakrishnan, R. Shelby, B. Wacaser, A. A. Stabile, J. W. Sleight, M. Brink, M. B. Rothwell, K. Rodbell, O. Dial, M. Steffen

Abstract: Quantum computing relies on the operation of qubits in an environment as free of noise as possible. This work reports on measuring the impact of environmental radiation on lifetimes of fixed frequency transmon qubits with various capacitor pad geometries by varying the amount of shielding used in the measurement space. It was found that the qubit lifetimes are robust against these shielding change… ▽ More Quantum computing relies on the operation of qubits in an environment as free of noise as possible. This work reports on measuring the impact of environmental radiation on lifetimes of fixed frequency transmon qubits with various capacitor pad geometries by varying the amount of shielding used in the measurement space. It was found that the qubit lifetimes are robust against these shielding changes until the most extreme limit was tested without a mixing chamber shield in the refrigerator. In contrast, the quasiparticle tunneling rates were found to be extremely sensitive to all configurations tested, indicating these devices are not yet limited by losses related to superconducting quasiparticles. △ Less

Submitted 28 May, 2021; originally announced May 2021.

Comments: 6 pages, 7 figures, and 2 tables

Merged-Element Transmons: Design and Qubit Performance

Authors: H. J. Mamin, E. Huang, S. Carnevale, C. T. Rettner, N. Arellano, M. H. Sherwood, C. Kurter, B. Trimm, M. Sandberg, R. M. Shelby, M. A. Mueed, B. A. Madon, A. Pushp, M. Steffen, D. Rugar

Abstract: We have demonstrated a novel type of superconducting transmon qubit in which a Josephson junction has been engineered to act as its own parallel shunt capacitor. This merged-element transmon (MET) potentially offers a smaller footprint and simpler fabrication than conventional transmons. Because it concentrates the electromagnetic energy inside the junction, it reduces relative electric field part… ▽ More We have demonstrated a novel type of superconducting transmon qubit in which a Josephson junction has been engineered to act as its own parallel shunt capacitor. This merged-element transmon (MET) potentially offers a smaller footprint and simpler fabrication than conventional transmons. Because it concentrates the electromagnetic energy inside the junction, it reduces relative electric field participation from other interfaces. By combining micrometer-scale Al/AlOx/Al junctions with long oxidations and novel processing, we have produced functional devices with $E_{J}$/$E_{C}$ in the low transmon regime ($E_{J}$/$E_{C}$ $\lesssim$30). Cryogenic I-V measurements show sharp dI/dV structure with low sub-gap conduction. Qubit spectroscopy of tunable versions show a small number of avoided level crossings, suggesting the presence of two-level systems (TLS). We have observed mean T1 times typically in the range of 10-90 microseconds, with some annealed devices exhibiting T1 > 100 microseconds over several hours. The results suggest that energy relaxation in conventional, small-junction transmons is not limited by junction loss. △ Less

Submitted 13 August, 2021; v1 submitted 16 March, 2021; originally announced March 2021.

Comments: 7 pages, 4 figures Added references Performed minor editing for clarity Made minor formatting changes to figures

Journal ref: Phys. Rev. Applied 16, 024023 (2021)