-
"This Applies to the RealWorld": Student Perspectives on Integrating Ethics into a Computer Science Assignment
Authors:
Julie Jarzemsky,
Joshua Paup,
Casey Fiesler
Abstract:
There is a growing movement in undergraduate computer science (CS) programs to embed ethics across CS classes rather than relying solely on standalone ethics courses. One strategy is creating assignments that encourage students to reflect on ethical issues inherent to the code they write. Building off prior work that has surveyed students after doing such assignments in class, we conducted focus g…
▽ More
There is a growing movement in undergraduate computer science (CS) programs to embed ethics across CS classes rather than relying solely on standalone ethics courses. One strategy is creating assignments that encourage students to reflect on ethical issues inherent to the code they write. Building off prior work that has surveyed students after doing such assignments in class, we conducted focus groups with students who reviewed a new introductory ethics-based CS assignment. In this experience report, we present a case study describing our process of designing an ethics-based assignment and proposing the assignment to students for feedback. Participants in our focus groups not only shared feedback on the assignment, but also on the integration of ethics into coding assignments in general, revealing the benefits and challenges of this work from a student perspective. We also generated novel ethics-oriented assignment concepts alongside students. Deriving from tech controversies that participants felt most affected by, we created a bank of ideas as a starting point for further curriculum development.
△ Less
Submitted 20 January, 2023;
originally announced January 2023.
-
Incorporating Ethics in Computing Courses: Perspectives from Educators
Authors:
Jessie J. Smith,
Blakeley H. Payne,
Shamika Klassen,
Dylan Thomas Doyle,
Casey Fiesler
Abstract:
Incorporating ethics into computing education has become a priority for the SIGCSE community. Many computing departments and educators have contributed to this endeavor by creating standalone computing ethics courses or integrating ethics modules and discussions into preexisting curricula. In this study, we hope to support this effort by reporting on computing educators' attitudes toward including…
▽ More
Incorporating ethics into computing education has become a priority for the SIGCSE community. Many computing departments and educators have contributed to this endeavor by creating standalone computing ethics courses or integrating ethics modules and discussions into preexisting curricula. In this study, we hope to support this effort by reporting on computing educators' attitudes toward including ethics in their computing classroom, with a special focus on the structures that hinder or help this endeavor. We surveyed 138 higher education computing instructors to understand their attitudes toward including ethics in their classes, what barriers might be preventing them from doing so, and which structures best support them. We found that even though instructors were generally positive about ethics as a component of computing education, there are specific barriers preventing ethics from being included in some computing courses. In this work, we explore how to alleviate these barriers and outline support structures that could encourage further integration of ethics and computing in higher education.
△ Less
Submitted 26 January, 2023; v1 submitted 12 December, 2022;
originally announced December 2022.
-
A Trade-off-centered Framework of Content Moderation
Authors:
Jialun Aaron Jiang,
Peipei Nie,
Jed R. Brubaker,
Casey Fiesler
Abstract:
Content moderation research typically prioritizes representing and addressing challenges for one group of stakeholders or communities in one type of context. While taking a focused approach is reasonable or even favorable for empirical case studies, it does not address how content moderation works in multiple contexts. Through a systematic literature review of 86 content moderation papers that doc…
▽ More
Content moderation research typically prioritizes representing and addressing challenges for one group of stakeholders or communities in one type of context. While taking a focused approach is reasonable or even favorable for empirical case studies, it does not address how content moderation works in multiple contexts. Through a systematic literature review of 86 content moderation papers that document empirical studies, we seek to uncover patterns and tensions within past content moderation research. We find that content moderation can be characterized as a series of trade-offs around moderation actions, styles, philosophies, and values. We discuss how facilitating cooperation and preventing abuse, two key elements in Grimmelmann's definition of moderation, are inherently dialectical in practice. We close by showing how researchers, designers, and moderators can use our framework of trade-offs in their own work, and arguing that trade-offs should be of central importance in investigating and designing content moderation.
△ Less
Submitted 7 June, 2022;
originally announced June 2022.
-
A Framework of Severity for Harmful Content Online
Authors:
Morgan Klaus Scheuerman,
Jialun Aaron Jiang,
Casey Fiesler,
Jed R. Brubaker
Abstract:
The proliferation of harmful content on online social media platforms has necessitated empirical understandings of experiences of harm online and the development of practices for harm mitigation. Both understandings of harm and approaches to mitigating that harm, often through content moderation, have implicitly embedded frameworks of prioritization - what forms of harm should be researched, how p…
▽ More
The proliferation of harmful content on online social media platforms has necessitated empirical understandings of experiences of harm online and the development of practices for harm mitigation. Both understandings of harm and approaches to mitigating that harm, often through content moderation, have implicitly embedded frameworks of prioritization - what forms of harm should be researched, how policy on harmful content should be implemented, and how harmful content should be moderated. To aid efforts of better understanding the variety of online harms, how they relate to one another, and how to prioritize harms relevant to research, policy, and practice, we present a theoretical framework of severity for harmful online content. By employing a grounded theory approach, we developed a framework of severity based on interviews and card-sorting activities conducted with 52 participants over the course of ten months. Through our analysis, we identified four Types of Harm (physical, emotional, relational, and financial) and eight Dimensions along which the severity of harm can be understood (perspectives, intent, agency, experience, scale, urgency, vulnerability, sphere). We describe how our framework can be applied to both research and policy settings towards deeper understandings of specific forms of harm (e.g., harassment) and prioritization frameworks when implementing policies encompassing many forms of harm.
△ Less
Submitted 17 September, 2021; v1 submitted 9 August, 2021;
originally announced August 2021.
-
Fairness and Transparency in Recommendation: The Users' Perspective
Authors:
Nasim Sonboli,
Jessie J. Smith,
Florencia Cabral Berenfus,
Robin Burke,
Casey Fiesler
Abstract:
Though recommender systems are defined by personalization, recent work has shown the importance of additional, beyond-accuracy objectives, such as fairness. Because users often expect their recommendations to be purely personalized, these new algorithmic objectives must be communicated transparently in a fairness-aware recommender system. While explanation has a long history in recommender systems…
▽ More
Though recommender systems are defined by personalization, recent work has shown the importance of additional, beyond-accuracy objectives, such as fairness. Because users often expect their recommendations to be purely personalized, these new algorithmic objectives must be communicated transparently in a fairness-aware recommender system. While explanation has a long history in recommender systems research, there has been little work that attempts to explain systems that use a fairness objective. Even though the previous work in other branches of AI has explored the use of explanations as a tool to increase fairness, this work has not been focused on recommendation. Here, we consider user perspectives of fairness-aware recommender systems and techniques for enhancing their transparency. We describe the results of an exploratory interview study that investigates user perceptions of fairness, recommender systems, and fairness-aware objectives. We propose three features -- informed by the needs of our participants -- that could improve user understanding of and trust in fairness-aware recommender systems.
△ Less
Submitted 15 March, 2021;
originally announced March 2021.
-
Supporting Serendipity: Opportunities and Challenges for Human-AI Collaboration in Qualitative Analysis
Authors:
Jialun Aaron Jiang,
Kandrea Wade,
Casey Fiesler,
Jed R. Brubaker
Abstract:
Qualitative inductive methods are widely used in CSCW and HCI research for their ability to generatively discover deep and contextualized insights, but these inherently manual and human-resource-intensive processes are often infeasible for analyzing large corpora. Researchers have been increasingly interested in ways to apply qualitative methods to "big" data problems, ho** to achieve more gener…
▽ More
Qualitative inductive methods are widely used in CSCW and HCI research for their ability to generatively discover deep and contextualized insights, but these inherently manual and human-resource-intensive processes are often infeasible for analyzing large corpora. Researchers have been increasingly interested in ways to apply qualitative methods to "big" data problems, ho** to achieve more generalizable results from larger amounts of data while preserving the depth and richness of qualitative methods. In this paper, we describe a study of qualitative researchers' work practices and their challenges, with an eye towards whether this is an appropriate domain for human-AI collaboration and what successful collaborations might entail. Our findings characterize participants' diverse methodological practices and nuanced collaboration dynamics, and identify areas where they might benefit from AI-based tools. While participants highlight the messiness and uncertainty of qualitative inductive analysis, they still want full agency over the process and believe that AI should not interfere. Our study provides a deep investigation of task delegability in human-AI collaboration in the context of qualitative analysis, and offers directions for the design of AI assistance that honor serendipity, human agency, and ambiguity.
△ Less
Submitted 6 February, 2021;
originally announced February 2021.
-
Moderation Challenges in Voice-based Online Communities on Discord
Authors:
Jialun Aaron Jiang,
Charles Kiene,
Skyler Middler,
Jed R. Brubaker,
Casey Fiesler
Abstract:
Online community moderators are on the front lines of combating problems like hate speech and harassment, but new modes of interaction can introduce unexpected challenges. In this paper, we consider moderation practices and challenges in the context of real-time, voice-based communication through 25 in-depth interviews with moderators on Discord. Our findings suggest that the affordances of voice-…
▽ More
Online community moderators are on the front lines of combating problems like hate speech and harassment, but new modes of interaction can introduce unexpected challenges. In this paper, we consider moderation practices and challenges in the context of real-time, voice-based communication through 25 in-depth interviews with moderators on Discord. Our findings suggest that the affordances of voice-based online communities change what it means to moderate content and interactions. Not only are there new ways to break rules that moderators of text-based communities find unfamiliar, such as disruptive noise and voice raiding, but acquiring evidence of rule-breaking behaviors is also more difficult due to the ephemerality of real-time voice. While moderators have developed new moderation strategies, these strategies are limited and often based on hearsay and first impressions, resulting in problems ranging from unsuccessful moderation to false accusations. Based on these findings, we discuss how voice communication complicates current understandings and assumptions about moderation, and outline ways that platform designers and administrators can design technology to facilitate moderation.
△ Less
Submitted 13 January, 2021;
originally announced January 2021.
-
Exploring User Opinions of Fairness in Recommender Systems
Authors:
Jessie Smith,
Nasim Sonboli,
Casey Fiesler,
Robin Burke
Abstract:
Algorithmic fairness for artificial intelligence has become increasingly relevant as these systems become more pervasive in society. One realm of AI, recommender systems, presents unique challenges for fairness due to trade offs between optimizing accuracy for users and fairness to providers. But what is fair in the context of recommendation--particularly when there are multiple stakeholders? In a…
▽ More
Algorithmic fairness for artificial intelligence has become increasingly relevant as these systems become more pervasive in society. One realm of AI, recommender systems, presents unique challenges for fairness due to trade offs between optimizing accuracy for users and fairness to providers. But what is fair in the context of recommendation--particularly when there are multiple stakeholders? In an initial exploration of this problem, we ask users what their ideas of fair treatment in recommendation might be, and why. We analyze what might cause discrepancies or changes between user's opinions towards fairness to eventually help inform the design of fairer and more transparent recommendation algorithms.
△ Less
Submitted 17 April, 2020; v1 submitted 13 March, 2020;
originally announced March 2020.
-
"The Perfect One": Understanding Communication Practices and Challenges with Animated GIFs
Authors:
Jialun "Aaron" Jiang,
Casey Fiesler,
Jed R. Brubaker
Abstract:
Animated GIFs are increasingly popular in text-based communication. Finding the perfect GIF can make conversations funny, interesting, and engaging, but GIFs also introduce potentials for miscommunication. Through 24 in-depth qualitative interviews, this empirical, exploratory study examines the nuances of communication practices with animated GIFs to better understand why and how GIFs can send un…
▽ More
Animated GIFs are increasingly popular in text-based communication. Finding the perfect GIF can make conversations funny, interesting, and engaging, but GIFs also introduce potentials for miscommunication. Through 24 in-depth qualitative interviews, this empirical, exploratory study examines the nuances of communication practices with animated GIFs to better understand why and how GIFs can send unintentional messages. We find participants leverage contexts like source material and interpersonal relationship to find the perfect GIFs for different communication scenarios, while these contexts are also the primary reason for miscommunication and some technical usability issues in GIFs. This paper concludes with a discussion of the important role that different types of context play in the use and interpretations of GIFs, and argues that nonverbal communication tools should account for complex contexts and common ground that communication media rely on.
△ Less
Submitted 22 March, 2019;
originally announced March 2019.
