-
Map** the Design Space of Teachable Social Media Feed Experiences
Authors:
K. J. Kevin Feng,
Xander Koo,
Lawrence Tan,
Amy Bruckman,
David W. McDonald,
Amy X. Zhang
Abstract:
Social media feeds are deeply personal spaces that reflect individual values and preferences. However, top-down, platform-wide content algorithms can reduce users' sense of agency and fail to account for nuanced experiences and values. Drawing on the paradigm of interactive machine teaching (IMT), an interaction framework for non-expert algorithmic adaptation, we map out a design space for teachab…
▽ More
Social media feeds are deeply personal spaces that reflect individual values and preferences. However, top-down, platform-wide content algorithms can reduce users' sense of agency and fail to account for nuanced experiences and values. Drawing on the paradigm of interactive machine teaching (IMT), an interaction framework for non-expert algorithmic adaptation, we map out a design space for teachable social media feed experiences to empower agential, personalized feed curation. To do so, we conducted a think-aloud study (N=24) featuring four social media platforms -- Instagram, Mastodon, TikTok, and Twitter -- to understand key signals users leveraged to determine the value of a post in their feed. We synthesized users' signals into taxonomies that, when combined with user interviews, inform five design principles that extend IMT into the social media setting. We finally embodied our principles into three feed designs that we present as sensitizing concepts for teachable feed experiences moving forward.
△ Less
Submitted 29 January, 2024; v1 submitted 25 January, 2024;
originally announced January 2024.
-
Mitigating Racial Biases in Toxic Language Detection with an Equity-Based Ensemble Framework
Authors:
Matan Halevy,
Camille Harris,
Amy Bruckman,
Diyi Yang,
Ayanna Howard
Abstract:
Recent research has demonstrated how racial biases against users who write African American English exists in popular toxic language datasets. While previous work has focused on a single fairness criteria, we propose to use additional descriptive fairness metrics to better understand the source of these biases. We demonstrate that different benchmark classifiers, as well as two in-process bias-rem…
▽ More
Recent research has demonstrated how racial biases against users who write African American English exists in popular toxic language datasets. While previous work has focused on a single fairness criteria, we propose to use additional descriptive fairness metrics to better understand the source of these biases. We demonstrate that different benchmark classifiers, as well as two in-process bias-remediation techniques, propagate racial biases even in a larger corpus. We then propose a novel ensemble-framework that uses a specialized classifier that is fine-tuned to the African American English dialect. We show that our proposed framework substantially reduces the racial biases that the model learns from these datasets. We demonstrate how the ensemble framework improves fairness metrics across all sample datasets with minimal impact on the classification performance, and provide empirical evidence in its ability to unlearn the annotation biases towards authors who use African American English.
** Please note that this work may contain examples of offensive words and phrases.
△ Less
Submitted 27 September, 2021;
originally announced September 2021.
-
WallStreetBets: Positions or Ban
Authors:
Christian Boylston,
Beatriz Palacios,
Plamen Tassev,
Amy Bruckman
Abstract:
r/wallstreetbets (WallStreetBets or WSB) is a subreddit devoted to irreverent memes and high-risk options trading. As of March 30, 2020, the subreddit boasts a usership of nearly 1.1 millions subscribers and self-describes as "if 4chan found a Bloomberg terminal." This paper will utilize Amy Jo Kim's community design principles along with social psychology theory as frameworks to understand how th…
▽ More
r/wallstreetbets (WallStreetBets or WSB) is a subreddit devoted to irreverent memes and high-risk options trading. As of March 30, 2020, the subreddit boasts a usership of nearly 1.1 millions subscribers and self-describes as "if 4chan found a Bloomberg terminal." This paper will utilize Amy Jo Kim's community design principles along with social psychology theory as frameworks to understand how this chaotic, oftentimes offensive community has developed one of the largest and most loyal user bases on the platform. We will further argue that humor plays a vital role in promoting in-group cohesion and in providing an unconventional third place for traders (and thinly veiled gamblers) to seek support from each other in the form of vulgar, yet good-humored taunting.
△ Less
Submitted 28 January, 2021;
originally announced January 2021.
-
Quarantined! Examining the Effects of a Community-Wide Moderation Intervention on Reddit
Authors:
Eshwar Chandrasekharan,
Shagun Jhaver,
Amy Bruckman,
Eric Gilbert
Abstract:
Should social media platforms override a community's self-policing when it repeatedly break rules? What actions can they consider? In light of this debate, platforms have begun experimenting with softer alternatives to outright bans. We examine one such intervention called quarantining, that impedes direct access to and promotion of controversial communities. Specifically, we present two case stud…
▽ More
Should social media platforms override a community's self-policing when it repeatedly break rules? What actions can they consider? In light of this debate, platforms have begun experimenting with softer alternatives to outright bans. We examine one such intervention called quarantining, that impedes direct access to and promotion of controversial communities. Specifically, we present two case studies of what happened when Reddit quarantined the influential communities r/TheRedPill (TRP) and r/The_Donald (TD). Using over 85M Reddit posts, we apply causal inference methods to examine the quarantine's effects on TRP and TD. We find that the quarantine made it more difficult to recruit new members: new user influx to TRP and TD decreased by 79.5% and 58%, respectively. Despite quarantining, existing users' misogyny and racism levels remained unaffected. We conclude by reflecting on the effectiveness of this design friction in limiting the influence of toxic communities and discuss broader implications for content moderation.
△ Less
Submitted 5 October, 2021; v1 submitted 24 September, 2020;
originally announced September 2020.
-
The View from the Other Side: The Border Between Controversial Speech and Harassment on Kotaku in Action
Authors:
Shagun Jhaver,
Larry Chan,
Amy Bruckman
Abstract:
In this paper, we use mixed methods to study a controversial Internet site: The Kotaku in Action (KiA) subreddit. Members of KiA are part of GamerGate, a distributed social movement. We present an emic account of what takes place on KiA who are they, what are their goals and beliefs, and what rules do they follow. Members of GamerGate in general and KiA in particular have often been accused of har…
▽ More
In this paper, we use mixed methods to study a controversial Internet site: The Kotaku in Action (KiA) subreddit. Members of KiA are part of GamerGate, a distributed social movement. We present an emic account of what takes place on KiA who are they, what are their goals and beliefs, and what rules do they follow. Members of GamerGate in general and KiA in particular have often been accused of harassment. However, KiA site policies explicitly prohibit such behavior, and members insist that they have been falsely accused. Underlying the controversy over whether KiA supports harassment is a complex disagreement about what "harassment" is, and where to draw the line between freedom of expression and censorship. We propose a model that characterizes perceptions of controversial speech, dividing it into four categories: criticism, insult, public shaming, and harassment. We also discuss design solutions that address the challenges of moderating harassment without im**ing on free speech, and communicating across different ideologies.
△ Less
Submitted 8 February, 2018; v1 submitted 11 December, 2017;
originally announced December 2017.
-
A Theoretical Model for Mars Crater-Size Frequency Distribution
Authors:
W. A. Bruckman,
A. Ruiz,
E. Ramos
Abstract:
We present a theoretical and analytical curve with reproduce essential features of the frequency distributions vs. diameter, of the 42,000 crater contained in the Barlow Mars Catalog. The model is derived using reasonable simple assumptions that allow us to relate the present craters population with the craters population at each particular epoch. The model takes into consideration the reduction…
▽ More
We present a theoretical and analytical curve with reproduce essential features of the frequency distributions vs. diameter, of the 42,000 crater contained in the Barlow Mars Catalog. The model is derived using reasonable simple assumptions that allow us to relate the present craters population with the craters population at each particular epoch. The model takes into consideration the reduction of the number of craters as a function of time caused by their erosion and obliteration, and this provides a simple and natural explanation for the presence of different slopes in the empirical log-log plot of number of craters (N) vs. diameter (D).
△ Less
Submitted 2 February, 2004;
originally announced February 2004.