Showing 1–50 of 64 results for author: Monroy-Hernández, A

Rideshare Transparency: Translating Gig Worker Insights on AI Platform Design to Policy

Authors: Varun Nagaraj Rao, Samantha Dalal, Eesha Agarwal, Dana Calacci, Andrés Monroy-Hernández

Abstract: Rideshare platforms exert significant control over workers through algorithmic systems that can result in financial, emotional, and physical harm. What steps can platforms, designers, and practitioners take to mitigate these negative impacts and meet worker needs? In this paper, through a novel mixed methods study combining a LLM-based analysis of over 1 million comments posted to online platform… ▽ More Rideshare platforms exert significant control over workers through algorithmic systems that can result in financial, emotional, and physical harm. What steps can platforms, designers, and practitioners take to mitigate these negative impacts and meet worker needs? In this paper, through a novel mixed methods study combining a LLM-based analysis of over 1 million comments posted to online platform worker communities with semi-structured interviews of workers, we thickly characterize transparency-related harms, mitigation strategies, and worker needs while validating and contextualizing our findings within the broader worker community. Our findings expose a transparency gap between existing platform designs and the information drivers need, particularly concerning promotions, fares, routes, and task allocation. Our analysis suggests that rideshare workers need key pieces of information, which we refer to as indicators, to make informed work decisions. These indicators include details about rides, driver statistics, algorithmic implementation details, and platform policy information. We argue that instead of relying on platforms to include such information in their designs, new regulations that require platforms to publish public transparency reports may be a more effective solution to improve worker well-being. We offer recommendations for implementing such a policy. △ Less

Submitted 19 June, 2024; v1 submitted 15 June, 2024; originally announced June 2024.

QuaLLM: An LLM-based Framework to Extract Quantitative Insights from Online Forums

Authors: Varun Nagaraj Rao, Eesha Agarwal, Samantha Dalal, Dan Calacci, Andrés Monroy-Hernández

Abstract: Online discussion forums provide crucial data to understand the concerns of a wide range of real-world communities. However, the typical qualitative and quantitative methods used to analyze those data, such as thematic analysis and topic modeling, are infeasible to scale or require significant human effort to translate outputs to human readable forms. This study introduces QuaLLM, a novel LLM-base… ▽ More Online discussion forums provide crucial data to understand the concerns of a wide range of real-world communities. However, the typical qualitative and quantitative methods used to analyze those data, such as thematic analysis and topic modeling, are infeasible to scale or require significant human effort to translate outputs to human readable forms. This study introduces QuaLLM, a novel LLM-based framework to analyze and extract quantitative insights from text data on online forums. The framework consists of a novel prompting methodology and evaluation strategy. We applied this framework to analyze over one million comments from two Reddit's rideshare worker communities, marking the largest study of its type. We uncover significant worker concerns regarding AI and algorithmic platform decisions, responding to regulatory calls about worker insights. In short, our work sets a new precedent for AI-assisted quantitative data analysis to surface concerns from online forums. △ Less

Submitted 8 May, 2024; originally announced May 2024.

Comments: Accepted to CHI LLM as Research Tools Workshop (2024)

With or Without Permission: Site-Specific Augmented Reality for Social Justice

Authors: Rafael M. L. Silva, Ana María Cárdenas Gasca, Joshua A. Fisher, Erica Principe Cruz, Cinthya Jauregui, Amy Lueck, Fannie Liu, Andrés Monroy-Hernández, Kai Lukoff

Abstract: Movements for social change are often tied to a particular locale. This makes Augmented Reality (AR), which changes how people perceive their surroundings, a promising technology for social justice. Site-specific AR empowers activists to re-tell the story of a place, with or without permission of its owner. It has been used, for example, to reveal hidden histories, re-imagine problematic monuments… ▽ More Movements for social change are often tied to a particular locale. This makes Augmented Reality (AR), which changes how people perceive their surroundings, a promising technology for social justice. Site-specific AR empowers activists to re-tell the story of a place, with or without permission of its owner. It has been used, for example, to reveal hidden histories, re-imagine problematic monuments, and celebrate minority cultures. However, challenges remain concerning technological ownership and accessibility, scalability, sustainability, and navigating collaborations with marginalized communities and across disciplinary boundaries. This half-day workshop at CHI 2024 seeks to bring together an interdisciplinary group of activists, computer scientists, designers, media scholars, and more to identify opportunities and challenges across domains. To anchor the discussion, participants will each share one example of an artifact used in speculating, designing, and/or delivering site-specific AR experiences. This collection of artifacts will inaugurate an interactive database that can inspire a new wave of activists to leverage AR for social justice. △ Less

Submitted 6 May, 2024; originally announced May 2024.

Comments: Presented at CHI 2024 (arXiv:2404.05889)

Report number: ARSJ/2024/01

The Future of Research on Social Technologies: CCC Workshop Visioning Report

Authors: Motahhare Eslami, Eric Gilbert, Sarita Schoenebeck, Eric P. S. Baumer, Eshwar Chandrasekharan, Michelle De Mooy, Karrie Karahalios, David Karger, Tressie McMillan Cottom, Andrés Monroy-Hernández, Loren Terveen, John Wihbey

Abstract: Social technologies are the systems, interfaces, features, infrastructures, and architectures that allow people to interact with each other online. These technologies dramatically shape the fabric of our everyday lives, from the information we consume to the people we interact with to the foundations of our culture and politics. While the benefits of social technologies are well documented, the ha… ▽ More Social technologies are the systems, interfaces, features, infrastructures, and architectures that allow people to interact with each other online. These technologies dramatically shape the fabric of our everyday lives, from the information we consume to the people we interact with to the foundations of our culture and politics. While the benefits of social technologies are well documented, the harms, too, have cast a long shadow. To address widespread problems like harassment, disinformation, information access, and mental health concerns, we need to rethink the foundations of how social technologies are designed, sustained, and governed. This report is based on discussions at the Computing Community Consortium Workshop, The Future of Research on Social Technologies, that was held November 2-3, 2023 in Washington, DC. The visioning workshop came together to focus on two questions. What should we know about social technologies, and what is needed to get there? The workshop brought together over 50 information and computer scientists, social scientists, communication and journalism scholars, and policy experts. We used a discussion format, with one day of guiding topics and a second day using an unconference model where participants created discussion topics. The interdisciplinary group of attendees discussed gaps in existing scholarship and the methods, resources, access, and collective effort needed to address those gaps. We also discussed approaches for translating scholarship for various audiences including citizens, funders, educators, industry professionals, and policymakers. This report presents a synthesis of major themes during our discussions. The themes presented are not a summary of what we know already, they are an exploration of what we do not know enough about, and what we should spend more effort and investment on in the coming years. △ Less

Submitted 16 April, 2024; originally announced April 2024.

With or Without Permission: Site-Specific Augmented Reality for Social Justice CHI 2024 Workshop Proceedings

Authors: Rafael M. L. Silva, Ana María Cárdenas Gasca, Joshua A. Fisher, Erica Principe Cruz, Cinthya Jauregui, Amy Lueck, Fannie Liu, Andrés Monroy-Hernández, Kai Lukoff

Abstract: This volume represents the proceedings of With or Without Permission: Site-Specific Augmented Reality for Social Justice CHI 2024 workshop. This volume represents the proceedings of With or Without Permission: Site-Specific Augmented Reality for Social Justice CHI 2024 workshop. △ Less

Submitted 22 April, 2024; v1 submitted 8 April, 2024; originally announced April 2024.

Comments: Workshop papers are indexed below

Report number: ARSJ/2024/00

Map** the Landscape of Independent Food Delivery Platforms in the United States

Authors: Yuhan Liu, Amna Liaqat, Owen Xingjian Zhang, Mariana Consuelo Fernández Espinosa, Ankhitha Manjunatha, Alexander Yang, Orestis Papakyriakopoulos, Andrés Monroy-Hernández

Abstract: Beyond the well-known giants like Uber Eats and DoorDash, there are hundreds of independent food delivery platforms in the United States. However, little is known about the sociotechnical landscape of these ``indie'' platforms. In this paper, we analyzed these platforms to understand why they were created, how they operate, and what technologies they use. We collected data on 495 indie platforms a… ▽ More Beyond the well-known giants like Uber Eats and DoorDash, there are hundreds of independent food delivery platforms in the United States. However, little is known about the sociotechnical landscape of these ``indie'' platforms. In this paper, we analyzed these platforms to understand why they were created, how they operate, and what technologies they use. We collected data on 495 indie platforms and detailed survey responses from 29 platforms. We found that personalized, timely service is a central value of indie platforms, as is a sense of responsibility to the local community they serve. Indie platforms are motivated to provide fair rates for restaurants and couriers. These alternative business practices differentiate them from mainstream platforms. Though indie platforms have plans to expand, a lack of customizability in off-the-shelf software prevents independent platforms from personalizing services for their local communities. We show that these platforms are a widespread and longstanding fixture of the food delivery market. We illustrate the diversity of motivations and values to explain why a one-size-fits-all support is insufficient, and we discuss the siloing of technology that inhibits platforms' growth. Through these insights, we aim to promote future HCI research into the potential development of public-interest technologies for local food delivery. △ Less

Submitted 25 March, 2024; v1 submitted 21 February, 2024; originally announced February 2024.

Comments: To appear in CSCW 2024

Ball-AR: Fostering Playful Co-Located Interaction Through Environment-centric Physical Activity with AR

Authors: Arnav Kumar, Andrés Monroy-Hernández

Abstract: We present Ball-AR, an augmented reality (AR) game where two players in the same physical space attempt to hit each other with virtual dodgeballs overlaid on the physical world. Researchers have studied AR's potential for fostering co-located interaction and physical activity; however, they have not investigated the impacts of physical activity and physical environment on user experiences and inte… ▽ More We present Ball-AR, an augmented reality (AR) game where two players in the same physical space attempt to hit each other with virtual dodgeballs overlaid on the physical world. Researchers have studied AR's potential for fostering co-located interaction and physical activity; however, they have not investigated the impacts of physical activity and physical environment on user experiences and interaction. We created an AR dodgeball game centered around encouraging physical activity and harnessing the physical environment. We then evaluated the game with five dyads to analyze the impacts of these design choices on the quality of gameplay and interaction between players. We found that physical activity and the shared physical space created memorable experiences and interactions among participants, although participants desired a more augmented and immersive experience. △ Less

Submitted 12 November, 2023; originally announced November 2023.

Beyond Screens: Supporting Co-located Augmented Reality Experiences with Smart Home Devices

Authors: Ava Robinson, Yu Jiang Tham, Rajan Vaish, Andrés Monroy-Hernández

Abstract: We introduce Spooky Spirits, an AR game that makes novel use of everyday smart home devices to support co-located play. Recent exploration of co-located AR experiences consists mainly of digital visual augmentations on mobile or head-mounted screens. In this work, we leverage widely adopted smart lightbulbs to expand AR capabilities beyond the digital and into the physical world, further leveragin… ▽ More We introduce Spooky Spirits, an AR game that makes novel use of everyday smart home devices to support co-located play. Recent exploration of co-located AR experiences consists mainly of digital visual augmentations on mobile or head-mounted screens. In this work, we leverage widely adopted smart lightbulbs to expand AR capabilities beyond the digital and into the physical world, further leveraging the physicality of users' shared environment. △ Less

Submitted 1 September, 2023; originally announced September 2023.

Social Wormholes: Exploring Preferences and Opportunities for Distributed and Physically-Grounded Social Connections

Authors: Joanne Leong, Yuanyang Teng, Xingyu "Bruce" Liu, Hanseul Jun, Sven Kratz, Yu Jiang Tham, Andrés Monroy-Hernández, Brian A. Smith, Rajan Vaish

Abstract: Ubiquitous computing encapsulates the idea for technology to be interwoven into the fabric of everyday life. As computing blends into everyday physical artifacts, powerful opportunities open up for social connection. Prior connected media objects span a broad spectrum of design combinations. Such diversity suggests that people have varying needs and preferences for staying connected to one another… ▽ More Ubiquitous computing encapsulates the idea for technology to be interwoven into the fabric of everyday life. As computing blends into everyday physical artifacts, powerful opportunities open up for social connection. Prior connected media objects span a broad spectrum of design combinations. Such diversity suggests that people have varying needs and preferences for staying connected to one another. However, since these designs have largely been studied in isolation, we do not have a holistic understanding around how people would configure and behave within a ubiquitous social ecosystem of physically-grounded artifacts. In this paper, we create a technology probe called Social Wormholes, that lets people configure their own home ecosystem of connected artifacts. Through a field study with 24 participants, we report on patterns of behaviors that emerged naturally in the context of their daily lives and shine a light on how ubiquitous computing could be leveraged for social computing. △ Less

Submitted 16 May, 2023; originally announced May 2023.

Comments: To appear in the Proceedings of the ACM on Human-Computer Interaction, CSCW2, November 2023 issue. To be presented at CSCW 2023. 29 pages

Humans, AI, and Context: Understanding End-Users' Trust in a Real-World Computer Vision Application

Authors: Sunnie S. Y. Kim, Elizabeth Anne Watkins, Olga Russakovsky, Ruth Fong, Andrés Monroy-Hernández

Abstract: Trust is an important factor in people's interactions with AI systems. However, there is a lack of empirical studies examining how real end-users trust or distrust the AI system they interact with. Most research investigates one aspect of trust in lab settings with hypothetical end-users. In this paper, we provide a holistic and nuanced understanding of trust in AI through a qualitative case study… ▽ More Trust is an important factor in people's interactions with AI systems. However, there is a lack of empirical studies examining how real end-users trust or distrust the AI system they interact with. Most research investigates one aspect of trust in lab settings with hypothetical end-users. In this paper, we provide a holistic and nuanced understanding of trust in AI through a qualitative case study of a real-world computer vision application. We report findings from interviews with 20 end-users of a popular, AI-based bird identification app where we inquired about their trust in the app from many angles. We find participants perceived the app as trustworthy and trusted it, but selectively accepted app outputs after engaging in verification behaviors, and decided against app adoption in certain high-stakes scenarios. We also find domain knowledge and context are important factors for trust-related assessment and decision-making. We discuss the implications of our findings and provide recommendations for future research on trust in AI. △ Less

Submitted 15 May, 2023; originally announced May 2023.

Comments: FAccT 2023

Should Policymakers be Involved? Understanding the Opinions and Needs for Independent Food Delivery Platforms in the United States regarding Public Policy

Authors: Yuhan Liu, Amna Liaqat, Andrés Monroy-Hernández

Abstract: Mainstream food delivery platforms, like DoorDash and Uber Eats, have been the locus of fierce policy debates about their unfair business and labor practices. At the same time, hundreds of independent food delivery services provide alternative opportunities to many communities across the U.S. We surveyed operators of independent food delivery platforms to learn about their perception of the role o… ▽ More Mainstream food delivery platforms, like DoorDash and Uber Eats, have been the locus of fierce policy debates about their unfair business and labor practices. At the same time, hundreds of independent food delivery services provide alternative opportunities to many communities across the U.S. We surveyed operators of independent food delivery platforms to learn about their perception of the role of public policy. We found conflicting opinions on whether and how policy should interact with their businesses, ranging from not wanting policymakers to interfere to articulating specific policies that would curtail mainstream platforms' business practices. We provide insights for technologists and policymakers interested in the sociotechnical challenges of local marketplaces. △ Less

Submitted 28 March, 2023; v1 submitted 27 March, 2023; originally announced March 2023.

Comments: Accepted by CHI'23 workshop Designing Technology and Policy Simultaneously: Towards A Research Agenda and New Practice

Supporting Piggybacked Co-Located Leisure Activities via Augmented Reality

Authors: Samantha Reig, Erica Principe Cruz, Melissa M. Powers, Jennifer He, Timothy Chong, Yu Jiang Tham, Sven Kratz, Ava Robinson, Brian A. Smith, Rajan Vaish, Andrés Monroy-Hernández

Abstract: Technology, especially the smartphone, is villainized for taking meaning and time away from in-person interactions and secluding people into "digital bubbles". We believe this is not an intrinsic property of digital gadgets, but evidence of a lack of imagination in technology design. Leveraging augmented reality (AR) toward this end allows us to create experiences for multiple people, their pets,… ▽ More Technology, especially the smartphone, is villainized for taking meaning and time away from in-person interactions and secluding people into "digital bubbles". We believe this is not an intrinsic property of digital gadgets, but evidence of a lack of imagination in technology design. Leveraging augmented reality (AR) toward this end allows us to create experiences for multiple people, their pets, and their environments. In this work, we explore the design of AR technology that "piggybacks" on everyday leisure to foster co-located interactions among close ties (with other people and pets. We designed, developed, and deployed three such AR applications, and evaluated them through a 41-participant and 19-pet user study. We gained key insights about the ability of AR to spur and enrich interaction in new channels, the importance of customization, and the challenges of designing for the physical aspects of AR devices (e.g., holding smartphones). These insights guide design implications for the novel research space of co-located AR. △ Less

Submitted 18 March, 2023; originally announced March 2023.

Understanding Human Intervention in the Platform Economy: A case study of an indie food delivery service

Authors: Samantha Dalal, Ngan Chiem, Nikoo Karbassi, Yuhan Liu, Andrés Monroy-Hernández

Abstract: This paper examines the sociotechnical infrastructure of an "indie" food delivery platform. The platform, Nosh, provides an alternative to mainstream services, such as Doordash and Uber Eats, in several communities in the Western United States. We interviewed 28 stakeholders including restauranteurs, couriers, consumers, and platform administrators. Drawing on infrastructure literature, we learned… ▽ More This paper examines the sociotechnical infrastructure of an "indie" food delivery platform. The platform, Nosh, provides an alternative to mainstream services, such as Doordash and Uber Eats, in several communities in the Western United States. We interviewed 28 stakeholders including restauranteurs, couriers, consumers, and platform administrators. Drawing on infrastructure literature, we learned that the platform is a patchwork of disparate technical systems held together by human intervention. Participants join this platform because they receive greater agency, financial security, and local support. We identify human intervention's key role in making food delivery platform users feel respected. This study provides insights into the affordances, limitations, and possibilities of food delivery platforms designed to prioritize local contexts over transnational scales. △ Less

Submitted 6 March, 2023; originally announced March 2023.

Comments: Accepted at CHI 2023

Towards Inclusive Avatars: Disability Representation in Avatar Platforms

Authors: Kelly Mack, Rai Ching Ling Hsu, Andrés Monroy-Hernández, Brian A. Smith, Fannie Liu

Abstract: Digital avatars are an important part of identity representation, but there is little work on understanding how to represent disability. We interviewed 18 people with disabilities and related identities about their experiences and preferences in representing their identities with avatars. Participants generally preferred to represent their disability identity if the context felt safe and platforms… ▽ More Digital avatars are an important part of identity representation, but there is little work on understanding how to represent disability. We interviewed 18 people with disabilities and related identities about their experiences and preferences in representing their identities with avatars. Participants generally preferred to represent their disability identity if the context felt safe and platforms supported their expression, as it was important for feeling authentically represented. They also utilized avatars in strategic ways: as a means to signal and disclose current abilities, access needs, and to raise awareness. Some participants even found avatars to be a more accessible way to communicate than alternatives. We discuss how avatars can support disability identity representation because of their easily customizable format that is not strictly tied to reality. We conclude with design recommendations for creating platforms that better support people in representing their disability and other minoritized identities. △ Less

Submitted 3 February, 2023; originally announced February 2023.

PokAR: Facilitating Poker Play Through Augmented Reality

Authors: Adam Gamba, Andrés Monroy-Hernández

Abstract: We introduce PokAR, an augmented reality (AR) application to facilitate poker play. PokAR aims to alleviate three difficulties of traditional poker by leveraging AR technology: (1) need to have physical poker chips, (2) complex rules of poker, (3) slow game pace caused by laborious tasks. Despite the potential benefits of AR in poker, not much research has been done in the field. In fact, PokAR is… ▽ More We introduce PokAR, an augmented reality (AR) application to facilitate poker play. PokAR aims to alleviate three difficulties of traditional poker by leveraging AR technology: (1) need to have physical poker chips, (2) complex rules of poker, (3) slow game pace caused by laborious tasks. Despite the potential benefits of AR in poker, not much research has been done in the field. In fact, PokAR is the first application to enable AR poker on a mobile device without requiring extra costly equipment. This has been done by creating a Snapchat Lens which can be used on most mobile devices. We evaluated this application by instructing 4 participant dyads to use PokAR to engage in poker play and respond to survey questions about their experience. We found that most PokAR features were positively received, AR did not significantly improve nor hinder socialization, PokAR slightly increased the game pace, and participants had an overall enjoyable experience with the Lens. These findings led to three major conclusions: (1) AR has the potential to augment and simplify traditional table games, (2) AR should not be used to replace traditional experiences, only augment them, (3) Future work includes additional features like increased tactility and statistical annotations. △ Less

Submitted 1 January, 2023; originally announced January 2023.

Exploring Immersive Interpersonal Communication via AR

Authors: Kyungjun Lee, Hong Li, Muhammad Rizky Wellyanto, Yu Jiang Tham, Andrés Monroy-Hernández, Fannie Liu, Brian A. Smith, Rajan Vaish

Abstract: A central challenge of social computing research is to enable people to communicate expressively with each other remotely. Augmented reality has great promise for expressive communication since it enables communication beyond texts and photos and towards immersive experiences rendered in recipients' physical environments. Little research, however, has explored AR's potential for everyday interpers… ▽ More A central challenge of social computing research is to enable people to communicate expressively with each other remotely. Augmented reality has great promise for expressive communication since it enables communication beyond texts and photos and towards immersive experiences rendered in recipients' physical environments. Little research, however, has explored AR's potential for everyday interpersonal communication. In this work, we prototype an AR messaging system, ARwand, to understand people's behaviors and perceptions around communicating with friends via AR messaging. We present our findings under four themes observed from a user study with 24 participants, including the types of immersive messages people choose to send to each other, which factors contribute to a sense of immersiveness, and what concerns arise over this new form of messaging. We discuss important implications of our findings on the design of future immersive communication systems. △ Less

Submitted 30 November, 2022; v1 submitted 28 November, 2022; originally announced November 2022.

Comments: Will be published in PACM HCI, CSCW1, April 2023 issue

"Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interaction

Authors: Sunnie S. Y. Kim, Elizabeth Anne Watkins, Olga Russakovsky, Ruth Fong, Andrés Monroy-Hernández

Abstract: Despite the proliferation of explainable AI (XAI) methods, little is understood about end-users' explainability needs and behaviors around XAI explanations. To address this gap and contribute to understanding how explainability can support human-AI interaction, we conducted a mixed-methods study with 20 end-users of a real-world AI application, the Merlin bird identification app, and inquired abou… ▽ More Despite the proliferation of explainable AI (XAI) methods, little is understood about end-users' explainability needs and behaviors around XAI explanations. To address this gap and contribute to understanding how explainability can support human-AI interaction, we conducted a mixed-methods study with 20 end-users of a real-world AI application, the Merlin bird identification app, and inquired about their XAI needs, uses, and perceptions. We found that participants desire practically useful information that can improve their collaboration with the AI, more so than technical system details. Relatedly, participants intended to use XAI explanations for various purposes beyond understanding the AI's outputs: calibrating trust, improving their task skills, changing their behavior to supply better inputs to the AI, and giving constructive feedback to developers. Finally, among existing XAI approaches, participants preferred part-based explanations that resemble human reasoning and explanations. We discuss the implications of our findings and provide recommendations for future XAI design. △ Less

Submitted 16 February, 2023; v1 submitted 2 October, 2022; originally announced October 2022.

Comments: CHI 2023

Journal ref: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23), April 23-28, 2023, Hamburg, Germany. ACM, New York, NY, USA

Revisiting Piggyback Prototy**: Examining Benefits and Tradeoffs in Extending Existing Social Computing Systems

Authors: Daniel A. Epstein, Fannie Liu, Andrés Monroy-Hernández, Dennis Wang

Abstract: The CSCW community has a history of designing, implementing, and evaluating novel social interactions in technology, but the process requires significant technical effort for uncertain value. We discuss the opportunities and applications of "piggyback prototy**", building and evaluating new ideas for social computing on top of existing ones, expanding on its potential to contribute design recomm… ▽ More The CSCW community has a history of designing, implementing, and evaluating novel social interactions in technology, but the process requires significant technical effort for uncertain value. We discuss the opportunities and applications of "piggyback prototy**", building and evaluating new ideas for social computing on top of existing ones, expanding on its potential to contribute design recommendations. Drawing on about 50 papers which use the method, we critically examine the intellectual and technical benefits it provides, such as ecological validity and leveraging well-tested features, as well as research-product and ethical tensions it imposes, such as limits to customization and violation of participant privacy. We discuss considerations for future researchers deciding whether to use piggyback prototy** and point to new research agendas which can reduce the burden of implementing the method. △ Less

Submitted 23 September, 2022; v1 submitted 10 August, 2022; originally announced August 2022.

Comments: To appear at the 25th ACM Conference On Computer-Supported Cooperative Work And Social Computing (CSCW '22)

ACM Class: H.5.3

Understanding Teenage Perceptions and Configurations of Privacy on Instagram

Authors: Dora Zhao, Mikako Inaba, Andrés Monroy-Hernández

Abstract: As teenage use of social media platform continues to proliferate, so do concerns about teenage privacy and safety online. Prior work has established that privacy on networked publics, such as social media, is complex, requiring users to navigate not only the technical affordances on the platform but also interpersonal relationships and social norms. We investigate how teenagers think about privacy… ▽ More As teenage use of social media platform continues to proliferate, so do concerns about teenage privacy and safety online. Prior work has established that privacy on networked publics, such as social media, is complex, requiring users to navigate not only the technical affordances on the platform but also interpersonal relationships and social norms. We investigate how teenagers think about privacy on the popular image-sharing platform, Instagram. We draw on an online survey (N=144) and semi-structured interviews (N=21) with teenagers, ages 13-19, to gain a better understanding how teenagers configure privacy on the popular image-sharing platform Instagram and why they make these privacy decisions. Finally, based on our findings, we provide design recommendations towards the design of better privacy controls for promoting teenage safety online. △ Less

Submitted 4 August, 2022; originally announced August 2022.

Comments: Accepted to CSCW 2022

CaminAR: Supporting Walk-and-talk Experiences for Remote Dyads using Augmented Reality on Smart Glasses

Authors: Victor Chu, Andrés Monroy-Hernández

Abstract: In this paper, we propose CaminAR, an augmented reality (AR) system for remote social walking among dyads. CaminAR enables two people who are physically away from one another to synchronously see and hear each other while going on a walk. The system shows a partner's avatar superimposed onto the physical world using smart glasses while walking and talking. Using a combination of visual and auditor… ▽ More In this paper, we propose CaminAR, an augmented reality (AR) system for remote social walking among dyads. CaminAR enables two people who are physically away from one another to synchronously see and hear each other while going on a walk. The system shows a partner's avatar superimposed onto the physical world using smart glasses while walking and talking. Using a combination of visual and auditory augments, CaminAR simulates the experience of co-located walking when dyads are apart. △ Less

Submitted 28 July, 2022; originally announced July 2022.

Comments: 3 pages, 1 figure, submitted to UIST Poster

Auggie: Encouraging Effortful Communication through Handcrafted Digital Experiences

Authors: Lei Zhang, Tianying Chen, Olivia Seow, Tim Chong, Sven Kratz, Yu Jiang Tham, Andrés Monroy-Hernández, Rajan Vaish, Fannie Liu

Abstract: Digital communication is often brisk and automated. From auto-completed messages to "likes," research has shown that such lightweight interactions can affect perceptions of authenticity and closeness. On the other hand, effort in relationships can forge emotional bonds by conveying a sense of caring and is essential in building and maintaining relationships. To explore effortful communication, we… ▽ More Digital communication is often brisk and automated. From auto-completed messages to "likes," research has shown that such lightweight interactions can affect perceptions of authenticity and closeness. On the other hand, effort in relationships can forge emotional bonds by conveying a sense of caring and is essential in building and maintaining relationships. To explore effortful communication, we designed and evaluated Auggie, an iOS app that encourages partners to create digitally handcrafted Augmented Reality (AR) experiences for each other. Auggie is centered around crafting a 3D character with photos, animated movements, drawings, and audio for someone else. We conducted a two-week-long field study with 30 participants (15 pairs), who used Auggie with their partners remotely. Our qualitative findings show that Auggie participants engaged in meaningful effort through the handcrafting process, and felt closer to their partners, although the tool may not be appropriate in all situations. We discuss design implications and future directions for systems that encourage effortful communication. △ Less

Submitted 15 July, 2022; originally announced July 2022.

Comments: To appear at the 25th ACM Conference On Computer-Supported Cooperative Work And Social Computing (CSCW '22). 25 pages

Understanding AR Activism: An Interview Study with Creators of Augmented Reality Experiences for Social Change

Authors: Rafael M. L. Silva, Erica Principe Cruz, Daniela K. Rosner, Dayton Kelly, Andrés Monroy-Hernández, Fannie Liu

Abstract: The rise of consumer augmented reality (AR) technology has opened up new possibilities for interventions intended to disrupt and subvert cultural conventions. From defacing corporate logos to erecting geofenced digital monuments, more and more people are creating AR experiences for social causes. We sought to understand this new form of activism, including why people use AR for these purposes, opp… ▽ More The rise of consumer augmented reality (AR) technology has opened up new possibilities for interventions intended to disrupt and subvert cultural conventions. From defacing corporate logos to erecting geofenced digital monuments, more and more people are creating AR experiences for social causes. We sought to understand this new form of activism, including why people use AR for these purposes, opportunities and challenges in using it, and how well it can support activist goals. We conducted semi-structured interviews with twenty people involved in projects that used AR for a social cause across six different countries. We found that AR can overcome physical world limitations of activism to convey immersive, multilayered narratives that aim to reveal invisible histories and perspectives. At the same time, people experienced challenges in creating, maintaining, and distributing their AR experiences to audiences. We discuss open questions and opportunities for creating AR tools and experiences for social change. △ Less

Submitted 20 April, 2022; originally announced April 2022.

Understanding the Role of Context in Creating Enjoyable Co-Located Interactions

Authors: Szu-Yu, Liu, Brian A. Smith, Rajan Vaish, Andrés Monroy-Hernández

Abstract: In recent years, public discourse has blamed digital technologies for making people feel "alone together," distracting us from engaging with one another, even when we are interacting in-person. We argue that in order to design technologies that foster and augment co-located interactions, we need to first understand the context in which enjoyable co-located socialization takes place. We address thi… ▽ More In recent years, public discourse has blamed digital technologies for making people feel "alone together," distracting us from engaging with one another, even when we are interacting in-person. We argue that in order to design technologies that foster and augment co-located interactions, we need to first understand the context in which enjoyable co-located socialization takes place. We address this gap by surveying and interviewing over 1,000 U.S.-based participants to understand what, where, with whom, how, and why people enjoy spending time in-person. Our findings suggest that people enjoy engaging in everyday activities with individuals with whom they have strong social ties because it helps enable nonverbal cues, facilitate spontaneity, support authenticity, encourage undivided attention, and leverage the physicality of their bodies and the environment. We conclude by providing a set of recommendations for designers interested in creating co-located technologies that encourage social engagement and relationship building. △ Less

Submitted 3 February, 2022; originally announced February 2022.

Comments: 26 pages, 3 figures, 2 tables

ACM Class: H.5.3

Project IRL: Playful Co-Located Interactions with Mobile Augmented Reality

Authors: Ella Dagan, Ana Cárdenas Gasca, Ava Robinson, Anwar Noriega, Yu Jiang Tham, Rajan Vaish, Andrés Monroy-Hernández

Abstract: We present Project IRL (In Real Life), a suite of five mobile apps we created to explore novel ways of supporting in-person social interactions with augmented reality. In recent years, the tone of public discourse surrounding digital technology has become increasingly critical, and technology's influence on the way people relate to each other has been blamed for making people feel "alone together,… ▽ More We present Project IRL (In Real Life), a suite of five mobile apps we created to explore novel ways of supporting in-person social interactions with augmented reality. In recent years, the tone of public discourse surrounding digital technology has become increasingly critical, and technology's influence on the way people relate to each other has been blamed for making people feel "alone together," diverting their attention from truly engaging with one another when they interact in person. Motivated by this challenge, we focus on an under-explored design space: playful co-located interactions. We evaluated the apps through a deployment study that involved interviews and participant observations with 101 people. We synthesized the results into a series of design guidelines that focus on four themes: (1) device arrangement (e.g., are people sharing one phone, or does each person have their own?), (2) enablers (e.g., should the activity focus on an object, body part, or pet?), (3) affordances of modifying reality (i.e., features of the technology that enhance its potential to encourage various aspects of social interaction), and (4) co-located play (i.e., using technology to make in-person play engaging and inviting). We conclude by presenting our design guidelines for future work on embodied social AR. △ Less

Submitted 25 March, 2022; v1 submitted 7 January, 2022; originally announced January 2022.

SceneAR: Scene-based Micro Narratives for Sharing and Remixing in Augmented Reality

Authors: Mengyu Chen, Andrés Monroy-Hernández, Misha Sra

Abstract: Short-form digital storytelling has become a popular medium for millions of people to express themselves. Traditionally, this medium uses primarily 2D media such as text (e.g., memes), images (e.g., Instagram), gifs (e.g., Giphy), and videos (e.g., TikTok, Snapchat). To expand the modalities from 2D to 3D media, we present SceneAR, a smartphone application for creating sequential scene-based micro… ▽ More Short-form digital storytelling has become a popular medium for millions of people to express themselves. Traditionally, this medium uses primarily 2D media such as text (e.g., memes), images (e.g., Instagram), gifs (e.g., Giphy), and videos (e.g., TikTok, Snapchat). To expand the modalities from 2D to 3D media, we present SceneAR, a smartphone application for creating sequential scene-based micro narratives in augmented reality (AR). What sets SceneAR apart from prior work is the ability to share the scene-based stories as AR content -- no longer limited to sharing images or videos, these narratives can now be experienced in people's own physical environments. Additionally, SceneAR affords users the ability to remix AR, empowering them to build-upon others' creations collectively. We asked 18 people to use SceneAR in a 3-day study. Based on user interviews, analysis of screen recordings, and the stories they created, we extracted three themes. From those themes and the study overall, we derived six strategies for designers interested in supporting short-form AR narratives. △ Less

Submitted 28 August, 2021; originally announced August 2021.

Comments: To be published in 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

Significant Otter: Understanding the Role of Biosignals in Communication

Authors: Fannie Liu, Chunjong Park, Yu Jiang Tham, Tsung-Yu Tsai, Laura Dabbish, Geoff Kaufman, Andrés Monroy-Hernández

Abstract: With the growing ubiquity of wearable devices, sensed physiological responses provide new means to connect with others. While recent research demonstrates the expressive potential for biosignals, the value of sharing these personal data remains unclear. To understand their role in communication, we created Significant Otter, an Apple Watch/iPhone app that enables romantic partners to share and res… ▽ More With the growing ubiquity of wearable devices, sensed physiological responses provide new means to connect with others. While recent research demonstrates the expressive potential for biosignals, the value of sharing these personal data remains unclear. To understand their role in communication, we created Significant Otter, an Apple Watch/iPhone app that enables romantic partners to share and respond to each other's biosignals in the form of animated otter avatars. In a one-month study with 20 couples, participants used Significant Otter with biosignals sensing OFF and ON. We found that while sensing OFF enabled couples to keep in touch, sensing ON enabled easier and more authentic communication that fostered social connection. However, the addition of biosignals introduced concerns about autonomy and agency over the messages they sent. We discuss design implications and future directions for communication systems that recommend messages based on biosignals. △ Less

Submitted 15 April, 2021; v1 submitted 16 February, 2021; originally announced February 2021.

Comments: CHI Conference on Human Factors in Computing Systems (CHI '21), May 8--13, 2021, Yokohama, Japan

Social App Accessibility for Deaf Signers

Authors: Kelly Mack, Danielle Bragg, Meredith Ringel Morris, Maarten W. Bos, Isabelle Albi, Andrés Monroy-Hernández

Abstract: Social media platforms support the sharing of written text, video, and audio. All of these formats may be inaccessible to people who are deaf or hard of hearing (DHH), particularly those who primarily communicate via sign language, people who we call Deaf signers. We study how Deaf signers engage with social platforms, focusing on how they share content and the barriers they face. We employ a mixe… ▽ More Social media platforms support the sharing of written text, video, and audio. All of these formats may be inaccessible to people who are deaf or hard of hearing (DHH), particularly those who primarily communicate via sign language, people who we call Deaf signers. We study how Deaf signers engage with social platforms, focusing on how they share content and the barriers they face. We employ a mixed-methods approach involving seven in-depth interviews and a survey of a larger population (n = 60). We find that Deaf signers share the most in written English, despite their desire to share in sign language. We further identify key areas of difficulty in consuming content (e.g., lack of captions for spoken content in videos) and producing content (e.g., captioning signed videos, signing into a phone camera) on social media platforms. Our results both provide novel insights into social media use by Deaf signers and reinforce prior findings on DHH communication more generally, while revealing potential ways to make social media platforms more accessible to Deaf signers. △ Less

Submitted 19 October, 2020; v1 submitted 13 August, 2020; originally announced August 2020.

Sifter: A Hybrid Workflow for Theme-based Video Curation at Scale

Authors: Yan Chen, Andrés Monroy-Hernández, Ian Wehrman, Steve Oney, Walter S. Lasecki, Rajan Vaish

Abstract: User-generated content platforms curate their vast repositories into thematic compilations that facilitate the discovery of high-quality material. Platforms that seek tight editorial control employ people to do this curation, but this process involves time-consuming routine tasks, such as sifting through thousands of videos. We introduce Sifter, a system that improves the curation process by combi… ▽ More User-generated content platforms curate their vast repositories into thematic compilations that facilitate the discovery of high-quality material. Platforms that seek tight editorial control employ people to do this curation, but this process involves time-consuming routine tasks, such as sifting through thousands of videos. We introduce Sifter, a system that improves the curation process by combining automated techniques with a human-powered pipeline that browses, selects, and reaches an agreement on what videos to include in a compilation. We evaluated Sifter by creating 12 compilations from over 34,000 user-generated videos. Sifter was more than three times faster than dedicated curators, and its output was of comparable quality. We reflect on the challenges and opportunities introduced by Sifter to inform the design of content curation systems that need subjective human judgments of videos at scale. △ Less

Submitted 6 April, 2020; v1 submitted 3 April, 2020; originally announced April 2020.

Blocks: Collaborative and Persistent Augmented Reality Experiences

Authors: Anhong Guo, Ilter Canberk, Hannah Murphy, Andrés Monroy-Hernández, Rajan Vaish

Abstract: We introduce Blocks, a mobile application that enables people to co-create AR structures that persist in the physical environment. Using Blocks, end users can collaborate synchronously or asynchronously, whether they are colocated or remote. Additionally, the AR structures can be tied to a physical location or can be accessed from anywhere. We evaluated how people used Blocks through a series of l… ▽ More We introduce Blocks, a mobile application that enables people to co-create AR structures that persist in the physical environment. Using Blocks, end users can collaborate synchronously or asynchronously, whether they are colocated or remote. Additionally, the AR structures can be tied to a physical location or can be accessed from anywhere. We evaluated how people used Blocks through a series of lab and field deployment studies with over 160 participants, and explored the interplay between two collaborative dimensions: space and time. We found that participants preferred creating structures synchronously with colocated collaborators. Additionally, they were most active when they created structures that were not restricted by time or place. Unlike most of today's AR experiences, which focus on content consumption, this work outlines new design opportunities for persistent and collaborative AR experiences that empower anyone to collaborate and create AR content. △ Less

Submitted 14 August, 2019; v1 submitted 6 August, 2019; originally announced August 2019.

Comments: ACM UbiComp 2019

Animo: Sharing Biosignals on a Smartwatch for Lightweight Social Connection

Authors: Fannie Liu, Mario Esparza, Maria Pavlovskaia, Geoff Kaufman, Laura Dabbish, Andrés Monroy-Hernández

Abstract: We present Animo, a smartwatch app that enables people to share and view each other's biosignals. We designed and engineered Animo to explore new ground for smartwatch-based biosignals social computing systems: identifying opportunities where these systems can support lightweight and mood-centric interactions. In our work we develop, explore, and evaluate several innovative features designed for d… ▽ More We present Animo, a smartwatch app that enables people to share and view each other's biosignals. We designed and engineered Animo to explore new ground for smartwatch-based biosignals social computing systems: identifying opportunities where these systems can support lightweight and mood-centric interactions. In our work we develop, explore, and evaluate several innovative features designed for dyadic communication of heart rate. We discuss the results of a two-week study (N=34), including new communication patterns participants engaged in, and outline the design landscape for communicating with biosignals on smartwatches. △ Less

Submitted 12 April, 2019; originally announced April 2019.

Comments: Journal Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/UbiComp '19). Volume 3 Issue 1, March 2019. Article No. 18

Analyzing the Use of Camera Glasses in the Wild

Authors: Taryn Bipat, Maarten Willem Bos, Rajan Vaish, Andrés Monroy-Hernández

Abstract: Camera glasses enable people to capture point-of-view videos using a common accessory, hands-free. In this paper, we investigate how, when, and why people used one such product: Spectacles. We conducted 39 semi-structured interviews and surveys with 191 owners of Spectacles. We found that the form factor elicits sustained usage behaviors, and opens opportunities for new use-cases and types of cont… ▽ More Camera glasses enable people to capture point-of-view videos using a common accessory, hands-free. In this paper, we investigate how, when, and why people used one such product: Spectacles. We conducted 39 semi-structured interviews and surveys with 191 owners of Spectacles. We found that the form factor elicits sustained usage behaviors, and opens opportunities for new use-cases and types of content captured. We provide a usage typology, and highlight societal and individual factors that influence the classification of behaviors. △ Less

Submitted 26 February, 2019; originally announced February 2019.

Comments: In Proceedings of the 37th Annual ACM Conference on Human Factors in Computing Systems (CHI 2019). ACM, New York, NY, USA

Laying the Groundwork for a Worker-Centric Peer Economy

Authors: Ali Alkhatib, Justin Cranshaw, Andrés Monroy-Hernández

Abstract: The "gig economy" has transformed the ways in which people work, but in many ways these markets stifle the growth of workers and the autonomy and protections that workers have grown to expect. We explored the viability of a "worker centric peer economy"--a system wherein workers benefit as well as consumers-- and conducted ethnographic field work across fields ranging from domestic labor to home h… ▽ More The "gig economy" has transformed the ways in which people work, but in many ways these markets stifle the growth of workers and the autonomy and protections that workers have grown to expect. We explored the viability of a "worker centric peer economy"--a system wherein workers benefit as well as consumers-- and conducted ethnographic field work across fields ranging from domestic labor to home health care. We discovered seven facets that system designers ought to consider when designing a labor market for "gig workers," consisting principally of the following: constructive feedback, assigning work fairly, managing customer expectations, protecting vulnerable workers, reconciling worker identities, assessing worker qualifications, & communicating worker quality. We discuss these considerations and provide guidance toward the design of a mutually beneficial market for gig workers. △ Less

Submitted 21 July, 2018; originally announced July 2018.

Report number: MSR-TR-2016-50

Understanding Chatbot-mediated Task Management

Authors: Carlos Toxtli, Andrés Monroy-Hernández, Justin Cranshaw

Abstract: Effective task management is essential to successful team collaboration. While the past decade has seen considerable innovation in systems that track and manage group tasks, these innovations have typically been outside of the principal communication channels: email, instant messenger, and group chat. Teams formulate, discuss, refine, assign, and track the progress of their collaborative tasks ove… ▽ More Effective task management is essential to successful team collaboration. While the past decade has seen considerable innovation in systems that track and manage group tasks, these innovations have typically been outside of the principal communication channels: email, instant messenger, and group chat. Teams formulate, discuss, refine, assign, and track the progress of their collaborative tasks over electronic communication channels, yet they must leave these channels to update their task-tracking tools, creating a source of friction and inefficiency. To address this problem, we explore how bots might be used to mediate task management for individuals and teams. We deploy a prototype bot to eight different teams of information workers to help them create, assign, and keep track of tasks, all within their main communication channel. We derived seven insights for the design of future bots for coordinating work. △ Less

Submitted 8 February, 2018; originally announced February 2018.

Comments: 5 pages, 2 figures, CHI 2018

ACM Class: H.5.m

Redes sociales, participación ciudadana y la hipótesis del slacktivismo: lecciones del caso de "El Bronco" / Social Media, Civic Engagement, and the Slacktivism Hypothesis: Lessons from Mexico's "El Bronco"

Authors: Philip N. Howard, Saiph Savage, Claudia Flores-Saviaga, Carlos Toxtli, Andres Monroy-Hernández

Abstract: El uso de las redes sociales tiene consecuencias positivas o negativas en la participación ciudadana? La gran parte de los intentos por responder a esta pregunta incluyen datos de la opinión pública de los Estados Unidos, por lo que nosotros ofrecemos un estudio sobre un caso significativo de México, donde un candidato independiente utilizó las redes sociales para comunicarse con el público y rehu… ▽ More El uso de las redes sociales tiene consecuencias positivas o negativas en la participación ciudadana? La gran parte de los intentos por responder a esta pregunta incluyen datos de la opinión pública de los Estados Unidos, por lo que nosotros ofrecemos un estudio sobre un caso significativo de México, donde un candidato independiente utilizó las redes sociales para comunicarse con el público y rehuyó de los medios de comunicación tradicionales. Dicho candidato, conocido como "El Bronco", ganó la carrera por la gubernatura del estado al derrotar a los candidatos de los partidos tradicionales. Además, generó una participación ciudadana que se ha mantenido más allá del día de las elecciones. En nuestra investigación analizamos más de 750 mil mensajes, comentarios y respuestas durante más de tres años de interacciones en la página pública de Facebook de "El Bronco". Examinamos y demostramos que las redes sociales pueden utilizarse para dar cabida a una gran cantidad de interacciones ciudadanas sobre la vida pública más allá de un acontecimiento político. Does social media use have a positive or negative impact on civic engagement? The "slacktivism hypothesis" holds that if citizens use social media for political conversation, those conversations will be fleeting and vapid. Most attempts to answer this question involve public opinion data from the United States, so we offer an examination of an important case from Mexico, where an independent candidate used social media to communicate with the public and eschewed traditional media outlets. He won the race for state governor, defeating candidates from traditional parties and triggering sustained public engagement beyond election day. In our investigation, we analyze over 750,000 posts, comments, and replies over three years of conversations on the Facebook page of "El Bronco". △ Less

Submitted 9 October, 2017; originally announced October 2017.

Calendar.help: Designing a Workflow-Based Scheduling Agent with Humans in the Loop

Authors: Justin Cranshaw, Emad Elwany, Todd Newman, Rafal Kocielnik, Bowen Yu, Sandeep Soni, Jaime Teevan, Andrés Monroy-Hernández

Abstract: Although information workers may complain about meetings, they are an essential part of their work life. Consequently, busy people spend a significant amount of time scheduling meetings. We present Calendar.help, a system that provides fast, efficient scheduling through structured workflows. Users interact with the system via email, delegating their scheduling needs to the system as if it were a h… ▽ More Although information workers may complain about meetings, they are an essential part of their work life. Consequently, busy people spend a significant amount of time scheduling meetings. We present Calendar.help, a system that provides fast, efficient scheduling through structured workflows. Users interact with the system via email, delegating their scheduling needs to the system as if it were a human personal assistant. Common scheduling scenarios are broken down using well-defined workflows and completed as a series of microtasks that are automated when possible and executed by a human otherwise. Unusual scenarios fall back to a trained human assistant who executes them as unstructured macrotasks. We describe the iterative approach we used to develop Calendar.help, and share the lessons learned from scheduling thousands of meetings during a year of real-world deployments. Our findings provide insight into how complex information tasks can be broken down into repeatable components that can be executed efficiently to improve productivity. △ Less

Submitted 24 March, 2017; originally announced March 2017.

Comments: 10 pages

A longitudinal dataset of five years of public activity in the Scratch online community

Authors: Benjamin Mako Hill, Andrés Monroy-Hernández

Abstract: Scratch is a programming environment and an online community where young people can create, share, learn, and communicate. In collaboration with the Scratch Team at MIT, we created a longitudinal dataset of public activity in the Scratch online community during its first five years (2007-2012). The dataset comprises 32 tables with information on more than 1 million Scratch users, nearly 2 million… ▽ More Scratch is a programming environment and an online community where young people can create, share, learn, and communicate. In collaboration with the Scratch Team at MIT, we created a longitudinal dataset of public activity in the Scratch online community during its first five years (2007-2012). The dataset comprises 32 tables with information on more than 1 million Scratch users, nearly 2 million Scratch projects, more than 10 million comments, more than 30 million visits to Scratch projects, and more. To help researchers understand this dataset, and to establish the validity of the data, we also include the source code of every version of the software that operated the website, as well as the software used to generate this dataset. We believe this is the largest and most comprehensive downloadable dataset of youth programming artifacts and communication. △ Less

Submitted 3 February, 2017; originally announced February 2017.

Journal ref: Scientific Data 4, Article number: 170002, 2017

CrowdTone: Crowd-powered tone feedback and improvement system for emails

Authors: Rajan Vaish, Andrés Monroy-Hernández

Abstract: In this paper, we present CrowdTone, a system designed to help people set the appropriate tone in their email communication. CrowdTone utilizes the context and content of an email message to identify and set the appropriate tone through a consensus-building process executed by crowd workers. We evaluated CrowdTone with 22 participants, who provided a total of 29 emails that they had received in th… ▽ More In this paper, we present CrowdTone, a system designed to help people set the appropriate tone in their email communication. CrowdTone utilizes the context and content of an email message to identify and set the appropriate tone through a consensus-building process executed by crowd workers. We evaluated CrowdTone with 22 participants, who provided a total of 29 emails that they had received in the past, and ran them through CrowdTone. Participants and professional writers assessed the quality of improvements finding a substantial increase in the percentage of emails deemed "appropriate" or "very appropriate" - from 25% to more than 90% by recipients, and from 45% to 90% by professional writers. Additionally, the recipients' feedback indicated that more than 90% of the CrowdTone processed emails showed improvement. △ Less

Submitted 7 January, 2017; originally announced January 2017.

Comments: 10 pages, 14 figures

Smart Societies: From Citizens as Sensors to Collective Action

Authors: Andrés Monroy-Hernández, Shelly Farnham, Emre Kıcıman, Scott Counts, Munmun De Choudhury

Abstract: Social media has become globally ubiquitous, transforming how people are networked and mobilized. This forum explores research and applications of these new networked publics at individual, organizational, and societal levels. Social media has become globally ubiquitous, transforming how people are networked and mobilized. This forum explores research and applications of these new networked publics at individual, organizational, and societal levels. △ Less

Submitted 28 May, 2016; originally announced May 2016.

Journal ref: interactions 20, 4 (July 2013)

Surviving an "Eternal September" - How an Online Community Managed a Surge of Newcomers

Authors: Charles Kiene, Andrés Monroy-Hernández, Benjamin Mako Hill

Abstract: We present a qualitative analysis of interviews with participants in the NoSleep community within Reddit where millions of fans and writers of horror fiction congregate. We explore how the community handled a massive, sudden, and sustained increase in new members. Although existing theory and stories like Usenet's infamous "Eternal September" suggest that large influxes of newcomers can hurt onlin… ▽ More We present a qualitative analysis of interviews with participants in the NoSleep community within Reddit where millions of fans and writers of horror fiction congregate. We explore how the community handled a massive, sudden, and sustained increase in new members. Although existing theory and stories like Usenet's infamous "Eternal September" suggest that large influxes of newcomers can hurt online communities, our interviews suggest that NoSleep survived without major incident. We propose that three features of NoSleep allowed it to manage the rapid influx of newcomers gracefully: (1) an active and well-coordinated group of administrators, (2) a shared sense of community which facilitated community moderation, and (3) technological systems that mitigated norm violations. We also point to several important trade-offs and limitations. △ Less

Submitted 27 May, 2016; originally announced May 2016.

Comments: In Proceedings of the 34th Annual ACM Conference on Human Factors in Computing Systems (CHI 2016). ACM, New York, NY, USA

Remixing as a Pathway to Computational Thinking

Authors: Sayamindu Dasgupta, William Hale, Andrés Monroy-Hernández, Benjamin Mako Hill

Abstract: Theorists and advocates of "remixing" have suggested that appropriation can act as a pathway for learning. We test this theory quantitatively using data from more than 2.4 million multimedia programming projects shared by more than 1 million users in the Scratch online community. First, we show that users who remix more often have larger repertoires of programming commands even after controlling f… ▽ More Theorists and advocates of "remixing" have suggested that appropriation can act as a pathway for learning. We test this theory quantitatively using data from more than 2.4 million multimedia programming projects shared by more than 1 million users in the Scratch online community. First, we show that users who remix more often have larger repertoires of programming commands even after controlling for the numbers of projects and amount of code shared. Second, we show that exposure to computational thinking concepts through remixing is associated with increased likelihood of using those concepts. Our results support theories that young people learn through remixing, and have important implications for designers of social computing systems. △ Less

Submitted 27 May, 2016; originally announced May 2016.

Comments: In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16)

Journeys & Notes: Designing Social Computing for Non-Places

Authors: Justin Cranshaw, Andrés Monroy-Hernández, S. A. Needham

Abstract: In this work we present a mobile application we designed and engineered to enable people to log their travels near and far, leave notes behind, and build a community around spaces in between destinations. Our design explores new ground for location-based social computing systems, identifying opportunities where these systems can foster the growth of on-line communities rooted at non-places. In our… ▽ More In this work we present a mobile application we designed and engineered to enable people to log their travels near and far, leave notes behind, and build a community around spaces in between destinations. Our design explores new ground for location-based social computing systems, identifying opportunities where these systems can foster the growth of on-line communities rooted at non-places. In our work we develop, explore, and evaluate several innovative features designed around four usage scenarios: daily commuting, long-distance traveling, quantified traveling, and journaling. We present the results of two small-scale user studies, and one large-scale, world-wide deployment, synthesizing the results as potential opportunities and lessons learned in designing social computing for non-places. △ Less

Submitted 27 May, 2016; originally announced May 2016.

Comments: CHI '16 Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Networks of Gratitude: Structures of Thanks and User Expectations in Workplace Appreciation Systems

Authors: Emma S. Spiro, J. Nathan Matias, Andrés Monroy-Hernández

Abstract: Appreciation systems--platforms for users to exchange thanks and praise--are becoming common in the workplace, where employees share appreciation, managers are notified, and aggregate scores are sometimes made visible. Who do people thank on these systems, and what do they expect from each other and their managers? After introducing the design affordances of 13 appreciation systems, we discuss a s… ▽ More Appreciation systems--platforms for users to exchange thanks and praise--are becoming common in the workplace, where employees share appreciation, managers are notified, and aggregate scores are sometimes made visible. Who do people thank on these systems, and what do they expect from each other and their managers? After introducing the design affordances of 13 appreciation systems, we discuss a system we call Gratia, in use at a large multinational company for over four years. Using logs of 422,000 appreciation messages and user surveys, we explore the social dynamics of use and ask if use of the system addresses the recognition problem. We find that while thanks is mostly exchanged among employees at the same level and different parts of the company, addressing the recognition problem, managers do not always act on that recognition in ways that employees expect. △ Less

Submitted 26 May, 2016; originally announced May 2016.

Comments: in Tenth International AAAI Conference on Web and Social Media, 2016

Botivist: Calling Volunteers to Action Using Online Bots

Authors: Saiph Savage, Andres Monroy-Hernandez, Tobias Hollerer

Abstract: To help activists call new volunteers to action, we present Botivist: a platform that uses Twitter bots to find potential volunteers and request contributions. By leveraging different Twitter accounts, Botivist employs different strategies to encourage participation. We explore how people respond to bots calling them to action using a test case about corruption in Latin America. Our results show t… ▽ More To help activists call new volunteers to action, we present Botivist: a platform that uses Twitter bots to find potential volunteers and request contributions. By leveraging different Twitter accounts, Botivist employs different strategies to encourage participation. We explore how people respond to bots calling them to action using a test case about corruption in Latin America. Our results show that the majority of volunteers (>80%) who responded to Botivist's calls to action contributed relevant proposals to address the assigned social problem. Different strategies produced differences in the quantity and relevance of contributions. Some strategies that work well offline and face-to-face appeared to hinder people's participation when used by an online bot. We analyze user behavior in response to being approached by bots with an activist purpose. We also provide strong evidence for the value of this type of civic media, and derive design implications. △ Less

Submitted 20 September, 2015; originally announced September 2015.

Comments: 9 pages, 3 figures, CSCW'16

ACM Class: H.5.2

Storia: Summarizing Social Media Content based on Narrative Theory using Crowdsourcing

Authors: Joy Kim, Andres Monroy-Hernandez

Abstract: People from all over the world use social media to share thoughts and opinions about events, and understanding what people say through these channels has been of increasing interest to researchers, journalists, and marketers alike. However, while automatically generated summaries enable people to consume large amounts of data efficiently, they do not provide the context needed for a viewer to full… ▽ More People from all over the world use social media to share thoughts and opinions about events, and understanding what people say through these channels has been of increasing interest to researchers, journalists, and marketers alike. However, while automatically generated summaries enable people to consume large amounts of data efficiently, they do not provide the context needed for a viewer to fully understand an event. Narrative structure can provide templates for the order and manner in which this data is presented to create stories that are oriented around narrative elements rather than summaries made up of facts. In this paper, we use narrative theory as a framework for identifying the links between social media content. To do this, we designed crowdsourcing tasks to generate summaries of events based on commonly used narrative templates. In a controlled study, for certain types of events, people were more emotionally engaged with stories created with narrative structure and were also more likely to recommend them to others compared to summaries created without narrative structure. △ Less

Submitted 10 September, 2015; originally announced September 2015.

ACM Class: H.5.3

Tag Me Maybe: Perceptions of Public Targeted Sharing on Facebook

Authors: Saiph Savage, Andres Monroy-Hernandez, Kasturi Bhattacharjee, Tobias Hollerer

Abstract: Social network sites allow users to publicly tag people in their posts. These tagged posts allow users to share to both the general public and a targeted audience, dynamically assembled via notifications that alert the people mentioned. We investigate people's perceptions of this mixed sharing mode through a qualitative study with 120 participants. We found that individuals like this sharing modal… ▽ More Social network sites allow users to publicly tag people in their posts. These tagged posts allow users to share to both the general public and a targeted audience, dynamically assembled via notifications that alert the people mentioned. We investigate people's perceptions of this mixed sharing mode through a qualitative study with 120 participants. We found that individuals like this sharing modality as they believe it strengthens their relationships. Individuals also report using tags to have more control of Facebook's ranking algorithm, and to expose one another to novel information and people. This work helps us understand people's complex relationships with the algorithms that mediate their interactions with each another. We conclude by discussing the design implications of these findings. △ Less

Submitted 3 September, 2015; originally announced September 2015.

Comments: 5 pages, one figure, Hypertext 2016

ACM Class: H.5.3

Political Bots and the Manipulation of Public Opinion in Venezuela

Authors: Michelle Forelle, Phil Howard, Andrés Monroy-Hernández, Saiph Savage

Abstract: Social and political bots have a small but strategic role in Venezuelan political conversations. These automated scripts generate content through social media platforms and then interact with people. In this preliminary study on the use of political bots in Venezuela, we analyze the tweeting, following and retweeting patterns for the accounts of prominent Venezuelan politicians and prominent Venez… ▽ More Social and political bots have a small but strategic role in Venezuelan political conversations. These automated scripts generate content through social media platforms and then interact with people. In this preliminary study on the use of political bots in Venezuela, we analyze the tweeting, following and retweeting patterns for the accounts of prominent Venezuelan politicians and prominent Venezuelan bots. We find that bots generate a very small proportion of all the traffic about political life in Venezuela. Bots are used to retweet content from Venezuelan politicians but the effect is subtle in that less than 10 percent of all retweets come from bot-related platforms. Nonetheless, we find that the most active bots are those used by Venezuela's radical opposition. Bots are pretending to be political leaders, government agencies and political parties more than citizens. Finally, bots are promoting innocuous political events more than attacking opponents or spreading misinformation. △ Less

Submitted 25 July, 2015; originally announced July 2015.

Comments: 8 pages, 3 figures

ACM Class: H.5.3

RIMES: Embedding Interactive Multimedia Exercises in Lecture Videos

Authors: Juho Kim, Elena L. Glassman, Andrés Monroy-Hernández, Meredith Ringel Morris

Abstract: Teachers in conventional classrooms often ask learners to express themselves and show their thought processes by speaking out loud, drawing on a whiteboard, or even using physical objects. Despite the pedagogical value of such activities, interactive exercises available in most online learning platforms are constrained to multiple-choice and short answer questions. We introduce RIMES, a system for… ▽ More Teachers in conventional classrooms often ask learners to express themselves and show their thought processes by speaking out loud, drawing on a whiteboard, or even using physical objects. Despite the pedagogical value of such activities, interactive exercises available in most online learning platforms are constrained to multiple-choice and short answer questions. We introduce RIMES, a system for easily authoring, recording, and reviewing interactive multimedia exercises embedded in lecture videos. With RIMES, teachers can prompt learners to record their responses to an activity using video, audio, and inking while watching lecture videos. Teachers can then review and interact with all the learners' responses in an aggregated gallery. We evaluated RIMES with 19 teachers and 25 students. Teachers created a diverse set of activities across multiple subjects that tested deep conceptual and procedural knowledge. Teachers found the exercises useful for capturing students' thought processes, identifying misconceptions, and engaging students with content. △ Less

Submitted 5 July, 2015; originally announced July 2015.

Journal ref: In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI 2015). ACM, New York, NY, USA, 1535-1544

Mudslide: A Spatially Anchored Census of Student Confusion for Online Lecture Videos

Authors: Elena L. Glassman, Juho Kim, Andrés Monroy-Hernández, Meredith Ringel Morris

Abstract: Educators have developed an effective technique to get feedback after in-person lectures, called "muddy card." Students are given time to reflect and write the "muddiest" (least clear) point on an index card, to hand in as they leave class. This practice of assigning end-of-lecture reflection tasks to generate explicit student feedback is well suited for adaptation to the challenge of supporting f… ▽ More Educators have developed an effective technique to get feedback after in-person lectures, called "muddy card." Students are given time to reflect and write the "muddiest" (least clear) point on an index card, to hand in as they leave class. This practice of assigning end-of-lecture reflection tasks to generate explicit student feedback is well suited for adaptation to the challenge of supporting feedback in online video lectures. We describe the design and evaluation of Mudslide, a prototype system that translates the practice of muddy cards into the realm of online lecture videos. Based on an in-lab study of students and teachers, we find that spatially contextualizing students' muddy point feedback with respect to particular lecture slides is advantageous to both students and teachers. We also reflect on further opportunities for enhancing this feedback method based on teachers' and students' experiences with our prototype. △ Less

Submitted 5 July, 2015; originally announced July 2015.

Comments: Best paper honorable mention

Journal ref: In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI 2015). ACM, New York, NY, USA, 1555-1564

Is Anyone Out There? Unpacking Q&A Hashtags on Twitter

Authors: Jeffrey M. Rzeszotarski, Emma S. Spiro, Jorge Nathan Matias, Andrés Monroy-Hernández, Meredith Ringel Morris

Abstract: In addition to posting news and status updates, many Twitter users post questions that seek various types of subjective and objective information. These questions are often labeled with "Q&A" hashtags, such as #lazyweb or #twoogle. We surveyed Twitter users and found they employ these Q&A hashtags both as a topical signifier (this tweet needs an answer!) and to reach out to those beyond their imme… ▽ More In addition to posting news and status updates, many Twitter users post questions that seek various types of subjective and objective information. These questions are often labeled with "Q&A" hashtags, such as #lazyweb or #twoogle. We surveyed Twitter users and found they employ these Q&A hashtags both as a topical signifier (this tweet needs an answer!) and to reach out to those beyond their immediate followers (a community of helpful tweeters who monitor the hashtag). However, our log analysis of thousands of hashtagged Q&A exchanges reveals that nearly all replies to hashtagged questions come from a user's immediate follower network, contradicting user's beliefs that they are tap** into a larger community by tagging their question tweets. This finding has implications for designing next-generation social search systems that reach and engage a wide audience of answerers. △ Less

Submitted 5 July, 2015; originally announced July 2015.

Journal ref: In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2014). ACM, New York, NY, USA, 2755-2758

Mixsourcing: a remix framework as a form of crowdsourcing

Authors: Sarah Hallacher, Jenny Rodenhouse, Andres Monroy-Hernandez

Abstract: In this paper, we introduce the concept of mixsourcing as a modality of crowdsourcing focused on using remixing as a framework to get people to perform creative tasks. We explore this idea through the design of a system that helped us identify the promises and challenges of this peer-production modality. In this paper, we introduce the concept of mixsourcing as a modality of crowdsourcing focused on using remixing as a framework to get people to perform creative tasks. We explore this idea through the design of a system that helped us identify the promises and challenges of this peer-production modality. △ Less

Submitted 5 July, 2015; originally announced July 2015.

Comments: In CHI 2013 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13)