-
"It's the only thing I can trust": Envisioning Large Language Model Use by Autistic Workers for Communication Assistance
Authors:
JiWoong Jang,
Sanika Moharana,
Patrick Carrington,
Andrew Begel
Abstract:
Autistic adults often experience stigma and discrimination at work, leading them to seek social communication support from coworkers, friends, and family despite emotional risks. Large language models (LLMs) are increasingly considered an alternative. In this work, we investigate the phenomenon of LLM use by autistic adults at work and explore opportunities and risks of LLMs as a source of social…
▽ More
Autistic adults often experience stigma and discrimination at work, leading them to seek social communication support from coworkers, friends, and family despite emotional risks. Large language models (LLMs) are increasingly considered an alternative. In this work, we investigate the phenomenon of LLM use by autistic adults at work and explore opportunities and risks of LLMs as a source of social communication advice. We asked 11 autistic participants to present questions about their own workplace-related social difficulties to (1) a GPT-4-based chatbot and (2) a disguised human confederate. Our evaluation shows that participants strongly preferred LLM over confederate interactions. However, a coach specializing in supporting autistic job-seekers raised concerns that the LLM was dispensing questionable advice. We highlight how this divergence in participant and practitioner attitudes reflects existing schisms in HCI on the relative privileging of end-user wants versus normative good and propose design considerations for LLMs to center autistic experiences.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
A Contextual Inquiry of People with Vision Impairments in Cooking
Authors:
Franklin Mingzhe Li,
Michael Xieyang Liu,
Shaun K. Kane,
Patrick Carrington
Abstract:
Individuals with vision impairments employ a variety of strategies for object identification, such as pans or soy sauce, in the culinary process. In addition, they often rely on contextual details about objects, such as location, orientation, and current status, to autonomously execute cooking activities. To understand how people with vision impairments collect and use the contextual information o…
▽ More
Individuals with vision impairments employ a variety of strategies for object identification, such as pans or soy sauce, in the culinary process. In addition, they often rely on contextual details about objects, such as location, orientation, and current status, to autonomously execute cooking activities. To understand how people with vision impairments collect and use the contextual information of objects while cooking, we conducted a contextual inquiry study with 12 participants in their own kitchens. This research aims to analyze object interaction dynamics in culinary practices to enhance assistive vision technologies for visually impaired cooks. We outline eight different types of contextual information and the strategies that blind cooks currently use to access the information while preparing meals. Further, we discuss preferences for communicating contextual information about kitchen objects as well as considerations for the deployment of AI-powered assistive technologies.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Understanding Visual Arts Experiences of Blind People
Authors:
Franklin Mingzhe Li,
Lotus Zhang,
Maryam Bandukda,
Abigale Stangl,
Kristen Shinohara,
Leah Findlater,
Patrick Carrington
Abstract:
Visual arts play an important role in cultural life and provide access to social heritage and self-enrichment, but most visual arts are inaccessible to blind people. Researchers have explored different ways to enhance blind people's access to visual arts (e.g., audio descriptions, tactile graphics). However, how blind people adopt these methods remains unknown. We conducted semi-structured intervi…
▽ More
Visual arts play an important role in cultural life and provide access to social heritage and self-enrichment, but most visual arts are inaccessible to blind people. Researchers have explored different ways to enhance blind people's access to visual arts (e.g., audio descriptions, tactile graphics). However, how blind people adopt these methods remains unknown. We conducted semi-structured interviews with 15 blind visual arts patrons to understand how they engage with visual artwork and the factors that influence their adoption of visual arts access methods. We further examined interview insights in a follow-up survey (N=220). We present: 1) current practices and challenges of accessing visual artwork in-person and online (e.g., Zoom tour), 2) motivation and cognition of perceiving visual arts (e.g., imagination), and 3) implications for designing visual arts access methods. Overall, our findings provide a roadmap for technology-based support for blind people's visual arts experiences.
△ Less
Submitted 30 January, 2023;
originally announced January 2023.
-
Freedom to Choose: Understanding Input Modality Preferences of People with Upper-body Motor Impairments for Activities of Daily Living
Authors:
Franklin Mingzhe Li,
Michael Xieyang Liu,
Yang Zhang,
Patrick Carrington
Abstract:
Many people with upper-body motor impairments encounter challenges while performing Activities of Daily Living (ADLs) and Instrumental Activities of Daily Living (IADLs), such as toileting, grooming, and managing finances, which have impacts on their Quality of Life (QOL). Although existing assistive technologies enable people with upper-body motor impairments to use different input modalities to…
▽ More
Many people with upper-body motor impairments encounter challenges while performing Activities of Daily Living (ADLs) and Instrumental Activities of Daily Living (IADLs), such as toileting, grooming, and managing finances, which have impacts on their Quality of Life (QOL). Although existing assistive technologies enable people with upper-body motor impairments to use different input modalities to interact with computing devices independently (e.g., using voice to interact with a computer), many people still require Personal Care Assistants (PCAs) to perform ADLs. Multimodal input has the potential to enable users to perform ADLs without human assistance. We conducted 12 semi-structured interviews with people who have upper-body motor impairments to capture their existing practices and challenges of performing ADLs, identify opportunities to expand the input possibilities for assistive devices, and understand user preferences for multimodal interaction during everyday tasks. Finally, we discuss implications for the design and use of multimodal input solutions to support user independence and collaborative experiences when performing daily living tasks.
△ Less
Submitted 9 July, 2022;
originally announced July 2022.
-
"It Feels Like Taking a Gamble": Exploring Perceptions, Practices, and Challenges of Using Makeup and Cosmetics for People with Visual Impairments
Authors:
Franklin Mingzhe Li,
Franchesca Spektor,
Meng Xia,
Mina Huh,
Peter Cederberg,
Yuqi Gong,
Kristen Shinohara,
Patrick Carrington
Abstract:
Makeup and cosmetics offer the potential for self-expression and the resha** of social roles for visually impaired people. However, there exist barriers to conducting a beauty regime because of the reliance on visual information and color variances in makeup. We present a content analysis of 145 YouTube videos to demonstrate visually impaired individuals' unique practices before, during, and aft…
▽ More
Makeup and cosmetics offer the potential for self-expression and the resha** of social roles for visually impaired people. However, there exist barriers to conducting a beauty regime because of the reliance on visual information and color variances in makeup. We present a content analysis of 145 YouTube videos to demonstrate visually impaired individuals' unique practices before, during, and after doing makeup. Based on the makeup practices, we then conducted semi-structured interviews with 12 visually impaired people to discuss their perceptions of and challenges with the makeup process in more depth. Overall, through our findings and discussion, we present novel perceptions of makeup from visually impaired individuals (e.g., broader representations of blindness and beauty). The existing challenges provide opportunities for future research to address learning barriers, insufficient feedback, and physical and environmental barriers, making the experience of doing makeup more accessible to people with visual impairments.
△ Less
Submitted 16 March, 2022;
originally announced March 2022.
-
An Exploration of Captioning Practices and Challenges of Individual Content Creators on YouTube for People with Hearing Impairments
Authors:
Franklin Mingzhe Li,
Cheng Lu,
Zhicong Lu,
Patrick Carrington,
Khai N. Truong
Abstract:
Deaf and Hard-of-Hearing (DHH) audiences have long complained about caption qualities for many online videos created by individual content creators on video-sharing platforms (e.g., YouTube). However, there lack explorations of practices, challenges, and perceptions of online video captions from the perspectives of both individual content creators and DHH audiences. In this work, we first explore…
▽ More
Deaf and Hard-of-Hearing (DHH) audiences have long complained about caption qualities for many online videos created by individual content creators on video-sharing platforms (e.g., YouTube). However, there lack explorations of practices, challenges, and perceptions of online video captions from the perspectives of both individual content creators and DHH audiences. In this work, we first explore DHH audiences' feedback on and reactions to YouTube video captions through interviews with 13 DHH individuals, and uncover DHH audiences' experiences, challenges, and perceptions on watching videos created by individual content creators (e.g., manually added caption tags could create additional confidence and trust in caption qualities for DHH audiences). We then discover individual content creators' practices, challenges, and perceptions on captioning their videos (e.g., back-captioning problems) by conducting a YouTube video analysis with 189 captioning-related YouTube videos, followed by a survey with 62 individual content creators. Overall, our findings provide an in-depth understanding of captions generated by individual content creators and bridge the knowledge gap mutually between content creators and DHH audiences on captions.
△ Less
Submitted 26 January, 2022;
originally announced January 2022.
-
Non-Visual Cooking: Exploring Practices and Challenges of Meal Preparation by People with Visual Impairments
Authors:
Franklin Mingzhe Li,
Jamie Dorst,
Peter Cederberg,
Patrick Carrington
Abstract:
The reliance on vision for tasks related to cooking and eating healthy can present barriers to cooking for oneself and achieving proper nutrition. There has been little research exploring cooking practices and challenges faced by people with visual impairments. We present a content analysis of 122 YouTube videos to highlight the cooking practices of visually impaired people, and we describe detail…
▽ More
The reliance on vision for tasks related to cooking and eating healthy can present barriers to cooking for oneself and achieving proper nutrition. There has been little research exploring cooking practices and challenges faced by people with visual impairments. We present a content analysis of 122 YouTube videos to highlight the cooking practices of visually impaired people, and we describe detailed practices for 12 different cooking activities (e.g., cutting and chop**, measuring, testing food for doneness). Based on the cooking practices, we also conducted semi-structured interviews with 12 visually impaired people who have cooking experience and show existing challenges, concerns, and risks in cooking (e.g., tracking the status of tasks in progress, verifying whether things are peeled or cleaned thoroughly). We further discuss opportunities to support the current practices and improve the independence of people with visual impairments in cooking (e.g., zero-touch interactions for cooking). Overall, our findings provide guidance for future research exploring various assistive technologies to help people cook without relying on vision.
△ Less
Submitted 12 July, 2021;
originally announced July 2021.
-
Long-term memory and delayed shear localisation in soft glassy materials
Authors:
Henry A. Lockwood,
Matthew P. Carrington,
Suzanne M. Fielding
Abstract:
We study theoretically the dynamics of soft glassy materials during the process of stress relaxation following the rapid imposition of a shear strain. By detailed numerical simulations of a mesoscopic soft glassy rheology model and three different simplified continuum fluidity models, we show that a dramatic shear localisation instability arises, in which the strain field suddenly becomes heteroge…
▽ More
We study theoretically the dynamics of soft glassy materials during the process of stress relaxation following the rapid imposition of a shear strain. By detailed numerical simulations of a mesoscopic soft glassy rheology model and three different simplified continuum fluidity models, we show that a dramatic shear localisation instability arises, in which the strain field suddenly becomes heterogeneous within the sample, accompanied by a precipitous drop in the stress. Remarkably, this instability can arise at extremely long delay times after the strain was applied, due to the long-term memory inherent to glassy systems. The finding that a catastrophic mechanical instability can arise long after any deformation could have far reaching consequences for material processing and performance, and potentially also for delayed geophysical phenomena.
△ Less
Submitted 12 July, 2019;
originally announced July 2019.
-
Optical properties of metamorphic type-I InAs$_{1-x}$Sb$_{x}$/Al$_{y}$In$_{1-y}$As quantum wells grown on GaAs for the mid-infrared spectral range
Authors:
Eva Repiso,
Christopher A. Broderick,
Maria de la Mata,
Reza Arkani,
Qi Lu,
Andrew R. J. Marshall,
Sergio I. Molina,
Eoin P. O'Reilly,
Peter J. Carrington,
Anthony Krier
Abstract:
We analyse the optical properties of InAs$_{1-x}$Sb$_{x}$/Al$_{y}$In$_{1-y}$As quantum wells (QWs) grown by molecular beam epitaxy on relaxed Al$_{y}$In$_{1-y}$As metamorphic buffer layers (MBLs) using GaAs substrates. The use of Al$_{y}$In$_{1-y}$As MBLs allows for the growth of QWs having large type-I band offsets, and emission wavelengths $> 3$ $μ$m. Photoluminescence (PL) measurements for QWs…
▽ More
We analyse the optical properties of InAs$_{1-x}$Sb$_{x}$/Al$_{y}$In$_{1-y}$As quantum wells (QWs) grown by molecular beam epitaxy on relaxed Al$_{y}$In$_{1-y}$As metamorphic buffer layers (MBLs) using GaAs substrates. The use of Al$_{y}$In$_{1-y}$As MBLs allows for the growth of QWs having large type-I band offsets, and emission wavelengths $> 3$ $μ$m. Photoluminescence (PL) measurements for QWs having Sb compositions up to $x = 10$\% demonstrate strong room temperature emission up to 3.4 $μ$m, as well as enhancement of the PL intensity with increasing wavelength. To quantify the trends in the measured PL we calculate the QW spontaneous emission, using a theoretical model based on an 8-band $\vec{k} \cdot \vec{p}$ Hamiltonian. The theoretical calculations, which are in good agreement with experiment, identify that the observed enhancement in PL intensity with increasing wavelength is associated with the impact of compressive strain on the QW valence band structure. Our results highlight the potential of type-I InAs$_{1-x}$Sb$_{x}$/Al$_{y}$In$_{1-y}$As metamorphic QWs to address several limitations associated with existing heterostructures operating in the mid-infrared, establishing these novel heterostructures as a suitable platform for the development of mid-infrared light-emitting diodes.
△ Less
Submitted 6 November, 2018;
originally announced November 2018.
