-
From Paper to Card: Transforming Design Implications with Generative AI
Authors:
Donghoon Shin,
Lucy Lu Wang,
Gary Hsieh
Abstract:
Communicating design implications is common within the HCI community when publishing academic papers, yet these papers are rarely read and used by designers. One solution is to use design cards as a form of translational resource that communicates valuable insights from papers in a more digestible and accessible format to assist in design processes. However, creating design cards can be time-consu…
▽ More
Communicating design implications is common within the HCI community when publishing academic papers, yet these papers are rarely read and used by designers. One solution is to use design cards as a form of translational resource that communicates valuable insights from papers in a more digestible and accessible format to assist in design processes. However, creating design cards can be time-consuming, and authors may lack the resources/know-how to produce cards. Through an iterative design process, we built a system that helps create design cards from academic papers using an LLM and text-to-image model. Our evaluation with designers (N=21) and authors of selected papers (N=12) revealed that designers perceived the design implications from our design cards as more inspiring and generative, compared to reading original paper texts, and the authors viewed our system as an effective way of communicating their design implications. We also propose future enhancements for AI-generated design cards.
△ Less
Submitted 12 March, 2024;
originally announced March 2024.
-
AI-Assisted Causal Pathway Diagram for Human-Centered Design
Authors:
Ruican Zhong,
Donghoon Shin,
Rosemary Meza,
Predrag Klasnja,
Lucas Colusso,
Gary Hsieh
Abstract:
This paper explores the integration of causal pathway diagrams (CPD) into human-centered design (HCD), investigating how these diagrams can enhance the early stages of the design process. A dedicated CPD plugin for the online collaborative whiteboard platform Miro was developed to streamline diagram creation and offer real-time AI-driven guidance. Through a user study with designers (N=20), we fou…
▽ More
This paper explores the integration of causal pathway diagrams (CPD) into human-centered design (HCD), investigating how these diagrams can enhance the early stages of the design process. A dedicated CPD plugin for the online collaborative whiteboard platform Miro was developed to streamline diagram creation and offer real-time AI-driven guidance. Through a user study with designers (N=20), we found that CPD's branching and its emphasis on causal connections supported both divergent and convergent processes during design. CPD can also facilitate communication among stakeholders. Additionally, we found our plugin significantly reduces designers' cognitive workload and increases their creativity during brainstorming, highlighting the implications of AI-assisted tools in supporting creative work and evidence-based designs.
△ Less
Submitted 12 March, 2024;
originally announced March 2024.
-
Speech as Interactive Design Material (SIDM): How to design and evaluate task-tailored synthetic voices?
Authors:
Mateusz Dubiel,
Matthew Aylett,
Anuschka Schmitt,
Zilin Ma,
Gary Hsieh,
Thiemo Wambsganss
Abstract:
The aim of this workshop is two-fold. First, it aims to establish a research community focused on design and evaluation of synthetic speech (TTS) interfaces that are tailored not only to goal oriented tasks (e.g., food ordering, online shop**) but also personal growth and resilience promoting applications (e.g., coaching, mindful reflection, and tutoring). Second, through discussion and collabor…
▽ More
The aim of this workshop is two-fold. First, it aims to establish a research community focused on design and evaluation of synthetic speech (TTS) interfaces that are tailored not only to goal oriented tasks (e.g., food ordering, online shop**) but also personal growth and resilience promoting applications (e.g., coaching, mindful reflection, and tutoring). Second, through discussion and collaborative efforts, to establish a set of practices and standards that will help to improve ecological validity of TTS evaluation. In particular, the workshop will explore the topics such as: interaction design of voice-based conversational interfaces; the interplay between prosodic aspects (e.g., pitch variance, loudness, jitter) of TTS and its impact on voice perception. This workshop will serve as a platform on which to build a community that is better equipped to tackle the dynamic field of interactive TTS interfaces, which remains understudied, yet increasingly pertinent to everyday lives of users.
△ Less
Submitted 26 February, 2024;
originally announced February 2024.
-
Comparing Large Language Model AI and Human-Generated Coaching Messages for Behavioral Weight Loss
Authors:
Zhuoran Huang,
Michael P. Berry,
Christina Chwyl,
Gary Hsieh,
**g Wei,
Evan M. Forman
Abstract:
Automated coaching messages for weight control can save time and costs, but their repetitive, generic nature may limit their effectiveness compared to human coaching. Large language model (LLM) based artificial intelligence (AI) chatbots, like ChatGPT, could offer more personalized and novel messages to address repetition with their data-processing abilities. While LLM AI demonstrates promise to e…
▽ More
Automated coaching messages for weight control can save time and costs, but their repetitive, generic nature may limit their effectiveness compared to human coaching. Large language model (LLM) based artificial intelligence (AI) chatbots, like ChatGPT, could offer more personalized and novel messages to address repetition with their data-processing abilities. While LLM AI demonstrates promise to encourage healthier lifestyles, studies have yet to examine the feasibility and acceptability of LLM-based BWL coaching. 87 adults in a weight-loss trial rated ten coaching messages' helpfulness (five human-written, five ChatGPT-generated) using a 5-point Likert scale, providing additional open-ended feedback to justify their ratings. Participants also identified which messages they believed were AI-generated. The evaluation occurred in two phases: messages in Phase 1 were perceived as impersonal and negative, prompting revisions for Phase 2 messages. In Phase 1, AI-generated messages were rated less helpful than human-written ones, with 66 percent receiving a helpfulness rating of 3 or higher. However, in Phase 2, the AI messages matched the human-written ones regarding helpfulness, with 82% scoring three or above. Additionally, 50% were misidentified as human-written, suggesting AI's sophistication in mimicking human-generated content. A thematic analysis of open-ended feedback revealed that participants appreciated AI's empathy and personalized suggestions but found them more formulaic, less authentic, and too data-focused. This study reveals the preliminary feasibility and acceptability of LLM AIs, like ChatGPT, in crafting potentially effective weight control coaching messages. Our findings also underscore areas for future enhancement.
△ Less
Submitted 7 December, 2023;
originally announced December 2023.
-
PlanFitting: Tailoring Personalized Exercise Plans with Large Language Models
Authors:
Donghoon Shin,
Gary Hsieh,
Young-Ho Kim
Abstract:
A personally tailored exercise regimen is crucial to ensuring sufficient physical activities, yet challenging to create as people have complex schedules and considerations and the creation of plans often requires iterations with experts. We present PlanFitting, a conversational AI that assists in personalized exercise planning. Leveraging generative capabilities of large language models, PlanFitti…
▽ More
A personally tailored exercise regimen is crucial to ensuring sufficient physical activities, yet challenging to create as people have complex schedules and considerations and the creation of plans often requires iterations with experts. We present PlanFitting, a conversational AI that assists in personalized exercise planning. Leveraging generative capabilities of large language models, PlanFitting enables users to describe various constraints and queries in natural language, thereby facilitating the creation and refinement of their weekly exercise plan to suit their specific circumstances while staying grounded in foundational principles. Through a user study where participants (N=18) generated a personalized exercise plan using PlanFitting and expert planners (N=3) evaluated these plans, we identified the potential of PlanFitting in generating personalized, actionable, and evidence-based exercise plans. We discuss future design opportunities for AI assistants in creating plans that better comply with exercise principles and accommodate personal constraints.
△ Less
Submitted 21 September, 2023;
originally announced September 2023.
-
Theoretical Foundation of Colored Petri Net through an Analysis of their Markings as Multi-classification
Authors:
Jules Chenou,
George Hsieh,
Aurelia Williams
Abstract:
Barwise and Seligman stated the first principle of information flow: "Information flow results from regularities in the distributed system." They represent a distributed system in terms of a classification consisting of a set of objects or tokens to be classified, a set of types used to classify tokens, and a binary relation between tokens and types that tells one which tokens are classified as be…
▽ More
Barwise and Seligman stated the first principle of information flow: "Information flow results from regularities in the distributed system." They represent a distributed system in terms of a classification consisting of a set of objects or tokens to be classified, a set of types used to classify tokens, and a binary relation between tokens and types that tells one which tokens are classified as being of which types. We aim to further this investigation and proceed with a dynamic or evolving system instead of a static system. We claim that a classification is a snapshot of a distributed system at a given moment or context. We then aim to answer the question posed by an evolving context. As the context or configuration changes, how to regularities evolve. This paper is a continuation of an investigation we started in \cite{esterlin}, where we initiated how to capture a dynamism of information flow with a Kripke structure. Here we develop the same procedure with colored Petri net(CPN). We first extend the classification concept to multiclassification by replacing its binary relation between tokens and types with a multi relation: a function from tok(A) x typ(A) to N, the set of natural numbers. The multiclassification will unfold into binary classification in order to compute its theory. It turns out that markings of a CPN are multiclassification; Amalgamating the theories of those classifications obtained as markings of CPN results in a CPN's knowledge base.
△ Less
Submitted 2 March, 2022;
originally announced March 2022.
-
Supporting Answerers with Feedback in Social Q&A
Authors:
John Frens,
Erin Walker,
Gary Hsieh
Abstract:
Prior research has examined the use of Social Question and Answer (Q&A) websites for answer and help seeking. However, the potential for these websites to support domain learning has not yet been realized. Hel** users write effective answers can be beneficial for subject area learning for both answerers and the recipients of answers. In this study, we examine the utility of crowdsourced, criteri…
▽ More
Prior research has examined the use of Social Question and Answer (Q&A) websites for answer and help seeking. However, the potential for these websites to support domain learning has not yet been realized. Hel** users write effective answers can be beneficial for subject area learning for both answerers and the recipients of answers. In this study, we examine the utility of crowdsourced, criteria-based feedback for answerers on a student-centered Q&A website, Brainly.com. In an experiment with 55 users, we compared perceptions of the current rating system against two feedback designs with explicit criteria (Appropriate, Understandable, and Generalizable). Contrary to our hypotheses, answerers disagreed with and rejected the criteria-based feedback. Although the criteria aligned with answerers' goals, and crowdsourced ratings were found to be objectively accurate, the norms and expectations for answers on Brainly conflicted with our design. We conclude with implications for the design of feedback in social Q&A.
△ Less
Submitted 26 September, 2018;
originally announced September 2018.
