-
Safeguarding Crowdsourcing Surveys from ChatGPT with Prompt Injection
Authors:
Chaofan Wang,
Samuel Kernan Freire,
Mo Zhang,
**g Wei,
Jorge Goncalves,
Vassilis Kostakos,
Zhanna Sarsenbayeva,
Christina Schneegass,
Alessandro Bozzon,
Evangelos Niforatos
Abstract:
ChatGPT and other large language models (LLMs) have proven useful in crowdsourcing tasks, where they can effectively annotate machine learning training data. However, this means that they also have the potential for misuse, specifically to automatically answer surveys. LLMs can potentially circumvent quality assurance measures, thereby threatening the integrity of methodologies that rely on crowds…
▽ More
ChatGPT and other large language models (LLMs) have proven useful in crowdsourcing tasks, where they can effectively annotate machine learning training data. However, this means that they also have the potential for misuse, specifically to automatically answer surveys. LLMs can potentially circumvent quality assurance measures, thereby threatening the integrity of methodologies that rely on crowdsourcing surveys. In this paper, we propose a mechanism to detect LLM-generated responses to surveys. The mechanism uses "prompt injection", such as directions that can mislead LLMs into giving predictable responses. We evaluate our technique against a range of question scenarios, types, and positions, and find that it can reliably detect LLM-generated responses with more than 93% effectiveness. We also provide an open-source software to help survey designers use our technique to detect LLM responses. Our work is a step in ensuring that survey methodologies remain rigorous vis-a-vis LLMs.
△ Less
Submitted 14 June, 2023;
originally announced June 2023.
-
Using Thermal Imaging to Measure Hand Hygiene Quality
Authors:
Chaofan Wang,
Weiwei Jiang,
Kangning Yang,
Zhanna Sarsenbayeva,
Benjamin Tag,
Tilman Dingler,
Jorge Goncalves,
Vassilis Kostakos
Abstract:
Hand hygiene has long been promoted as the most effective way to prevent the transmission of infection. However, due to the low compliance and quality of hand hygiene reported in previous studies, constant monitoring of healthcare workers' hand hygiene compliance and quality is crucial. In this study, we investigate the feasibility of using a thermal camera together with an RGB camera to detect ha…
▽ More
Hand hygiene has long been promoted as the most effective way to prevent the transmission of infection. However, due to the low compliance and quality of hand hygiene reported in previous studies, constant monitoring of healthcare workers' hand hygiene compliance and quality is crucial. In this study, we investigate the feasibility of using a thermal camera together with an RGB camera to detect hand coverage of alcohol-based formulation, thereby monitoring handrub quality. The system yields promising results in terms of accuracy (93.5%) and Dice coefficient (87.1%) when observations take place 10 seconds after performing handrub. In addition, we also examine the system performance change over a 60-second observation period, and the accuracy and Dice coefficient still remain at about 92.4% and 85.7% when observation happens at the 60-second time point. Given these encouraging results, thermal imaging shows its potential feasibility in providing accurate, constant, and systematic hand hygiene quality monitoring.
△ Less
Submitted 4 February, 2023;
originally announced February 2023.
-
Current Challenges of Using Wearable Devices for Online Emotion Sensing
Authors:
Weiwei Jiang,
Kangning Yang,
Maximiliane Windl,
Francesco Chiossi,
Benjamin Tag,
Sven Mayer,
Zhanna Sarsenbayeva
Abstract:
A growing number of wearable devices is becoming increasingly non-invasive, readily available, and versatile for measuring different physiological signals. This renders them ideal for inferring the emotional states of their users. Despite the success of wearable devices in recent emotion studies, there are still several challenges to be addressed. In this position paper, we compare currently avail…
▽ More
A growing number of wearable devices is becoming increasingly non-invasive, readily available, and versatile for measuring different physiological signals. This renders them ideal for inferring the emotional states of their users. Despite the success of wearable devices in recent emotion studies, there are still several challenges to be addressed. In this position paper, we compare currently available wearables that can be used for emotion-sensing and identify the challenges and opportunities for future researchers. Our investigation opens the discussion of what is missing for in-the-wild for emotion-sensing studies.
△ Less
Submitted 10 August, 2022;
originally announced August 2022.
-
UbiNIRS: A Software Framework for Miniaturized NIRS-based Applications
Authors:
Weiwei Jiang,
Zhanna Sarsenbayeva,
Difeng Yu,
**g Wei,
Niels van Berkel,
Jorge Goncalves,
Vassilis Kostakos
Abstract:
We present UbiNIRS, a software framework for rapid development and deployment of applications using miniaturized near-infrared spectroscopy (NIRS). NIRS is an emerging material sensing technology that has shown a great potential in recent work from the HCI community such as in situ pill testing. However, existing methods require significant programming efforts and professional knowledge of NIRS, a…
▽ More
We present UbiNIRS, a software framework for rapid development and deployment of applications using miniaturized near-infrared spectroscopy (NIRS). NIRS is an emerging material sensing technology that has shown a great potential in recent work from the HCI community such as in situ pill testing. However, existing methods require significant programming efforts and professional knowledge of NIRS, and hence, challenge the creation of new NIRS based applications. Our system helps to resolve this issue by providing a generic server and a mobile app, using the best practices for NIRS applications in literature. The server creates and manages UbiNIRS instances without the need for any coding or professional knowledge of NIRS. The mobile app can register multiple UbiNIRS instances by communicating with the server for different NIRS based applications. Furthermore, UbiNIRS enables NIRS spectrum crowdsourcing for building a knowledge base.
△ Less
Submitted 10 December, 2021;
originally announced December 2021.
-
InfoPrint: Embedding Information into 3D Printed Objects
Authors:
Weiwei Jiang,
Chaofan Wang,
Zhanna Sarsenbayeva,
Andrew Irlitti,
Jarrod Knibbe,
Tilman Dingler,
Jorge Goncalves,
Vassilis Kostakos
Abstract:
We present a technique to embed information invisible to the eye inside 3D printed objects. The information is integrated in the object model, and then fabricated using off-the-shelf dual-head FDM (Fused Deposition Modeling) 3D printers. Our process does not require human intervention during or after printing with the integrated model. The information can be arbitrary symbols, such as icons, text,…
▽ More
We present a technique to embed information invisible to the eye inside 3D printed objects. The information is integrated in the object model, and then fabricated using off-the-shelf dual-head FDM (Fused Deposition Modeling) 3D printers. Our process does not require human intervention during or after printing with the integrated model. The information can be arbitrary symbols, such as icons, text,binary, or handwriting. To retrieve the information, we evaluate two different infrared-based imaging devices that are readily available-thermal cameras and near-infrared scanners. Based on our results, we propose design guidelines for a range of use cases to embed and extract hidden information. We demonstrate how our method can be used for different applications, such as interactive thermal displays, hidden board game tokens, tagging functional printed objects, and autographing non-fungible fabrication work.
△ Less
Submitted 30 November, 2021;
originally announced December 2021.
-
Situationally-Induced Impairments and Disabilities Research
Authors:
Zhanna Sarsenbayeva,
Vassilis Kostakos,
Jorge Goncalves
Abstract:
Research has shown that various environmental factors impact smartphone interaction and lead to Situationally-Induced Impairments and Disabilities. In this work we discuss the importance of thoroughly understanding the effects of these situational impairments on smartphone interaction. We argue that systematic investigation of the effects of different situational impairments is quintessential for…
▽ More
Research has shown that various environmental factors impact smartphone interaction and lead to Situationally-Induced Impairments and Disabilities. In this work we discuss the importance of thoroughly understanding the effects of these situational impairments on smartphone interaction. We argue that systematic investigation of the effects of different situational impairments is quintessential for conducting successful research in the field of SIIDs that might lead to building appropriate sensing, modelling, and adapting techniques. We also provide insights for future work identifying potential directions to conduct research in SIIDs.
△ Less
Submitted 12 April, 2019;
originally announced April 2019.
-
Proceedings of the CHI'19 Workshop: Addressing the Challenges of Situationally-Induced Impairments and Disabilities in Mobile Interaction
Authors:
Garreth W. Tigwell,
Zhanna Sarsenbayeva,
Benjamin M. Gorman,
David R. Flatla,
Jorge Goncalves,
Yeliz Yesilada,
Jacob O. Wobbrock
Abstract:
Situationally-induced impairments and disabilities (SIIDs) make it difficult for users of interactive computing systems to perform tasks due to context (e.g., listening to a phone call when in a noisy crowd) rather than a result of a congenital or acquired impairment (e.g., hearing damage). SIIDs are a great concern when considering the ubiquitousness of technology in a wide range of contexts. Con…
▽ More
Situationally-induced impairments and disabilities (SIIDs) make it difficult for users of interactive computing systems to perform tasks due to context (e.g., listening to a phone call when in a noisy crowd) rather than a result of a congenital or acquired impairment (e.g., hearing damage). SIIDs are a great concern when considering the ubiquitousness of technology in a wide range of contexts. Considering our daily reliance on technology, and mobile technology in particular, it is increasingly important that we fully understand and model how SIIDs occur. Similarly, we must identify appropriate methods for sensing and adapting technology to reduce the effects of SIIDs. In this workshop, we will bring together researchers working on understanding, sensing, modelling, and adapting technologies to ameliorate the effects of SIIDs. This workshop will provide a venue to identify existing research gaps, new directions for future research, and opportunities for future collaboration.
△ Less
Submitted 6 April, 2019;
originally announced April 2019.
