Resistance Against Manipulative AI: key factors and possible actions
Authors:
Piotr Wilczyński,
Wiktoria Mieleszczenko-Kowszewicz,
Przemysław Biecek
Abstract:
If AI is the new electricity, what should we do to keep ourselves from getting electrocuted? In this work, we explore factors related to the potential of large language models (LLMs) to manipulate human decisions. We describe the results of two experiments designed to determine what characteristics of humans are associated with their susceptibility to LLM manipulation, and what characteristics of…
▽ More
If AI is the new electricity, what should we do to keep ourselves from getting electrocuted? In this work, we explore factors related to the potential of large language models (LLMs) to manipulate human decisions. We describe the results of two experiments designed to determine what characteristics of humans are associated with their susceptibility to LLM manipulation, and what characteristics of LLMs are associated with their manipulativeness potential. We explore human factors by conducting user studies in which participants answer general knowledge questions using LLM-generated hints, whereas LLM factors by provoking language models to create manipulative statements. Then, we analyze their obedience, the persuasion strategies used, and the choice of vocabulary. Based on these experiments, we discuss two actions that can protect us from LLM manipulation. In the long term, we put AI literacy at the forefront, arguing that educating society would minimize the risk of manipulation and its consequences. We also propose an ad hoc solution, a classifier that detects manipulation of LLMs - a Manipulation Fuse.
△ Less
Submitted 22 April, 2024;
originally announced April 2024.
ChatGPT: Jack of all trades, master of none
Authors:
Jan Kocoń,
Igor Cichecki,
Oliwier Kaszyca,
Mateusz Kochanek,
Dominika Szydło,
Joanna Baran,
Julita Bielaniewicz,
Marcin Gruza,
Arkadiusz Janz,
Kamil Kanclerz,
Anna Kocoń,
Bartłomiej Koptyra,
Wiktoria Mieleszczenko-Kowszewicz,
Piotr Miłkowski,
Marcin Oleksy,
Maciej Piasecki,
Łukasz Radliński,
Konrad Wojtasik,
Stanisław Woźniak,
Przemysław Kazienko
Abstract:
OpenAI has released the Chat Generative Pre-trained Transformer (ChatGPT) and revolutionized the approach in artificial intelligence to human-model interaction. Several publications on ChatGPT evaluation test its effectiveness on well-known natural language processing (NLP) tasks. However, the existing studies are mostly non-automated and tested on a very limited scale. In this work, we examined C…
▽ More
OpenAI has released the Chat Generative Pre-trained Transformer (ChatGPT) and revolutionized the approach in artificial intelligence to human-model interaction. Several publications on ChatGPT evaluation test its effectiveness on well-known natural language processing (NLP) tasks. However, the existing studies are mostly non-automated and tested on a very limited scale. In this work, we examined ChatGPT's capabilities on 25 diverse analytical NLP tasks, most of them subjective even to humans, such as sentiment analysis, emotion recognition, offensiveness, and stance detection. In contrast, the other tasks require more objective reasoning like word sense disambiguation, linguistic acceptability, and question answering. We also evaluated GPT-4 model on five selected subsets of NLP tasks. We automated ChatGPT and GPT-4 prompting process and analyzed more than 49k responses. Our comparison of its results with available State-of-the-Art (SOTA) solutions showed that the average loss in quality of the ChatGPT model was about 25% for zero-shot and few-shot evaluation. For GPT-4 model, a loss for semantic tasks is significantly lower than for ChatGPT. We showed that the more difficult the task (lower SOTA performance), the higher the ChatGPT loss. It especially refers to pragmatic NLP problems like emotion recognition. We also tested the ability to personalize ChatGPT responses for selected subjective tasks via Random Contextual Few-Shot Personalization, and we obtained significantly better user-based predictions. Additional qualitative analysis revealed a ChatGPT bias, most likely due to the rules imposed on human trainers by OpenAI. Our results provide the basis for a fundamental discussion of whether the high quality of recent predictive NLP models can indicate a tool's usefulness to society and how the learning and validation procedures for such systems should be established.
△ Less
Submitted 9 June, 2023; v1 submitted 21 February, 2023;
originally announced February 2023.
Tell Me How You Feel: Designing Emotion-Aware Voicebots to Ease Pandemic Anxiety In Aging Citizens
Authors:
W. Mieleszczenko-Kowszewicz,
K. Warpechowski,
K. Zieliński,
R. Nielek,
A. Wierzbicki
Abstract:
The feeling of anxiety and loneliness among aging population has been recently amplified by the COVID-19 related lockdowns. Emotion-aware multimodal bot application combining voice and visual interface was developed to address the problem in the group of older citizens. The application is novel as it combines three main modules: information, emotion selection and psychological intervention, with t…
▽ More
The feeling of anxiety and loneliness among aging population has been recently amplified by the COVID-19 related lockdowns. Emotion-aware multimodal bot application combining voice and visual interface was developed to address the problem in the group of older citizens. The application is novel as it combines three main modules: information, emotion selection and psychological intervention, with the aim of improving human well-being. The preliminary study with target group confirmed that multimodality improves usability and that the information module is essential for participating in a psychological intervention. The solution is universal and can also be applied to areas not directly related to COVID-19 pandemic.
△ Less
Submitted 21 July, 2022;
originally announced July 2022.
