-
How Human-Centered Explainable AI Interface Are Designed and Evaluated: A Systematic Survey
Authors:
Thu Nguyen,
Alessandro Canossa,
Jichen Zhu
Abstract:
Despite its technological breakthroughs, eXplainable Artificial Intelligence (XAI) research has limited success in producing the {\em effective explanations} needed by users. In order to improve XAI systems' usability, practical interpretability, and efficacy for real users, the emerging area of {\em Explainable Interfaces} (EIs) focuses on the user interface and user experience design aspects of…
▽ More
Despite its technological breakthroughs, eXplainable Artificial Intelligence (XAI) research has limited success in producing the {\em effective explanations} needed by users. In order to improve XAI systems' usability, practical interpretability, and efficacy for real users, the emerging area of {\em Explainable Interfaces} (EIs) focuses on the user interface and user experience design aspects of XAI. This paper presents a systematic survey of 53 publications to identify current trends in human-XAI interaction and promising directions for EI design and development. This is among the first systematic survey of EI research.
△ Less
Submitted 21 March, 2024;
originally announced March 2024.
-
Glyph: Visualization Tool for Understanding Problem Solving Strategies in Puzzle Games
Authors:
Truong-Huy Dinh Nguyen,
Magy Seif El-Nasr,
Alessandro Canossa
Abstract:
Understanding player strategies is a key question when analyzing player behavior both for academic researchers and industry practitioners. For game designers and game user researchers, it is important to gauge the distance between intended strategies and emergent strategies; this comparison allows identification of glitches or undesirable behaviors. For academic researchers using games for serious…
▽ More
Understanding player strategies is a key question when analyzing player behavior both for academic researchers and industry practitioners. For game designers and game user researchers, it is important to gauge the distance between intended strategies and emergent strategies; this comparison allows identification of glitches or undesirable behaviors. For academic researchers using games for serious purposes such as education, the strategies adopted by players are indicative of their cognitive progress in relation to serious goals, such as learning process. Current techniques and systems created to address these needs present a few drawbacks. Qualitative methods are difficult to scale upwards to include large number of players and are prone to subjective biases. Other approaches such as visualization and analytical tools are either designed to provide an aggregated overview of the data, losing the nuances of individual player behaviors, or, in the attempt of accounting for individual behavior, are not specifically designed to reduce the visual cognitive load. In this work, we propose a novel visualization technique that specifically addresses the tasks of comparing behavior sequences in order to capture an overview of the strategies enacted by players and at the same time examine individual player behaviors to identify differences and outliers. This approach allows users to form hypotheses about player strategies and verify them. We demonstrate the effectiveness of the technique through a case study: utilizing a prototype system to investigate data collected from a commercial educational puzzle game. While the prototype's usability can be improved, initial testing results show that core features of the system proved useful to our potential users for understanding player strategies.
△ Less
Submitted 25 June, 2021;
originally announced June 2021.
-
Your Gameplay Says It All: Modelling Motivation in Tom Clancy's The Division
Authors:
David Melhart,
Ahmad Azadvar,
Alessandro Canossa,
Antonios Liapis,
Georgios N. Yannakakis
Abstract:
Is it possible to predict the motivation of players just by observing their gameplay data? Even if so, how should we measure motivation in the first place? To address the above questions, on the one end, we collect a large dataset of gameplay data from players of the popular game Tom Clancy's The Division. On the other end, we ask them to report their levels of competence, autonomy, relatedness an…
▽ More
Is it possible to predict the motivation of players just by observing their gameplay data? Even if so, how should we measure motivation in the first place? To address the above questions, on the one end, we collect a large dataset of gameplay data from players of the popular game Tom Clancy's The Division. On the other end, we ask them to report their levels of competence, autonomy, relatedness and presence using the Ubisoft Perceived Experience Questionnaire. After processing the survey responses in an ordinal fashion we employ preference learning methods based on support vector machines to infer the map** between gameplay and the reported four motivation factors. Our key findings suggest that gameplay features are strong predictors of player motivation as the best obtained models reach accuracies of near certainty, from 92% up to 94% on unseen players.
△ Less
Submitted 22 May, 2019; v1 submitted 31 January, 2019;
originally announced February 2019.
-
Modeling Individual Differences in Game Behavior using HMM
Authors:
Sara Bunian,
Alessandro Canossa,
Randy Colvin,
Magy Seif El-Nasr
Abstract:
Player modeling is an important concept that has gained much attention in game research due to its utility in develo** adaptive techniques to target better designs for engagement and retention. Previous work has explored modeling individual differences using machine learning algorithms per- formed on aggregated game actions. However, players' individual differences may be better manifested throu…
▽ More
Player modeling is an important concept that has gained much attention in game research due to its utility in develo** adaptive techniques to target better designs for engagement and retention. Previous work has explored modeling individual differences using machine learning algorithms per- formed on aggregated game actions. However, players' individual differences may be better manifested through sequential patterns of the in-game player's actions. While few works have explored sequential analysis of player data, none have explored the use of Hidden Markov Models (HMM) to model individual differences, which is the topic of this paper. In par- ticular, we developed a modeling approach using data col- lected from players playing a Role-Playing Game (RPG). Our proposed approach is two fold: 1. We present a Hidden Markov Model (HMM) of player in-game behaviors to model individual differences, and 2. using the output of the HMM, we generate behavioral features used to classify real world players' characteristics, including game expertise and the big five personality traits. Our results show predictive power for some of personality traits, such as game expertise and conscientiousness, but the most influential factor was game expertise.
△ Less
Submitted 31 March, 2018;
originally announced April 2018.
