Mixed Reality UI Adaptations with Inaccurate and Incomplete Objectives
Authors:
Christoph Albert Johns,
João Marcelo Evangelista Belo
Abstract:
This position paper outlines a new approach to adapting 3D user interface (UI) layouts given the complex nature of end-user preferences. Current optimization techniques, which mainly rely on weighted sum methods, can be inflexible and result in unsatisfactory adaptations. We propose using multi-objective optimization and interactive preference elicitation to provide semi-automated, flexible, and e…
▽ More
This position paper outlines a new approach to adapting 3D user interface (UI) layouts given the complex nature of end-user preferences. Current optimization techniques, which mainly rely on weighted sum methods, can be inflexible and result in unsatisfactory adaptations. We propose using multi-objective optimization and interactive preference elicitation to provide semi-automated, flexible, and effective adaptations of 3D UIs. Our approach is demonstrated using an example of single-element 3D layout adaptation with ergonomic objectives. Future work is needed to address questions around the presentation and selection of optimal solutions, the impact on cognitive load, and the integration of preference learning. We conclude that, to make adaptive 3D UIs truly effective, we must acknowledge the limitations of our optimization objectives and techniques and emphasize the importance of user control.
△ Less
Submitted 17 November, 2023;
originally announced November 2023.
XAIR: A Framework of Explainable AI in Augmented Reality
Authors:
Xuhai Xu,
Mengjie Yu,
Tanya R. Jonker,
Kashyap Todi,
Feiyu Lu,
Xun Qian,
João Marcelo Evangelista Belo,
Tianyi Wang,
Michelle Li,
Aran Mun,
Te-Yen Wu,
Junxiao Shen,
Ting Zhang,
Narine Kokhlikyan,
Fulton Wang,
Paul Sorenson,
Sophie Kahyun Kim,
Hrvoje Benko
Abstract:
Explainable AI (XAI) has established itself as an important component of AI-driven interactive systems. With Augmented Reality (AR) becoming more integrated in daily lives, the role of XAI also becomes essential in AR because end-users will frequently interact with intelligent services. However, it is unclear how to design effective XAI experiences for AR. We propose XAIR, a design framework that…
▽ More
Explainable AI (XAI) has established itself as an important component of AI-driven interactive systems. With Augmented Reality (AR) becoming more integrated in daily lives, the role of XAI also becomes essential in AR because end-users will frequently interact with intelligent services. However, it is unclear how to design effective XAI experiences for AR. We propose XAIR, a design framework that addresses "when", "what", and "how" to provide explanations of AI output in AR. The framework was based on a multi-disciplinary literature review of XAI and HCI research, a large-scale survey probing 500+ end-users' preferences for AR-based explanations, and three workshops with 12 experts collecting their insights about XAI design in AR. XAIR's utility and effectiveness was verified via a study with 10 designers and another study with 12 end-users. XAIR can provide guidelines for designers, inspiring them to identify new design opportunities and achieve effective XAI designs in AR.
△ Less
Submitted 28 March, 2023;
originally announced March 2023.
