-
Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Process
Authors:
Zelun Tony Zhang,
Sebastian S. Feger,
Lucas Dullenkopf,
Rulu Liao,
Lukas Süsslin,
Yuanting Liu,
Andreas Butz
Abstract:
AI is anticipated to enhance human decision-making in high-stakes domains like aviation, but adoption is often hindered by challenges such as inappropriate reliance and poor alignment with users' decision-making. Recent research suggests that a core underlying issue is the recommendation-centric design of many AI systems, i.e., they give end-to-end recommendations and ignore the rest of the decisi…
▽ More
AI is anticipated to enhance human decision-making in high-stakes domains like aviation, but adoption is often hindered by challenges such as inappropriate reliance and poor alignment with users' decision-making. Recent research suggests that a core underlying issue is the recommendation-centric design of many AI systems, i.e., they give end-to-end recommendations and ignore the rest of the decision-making process. Alternative support paradigms are rare, and it remains unclear how the few that do exist compare to recommendation-centric support. In this work, we aimed to empirically compare recommendation-centric support to an alternative paradigm, continuous support, in the context of diversions in aviation. We conducted a mixed-methods study with 32 professional pilots in a realistic setting. To ensure the quality of our study scenarios, we conducted a focus group with four additional pilots prior to the study. We found that continuous support can support pilots' decision-making in a forward direction, allowing them to think more beyond the limits of the system and make faster decisions when combined with recommendations, though the forward support can be disrupted. Participants' statements further suggest a shift in design goal away from providing recommendations, to supporting quick information gathering. Our results show ways to design more helpful and effective AI decision support that goes beyond end-to-end recommendations.
△ Less
Submitted 13 June, 2024;
originally announced June 2024.
-
Incorporating precipitation-related effects on plastic anisotropy of age-hardenable aluminium alloys into crystal plasticity constitutive models
Authors:
Alexander Wessel,
Emin Semih Perdahcıoğlu,
Antonius Henricus van den Boogaard,
Alexander Butz,
Wolfram Volk
Abstract:
Crystal plasticity finite element simulations are frequently employed to predict the plastic anisotropy of polycrystalline metals based on their crystallographic texture. However, precipitation in age-hardenable aluminium alloys is known to affect the texture-induced plastic anisotropy. A new modelling approach that incorporates this effect into crystal plasticity constitutive models is presented…
▽ More
Crystal plasticity finite element simulations are frequently employed to predict the plastic anisotropy of polycrystalline metals based on their crystallographic texture. However, precipitation in age-hardenable aluminium alloys is known to affect the texture-induced plastic anisotropy. A new modelling approach that incorporates this effect into crystal plasticity constitutive models is presented to address this issue. The approach is based on the hypothesis that precipitation occurs in a global preferred direction, resulting in direction-dependent hardening behaviour for the slip systems. The direction dependency is implemented into a conventional crystal plasticity constitutive model by modification of the hardening law using only one additional parameter. To demonstrate the applicability of the new modelling approach, it is applied to an AA6014-T4 age-hardenable aluminium alloy and compared against the current state-of-the-art crystal plasticity modelling approach, taking only the crystallographic texture into account. The results demonstrate that the predicted accuracy of the plastic anisotropy for the AA6014-T4 aluminium alloy studied is significantly improved by the proposed new modelling approach for incorporating precipitation-related effects.
△ Less
Submitted 27 May, 2024;
originally announced May 2024.
-
Evolutionary Solution Adaption for Multi-Objective Metal Cutting Process Optimization
Authors:
Leo Francoso Dal Piccol Sotto,
Sebastian Mayer,
Hemanth Janarthanam,
Alexander Butz,
Jochen Garcke
Abstract:
Optimizing manufacturing process parameters is typically a multi-objective problem with often contradictory objectives such as production quality and production time. If production requirements change, process parameters have to be optimized again. Since optimization usually requires costly simulations based on, for example, the Finite Element method, it is of great interest to have means to reduc…
▽ More
Optimizing manufacturing process parameters is typically a multi-objective problem with often contradictory objectives such as production quality and production time. If production requirements change, process parameters have to be optimized again. Since optimization usually requires costly simulations based on, for example, the Finite Element method, it is of great interest to have means to reduce the number of evaluations needed for optimization. To this end, we consider optimizing for different production requirements from the viewpoint of a framework for system flexibility that allows us to study the ability of an algorithm to transfer solutions from previous optimization tasks, which also relates to dynamic evolutionary optimization. Based on the extended Oxley model for orthogonal metal cutting, we introduce a multi-objective optimization benchmark where different materials define related optimization tasks, and use it to study the flexibility of NSGA-II, which we extend by two variants: 1) varying goals, that optimizes solutions for two tasks simultaneously to obtain in-between source solutions expected to be more adaptable, and 2) active-inactive genotype, that accommodates different possibilities that can be activated or deactivated. Results show that adaption with standard NSGA-II greatly reduces the number of evaluations required for optimization to a target goal, while the proposed variants further improve the adaption costs, although further work is needed towards making the methods advantageous for real applications.
△ Less
Submitted 31 May, 2023;
originally announced May 2023.
-
The Impact of Expertise in the Loop for Exploring Machine Rationality
Authors:
Changkun Ou,
Sven Mayer,
Andreas Butz
Abstract:
Human-in-the-loop optimization utilizes human expertise to guide machine optimizers iteratively and search for an optimal solution in a solution space. While prior empirical studies mainly investigated novices, we analyzed the impact of the levels of expertise on the outcome quality and corresponding subjective satisfaction. We conducted a study (N=60) in text, photo, and 3D mesh optimization cont…
▽ More
Human-in-the-loop optimization utilizes human expertise to guide machine optimizers iteratively and search for an optimal solution in a solution space. While prior empirical studies mainly investigated novices, we analyzed the impact of the levels of expertise on the outcome quality and corresponding subjective satisfaction. We conducted a study (N=60) in text, photo, and 3D mesh optimization contexts. We found that novices can achieve an expert level of quality performance, but participants with higher expertise led to more optimization iteration with more explicit preference while kee** satisfaction low. In contrast, novices were more easily satisfied and terminated faster. Therefore, we identified that experts seek more diverse outcomes while the machine reaches optimal results, and the observed behavior can be used as a performance indicator for human-in-the-loop system designers to improve underlying models. We inform future research to be cautious about the impact of user expertise when designing human-in-the-loop systems.
△ Less
Submitted 11 February, 2023;
originally announced February 2023.
-
Short-Form Videos Degrade Our Capacity to Retain Intentions: Effect of Context Switching On Prospective Memory
Authors:
Francesco Chiossi,
Luke Haliburton,
Changkun Ou,
Andreas Butz,
Albrecht Schmidt
Abstract:
Social media platforms use short, highly engaging videos to catch users' attention. While the short-form video feeds popularized by TikTok are rapidly spreading to other platforms, we do not yet understand their impact on cognitive functions. We conducted a between-subjects experiment (N=60) investigating the impact of engaging with TikTok, Twitter, and YouTube while performing a Prospective Memor…
▽ More
Social media platforms use short, highly engaging videos to catch users' attention. While the short-form video feeds popularized by TikTok are rapidly spreading to other platforms, we do not yet understand their impact on cognitive functions. We conducted a between-subjects experiment (N=60) investigating the impact of engaging with TikTok, Twitter, and YouTube while performing a Prospective Memory task (i.e., executing a previously planned action). The study required participants to remember intentions over interruptions. We found that the TikTok condition significantly degraded the users' performance in this task. As none of the other conditions (Twitter, YouTube, no activity) had a similar effect, our results indicate that the combination of short videos and rapid context-switching impairs intention recall and execution. We contribute a quantified understanding of the effect of social media feed format on Prospective Memory and outline consequences for media technology designers to not harm the users' memory and wellbeing.
△ Less
Submitted 7 February, 2023;
originally announced February 2023.
-
Machine learning-based sampling of virtual experiments within the full stress state
Authors:
Alexander Wessel,
Lukas Morand,
Alexander Butz,
Dirk Helm,
Wolfram Volk
Abstract:
This paper presents a new machine learning-based approach to investigate anisotropic yield surfaces of sheet metals by means of virtual experiments. The new sampling approach is based on the machine learning technique known as active learning, which has been adapted to efficiently sample virtual experiments with respect to the full stress state in order to identify parameters of anisotropic yield…
▽ More
This paper presents a new machine learning-based approach to investigate anisotropic yield surfaces of sheet metals by means of virtual experiments. The new sampling approach is based on the machine learning technique known as active learning, which has been adapted to efficiently sample virtual experiments with respect to the full stress state in order to identify parameters of anisotropic yield functions. The approach was employed to sample virtual experiments based on the crystal plasticity finite element method (CPFEM) for a DX56D deep drawing steel and compared with two state-of-the-art sampling methods taken from the literature. The resulting points on the initial yield surface for all three sampling methods were used to identify parameters of the anisotropic yield functions Hill48, Yld91, Yld2004-18p and Yld2004-27p. The results show that the new machine learning-based sampling approach has a higher sampling efficiency than the two state-of-the-art sampling methods. Consequently, fewer computationally expensive crystal plasticity simulations are required. By comparing different variants of the Hill48, Yld91, Yld2004-18p and Yld2004-27p yield surfaces, it was also found that identifying parameters of anisotropic yield functions based on virtual experiments sampled within the full stress state can lead to a degraded representation of the in-plane anisotropy. With respect to DX56D deep drawing steel, this degradation was observed for the Yld2004-18p yield function. As a consequence, the representation of the in-plane anisotropy must be carefully reviewed when taking the full stress state into account. In this context, Yld2004-27p was identified as being sufficiently flexible to simultaneously represent the plastic anisotropy of DX56D with respect to the in-plane and out-of-plane behaviour with high accuracy.
△ Less
Submitted 19 April, 2024; v1 submitted 31 October, 2022;
originally announced November 2022.
-
The Human in the Infinite Loop: A Case Study on Revealing and Explaining Human-AI Interaction Loop Failures
Authors:
Changkun Ou,
Daniel Buschek,
Sven Mayer,
Andreas Butz
Abstract:
Interactive AI systems increasingly employ a human-in-the-loop strategy. This creates new challenges for the HCI community when designing such systems. We reveal and investigate some of these challenges in a case study with an industry partner, and developed a prototype human-in-the-loop system for preference-guided 3D model processing. Two 3D artists used it in their daily work for 3 months. We f…
▽ More
Interactive AI systems increasingly employ a human-in-the-loop strategy. This creates new challenges for the HCI community when designing such systems. We reveal and investigate some of these challenges in a case study with an industry partner, and developed a prototype human-in-the-loop system for preference-guided 3D model processing. Two 3D artists used it in their daily work for 3 months. We found that the human-AI loop often did not converge towards a satisfactory result and designed a lab study (N=20) to investigate this further. We analyze interaction data and user feedback through the lens of theories of human judgment to explain the observed human-in-the-loop failures with two key insights: 1) optimization using preferential choices lacks mechanisms to deal with inconsistent and contradictory human judgments; 2) machine outcomes, in turn, influence future user inputs via heuristic biases and loss aversion. To mitigate these problems, we propose descriptive UI design guidelines. Our case study draws attention to challenging and practically relevant imperfections in human-AI loops that need to be considered when designing human-in-the-loop systems.
△ Less
Submitted 26 July, 2022;
originally announced July 2022.
-
Respiration driven CO2 pulses dominate Australia's flux variability
Authors:
Eva-Marie Metz,
Sanam N. Vardag,
Sourish Basu,
Martin Jung,
Bernhard Ahrens,
Tarek El-Madany,
Stephen Sitch,
Vivek K. Arora,
Peter R. Briggs,
Pierre Friedlingstein,
Daniel S. Goll,
Atul K. Jain,
Etsushi Kato,
Danica Lombardozzi,
Julia E. M. S. Nabel,
Benjamin Poulter,
Roland Séférian,
Hanqin Tian,
Andrew Wiltshire,
Wen** Yuan,
Xu Yue,
Sönke Zaehle,
Nicholas M. Deutscher,
David W. T. Griffith,
André Butz
Abstract:
The Australian continent contributes substantially to the year-to-year variability of the global terrestrial carbon dioxide (CO2) sink. However, the scarcity of in-situ observations in remote areas prevents deciphering the processes that force the CO2 flux variability. Here, examining atmospheric CO2 measurements from satellites in the period 2009-2018, we find recurrent end-of-dry-season CO2 puls…
▽ More
The Australian continent contributes substantially to the year-to-year variability of the global terrestrial carbon dioxide (CO2) sink. However, the scarcity of in-situ observations in remote areas prevents deciphering the processes that force the CO2 flux variability. Here, examining atmospheric CO2 measurements from satellites in the period 2009-2018, we find recurrent end-of-dry-season CO2 pulses over the Australian continent. These pulses largely control the year-to-year variability of Australia's CO2 balance, due to 2-3 times higher seasonal variations compared to previous top-down inversions and bottom-up estimates. The CO2 pulses occur shortly after the onset of rainfall and are driven by enhanced soil respiration preceding photosynthetic uptake in Australia's semi-arid regions. The suggested continental-scale relevance of soil rewetting processes has large implications for our understanding and modelling of global climate-carbon cycle feedbacks.
△ Less
Submitted 30 November, 2022; v1 submitted 14 July, 2022;
originally announced July 2022.
-
How Should Voice Assistants Deal With Users' Emotions?
Authors:
Yong Ma,
Heiko Drewes,
Andreas Butz
Abstract:
There is a growing body of research in HCI on detecting the users' emotions. Once it is possible to detect users' emotions reliably, the next question is how an emotion-aware interface should react to the detected emotion. In a first step, we tried to find out how humans deal with the negative emotions of an avatar. The hope behind this approach was to identify human strategies, which we can then…
▽ More
There is a growing body of research in HCI on detecting the users' emotions. Once it is possible to detect users' emotions reliably, the next question is how an emotion-aware interface should react to the detected emotion. In a first step, we tried to find out how humans deal with the negative emotions of an avatar. The hope behind this approach was to identify human strategies, which we can then mimic in an emotion-aware voice assistant. We present a user study in which participants were confronted with an angry, sad, or frightened avatar. Their task was to make the avatar happy by talking to it. We recorded the voice signal and analyzed it. The results show that users predominantly reacted with neutral emotion. However, we also found gender differences, which opens a range of questions.
△ Less
Submitted 5 April, 2022;
originally announced April 2022.
-
Modeling Web Browsing Behavior across Tabs and Websites with Tracking and Prediction on the Client Side
Authors:
Changkun Ou,
Daniel Buschek,
Malin Eiband,
Andreas Butz
Abstract:
Clickstreams on individual websites have been studied for decades to gain insights into user interests and to improve website experiences. This paper proposes and examines a novel sequence modeling approach for web clickstreams, that also considers multi-tab branching and backtracking actions across websites to capture the full action sequence of a user while browsing. All of this is done using ma…
▽ More
Clickstreams on individual websites have been studied for decades to gain insights into user interests and to improve website experiences. This paper proposes and examines a novel sequence modeling approach for web clickstreams, that also considers multi-tab branching and backtracking actions across websites to capture the full action sequence of a user while browsing. All of this is done using machine learning on the client side to obtain a more comprehensive view and at the same time preserve privacy. We evaluate our formalism with a model trained on data collected in a user study with three different browsing tasks based on different human information seeking strategies from psychological literature. Our results show that the model can successfully distinguish between browsing behaviors and correctly predict future actions. A subsequent qualitative analysis identified five common web browsing patterns from our collected behavior data, which help to interpret the model. More generally, this illustrates the power of overparameterization in ML and offers a new way of modeling, reasoning with, and prediction of observable sequential human interaction behaviors.
△ Less
Submitted 8 March, 2021;
originally announced March 2021.
-
What If Your Car Would Care? Exploring Use Cases For Affective Automotive User Interfaces
Authors:
Michael Braun,
**gyi Li,
Florian Weber,
Bastian Pfleging,
Andreas Butz,
Florian Alt
Abstract:
In this paper we present use cases for affective user interfaces (UIs) in cars and how they are perceived by potential users in China and Germany. Emotion-aware interaction is enabled by the improvement of ubiquitous sensing methods and provides potential benefits for both traffic safety and personal well-being. To promote the adoption of affective interaction at an international scale, we develop…
▽ More
In this paper we present use cases for affective user interfaces (UIs) in cars and how they are perceived by potential users in China and Germany. Emotion-aware interaction is enabled by the improvement of ubiquitous sensing methods and provides potential benefits for both traffic safety and personal well-being. To promote the adoption of affective interaction at an international scale, we developed 20 mobile in-car use cases through an inter-cultural design approach and evaluated them with 65 drivers in Germany and China. Our data shows perceived benefits in specific areas of pragmatic quality as well as cultural differences, especially for socially interactive use cases. We also discuss general implications for future affective automotive UI. Our results provide a perspective on cultural peculiarities and a concrete starting point for practitioners and researchers working on emotion-aware interfaces.
△ Less
Submitted 6 April, 2020;
originally announced April 2020.
