Showing 1–14 of 14 results for author: Hasler, S

Stacked Confusion Reject Plots (SCORE)

Authors: Stephan Hasler, Lydia Fischer

Abstract: Machine learning is more and more applied in critical application areas like health and driver assistance. To minimize the risk of wrong decisions, in such applications it is necessary to consider the certainty of a classification to reject uncertain samples. An established tool for this are reject curves that visualize the trade-off between the number of rejected samples and classification perfor… ▽ More Machine learning is more and more applied in critical application areas like health and driver assistance. To minimize the risk of wrong decisions, in such applications it is necessary to consider the certainty of a classification to reject uncertain samples. An established tool for this are reject curves that visualize the trade-off between the number of rejected samples and classification performance metrics. We argue that common reject curves are too abstract and hard to interpret by non-experts. We propose Stacked Confusion Reject Plots (SCORE) that offer a more intuitive understanding of the used data and the classifier's behavior. We present example plots on artificial Gaussian data to document the different options of SCORE and provide the code as a Python package. △ Less

Submitted 25 June, 2024; originally announced June 2024.

Comments: 6 pages, 2 figures

Detection of an Earth-sized exoplanet orbiting the nearby ultracool dwarf star SPECULOOS-3

Authors: Michaël Gillon, Peter P. Pedersen, Benjamin V. Rackham, Georgina Dransfield, Elsa Ducrot, Khalid Barkaoui, Artem Y. Burdanov, Urs Schroffenegger, Yilen Gómez Maqueo Chew, Susan M. Lederer, Roi Alonso, Adam J. Burgasser, Steve B. Howell, Norio Narita, Julien de Wit, Brice-Olivier Demory, Didier Queloz, Amaury H. M. J. Triaud, Laetitia Delrez, Emmanuël Jehin, Matthew J. Hooton, Lionel J. Garcia, Clàudia Jano Muñoz, Catriona A. Murray, Francisco J. Pozuelos , et al. (59 additional authors not shown)

Abstract: Located at the bottom of the main sequence, ultracool dwarf stars are widespread in the solar neighbourhood. Nevertheless, their extremely low luminosity has left their planetary population largely unexplored, and only one of them, TRAPPIST-1, has so far been found to host a transiting planetary system. In this context, we present the SPECULOOS project's detection of an Earth-sized planet in a 17… ▽ More Located at the bottom of the main sequence, ultracool dwarf stars are widespread in the solar neighbourhood. Nevertheless, their extremely low luminosity has left their planetary population largely unexplored, and only one of them, TRAPPIST-1, has so far been found to host a transiting planetary system. In this context, we present the SPECULOOS project's detection of an Earth-sized planet in a 17 h orbit around an ultracool dwarf of M6.5 spectral type located 16.8 pc away. The planet's high irradiation (16 times that of Earth) combined with the infrared luminosity and Jupiter-like size of its host star make it one of the most promising rocky exoplanet targets for detailed emission spectroscopy characterization with JWST. Indeed, our sensitivity study shows that just ten secondary eclipse observations with the Mid-InfraRed Instrument/Low-Resolution Spectrometer on board JWST should provide strong constraints on its atmospheric composition and/or surface mineralogy. △ Less

Submitted 2 June, 2024; originally announced June 2024.

Efficient Symbolic Planning with Views

Authors: Stephan Hasler, Daniel Tanneberg, Michael Gienger

Abstract: Robotic planning systems model spatial relations in detail as these are needed for manipulation tasks. In contrast to this, other physical attributes of objects and the effect of devices are usually oversimplified and expressed by abstract compound attributes. This limits the ability of planners to find alternative solutions. We propose to break these compound attributes down into a shared set of… ▽ More Robotic planning systems model spatial relations in detail as these are needed for manipulation tasks. In contrast to this, other physical attributes of objects and the effect of devices are usually oversimplified and expressed by abstract compound attributes. This limits the ability of planners to find alternative solutions. We propose to break these compound attributes down into a shared set of elementary attributes. This strongly facilitates generalization between different tasks and environments and thus helps to find innovative solutions. On the down-side, this generalization comes with an increased complexity of the solution space. Therefore, as the main contribution of the paper, we propose a method that splits the planning problem into a sequence of views, where in each view only an increasing subset of attributes is considered. We show that this view-based strategy offers a good compromise between planning speed and quality of the found plan, and discuss its general applicability and limitations. △ Less

Submitted 6 May, 2024; originally announced May 2024.

Comments: 6 pages

To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactions

Authors: Daniel Tanneberg, Felix Ocker, Stephan Hasler, Joerg Deigmoeller, Anna Belardinelli, Chao Wang, Heiko Wersing, Bernhard Sendhoff, Michael Gienger

Abstract: How can a robot provide unobtrusive physical support within a group of humans? We present Attentive Support, a novel interaction concept for robots to support a group of humans. It combines scene perception, dialogue acquisition, situation understanding, and behavior generation with the common-sense reasoning capabilities of Large Language Models (LLMs). In addition to following user instructions,… ▽ More How can a robot provide unobtrusive physical support within a group of humans? We present Attentive Support, a novel interaction concept for robots to support a group of humans. It combines scene perception, dialogue acquisition, situation understanding, and behavior generation with the common-sense reasoning capabilities of Large Language Models (LLMs). In addition to following user instructions, Attentive Support is capable of deciding when and how to support the humans, and when to remain silent to not disturb the group. With a diverse set of scenarios, we show and evaluate the robot's attentive behavior, which supports and helps the humans when required, while not disturbing if no help is needed. △ Less

Submitted 19 March, 2024; originally announced March 2024.

Comments: 8 pages, 5 figures

ACM Class: I.2.8; I.2.9

LaMI: Large Language Models for Multi-Modal Human-Robot Interaction

Authors: Chao Wang, Stephan Hasler, Daniel Tanneberg, Felix Ocker, Frank Joublin, Antonello Ceravola, Joerg Deigmoeller, Michael Gienger

Abstract: This paper presents an innovative large language model (LLM)-based robotic system for enhancing multi-modal human-robot interaction (HRI). Traditional HRI systems relied on complex designs for intent estimation, reasoning, and behavior generation, which were resource-intensive. In contrast, our system empowers researchers and practitioners to regulate robot behavior through three key aspects: prov… ▽ More This paper presents an innovative large language model (LLM)-based robotic system for enhancing multi-modal human-robot interaction (HRI). Traditional HRI systems relied on complex designs for intent estimation, reasoning, and behavior generation, which were resource-intensive. In contrast, our system empowers researchers and practitioners to regulate robot behavior through three key aspects: providing high-level linguistic guidance, creating "atomic actions" and expressions the robot can use, and offering a set of examples. Implemented on a physical robot, it demonstrates proficiency in adapting to multi-modal inputs and determining the appropriate manner of action to assist humans with its arms, following researchers' defined guidelines. Simultaneously, it coordinates the robot's lid, neck, and ear movements with speech output to produce dynamic, multi-modal expressions. This showcases the system's potential to revolutionize HRI by shifting from conventional, manual state-and-flow design methods to an intuitive, guidance-based, and example-driven approach. Supplementary material can be found at https://hri-eu.github.io/Lami/ △ Less

Submitted 11 April, 2024; v1 submitted 26 January, 2024; originally announced January 2024.

Comments: 10 pages, 6 figures

CoPAL: Corrective Planning of Robot Actions with Large Language Models

Authors: Frank Joublin, Antonello Ceravola, Pavel Smirnov, Felix Ocker, Joerg Deigmoeller, Anna Belardinelli, Chao Wang, Stephan Hasler, Daniel Tanneberg, Michael Gienger

Abstract: In the pursuit of fully autonomous robotic systems capable of taking over tasks traditionally performed by humans, the complexity of open-world environments poses a considerable challenge. Addressing this imperative, this study contributes to the field of Large Language Models (LLMs) applied to task and motion planning for robots. We propose a system architecture that orchestrates a seamless inter… ▽ More In the pursuit of fully autonomous robotic systems capable of taking over tasks traditionally performed by humans, the complexity of open-world environments poses a considerable challenge. Addressing this imperative, this study contributes to the field of Large Language Models (LLMs) applied to task and motion planning for robots. We propose a system architecture that orchestrates a seamless interplay between multiple cognitive levels, encompassing reasoning, planning, and motion generation. At its core lies a novel replanning strategy that handles physically grounded, logical, and semantic errors in the generated plans. We demonstrate the efficacy of the proposed feedback architecture, particularly its impact on executability, correctness, and time complexity via empirical evaluation in the context of a simulation and two intricate real-world scenarios: blocks world, barman and pizza preparation. △ Less

Submitted 11 October, 2023; originally announced October 2023.

Small body harvest with the Antarctic Search for Transiting Exoplanets (ASTEP) project

Authors: Samantha Hasler, Artem Burdanov, Julien de Wit, Georgina Dransfield, Lyu Abe, A. Agabi, Philippe Bendjoya, Nicolas Crouzet, Tristan Guillot, Djamel Mékarnia, F. -X. Schmider, Olga Suárez, Amaury Triaud

Abstract: Small Solar system bodies serve as pristine records that have been minimally altered since their formation. Their observations provide valuable information regarding the formation and evolution of our Solar system. Interstellar objects (ISOs) can also provide insight on the formation of exoplanetary systems and planetary system evolution as a whole. In this work, we present the application of our… ▽ More Small Solar system bodies serve as pristine records that have been minimally altered since their formation. Their observations provide valuable information regarding the formation and evolution of our Solar system. Interstellar objects (ISOs) can also provide insight on the formation of exoplanetary systems and planetary system evolution as a whole. In this work, we present the application of our framework to search for small Solar system bodies in exoplanet transit survey data collected by the Antarctic Search for Transiting ExoPlanets (ASTEP) project. We analysed data collected during the Austral winter of 2021 by the ASTEP 400 telescope located at the Concordia Station, at Dome C, Antarctica. We identified 20 known objects from dynamical classes ranging from Inner Main-belt asteroids to one comet. Our search recovered known objects down to a magnitude of $V$ = 20.4 mag, with a retrieval rate of $\sim$80% for objects with $V \le $ 20 mag. Future work will apply the pipeline to archival ASTEP data that observed fields for periods of longer than a few hours to treat them as deep-drilling datasets and reach fainter limiting magnitudes for slow-moving objects, on the order of $V\approx $ 23-24 mag. △ Less

Submitted 25 September, 2023; originally announced September 2023.

Comments: Accepted for publication in MNRAS (Monthly Notices of the Royal Astronomical Society), 9 pages, 8 figures

Communicating Robot's Intentions while Assisting Users via Augmented Reality

Authors: Chao Wang, Theodoros Stouraitis, Anna Belardinelli, Stephan Hasler, Michael Gienger

Abstract: This paper explores the challenges faced by assistive robots in effectively cooperating with humans, requiring them to anticipate human behavior, predict their actions' impact, and generate understandable robot actions. The study focuses on a use-case involving a user with limited mobility needing assistance with pouring a beverage, where tasks like unscrewing a cap or reaching for objects demand… ▽ More This paper explores the challenges faced by assistive robots in effectively cooperating with humans, requiring them to anticipate human behavior, predict their actions' impact, and generate understandable robot actions. The study focuses on a use-case involving a user with limited mobility needing assistance with pouring a beverage, where tasks like unscrewing a cap or reaching for objects demand coordinated support from the robot. Yet, anticipating the robot's intentions can be challenging for the user, which can hinder effective collaboration. To address this issue, we propose an innovative solution that utilizes Augmented Reality (AR) to communicate the robot's intentions and expected movements to the user, fostering a seamless and intuitive interaction. △ Less

Submitted 21 August, 2023; originally announced August 2023.

GPU-based framework for detecting small Solar System bodies in targeted exoplanet surveys

Authors: Artem Burdanov, Samantha Hasler, Julien de Wit

Abstract: Small Solar System bodies are pristine remnants of Solar System formation, which provide valuable insights for planetary science and astronomy. Their discovery and cataloging also have strong practical implications to life on Earth as the nearest asteroids could pose a serious impact threat. Concurrently with dedicated observational projects, searches for small bodies have been performed on numero… ▽ More Small Solar System bodies are pristine remnants of Solar System formation, which provide valuable insights for planetary science and astronomy. Their discovery and cataloging also have strong practical implications to life on Earth as the nearest asteroids could pose a serious impact threat. Concurrently with dedicated observational projects, searches for small bodies have been performed on numerous archival data sets from different facilities. Here, we present a framework to increase the scientific return of an exoplanet transit-search survey by recovering serendipitous detections of small bodies in its daily and archival data using a GPU-based synthetic tracking algorithm. As a proof of concept, we analysed $12 \times 12 \mathrm{arcmin^2}$ sky fields observed by the 1-m telescopes of the SPECULOOS survey. We analysed 90 sky fields distributed uniformly across the sky as part of the daily search for small bodies and 21 archival fields located within 5 deg from the ecliptic plane as part of the archival search (4.4 deg$^2$ in total). Overall, we identified 400 known objects of different dynamical classes from Inner Main-belt Asteroids to Jupiter Trojans and 43 potentially new small bodies with no priors on their motion. We were able to reach limiting magnitude for unknown objects of $V$=23.8 mag, and a retrieval rate of $\sim$80% for objects with $V<$22 mag and $V<$23.5 mag for the daily and archival searches, respectively. SPECULOOS and similar exoplanet surveys can thus serve as pencil-beam surveys for small bodies and probe parameter space beyond $V$=22 mag. △ Less

Submitted 13 March, 2023; originally announced March 2023.

Comments: Accepted for publication in MNRAS (Monthly Notices of the Royal Astronomical Society), 11 pages, 11 figures

FIDO2 the Rescue? Platform vs. Roaming Authentication on Smartphones

Authors: Leon Würsching, Florentin Putz, Steffen Haesler, Matthias Hollick

Abstract: Modern smartphones support FIDO2 passwordless authentication using either external security keys or internal biometric authentication, but it is unclear whether users appreciate and accept these new forms of web authentication for their own accounts. We present the first lab study (N=87) comparing platform and roaming authentication on smartphones, determining the practical strengths and weaknesse… ▽ More Modern smartphones support FIDO2 passwordless authentication using either external security keys or internal biometric authentication, but it is unclear whether users appreciate and accept these new forms of web authentication for their own accounts. We present the first lab study (N=87) comparing platform and roaming authentication on smartphones, determining the practical strengths and weaknesses of FIDO2 as perceived by users in a mobile scenario. Most participants were willing to adopt passwordless authentication during our in-person user study, but closer analysis shows that participants prioritize usability, security, and availability differently depending on the account type. We identify remaining adoption barriers that prevent FIDO2 from succeeding password authentication, such as missing support for contemporary usage patterns, including account delegation and usage on multiple clients. △ Less

Submitted 15 February, 2023; originally announced February 2023.

Comments: 16 pages, 6 figures, the dataset is available at https://doi.org/10.5281/zenodo.7572697 and the source code is available at https://github.com/seemoo-lab/fido2-the-smartphone

Journal ref: ACM CHI 2023

Explainable Human-Robot Training and Cooperation with Augmented Reality

Authors: Chao Wang, Anna Belardinelli, Stephan Hasler, Theodoros Stouraitis, Daniel Tanneberg, Michael Gienger

Abstract: The current spread of social and assistive robotics applications is increasingly highlighting the need for robots that can be easily taught and interacted with, even by users with no technical background. Still, it is often difficult to grasp what such robots know or to assess if a correct representation of the task is being formed. Augmented Reality (AR) has the potential to bridge this gap. We d… ▽ More The current spread of social and assistive robotics applications is increasingly highlighting the need for robots that can be easily taught and interacted with, even by users with no technical background. Still, it is often difficult to grasp what such robots know or to assess if a correct representation of the task is being formed. Augmented Reality (AR) has the potential to bridge this gap. We demonstrate three use cases where AR design elements enhance the explainability and efficiency of human-robot interaction: 1) a human teaching a robot some simple kitchen tasks by demonstration, 2) the robot showing its plan for solving novel tasks in AR to a human for validation, and 3) a robot communicating its intentions via AR while assisting people with limited mobility during daily activities. △ Less

Submitted 2 February, 2023; originally announced February 2023.

Improved Multi-Source Domain Adaptation by Preservation of Factors

Authors: Sebastian Schrom, Stephan Hasler, Jürgen Adamy

Abstract: Domain Adaptation (DA) is a highly relevant research topic when it comes to image classification with deep neural networks. Combining multiple source domains in a sophisticated way to optimize a classification model can improve the generalization to a target domain. Here, the difference in data distributions of source and target image datasets plays a major role. In this paper, we describe based o… ▽ More Domain Adaptation (DA) is a highly relevant research topic when it comes to image classification with deep neural networks. Combining multiple source domains in a sophisticated way to optimize a classification model can improve the generalization to a target domain. Here, the difference in data distributions of source and target image datasets plays a major role. In this paper, we describe based on a theory of visual factors how real-world scenes appear in images in general and how recent DA datasets are composed of such. We show that different domains can be described by a set of so called domain factors, whose values are consistent within a domain, but can change across domains. Many DA approaches try to remove all domain factors from the feature representation to be domain invariant. In this paper we show that this can lead to negative transfer since task-informative factors can get lost as well. To address this, we propose Factor-Preserving DA (FP-DA), a method to train a deep adversarial unsupervised DA model, which is able to preserve specific task relevant factors in a multi-domain scenario. We demonstrate on CORe50, a dataset with many domains, how such factors can be identified by standard one-to-one transfer experiments between single domains combined with PCA. By applying FP-DA, we show that the highest average and minimum performance can be achieved. △ Less

Submitted 16 October, 2020; v1 submitted 15 October, 2020; originally announced October 2020.

Designing Interaction for Multi-agent Cooperative System in an Office Environment

Authors: Chao Wang, Stephan Hasler, Manuel Muehlig, Frank Joublin, Antonello Ceravola, Joerg Deigmoeller, Lydia Fischer

Abstract: Future intelligent system will involve very various types of artificial agents, such as mobile robots, smart home infrastructure or personal devices, which share data and collaborate with each other to execute certain tasks.Designing an efficient human-machine interface, which can support users to express needs to the system, supervise the collaboration progress of different entities and evaluate… ▽ More Future intelligent system will involve very various types of artificial agents, such as mobile robots, smart home infrastructure or personal devices, which share data and collaborate with each other to execute certain tasks.Designing an efficient human-machine interface, which can support users to express needs to the system, supervise the collaboration progress of different entities and evaluate the result, will be challengeable. This paper presents the design and implementation of the human-machine interface of Intelligent Cyber-Physical system (ICPS),which is a multi-entity coordination system of robots and other smart devices in a working environment. ICPS gathers sensory data from entities and then receives users' command, then optimizes plans to utilize the capability of different entities to serve people. Using multi-model interaction methods, e.g. graphical interfaces, speech interaction, gestures and facial expressions, ICPS is able to receive inputs from users through different entities, keep users aware of the progress and accomplish the task efficiently △ Less

Submitted 15 February, 2020; originally announced February 2020.

Technical Design Report for the PANDA Endcap Disc DIRC

Authors: Panda Collaboration, F. Davi, W. Erni, B. Krusche, M. Steinacher, N. Walford, H. Liu, Z. Liu, B. Liu, X. Shen, C. Wang, J. Zhao, M. Albrecht, T. Erlen, F. Feldbauer, M. Fink, V. Freudenreich, M. Fritsch, F. H. Heinsius, T. Held, T. Holtmann, I. Keshk, H. Koch, B. Kopf, M. Kuhlmann , et al. (441 additional authors not shown)

Abstract: PANDA (anti-Proton ANnihiliation at DArmstadt) is planned to be one of the four main experiments at the future international accelerator complex FAIR (Facility for Antiproton and Ion Research) in Darmstadt, Germany. It is going to address fundamental questions of hadron physics and quantum chromodynamics using cooled antiproton beams with a high intensity and and momenta between 1.5 and 15 GeV/c.… ▽ More PANDA (anti-Proton ANnihiliation at DArmstadt) is planned to be one of the four main experiments at the future international accelerator complex FAIR (Facility for Antiproton and Ion Research) in Darmstadt, Germany. It is going to address fundamental questions of hadron physics and quantum chromodynamics using cooled antiproton beams with a high intensity and and momenta between 1.5 and 15 GeV/c. PANDA is designed to reach a maximum luminosity of 2x10^32 cm^2 s. Most of the physics programs require an excellent particle identification (PID). The PID of hadronic states at the forward endcap of the target spectrometer will be done by a fast and compact Cherenkov detector that uses the detection of internally reflected Cherenkov light (DIRC) principle. It is designed to cover the polar angle range from 5° to 22° and to provide a separation power for the separation of charged pions and kaons up to 3 standard deviations (s.d.) for particle momenta up to 4 GeV/c in order to cover the important particle phase space. This document describes the technical design and the expected performance of the novel PANDA Disc DIRC detector that has not been used in any other high energy physics experiment (HEP) before. The performance has been studied with Monte-Carlo simulations and various beam tests at DESY and CERN. The final design meets all PANDA requirements and guarantees suffcient safety margins. △ Less

Submitted 29 December, 2019; originally announced December 2019.

Comments: TDR for Panda/Fair to be published