-
Resource-efficient Medical Image Analysis with Self-adapting Forward-Forward Networks
Authors:
Johanna P. Müller,
Bernhard Kainz
Abstract:
We introduce a fast Self-adapting Forward-Forward Network (SaFF-Net) for medical imaging analysis, mitigating power consumption and resource limitations, which currently primarily stem from the prevalent reliance on back-propagation for model training and fine-tuning. Building upon the recently proposed Forward-Forward Algorithm (FFA), we introduce the Convolutional Forward-Forward Algorithm (CFFA…
▽ More
We introduce a fast Self-adapting Forward-Forward Network (SaFF-Net) for medical imaging analysis, mitigating power consumption and resource limitations, which currently primarily stem from the prevalent reliance on back-propagation for model training and fine-tuning. Building upon the recently proposed Forward-Forward Algorithm (FFA), we introduce the Convolutional Forward-Forward Algorithm (CFFA), a parameter-efficient reformulation that is suitable for advanced image analysis and overcomes the speed and generalisation constraints of the original FFA. To address hyper-parameter sensitivity of FFAs we are also introducing a self-adapting framework SaFF-Net fine-tuning parameters during warmup and training in parallel. Our approach enables more effective model training and eliminates the previously essential requirement for an arbitrarily chosen Goodness function in FFA. We evaluate our approach on several benchmarking datasets in comparison with standard Back-Propagation (BP) neural networks showing that FFA-based networks with notably fewer parameters and function evaluations can compete with standard models, especially, in one-shot scenarios and large batch sizes. The code will be available at the time of the conference.
△ Less
Submitted 20 June, 2024;
originally announced June 2024.
-
ADESSE: Advice Explanations in Complex Repeated Decision-Making Environments
Authors:
Sören Schleibaum,
Lu Feng,
Sarit Kraus,
Jörg P. Müller
Abstract:
In the evolving landscape of human-centered AI, fostering a synergistic relationship between humans and AI agents in decision-making processes stands as a paramount challenge. This work considers a problem setup where an intelligent agent comprising a neural network-based prediction component and a deep reinforcement learning component provides advice to a human decision-maker in complex repeated…
▽ More
In the evolving landscape of human-centered AI, fostering a synergistic relationship between humans and AI agents in decision-making processes stands as a paramount challenge. This work considers a problem setup where an intelligent agent comprising a neural network-based prediction component and a deep reinforcement learning component provides advice to a human decision-maker in complex repeated decision-making environments. Whether the human decision-maker would follow the agent's advice depends on their beliefs and trust in the agent and on their understanding of the advice itself. To this end, we developed an approach named ADESSE to generate explanations about the adviser agent to improve human trust and decision-making. Computational experiments on a range of environments with varying model sizes demonstrate the applicability and scalability of ADESSE. Furthermore, an interactive game-based user study shows that participants were significantly more satisfied, achieved a higher reward in the game, and took less time to select an action when presented with explanations generated by ADESSE. These findings illuminate the critical role of tailored, human-centered explanations in AI-assisted decision-making.
△ Less
Submitted 31 May, 2024;
originally announced May 2024.
-
Double diffraction imaging of X-ray induced structural dynamics in single free nanoparticles
Authors:
M. Sauppe,
T. Bischoff,
C. Bomme,
C. Bostedt,
A. Colombo,
B. Erk,
T. Feigl,
L. Flückiger,
T. Gorkhover,
A. Heilrath,
K. Kolatzki,
Y. Kumagai,
B. Langbehn,
J. P. Müller,
C. Passow,
D. Ramm,
D. Rolles,
D. Rompotis,
J. Schäfer-Zimmermann,
B. Senfftleben,
R. Treusch,
A. Ulmer,
J. Zimbalski,
T. Möller,
D. Rupp
Abstract:
Because of their high photon flux, X-ray free-electron lasers (FEL) allow to resolve the structure of individual nanoparticles via coherent diffractive imaging (CDI) within a single X-ray pulse. Since the inevitable rapid destruction of the sample limits the achievable resolution, a thorough understanding of the spatiotemporal evolution of matter on the nanoscale following the irradiation is cruci…
▽ More
Because of their high photon flux, X-ray free-electron lasers (FEL) allow to resolve the structure of individual nanoparticles via coherent diffractive imaging (CDI) within a single X-ray pulse. Since the inevitable rapid destruction of the sample limits the achievable resolution, a thorough understanding of the spatiotemporal evolution of matter on the nanoscale following the irradiation is crucial. We present a technique to track X-ray induced structural changes in time and space by recording two consecutive diffraction patterns of the same single, free-flying nanoparticle, acquired separately on two large-area detectors opposite to each other, thus examining both the initial and evolved particle structure. We demonstrate the method at the extreme ultraviolet (XUV) and soft X-ray Free-electron LASer in Hamburg (FLASH), investigating xenon clusters as model systems. By splitting a single XUV pulse, two diffraction patterns from the same particle can be obtained. For focus intensities of about $2\cdot10^{12}\,\text{W/cm}^2$ we observe still largely intact clusters even at the longest delays of up to 650 picoseconds of the second pulse, indicating that in the highly absorbing systems the damage remains confined to one side of the cluster. Instead, in case of five times higher flux, the diffraction patterns show clear signatures of disintegration, namely increased diameters and density fluctuations in the fragmenting clusters. Future improvements to the accessible range of dynamics and time resolution of the approach are discussed.
△ Less
Submitted 22 May, 2024; v1 submitted 19 December, 2023;
originally announced December 2023.
-
Stochastic Vision Transformers with Wasserstein Distance-Aware Attention
Authors:
Franciskus Xaverius Erick,
Mina Rezaei,
Johanna Paula Müller,
Bernhard Kainz
Abstract:
Self-supervised learning is one of the most promising approaches to acquiring knowledge from limited labeled data. Despite the substantial advancements made in recent years, self-supervised models have posed a challenge to practitioners, as they do not readily provide insight into the model's confidence and uncertainty. Tackling this issue is no simple feat, primarily due to the complexity involve…
▽ More
Self-supervised learning is one of the most promising approaches to acquiring knowledge from limited labeled data. Despite the substantial advancements made in recent years, self-supervised models have posed a challenge to practitioners, as they do not readily provide insight into the model's confidence and uncertainty. Tackling this issue is no simple feat, primarily due to the complexity involved in implementing techniques that can make use of the latent representations learned during pre-training without relying on explicit labels. Motivated by this, we introduce a new stochastic vision transformer that integrates uncertainty and distance awareness into self-supervised learning (SSL) pipelines. Instead of the conventional deterministic vector embedding, our novel stochastic vision transformer encodes image patches into elliptical Gaussian distributional embeddings. Notably, the attention matrices of these stochastic representational embeddings are computed using Wasserstein distance-based attention, effectively capitalizing on the distributional nature of these embeddings. Additionally, we propose a regularization term based on Wasserstein distance for both pre-training and fine-tuning processes, thereby incorporating distance awareness into latent representations. We perform extensive experiments across different tasks such as in-distribution generalization, out-of-distribution detection, dataset corruption, semi-supervised settings, and transfer learning to other datasets and tasks. Our proposed method achieves superior accuracy and calibration, surpassing the self-supervised baseline in a wide range of experiments on a variety of datasets.
△ Less
Submitted 30 November, 2023;
originally announced November 2023.
-
Whole Slide Multiple Instance Learning for Predicting Axillary Lymph Node Metastasis
Authors:
Glejdis Shkëmbi,
Johanna P. Müller,
Zhe Li,
Katharina Breininger,
Peter Schüffler,
Bernhard Kainz
Abstract:
Breast cancer is a major concern for women's health globally, with axillary lymph node (ALN) metastasis identification being critical for prognosis evaluation and treatment guidance. This paper presents a deep learning (DL) classification pipeline for quantifying clinical information from digital core-needle biopsy (CNB) images, with one step less than existing methods. A publicly available datase…
▽ More
Breast cancer is a major concern for women's health globally, with axillary lymph node (ALN) metastasis identification being critical for prognosis evaluation and treatment guidance. This paper presents a deep learning (DL) classification pipeline for quantifying clinical information from digital core-needle biopsy (CNB) images, with one step less than existing methods. A publicly available dataset of 1058 patients was used to evaluate the performance of different baseline state-of-the-art (SOTA) DL models in classifying ALN metastatic status based on CNB images. An extensive ablation study of various data augmentation techniques was also conducted. Finally, the manual tumor segmentation and annotation step performed by the pathologists was assessed.
△ Less
Submitted 6 October, 2023;
originally announced October 2023.
-
Many tasks make light work: Learning to localise medical anomalies from multiple synthetic tasks
Authors:
Matthew Baugh,
Jeremy Tan,
Johanna P. Müller,
Mischa Dombrowski,
James Batten,
Bernhard Kainz
Abstract:
There is a growing interest in single-class modelling and out-of-distribution detection as fully supervised machine learning models cannot reliably identify classes not included in their training. The long tail of infinitely many out-of-distribution classes in real-world scenarios, e.g., for screening, triage, and quality control, means that it is often necessary to train single-class models that…
▽ More
There is a growing interest in single-class modelling and out-of-distribution detection as fully supervised machine learning models cannot reliably identify classes not included in their training. The long tail of infinitely many out-of-distribution classes in real-world scenarios, e.g., for screening, triage, and quality control, means that it is often necessary to train single-class models that represent an expected feature distribution, e.g., from only strictly healthy volunteer data. Conventional supervised machine learning would require the collection of datasets that contain enough samples of all possible diseases in every imaging modality, which is not realistic. Self-supervised learning methods with synthetic anomalies are currently amongst the most promising approaches, alongside generative auto-encoders that analyse the residual reconstruction error. However, all methods suffer from a lack of structured validation, which makes calibration for deployment difficult and dataset-dependant. Our method alleviates this by making use of multiple visually-distinct synthetic anomaly learning tasks for both training and validation. This enables more robust training and generalisation. With our approach we can readily outperform state-of-the-art methods, which we demonstrate on exemplars in brain MRI and chest X-rays. Code is available at https://github.com/matt-baugh/many-tasks-make-light-work .
△ Less
Submitted 3 July, 2023;
originally announced July 2023.
-
Zero-Shot Anomaly Detection with Pre-trained Segmentation Models
Authors:
Matthew Baugh,
James Batten,
Johanna P. Müller,
Bernhard Kainz
Abstract:
This technical report outlines our submission to the zero-shot track of the Visual Anomaly and Novelty Detection (VAND) 2023 Challenge. Building on the performance of the WINCLIP framework, we aim to enhance the system's localization capabilities by integrating zero-shot segmentation models. In addition, we perform foreground instance segmentation which enables the model to focus on the relevant p…
▽ More
This technical report outlines our submission to the zero-shot track of the Visual Anomaly and Novelty Detection (VAND) 2023 Challenge. Building on the performance of the WINCLIP framework, we aim to enhance the system's localization capabilities by integrating zero-shot segmentation models. In addition, we perform foreground instance segmentation which enables the model to focus on the relevant parts of the image, thus allowing the models to better identify small or subtle deviations. Our pipeline requires no external data or information, allowing for it to be directly applied to new datasets. Our team (Variance Vigilance Vanguard) ranked third in the zero-shot track of the VAND challenge, and achieve an average F1-max score of 81.5/24.2 at a sample/pixel level on the VisA dataset.
△ Less
Submitted 15 June, 2023;
originally announced June 2023.
-
Trade-offs in Fine-tuned Diffusion Models Between Accuracy and Interpretability
Authors:
Mischa Dombrowski,
Hadrien Reynaud,
Johanna P. Müller,
Matthew Baugh,
Bernhard Kainz
Abstract:
Recent advancements in diffusion models have significantly impacted the trajectory of generative machine learning research, with many adopting the strategy of fine-tuning pre-trained models using domain-specific text-to-image datasets. Notably, this method has been readily employed for medical applications, such as X-ray image synthesis, leveraging the plethora of associated radiology reports. Yet…
▽ More
Recent advancements in diffusion models have significantly impacted the trajectory of generative machine learning research, with many adopting the strategy of fine-tuning pre-trained models using domain-specific text-to-image datasets. Notably, this method has been readily employed for medical applications, such as X-ray image synthesis, leveraging the plethora of associated radiology reports. Yet, a prevailing concern is the lack of assurance on whether these models genuinely comprehend their generated content. With the evolution of text-conditional image generation, these models have grown potent enough to facilitate object localization scrutiny. Our research underscores this advancement in the critical realm of medical imaging, emphasizing the crucial role of interpretability. We further unravel a consequential trade-off between image fidelity as gauged by conventional metrics and model interpretability in generative diffusion models. Specifically, the adoption of learnable text encoders when fine-tuning results in diminished interpretability. Our in-depth exploration uncovers the underlying factors responsible for this divergence. Consequently, we present a set of design principles for the development of truly interpretable generative models. Code is available at https://github.com/MischaD/chest-distillation.
△ Less
Submitted 19 December, 2023; v1 submitted 31 March, 2023;
originally announced March 2023.
-
Confidence-Aware and Self-Supervised Image Anomaly Localisation
Authors:
Johanna P. Müller,
Matthew Baugh,
Jeremy Tan,
Mischa Dombrowski,
Bernhard Kainz
Abstract:
Universal anomaly detection still remains a challenging problem in machine learning and medical image analysis. It is possible to learn an expected distribution from a single class of normative samples, e.g., through epistemic uncertainty estimates, auto-encoding models, or from synthetic anomalies in a self-supervised way. The performance of self-supervised anomaly detection approaches is still i…
▽ More
Universal anomaly detection still remains a challenging problem in machine learning and medical image analysis. It is possible to learn an expected distribution from a single class of normative samples, e.g., through epistemic uncertainty estimates, auto-encoding models, or from synthetic anomalies in a self-supervised way. The performance of self-supervised anomaly detection approaches is still inferior compared to methods that use examples from known unknown classes to shape the decision boundary. However, outlier exposure methods often do not identify unknown unknowns. Here we discuss an improved self-supervised single-class training strategy that supports the approximation of probabilistic inference with loosen feature locality constraints. We show that up-scaling of gradients with histogram-equalised images is beneficial for recently proposed self-supervision tasks. Our method is integrated into several out-of-distribution (OOD) detection models and we show evidence that our method outperforms the state-of-the-art on various benchmark datasets.
△ Less
Submitted 2 October, 2023; v1 submitted 23 March, 2023;
originally announced March 2023.
-
Adnexal Mass Segmentation with Ultrasound Data Synthesis
Authors:
Clara Lebbos,
Jen Barcroft,
Jeremy Tan,
Johanna P. Muller,
Matthew Baugh,
Athanasios Vlontzos,
Srdjan Saso,
Bernhard Kainz
Abstract:
Ovarian cancer is the most lethal gynaecological malignancy. The disease is most commonly asymptomatic at its early stages and its diagnosis relies on expert evaluation of transvaginal ultrasound images. Ultrasound is the first-line imaging modality for characterising adnexal masses, it requires significant expertise and its analysis is subjective and labour-intensive, therefore open to error. Hen…
▽ More
Ovarian cancer is the most lethal gynaecological malignancy. The disease is most commonly asymptomatic at its early stages and its diagnosis relies on expert evaluation of transvaginal ultrasound images. Ultrasound is the first-line imaging modality for characterising adnexal masses, it requires significant expertise and its analysis is subjective and labour-intensive, therefore open to error. Hence, automating processes to facilitate and standardise the evaluation of scans is desired in clinical practice. Using supervised learning, we have demonstrated that segmentation of adnexal masses is possible, however, prevalence and label imbalance restricts the performance on under-represented classes. To mitigate this we apply a novel pathology-specific data synthesiser. We create synthetic medical images with their corresponding ground truth segmentations by using Poisson image editing to integrate less common masses into other samples. Our approach achieves the best performance across all classes, including an improvement of up to 8% when compared with nnU-Net baseline approaches.
△ Less
Submitted 25 September, 2022;
originally announced September 2022.
-
nnOOD: A Framework for Benchmarking Self-supervised Anomaly Localisation Methods
Authors:
Matthew Baugh,
Jeremy Tan,
Athanasios Vlontzos,
Johanna P. Müller,
Bernhard Kainz
Abstract:
The wide variety of in-distribution and out-of-distribution data in medical imaging makes universal anomaly detection a challenging task. Recently a number of self-supervised methods have been developed that train end-to-end models on healthy data augmented with synthetic anomalies. However, it is difficult to compare these methods as it is not clear whether gains in performance are from the task…
▽ More
The wide variety of in-distribution and out-of-distribution data in medical imaging makes universal anomaly detection a challenging task. Recently a number of self-supervised methods have been developed that train end-to-end models on healthy data augmented with synthetic anomalies. However, it is difficult to compare these methods as it is not clear whether gains in performance are from the task itself or the training pipeline around it. It is also difficult to assess whether a task generalises well for universal anomaly detection, as they are often only tested on a limited range of anomalies. To assist with this we have developed nnOOD, a framework that adapts nnU-Net to allow for comparison of self-supervised anomaly localisation methods. By isolating the synthetic, self-supervised task from the rest of the training process we perform a more faithful comparison of the tasks, whilst also making the workflow for evaluating over a given dataset quick and easy. Using this we have implemented the current state-of-the-art tasks and evaluated them on a challenging X-ray dataset.
△ Less
Submitted 2 September, 2022;
originally announced September 2022.
-
An Explainable Stacked Ensemble Model for Static Route-Free Estimation of Time of Arrival
Authors:
Sören Schleibaum,
Jörg P. Müller,
Monika Sester
Abstract:
To compare alternative taxi schedules and to compute them, as well as to provide insights into an upcoming taxi trip to drivers and passengers, the duration of a trip or its Estimated Time of Arrival (ETA) is predicted. To reach a high prediction precision, machine learning models for ETA are state of the art. One yet unexploited option to further increase prediction precision is to combine multip…
▽ More
To compare alternative taxi schedules and to compute them, as well as to provide insights into an upcoming taxi trip to drivers and passengers, the duration of a trip or its Estimated Time of Arrival (ETA) is predicted. To reach a high prediction precision, machine learning models for ETA are state of the art. One yet unexploited option to further increase prediction precision is to combine multiple ETA models into an ensemble. While an increase of prediction precision is likely, the main drawback is that the predictions made by such an ensemble become less transparent due to the sophisticated ensemble architecture. One option to remedy this drawback is to apply eXplainable Artificial Intelligence (XAI). The contribution of this paper is three-fold. First, we combine multiple machine learning models from our previous work for ETA into a two-level ensemble model - a stacked ensemble model - which on its own is novel; therefore, we can outperform previous state-of-the-art static route-free ETA approaches. Second, we apply existing XAI methods to explain the first- and second-level models of the ensemble. Third, we propose three joining methods for combining the first-level explanations with the second-level ones. Those joining methods enable us to explain stacked ensembles for regression tasks. An experimental evaluation shows that the ETA models correctly learned the importance of those input features driving the prediction.
△ Less
Submitted 11 January, 2024; v1 submitted 17 March, 2022;
originally announced March 2022.
-
On Intercultural Transferability and Calibration of Heterogeneous Shared Space Motion Models
Authors:
Fatema T. Johora,
Jörg P. Müller
Abstract:
Modelling and simulation of mixed-traffic zones is an important tool for transportation planners to assess safety, efficiency, and human-friendliness of future urban areas. This paper addresses problems of calibration and transferability of existing shared space models when applied to scenarios that differ in terms of cultural aspects, traffic conditions, and spatial layout. In particular, the fir…
▽ More
Modelling and simulation of mixed-traffic zones is an important tool for transportation planners to assess safety, efficiency, and human-friendliness of future urban areas. This paper addresses problems of calibration and transferability of existing shared space models when applied to scenarios that differ in terms of cultural aspects, traffic conditions, and spatial layout. In particular, the first contribution of this work is an enhancement of the Game-Theoretic Social Force Model (GSFM) by a generic methodology for largely automated model calibration; we illustrate the use of the calibration method for a shared space environment in Germany. The second contribution is an investigation into transferability of shared space models. We define criteria for model transferability and present a case study, in which we analyse and evaluate transferability of the model we constructed based on the ``German dataset'' to a different shared space environment from China. Our results indicate that although -- as to be expected -- the model faces difficulties to replicate the movement behaviours of road users from a new environment, by adding social norms (derived through analysis) of that environment to our model, satisfactory improvement of model accuracy can be obtained with limited effort.
△ Less
Submitted 27 February, 2022;
originally announced February 2022.
-
Investigating the Role of Pedestrian Groups in Shared Spaces through Simulation Modeling
Authors:
Suhair Ahmed,
Fatema T. Johora,
Jörg P. Müller
Abstract:
In shared space environments, urban space is shared among different types of road users, who frequently interact with each other to negotiate priority and coordinate their trajectories. Instead of traffic rules, interactions among them are conducted by informal rules like speed limitations and by social protocols e.g., courtesy behavior. Social groups (socially related road users who walk together…
▽ More
In shared space environments, urban space is shared among different types of road users, who frequently interact with each other to negotiate priority and coordinate their trajectories. Instead of traffic rules, interactions among them are conducted by informal rules like speed limitations and by social protocols e.g., courtesy behavior. Social groups (socially related road users who walk together) are an essential phenomenon in shared spaces and affect the safety and efficiency of such environments. To replicate group phenomena and systematically study their influence in shared spaces; realistic models of social groups and the integration of these models into shared space simulations are required. In this work, we focus on pedestrian groups and adopt an extended version of the social force model in conjunction with a game-theoretic model to simulate their movements. The novelty of our paper is in the modeling of interactions between social groups and vehicles. We validate our model by simulating scenarios involving interaction between social groups and also group-to-vehicle interaction.
△ Less
Submitted 27 February, 2022;
originally announced February 2022.
-
SFMGNet: A Physics-based Neural Network To Predict Pedestrian Trajectories
Authors:
Sakif Hossain,
Fatema T. Johora,
Jörg P. Müller,
Sven Hartmann,
Andreas Reinhardt
Abstract:
Autonomous robots and vehicles are expected to soon become an integral part of our environment. Unsatisfactory issues regarding interaction with existing road users, performance in mixed-traffic areas and lack of interpretable behavior remain key obstacles. To address these, we present a physics-based neural network, based on a hybrid approach combining a social force model extended by group force…
▽ More
Autonomous robots and vehicles are expected to soon become an integral part of our environment. Unsatisfactory issues regarding interaction with existing road users, performance in mixed-traffic areas and lack of interpretable behavior remain key obstacles. To address these, we present a physics-based neural network, based on a hybrid approach combining a social force model extended by group force (SFMG) with Multi-Layer Perceptron (MLP) to predict pedestrian trajectories considering its interaction with static obstacles, other pedestrians and pedestrian groups. We quantitatively and qualitatively evaluate the model with respect to realistic prediction, prediction performance and prediction "interpretability". Initial results suggest, the model even when solely trained on a synthetic dataset, can predict realistic and interpretable trajectories with better than state-of-the-art accuracy.
△ Less
Submitted 6 February, 2022;
originally announced February 2022.
-
Ride Sharing & Data Privacy: An Analysis of the State of Practice
Authors:
Carsten Hesselmann,
Jan Gertheiss,
Jörg P. Müller
Abstract:
Digital services like ride sharing rely heavily on personal data as individuals have to disclose personal information in order to gain access to the market and exchange their information with other participants; yet, the service provider usually gives little to no information regarding the privacy status of the disclosed information though privacy concerns are a decisive factor for individuals to…
▽ More
Digital services like ride sharing rely heavily on personal data as individuals have to disclose personal information in order to gain access to the market and exchange their information with other participants; yet, the service provider usually gives little to no information regarding the privacy status of the disclosed information though privacy concerns are a decisive factor for individuals to (not) use these services. We analyzed how popular ride sharing services handle user privacy to assess the current state of practice. The results show that services include a varying set of personal data and offer limited privacy-related features.
△ Less
Submitted 19 October, 2021; v1 submitted 18 October, 2021;
originally announced October 2021.
-
Modeling Interactions of Multimodal Road Users in Shared Spaces
Authors:
Fatema T. Johora,
Jörg P. Müller
Abstract:
In shared spaces, motorized and non-motorized road users share the same space with equal priority. Their movements are not regulated by traffic rules, hence they interact more frequently to negotiate priority over the shared space. To estimate the safeness and efficiency of shared spaces, reproducing the traffic behavior in such traffic places is important. In this paper, we consider and combine d…
▽ More
In shared spaces, motorized and non-motorized road users share the same space with equal priority. Their movements are not regulated by traffic rules, hence they interact more frequently to negotiate priority over the shared space. To estimate the safeness and efficiency of shared spaces, reproducing the traffic behavior in such traffic places is important. In this paper, we consider and combine different levels of interaction between pedestrians and cars in shared space environments. Our proposed model consists of three layers: a layer to plan trajectories of road users; a force-based modeling layer to reproduce free flow movement and simple interactions; and a game-theoretic decision layer to handle complex situations where road users need to make a decision over different alternatives. We validate our model by simulating scenarios involving various interactions between pedestrians and cars and also car-to-car interaction. The results indicate that simulated behaviors match observed behaviors well.
△ Less
Submitted 5 July, 2021;
originally announced July 2021.
-
On the Generalizability of Motion Models for Road Users in Heterogeneous Shared Traffic Spaces
Authors:
Fatema T. Johora,
Dongfang Yang,
Jörg P. Müller,
Ümit Özgüner
Abstract:
Modeling mixed-traffic motion and interactions is crucial to assess safety, efficiency, and feasibility of future urban areas. The lack of traffic regulations, diverse transport modes, and the dynamic nature of mixed-traffic zones like shared spaces make realistic modeling of such environments challenging. This paper focuses on the generalizability of the motion model, i.e., its ability to generat…
▽ More
Modeling mixed-traffic motion and interactions is crucial to assess safety, efficiency, and feasibility of future urban areas. The lack of traffic regulations, diverse transport modes, and the dynamic nature of mixed-traffic zones like shared spaces make realistic modeling of such environments challenging. This paper focuses on the generalizability of the motion model, i.e., its ability to generate realistic behavior in different environmental settings, an aspect which is lacking in existing works. Specifically, our first contribution is a novel and systematic process of formulating general motion models and application of this process is to extend our Game-Theoretic Social Force Model (GSFM) towards a general model for generating a large variety of motion behaviors of pedestrians and cars from different shared spaces. Our second contribution is to consider different motion patterns of pedestrians by calibrating motion-related features of individual pedestrian and clustering them into groups. We analyze two clustering approaches. The calibration and evaluation of our model are performed on three different shared space data sets. The results indicate that our model can realistically simulate a wide range of motion behaviors and interaction scenarios, and that adding different motion patterns of pedestrians into our model improves its performance.
△ Less
Submitted 18 January, 2021;
originally announced January 2021.
-
Sub-Goal Social Force Model for Collective Pedestrian Motion Under Vehicle Influence
Authors:
Dongfang Yang,
Fatema T. Johora,
Keith A. Redmill,
Ümit Özgüner,
Jörg P. Müller
Abstract:
In mixed traffic scenarios, a certain number of pedestrians might coexist in a small area while interacting with vehicles. In this situation, every pedestrian must simultaneously react to the surrounding pedestrians and vehicles. Analytical modeling of such collective pedestrian motion can benefit intelligent transportation practices like shared space design and urban autonomous driving. This work…
▽ More
In mixed traffic scenarios, a certain number of pedestrians might coexist in a small area while interacting with vehicles. In this situation, every pedestrian must simultaneously react to the surrounding pedestrians and vehicles. Analytical modeling of such collective pedestrian motion can benefit intelligent transportation practices like shared space design and urban autonomous driving. This work proposed the sub-goal social force model (SG-SFM) to describe the collective pedestrian motion under vehicle influence. The proposed model introduced a new design of vehicle influence on pedestrian motion, which was smoothly combined with the influence of surrounding pedestrians using the sub-goal concept. This model aims to describe generalized pedestrian motion, i.e., it is applicable to various vehicle-pedestrian interaction patterns. The generalization was verified by both quantitative and qualitative evaluation. The quantitative evaluation was conducted to reproduce pedestrian motion in three different datasets, HBS, CITR, and DUT. It also compared two different ways of calibrating the model parameters. The qualitative evaluation examined the simulation of collective pedestrian motion in a series of fundamental vehicle-pedestrian interaction scenarios. The above evaluation results demonstrated the effectiveness of the proposed model.
△ Less
Submitted 10 January, 2021;
originally announced January 2021.
-
PFaRA: a Platoon Forming and Routing Algorithm for Same-Day Deliveries
Authors:
Sînziana-Maria Sebe,
Jörg P. Müller
Abstract:
Platoons, vehicles that travel very close together acting as one, promise to improve road usage on freeways and city roads alike. We study platoon formation in the context of same-day delivery in urban environments. Multiple self-interested logistic service providers (LSP) carry out same-day deliveries by deploying autonomous electric vehicles that are capable of forming and traveling in platoons.…
▽ More
Platoons, vehicles that travel very close together acting as one, promise to improve road usage on freeways and city roads alike. We study platoon formation in the context of same-day delivery in urban environments. Multiple self-interested logistic service providers (LSP) carry out same-day deliveries by deploying autonomous electric vehicles that are capable of forming and traveling in platoons. The novel aspect that we consider in our research is heterogeneity of platoons in the sense that vehicles are equipped with different capabilities and constraints, and belong to different providers. Our aim is to examine how these platoons can form and their potential properties and benefits. We present a platoon forming and routing algorithm, called PFaRA, that finds longest common routes for multiple vehicles, while also respecting vehicle preferences and constraints. PFaRA consists of two parts, a speed clustering step and a linear optimisation step. To test the approach, a simulation was used, working with realistic urban network data and background traffic models. Our results showed that the performance of our approach is comparable to a simple route-matching one, but it leads to better utility values for vehicles and by extension the LSPs. We show that the grou** provided is viable and provides benefits to all vehicles participating in the platoon.
△ Less
Submitted 14 November, 2019;
originally announced December 2019.
-
AI for Explaining Decisions in Multi-Agent Environments
Authors:
Sarit Kraus,
Amos Azaria,
Jelena Fiosina,
Maike Greve,
Noam Hazon,
Lutz Kolbe,
Tim-Benjamin Lembcke,
Jörg P. Müller,
Sören Schleibaum,
Mark Vollrath
Abstract:
Explanation is necessary for humans to understand and accept decisions made by an AI system when the system's goal is known. It is even more important when the AI system makes decisions in multi-agent environments where the human does not know the systems' goals since they may depend on other agents' preferences. In such situations, explanations should aim to increase user satisfaction, taking int…
▽ More
Explanation is necessary for humans to understand and accept decisions made by an AI system when the system's goal is known. It is even more important when the AI system makes decisions in multi-agent environments where the human does not know the systems' goals since they may depend on other agents' preferences. In such situations, explanations should aim to increase user satisfaction, taking into account the system's decision, the user's and the other agents' preferences, the environment settings and properties such as fairness, envy and privacy. Generating explanations that will increase user satisfaction is very challenging; to this end, we propose a new research direction: xMASE. We then review the state of the art and discuss research directions towards efficient methodologies and algorithms for generating explanations that will increase users' satisfaction from AI system's decisions in multi-agent environments.
△ Less
Submitted 12 October, 2019; v1 submitted 10 October, 2019;
originally announced October 2019.
-
Dynamic Path Planning and Movement Control in Pedestrian Simulation
Authors:
Fatema Tuj Johora,
Philipp Kraus,
Jörg P. Müller
Abstract:
Modeling and simulation of pedestrian behavior is used in applications such as planning large buildings, disaster management, or urban planning. Realistically simulating pedestrian behavior is challenging, due to the complexity of individual behavior as well as the complexity of interactions of pedestrians with each other and with the environment. This work-in-progress paper addresses the tactical…
▽ More
Modeling and simulation of pedestrian behavior is used in applications such as planning large buildings, disaster management, or urban planning. Realistically simulating pedestrian behavior is challenging, due to the complexity of individual behavior as well as the complexity of interactions of pedestrians with each other and with the environment. This work-in-progress paper addresses the tactical (path planning) and the operational level (movement control) of pedestrian simulation from the perspective of multiagent-based modeling. We propose (1) an novel extension of the JPS routing algorithm for tactical planning, and (2) an architecture how path planning can be integrated with a social-force based movement control. The architecture is inspired by layered architectures for robot planning and control. We validate correctness and efficiency of our approach through simulation runs.
△ Less
Submitted 24 September, 2017;
originally announced September 2017.
-
Diffractive imaging of transient electronic core-shell structures in a nanoplasma
Authors:
Daniela Rupp,
Leonie Flückiger,
Marcus Adolph,
Tais Gorkhover,
Maria Krikunova,
Jan Phillipe Müller,
Maria Müller,
Tim Oelze,
Yevheniy Ovcharenko,
Mario Sauppe,
Sebastian Schorb,
David Wolter,
Marion Harmand,
Rolf Treusch,
Christoph Bostedt,
Thomas Möller
Abstract:
We have recorded the coherent diffraction images of individual xenon clusters with intense extreme ultraviolet pulses to elucidate the influence of light-induced electronic changes on the diffraction pattern. Using the FLASH free-electron laser we tuned the wavelength to specific xenon atomic and ionic resonances. The data show the emergence of a transient core-shell structure within the otherwise…
▽ More
We have recorded the coherent diffraction images of individual xenon clusters with intense extreme ultraviolet pulses to elucidate the influence of light-induced electronic changes on the diffraction pattern. Using the FLASH free-electron laser we tuned the wavelength to specific xenon atomic and ionic resonances. The data show the emergence of a transient core-shell structure within the otherwise homogeneous sample. Simulations indicate that ionization and nanoplasma formation result in a cluster shell with strongly altered refraction. The presented resonant scattering approach enables imaging of ultrafast electron dynamics on their natural time scale.
△ Less
Submitted 11 October, 2017; v1 submitted 3 November, 2016;
originally announced November 2016.
-
Ultra-compact In-Line Scattering Polarimetry
Authors:
J. P. Balthasar Müller,
Kristjan Leosson,
Federico Capasso
Abstract:
In-line polarimeters perform non-destructive polarization measurements of optical signals, and play a critical role in monitoring and controlling the polarization environment in for example optical networks. While current in-line polarimeters are constructed with multiple optical components, either fabricated into an optical fiber or using free-space optics, we present here a novel architecture co…
▽ More
In-line polarimeters perform non-destructive polarization measurements of optical signals, and play a critical role in monitoring and controlling the polarization environment in for example optical networks. While current in-line polarimeters are constructed with multiple optical components, either fabricated into an optical fiber or using free-space optics, we present here a novel architecture conducive to monolithic on-chip integration. This enables the scalable fabrication of high-performance polarization sensors with exceptional stability, compactness and speed. The method relies on the detection of the highly polarization-dependent scattered field of a sub-wavelength antenna array known as metasurface, and is shown here to provide polarization state measurements matching those of a state-of-the-art commercial polarimeter.
△ Less
Submitted 8 December, 2015; v1 submitted 17 September, 2015;
originally announced September 2015.
-
Lateral Chirality-sorting Optical Spin Forces in Evanescent Fields
Authors:
Amaury Hayat,
J. P. Balthasar Müller,
Federico Capasso
Abstract:
The transverse component of the spin angular momentum of evanescent waves gives rise to lateral optical forces on chiral particles, which have the unusual property of acting in a direction in which there is neither a field gradient nor wave propagation. As their direction and strength depends on the chiral polarizability of the particle, they act as chirality-sorting and may offer a mechanism for…
▽ More
The transverse component of the spin angular momentum of evanescent waves gives rise to lateral optical forces on chiral particles, which have the unusual property of acting in a direction in which there is neither a field gradient nor wave propagation. As their direction and strength depends on the chiral polarizability of the particle, they act as chirality-sorting and may offer a mechanism for passive chirality spectroscopy. The absolute strength of the forces also substantially exceeds that of other recently predicted sideways optical forces, such that they may more readily offer an experimental confirmation of the phenomenon.
△ Less
Submitted 20 December, 2014; v1 submitted 10 August, 2014;
originally announced August 2014.
-
Strong Asymmetric Surface Plasmon Polariton Emission by a Dipole Emitter near a Metal Surface
Authors:
J. P. Balthasar Mueller,
Federico Capasso
Abstract:
We show that the surface plasmon polariton (SPP) radiation patterns of point-dipole emitters in the vicinity of a metal-dielectric interface are generally asymmetric with respect to the location of the emitter. In particular rotating dipoles, which emit elliptically polarized light, produce highly asymmetric SPP radiation fields that include unidirectional emission. Asymmetric SPP radiation patter…
▽ More
We show that the surface plasmon polariton (SPP) radiation patterns of point-dipole emitters in the vicinity of a metal-dielectric interface are generally asymmetric with respect to the location of the emitter. In particular rotating dipoles, which emit elliptically polarized light, produce highly asymmetric SPP radiation fields that include unidirectional emission. Asymmetric SPP radiation patterns also result when a dipole oscillates tilted with respect to the plane of the interface and optical losses or gains are present in the materials. These effects can be used to directionally control SPP emission and absorption, as well as to study emission and scattering processes close to metal-dielectric interfaces. Possible implementations of asymmetrically emitting SPP sources are discussed.
△ Less
Submitted 6 November, 2013; v1 submitted 8 April, 2013;
originally announced April 2013.
-
Steplike intensity threshold behavior of extreme ionization in laser-driven Xe clusters
Authors:
T. Döppner,
J. P. Müller,
A. Przystawik,
S. Göde,
J. Tiggesbäumker,
K. -H. Meiwes-Broer,
C. Varin,
L. Ramunno,
T. Brabec,
T. Fennel
Abstract:
The generation of highly charged Xe$^{q+}$ ions up to {$q=24$} is observed in Xe clusters embedded in helium nanodroplets and exposed to intense femtosecond laser pulses ($λ$=800 nm). Laser intensity resolved measurements show that the high-$q$ ion generation starts at an unexpectedly low threshold intensity of about {10$^{14}$ W/cm$^{2}$}. Above threshold, the Xe ion charge spectrum saturates q…
▽ More
The generation of highly charged Xe$^{q+}$ ions up to {$q=24$} is observed in Xe clusters embedded in helium nanodroplets and exposed to intense femtosecond laser pulses ($λ$=800 nm). Laser intensity resolved measurements show that the high-$q$ ion generation starts at an unexpectedly low threshold intensity of about {10$^{14}$ W/cm$^{2}$}. Above threshold, the Xe ion charge spectrum saturates quickly and changes only weakly for higher laser intensities. Good agreement between these observations and a molecular dynamics analysis allows us to identify the mechanisms responsible for the highly charged ion production and the surprising intensity threshold behavior of the ionization process.
△ Less
Submitted 6 March, 2010; v1 submitted 14 August, 2009;
originally announced August 2009.
