Showing 1–8 of 8 results for author: Knittel, A

Conditional Unscented Autoencoders for Trajectory Prediction

Authors: Faris Janjoš, Marcel Hallgarten, Anthony Knittel, Maxim Dolgov, Andreas Zell, J. Marius Zöllner

Abstract: The CVAE is one of the most widely-used models in trajectory prediction for AD. It captures the interplay between a driving context and its ground-truth future into a probabilistic latent space and uses it to produce predictions. In this paper, we challenge key components of the CVAE. We leverage recent advances in the space of the VAE, the foundation of the CVAE, which show that a simple change i… ▽ More The CVAE is one of the most widely-used models in trajectory prediction for AD. It captures the interplay between a driving context and its ground-truth future into a probabilistic latent space and uses it to produce predictions. In this paper, we challenge key components of the CVAE. We leverage recent advances in the space of the VAE, the foundation of the CVAE, which show that a simple change in the sampling procedure can greatly benefit performance. We find that unscented sampling, which draws samples from any learned distribution in a deterministic manner, can naturally be better suited to trajectory prediction than potentially dangerous random sampling. We go further and offer additional improvements including a more structured Gaussian mixture latent space, as well as a novel, potentially more expressive way to do inference with CVAEs. We show wide applicability of our models by evaluating them on the INTERACTION prediction dataset, outperforming the state of the art, as well as at the task of image modeling on the CelebA dataset, outperforming the baseline vanilla CVAE. Code is available at https://github.com/boschresearch/cuae-prediction. △ Less

Submitted 27 February, 2024; v1 submitted 30 October, 2023; originally announced October 2023.

Comparison of Pedestrian Prediction Models from Trajectory and Appearance Data for Autonomous Driving

Authors: Anthony Knittel, Morris Antonello, John Redford, Subramanian Ramamoorthy

Abstract: The ability to anticipate pedestrian motion changes is a critical capability for autonomous vehicles. In urban environments, pedestrians may enter the road area and create a high risk for driving, and it is important to identify these cases. Typical predictors use the trajectory history to predict future motion, however in cases of motion initiation, motion in the trajectory may only be clearly vi… ▽ More The ability to anticipate pedestrian motion changes is a critical capability for autonomous vehicles. In urban environments, pedestrians may enter the road area and create a high risk for driving, and it is important to identify these cases. Typical predictors use the trajectory history to predict future motion, however in cases of motion initiation, motion in the trajectory may only be clearly visible after a delay, which can result in the pedestrian has entered the road area before an accurate prediction can be made. Appearance data includes useful information such as changes of gait, which are early indicators of motion changes, and can inform trajectory prediction. This work presents a comparative evaluation of trajectory-only and appearance-based methods for pedestrian prediction, and introduces a new dataset experiment for prediction using appearance. We create two trajectory and image datasets based on the combination of image and trajectory sequences from the popular NuScenes dataset, and examine prediction of trajectories using observed appearance to influence futures. This shows some advantages over trajectory prediction alone, although problems with the dataset prevent advantages of appearance-based models from being shown. We describe methods for improving the dataset and experiment to allow benefits of appearance-based models to be captured. △ Less

Submitted 25 May, 2023; originally announced May 2023.

DiPA: Probabilistic Multi-Modal Interactive Prediction for Autonomous Driving

Authors: Anthony Knittel, Majd Hawasly, Stefano V. Albrecht, John Redford, Subramanian Ramamoorthy

Abstract: Accurate prediction is important for operating an autonomous vehicle in interactive scenarios. Prediction must be fast, to support multiple requests from a planner exploring a range of possible futures. The generated predictions must accurately represent the probabilities of predicted trajectories, while also capturing different modes of behaviour (such as turning left vs continuing straight at a… ▽ More Accurate prediction is important for operating an autonomous vehicle in interactive scenarios. Prediction must be fast, to support multiple requests from a planner exploring a range of possible futures. The generated predictions must accurately represent the probabilities of predicted trajectories, while also capturing different modes of behaviour (such as turning left vs continuing straight at a junction). To this end, we present DiPA, an interactive predictor that addresses these challenging requirements. Previous interactive prediction methods use an encoding of k-mode-samples, which under-represents the full distribution. Other methods optimise closest-mode evaluations, which test whether one of the predictions is similar to the ground-truth, but allow additional unlikely predictions to occur, over-representing unlikely predictions. DiPA addresses these limitations by using a Gaussian-Mixture-Model to encode the full distribution, and optimising predictions using both probabilistic and closest-mode measures. These objectives respectively optimise probabilistic accuracy and the ability to capture distinct behaviours, and there is a challenging trade-off between them. We are able to solve both together using a novel training regime. DiPA achieves new state-of-the-art performance on the INTERACTION and NGSIM datasets, and improves over the baseline (MFP) when both closest-mode and probabilistic evaluations are used. This demonstrates effective prediction for supporting a planner on interactive scenarios. △ Less

Submitted 8 March, 2023; v1 submitted 12 October, 2022; originally announced October 2022.

Journal ref: IEEE Robotics and Automation Letters, vol. 8, no. 8, pp. 4887-4894, Aug. 2023

Beyond RMSE: Do machine-learned models of road user interaction produce human-like behavior?

Authors: Aravinda Ramakrishnan Srinivasan, Yi-Shin Lin, Morris Antonello, Anthony Knittel, Mohamed Hasan, Majd Hawasly, John Redford, Subramanian Ramamoorthy, Matteo Leonetti, Jac Billington, Richard Romano, Gustav Markkula

Abstract: Autonomous vehicles use a variety of sensors and machine-learned models to predict the behavior of surrounding road users. Most of the machine-learned models in the literature focus on quantitative error metrics like the root mean square error (RMSE) to learn and report their models' capabilities. This focus on quantitative error metrics tends to ignore the more important behavioral aspect of the… ▽ More Autonomous vehicles use a variety of sensors and machine-learned models to predict the behavior of surrounding road users. Most of the machine-learned models in the literature focus on quantitative error metrics like the root mean square error (RMSE) to learn and report their models' capabilities. This focus on quantitative error metrics tends to ignore the more important behavioral aspect of the models, raising the question of whether these models really predict human-like behavior. Thus, we propose to analyze the output of machine-learned models much like we would analyze human data in conventional behavioral research. We introduce quantitative metrics to demonstrate presence of three different behavioral phenomena in a naturalistic highway driving dataset: 1) The kinematics-dependence of who passes a merging point first 2) Lane change by an on-highway vehicle to accommodate an on-ramp vehicle 3) Lane changes by vehicles on the highway to avoid lead vehicle conflicts. Then, we analyze the behavior of three machine-learned models using the same metrics. Even though the models' RMSE value differed, all the models captured the kinematic-dependent merging behavior but struggled at varying degrees to capture the more nuanced courtesy lane change and highway lane change behavior. Additionally, the collision aversion analysis during lane changes showed that the models struggled to capture the physical aspect of human driving: leaving adequate gap between the vehicles. Thus, our analysis highlighted the inadequacy of simple quantitative metrics and the need to take a broader behavioral perspective when analyzing machine-learned models of human driving predictions. △ Less

Submitted 28 March, 2023; v1 submitted 22 June, 2022; originally announced June 2022.

Comments: This work has been accepted for publication in the IEEE Transactions on Intelligent Transportation Systems journal on 13th March 2023

Exposure Effects on Count Outcomes with Observational Data, with Application to Incarcerated Women

Authors: Bonnie E. Shook-Sa, Michael G. Hudgens, Andrea K. Knittel, Andrew Edmonds, Catalina Ramirez, Stephen R. Cole, Mardge Cohen, Adebola Adedimeji, Tonya Taylor, Katherine G. Michel, Andrea Kovacs, Jennifer Cohen, Jessica Donohue, Antonina Foster, Margaret A. Fischl, Dustin Long, Adaora A. Adimora

Abstract: Causal inference methods can be applied to estimate the effect of a point exposure or treatment on an outcome of interest using data from observational studies. For example, in the Women's Interagency HIV Study, it is of interest to understand the effects of incarceration on the number of sexual partners and the number of cigarettes smoked after incarceration. In settings like this where the outco… ▽ More Causal inference methods can be applied to estimate the effect of a point exposure or treatment on an outcome of interest using data from observational studies. For example, in the Women's Interagency HIV Study, it is of interest to understand the effects of incarceration on the number of sexual partners and the number of cigarettes smoked after incarceration. In settings like this where the outcome is a count, the estimand is often the causal mean ratio, i.e., the ratio of the counterfactual mean count under exposure to the counterfactual mean count under no exposure. This paper considers estimators of the causal mean ratio based on inverse probability of treatment weights, the parametric g-formula, and doubly robust estimation, each of which can account for overdispersion, zero-inflation, and hea** in the measured outcome. Methods are compared in simulations and are applied to data from the Women's Interagency HIV Study. △ Less

Submitted 6 November, 2023; v1 submitted 3 February, 2022; originally announced February 2022.

Frontal Screens on Head-Mounted Displays to Increase Awareness of the HMD Users' State in Mixed Presence Collaboration

Authors: Christian Mai, Alexander Knittel, Heinrich Hußmann

Abstract: In the everyday context, e.g., a household, HMD users remain a part of the social life for Non-HMD users being co-located with them. Due to the social context situations arise that demand interaction between the HMD and the Non-HMD user. We focus on the challenge that the Non-HMD user is not able to interpret the HMD user's state -- e.g., attentiveness; the need for assistance --, as the HMD cover… ▽ More In the everyday context, e.g., a household, HMD users remain a part of the social life for Non-HMD users being co-located with them. Due to the social context situations arise that demand interaction between the HMD and the Non-HMD user. We focus on the challenge that the Non-HMD user is not able to interpret the HMD user's state -- e.g., attentiveness; the need for assistance --, as the HMD covers the wearer's face. We propose a front facing display attached to the HMD that supports collaboration by showing the state. We explore the impact of abstract and realistic visualizations for such displays on collaborative performance and social presence in a within-subject user study (N=25). We present to the Non-HMD user (1) a blank screen (baseline), (2) textual representation of the user's state and (3) a representation that looks like the HMD is see-through. The results show positive effects for textual representation on collaborative performance and a positive effect of realistic representation on social presence. We conclude that when develo** HMDs we need to take into account the social needs of everyday life to reduce the risk of social separation in a household context. △ Less

Submitted 15 May, 2019; originally announced May 2019.

Sparse, guided feature connections in an Abstract Deep Network

Authors: Anthony Knittel, Alan Blair

Abstract: We present a technique for develo** a network of re-used features, where the topology is formed using a coarse learning method, that allows gradient-descent fine tuning, known as an Abstract Deep Network (ADN). New features are built based on observed co-occurrences, and the network is maintained using a selection process related to evolutionary algorithms. This allows coarse ex- ploration of th… ▽ More We present a technique for develo** a network of re-used features, where the topology is formed using a coarse learning method, that allows gradient-descent fine tuning, known as an Abstract Deep Network (ADN). New features are built based on observed co-occurrences, and the network is maintained using a selection process related to evolutionary algorithms. This allows coarse ex- ploration of the problem space, effective for irregular domains, while gradient descent allows pre- cise solutions. Accuracy on standard UCI and Protein-Structure Prediction problems is comparable with benchmark SVM and optimized GBML approaches, and shows scalability for addressing large problems. The discrete implementation is symbolic, allowing interpretability, while the continuous method using fine-tuning shows improved accuracy. The binary multiplexer problem is explored, as an irregular domain that does not support gradient descent learning, showing solution to the bench- mark 135-bit problem. A convolutional implementation is demonstrated on image classification, showing an error-rate of 0.79% on the MNIST problem, without a pre-defined topology. The ADN system provides a method for develo** a very sparse, deep feature topology, based on observed relationships between features, that is able to find solutions in irregular domains, and initialize a network prior to gradient descent learning. △ Less

Submitted 16 December, 2014; originally announced December 2014.

Enhanced spin transfer torque effect for transverse domain walls in cylindrical nanowires

Authors: Matteo Franchin, Andreas Knittel, Maximilian Albert, Dmitri Chernyshenko, Thomas Fischbacher, Anil Prabhakar, Hans Fangohr

Abstract: Recent studies have predicted extraordinary properties for transverse domain walls in cylindrical nanowires: zero depinning current, the absence of the Walker breakdown, and applications as domain wall oscillators. In order to reliably control the domain wall motion, it is important to understand how they interact with energy barriers. In this paper, we study the motion and depinning of transver… ▽ More Recent studies have predicted extraordinary properties for transverse domain walls in cylindrical nanowires: zero depinning current, the absence of the Walker breakdown, and applications as domain wall oscillators. In order to reliably control the domain wall motion, it is important to understand how they interact with energy barriers. In this paper, we study the motion and depinning of transverse domain walls through potential barriers in ferromagnetic cylindrical nanowires. We use magnetic fields and spin-polarized currents to drive the domain walls along the wire. Using magnetic fields, we find that the minimum and the maximum fields required to push the domain wall through the barrier differ by 30 %. On the contrary, using spin-polarized currents, we find variations of a factor 130 between the minimum value of the depinning current density and the maximum value. We study the depinning current density as a function of the height of the energy barrier using numerical and analytical methods. We find that, for a barrier of 40 k_B T, a depinning current density of about 5 uA is sufficient to depin the domain wall. We reveal and explain the mechanism that leads to these unusually low depinning currents. One requirement for this new depinning mechanism is for the domain wall to be able to rotate around its own axis. With the right barrier design, the spin torque transfer term is acting exactly against the dam** in the micromagnetic system, and thus the low current density is sufficient to accumulate enough energy quickly. These key insights may be crucial in furthering the development of novel memory technologies, such as the racetrack memory, that can be controlled through low current densities. △ Less

Submitted 15 April, 2011; originally announced April 2011.

Comments: 9 pages, 10 figures