-
Pixel State Value Network for Combined Prediction and Planning in Interactive Environments
Authors:
Sascha Rosbach,
Stefan M. Leupold,
Simon Großjohann,
Stefan Roth
Abstract:
Automated vehicles operating in urban environments have to reliably interact with other traffic participants. Planning algorithms often utilize separate prediction modules forecasting probabilistic, multi-modal, and interactive behaviors of objects. Designing prediction and planning as two separate modules introduces significant challenges, particularly due to the interdependence of these modules.…
▽ More
Automated vehicles operating in urban environments have to reliably interact with other traffic participants. Planning algorithms often utilize separate prediction modules forecasting probabilistic, multi-modal, and interactive behaviors of objects. Designing prediction and planning as two separate modules introduces significant challenges, particularly due to the interdependence of these modules. This work proposes a deep learning methodology to combine prediction and planning. A conditional GAN with the U-Net architecture is trained to predict two high-resolution image sequences. The sequences represent explicit motion predictions, mainly used to train context understanding, and pixel state values suitable for planning encoding kinematic reachability, object dynamics, safety, and driving comfort. The model can be trained offline on target images rendered by a sampling-based model-predictive planner, leveraging real-world driving data. Our results demonstrate intuitive behavior in complex situations, such as lane changes amidst conflicting objectives.
△ Less
Submitted 11 October, 2023;
originally announced October 2023.
-
Planning on the fast lane: Learning to interact using attention mechanisms in path integral inverse reinforcement learning
Authors:
Sascha Rosbach,
Xing Li,
Simon Großjohann,
Silviu Homoceanu,
Stefan Roth
Abstract:
General-purpose trajectory planning algorithms for automated driving utilize complex reward functions to perform a combined optimization of strategic, behavioral, and kinematic features. The specification and tuning of a single reward function is a tedious task and does not generalize over a large set of traffic situations. Deep learning approaches based on path integral inverse reinforcement lear…
▽ More
General-purpose trajectory planning algorithms for automated driving utilize complex reward functions to perform a combined optimization of strategic, behavioral, and kinematic features. The specification and tuning of a single reward function is a tedious task and does not generalize over a large set of traffic situations. Deep learning approaches based on path integral inverse reinforcement learning have been successfully applied to predict local situation-dependent reward functions using features of a set of sampled driving policies. Sample-based trajectory planning algorithms are able to approximate a spatio-temporal subspace of feasible driving policies that can be used to encode the context of a situation. However, the interaction with dynamic objects requires an extended planning horizon, which depends on sequential context modeling. In this work, we are concerned with the sequential reward prediction over an extended time horizon. We present a neural network architecture that uses a policy attention mechanism to generate a low-dimensional context vector by concentrating on trajectories with a human-like driving style. Apart from this, we propose a temporal attention mechanism to identify context switches and allow for stable adaptation of rewards. We evaluate our results on complex simulated driving situations, including other moving vehicles. Our evaluation shows that our policy attention mechanism learns to focus on collision-free policies in the configuration space. Furthermore, the temporal attention mechanism learns persistent interaction with other vehicles over an extended planning horizon.
△ Less
Submitted 12 September, 2020; v1 submitted 11 July, 2020;
originally announced July 2020.
-
Driving Style Encoder: Situational Reward Adaptation for General-Purpose Planning in Automated Driving
Authors:
Sascha Rosbach,
Vinit James,
Simon Großjohann,
Silviu Homoceanu,
Xing Li,
Stefan Roth
Abstract:
General-purpose planning algorithms for automated driving combine mission, behavior, and local motion planning. Such planning algorithms map features of the environment and driving kinematics into complex reward functions. To achieve this, planning experts often rely on linear reward functions. The specification and tuning of these reward functions is a tedious process and requires significant exp…
▽ More
General-purpose planning algorithms for automated driving combine mission, behavior, and local motion planning. Such planning algorithms map features of the environment and driving kinematics into complex reward functions. To achieve this, planning experts often rely on linear reward functions. The specification and tuning of these reward functions is a tedious process and requires significant experience. Moreover, a manually designed linear reward function does not generalize across different driving situations. In this work, we propose a deep learning approach based on inverse reinforcement learning that generates situation-dependent reward functions. Our neural network provides a map** between features and actions of sampled driving policies of a model-predictive control-based planner and predicts reward functions for upcoming planning cycles. In our evaluation, we compare the driving style of reward functions predicted by our deep network against clustered and linear reward functions. Our proposed deep learning approach outperforms clustered linear reward functions and is at par with linear reward functions with a-priori knowledge about the situation.
△ Less
Submitted 13 September, 2020; v1 submitted 7 December, 2019;
originally announced December 2019.
-
Driving with Style: Inverse Reinforcement Learning in General-Purpose Planning for Automated Driving
Authors:
Sascha Rosbach,
Vinit James,
Simon Großjohann,
Silviu Homoceanu,
Stefan Roth
Abstract:
Behavior and motion planning play an important role in automated driving. Traditionally, behavior planners instruct local motion planners with predefined behaviors. Due to the high scene complexity in urban environments, unpredictable situations may occur in which behavior planners fail to match predefined behavior templates. Recently, general-purpose planners have been introduced, combining behav…
▽ More
Behavior and motion planning play an important role in automated driving. Traditionally, behavior planners instruct local motion planners with predefined behaviors. Due to the high scene complexity in urban environments, unpredictable situations may occur in which behavior planners fail to match predefined behavior templates. Recently, general-purpose planners have been introduced, combining behavior and local motion planning. These general-purpose planners allow behavior-aware motion planning given a single reward function. However, two challenges arise: First, this function has to map a complex feature space into rewards. Second, the reward function has to be manually tuned by an expert. Manually tuning this reward function becomes a tedious task. In this paper, we propose an approach that relies on human driving demonstrations to automatically tune reward functions. This study offers important insights into the driving style optimization of general-purpose planners with maximum entropy inverse reinforcement learning. We evaluate our approach based on the expected value difference between learned and demonstrated policies. Furthermore, we compare the similarity of human driven trajectories with optimal policies of our planner under learned and expert-tuned reward functions. Our experiments show that we are able to learn reward functions exceeding the level of manual expert tuning without prior domain knowledge.
△ Less
Submitted 12 September, 2020; v1 submitted 1 May, 2019;
originally announced May 2019.
-
Low frequency spin dynamics in the quantum magnet copper pyrazine dinitrate
Authors:
H. Kuehne,
M. Guenther,
S. Grossjohann,
W. Brenig,
F. J. Litterst,
A. P. Reyes,
P. L. Kuhns,
M. M. Turnbull,
C. P. Landee,
H. -H. Klauss
Abstract:
The S=1/2 antiferromagnetic Heisenberg chain exhibits a magnetic field driven quantum critical point. We study the low frequency spin dynamics in copper pyrazine dinitrate (CuPzN), a realization of this model system of quantum magnetism, by means of $^{13}$C-NMR spectroscopy. Measurements of the nuclear spin-lattice relaxation rate $T_1^{-1}$ in the vicinity of the saturation field are compared wi…
▽ More
The S=1/2 antiferromagnetic Heisenberg chain exhibits a magnetic field driven quantum critical point. We study the low frequency spin dynamics in copper pyrazine dinitrate (CuPzN), a realization of this model system of quantum magnetism, by means of $^{13}$C-NMR spectroscopy. Measurements of the nuclear spin-lattice relaxation rate $T_1^{-1}$ in the vicinity of the saturation field are compared with quantum Monte Carlo calculations of the dynamic structure factor. Both show a strong divergence of low energy excitations at temperatures in the quantum regime. The analysis of the anisotropic $T_1^{-1}$-rates and frequency shifts allows one to disentangle the contributions from transverse and longitudinal spin fluctuations for a selective study and to determine the transfer of delocalized spin moments from copper to the neighboring nitrogen atoms.
△ Less
Submitted 23 March, 2010;
originally announced March 2010.
-
Hydrodynamic Limit for the Spin Dynamics of the Heisenberg Chain
Authors:
Simon Grossjohann,
Wolfram Brenig
Abstract:
We show that Quantum-Monte-Carlo calculations of the dynamic structure factor of the isotropic spin-1/2 antiferromagnetic chain at intermediate temperatures corroborate a picture of diffusive spin dynamics at finite frequencies in the low-energy long wave-length limit and are in good agreement with recent predictions for this by J. Sirker, R. G. Pereira, and I. Affleck [arXiv:0906.1978v1].
We show that Quantum-Monte-Carlo calculations of the dynamic structure factor of the isotropic spin-1/2 antiferromagnetic chain at intermediate temperatures corroborate a picture of diffusive spin dynamics at finite frequencies in the low-energy long wave-length limit and are in good agreement with recent predictions for this by J. Sirker, R. G. Pereira, and I. Affleck [arXiv:0906.1978v1].
△ Less
Submitted 10 September, 2009;
originally announced September 2009.
-
Spin-Dynamics of the antiferromagnetic S=1/2-Chain at finite magnetic Fields and intermediate Temperatures
Authors:
S. Grossjohann,
W. Brenig
Abstract:
We present a study of the dynamic structure factor of the antiferromagnetic spin-1/2 Heisenberg chain at finite temperatures and finite magnetic fields. Using Quantum-Monte-Carlo based on the stochastic series expansion and Maximum-Entropy methods we evaluate the longitudinal and the transverse dynamic structure factor from vanishing magnetic fields up to and above the threshold $B_c$ for ferrom…
▽ More
We present a study of the dynamic structure factor of the antiferromagnetic spin-1/2 Heisenberg chain at finite temperatures and finite magnetic fields. Using Quantum-Monte-Carlo based on the stochastic series expansion and Maximum-Entropy methods we evaluate the longitudinal and the transverse dynamic structure factor from vanishing magnetic fields up to and above the threshold $B_c$ for ferromagnetic saturation, as well as for high and for intermediate temperatures. We study the field-induced redistribution of spectral weight contrasting longitudinal versus transverse excitations. At finite fields below saturation incommensurate low-energy modes are found consistent with zero temperature Bethe-Ansatz. The crossover between the field induced ferromagnet above $B_c$ and the Luttinger liquid below $B_c$ is analyzed in terms of the transverse spin-dynamics. Evaluating sum-rules we assess the quality of the analytic continuation and demonstrate excellent consistency of the Maximum-Entropy results.
△ Less
Submitted 13 November, 2008; v1 submitted 12 November, 2008;
originally announced November 2008.
-
Quantum critical dynamics of a S = 1/2 antiferromagnetic Heisenberg chain studied by 13C-NMR spectroscopy
Authors:
H. Kuehne,
H. -H. Klauss,
S. Grossjohann,
W. Brenig,
F. J. Litterst,
A. P. Reyes,
P. L. Kuhns,
M. M. Turnbull,
C. P. Landee
Abstract:
We present a 13C-NMR study of the magnetic field driven transition to complete polarization of the S=1/2 antiferromagnetic Heisenberg chain system copper pyrazine dinitrate Cu(C_4H_4N_2)(NO_3)_2 (CuPzN). The static local magnetization as well as the low-frequency spin dynamics, probed via the nuclear spin-lattice relaxation rate 1/T_1, were explored from the low to the high field limit and at te…
▽ More
We present a 13C-NMR study of the magnetic field driven transition to complete polarization of the S=1/2 antiferromagnetic Heisenberg chain system copper pyrazine dinitrate Cu(C_4H_4N_2)(NO_3)_2 (CuPzN). The static local magnetization as well as the low-frequency spin dynamics, probed via the nuclear spin-lattice relaxation rate 1/T_1, were explored from the low to the high field limit and at temperatures from the quantum regime (k_B T << J) up to the classical regime (k_B T >> J). The experimental data show very good agreement with quantum Monte Carlo calculations over the complete range of parameters investigated. Close to the critical field, as derived from static experiments, a pronounced maximum in 1/T_1 is found which we interpret as the finite-temperature manifestation of a diverging density of zero-energy magnetic excitations at the field-driven quantum critical point.
△ Less
Submitted 13 August, 2009; v1 submitted 14 April, 2008;
originally announced April 2008.
-
Antiferromagnetic Dimers of Ni(II) in the S=1 Spin-Ladder Na_2Ni_2(C_2O_4)_3(H_2O)_2
Authors:
C. Mennerich,
H. -H. Klauss,
M. Broekelmann,
F. J. Litterst,
C. Golze,
R. Klingeler,
V. Kataev,
B. B"uchner,
S. -N. Grossjohann,
W. Brenig,
M. Goiran,
H. Rakoto,
J. -M. Broto,
O. Kataeva,
D. J. Price
Abstract:
We report the synthesis, crystal structure and magnetic properties of the S=1 2-leg spin-ladder compound Na_2Ni_2(C_2O_4)_3(H_2O)_2. The magnetic properties were examined by magnetic susceptibility and pulsed high field magnetization measurements. The magnetic excitations have been measured in high field high frequency ESR. Although the Ni(II) ions form structurally a 2-leg ladder, an isolated d…
▽ More
We report the synthesis, crystal structure and magnetic properties of the S=1 2-leg spin-ladder compound Na_2Ni_2(C_2O_4)_3(H_2O)_2. The magnetic properties were examined by magnetic susceptibility and pulsed high field magnetization measurements. The magnetic excitations have been measured in high field high frequency ESR. Although the Ni(II) ions form structurally a 2-leg ladder, an isolated dimer model consistently describes the observations very well. The analysis of the temperature dependent magnetization data leads to a magnetic exchange constant of J=43 K along the rungs of the ladder and an average value of the g-factor of 2.25. From the ESR measurements, we determined the single ion anisotropy to D=11.5 K. The validity of the isolated dimer model is supported by Quantum Monte Carlo calculations, performed for several ratios of interdimer and intradimer magnetic exchange and taking into account the experimentally determined single ion anisotropy. The results can be understood in terms of the different coordination and superexchange angles of the oxalate ligands along the rungs and legs of the 2-leg spin ladder.
△ Less
Submitted 13 January, 2006;
originally announced January 2006.