-
Dynamically Iterated Filters: A unified framework for improved iterated filtering and smoothing
Authors:
Anton Kullberg,
Martin A. Skoglund,
Isaac Skog,
Gustaf Hendeby
Abstract:
Typical iterated filters, such as the iterated extended Kalman filter (IEKF), iterated unscented Kalman filter (IUKF), and iterated posterior linearization filter (IPLF), have been developed to improve the linearization point (or density) of the likelihood linearization in the well-known extended Kalman filter (EKF) and unscented Kalman filter (UKF). A shortcoming of typical iterated filters is th…
▽ More
Typical iterated filters, such as the iterated extended Kalman filter (IEKF), iterated unscented Kalman filter (IUKF), and iterated posterior linearization filter (IPLF), have been developed to improve the linearization point (or density) of the likelihood linearization in the well-known extended Kalman filter (EKF) and unscented Kalman filter (UKF). A shortcoming of typical iterated filters is that they do not treat the linearization of the transition model of the system. To remedy this shortcoming, we introduce dynamically iterated filters (DIFs), a unified framework for iterated linearization-based nonlinear filters that deals with nonlinearities in both the transition model and the likelihood, thereby constituting a generalization of the aforementioned iterated filters. We further establish a relationship between the general DIF and the approximate iterated Rauch-Tung-Striebel smoother. This relationship allows for a Gauss-Newton interpretation, which in turn enables explicit step-size correction, leading to damped versions of the DIFs. The developed algorithms, both damped and non-damped, are numerically demonstrated in three examples, showing superior mean-squared error as well as improved parameter tuning robustness as compared to the analogous standard iterated filters.
△ Less
Submitted 17 April, 2024;
originally announced April 2024.
-
Extended target tracking utilizing machine-learning software -- with applications to animal classification
Authors:
Magnus Malmström,
Anton Kullberg,
Isaac Skog,
Daniel Axehill,
Fredrik Gustafsson
Abstract:
This paper considers the problem of detecting and tracking objects in a sequence of images. The problem is formulated in a filtering framework, using the output of object-detection algorithms as measurements. An extension to the filtering formulation is proposed that incorporates class information from the previous frame to robustify the classification, even if the object-detection algorithm outpu…
▽ More
This paper considers the problem of detecting and tracking objects in a sequence of images. The problem is formulated in a filtering framework, using the output of object-detection algorithms as measurements. An extension to the filtering formulation is proposed that incorporates class information from the previous frame to robustify the classification, even if the object-detection algorithm outputs an incorrect prediction. Further, the properties of the object-detection algorithm are exploited to quantify the uncertainty of the bounding box detection in each frame. The complete filtering method is evaluated on camera trap images of the four large Swedish carnivores, bear, lynx, wolf, and wolverine. The experiments show that the class tracking formulation leads to a more robust classification.
△ Less
Submitted 12 October, 2023;
originally announced October 2023.
-
On the Relationship Between Iterated Statistical Linearization and Quasi-Newton Methods
Authors:
Anton Kullberg,
Martin A. Skoglund,
Isaac Skog,
Gustaf Hendeby
Abstract:
This letter investigates relationships between iterated filtering algorithms based on statistical linearization, such as the iterated unscented Kalman filter (IUKF), and filtering algorithms based on quasi-Newton (QN) methods, such as the QN iterated extended Kalman filter (QN-IEKF). Firstly, it is shown that the IUKF and the iterated posterior linearization filter (IPLF) can be viewed as QN algor…
▽ More
This letter investigates relationships between iterated filtering algorithms based on statistical linearization, such as the iterated unscented Kalman filter (IUKF), and filtering algorithms based on quasi-Newton (QN) methods, such as the QN iterated extended Kalman filter (QN-IEKF). Firstly, it is shown that the IUKF and the iterated posterior linearization filter (IPLF) can be viewed as QN algorithms, by finding a Hessian correction in the QN-IEKF such that the IPLF iterate updates are identical to that of the QN-IEKF. Secondly, it is shown that the IPLF/IUKF update can be rewritten such that it is approximately identical to the QN-IEKF, albeit for an additional correction term. This enables a richer understanding of the properties of iterated filtering algorithms based on statistical linearization.
△ Less
Submitted 20 November, 2023; v1 submitted 14 September, 2023;
originally announced September 2023.
-
Unified Linearization-based Nonlinear Filtering
Authors:
Anton Kullberg,
Isaac Skog,
Gustaf Hendeby
Abstract:
This letter shows that the following three classes of recursive state estimation filters: standard filters, such as the extended Kalman filter; iterated filters, such as the iterated unscented Kalman filter; and dynamically iterated filters, such as the dynamically iterated posterior linearization filters; can be unified in terms of a general algorithm. The general algorithm highlights the strong…
▽ More
This letter shows that the following three classes of recursive state estimation filters: standard filters, such as the extended Kalman filter; iterated filters, such as the iterated unscented Kalman filter; and dynamically iterated filters, such as the dynamically iterated posterior linearization filters; can be unified in terms of a general algorithm. The general algorithm highlights the strong similarities between specific filtering algorithms in the three filter classes and facilitates an in-depth understanding of the pros and cons of the different filter classes and algorithms. We end with a numerical example showing the estimation accuracy differences between the three classes of filters when applied to a nonlinear localization problem.
△ Less
Submitted 14 September, 2023;
originally announced September 2023.
-
Fast or Cheap: Time and Energy Optimal Control of Ship-to-Shore Cranes
Authors:
Filipe Marques Barbosa,
Anton Kullberg,
Johan Löfberg
Abstract:
This paper addresses the trade-off between time- and energy-efficiency for the problem of loading and unloading a ship. Container height constraints and energy consumption and regeneration are dealt with. We build upon a previous work that introduced a coordinate system suitable to deal with container avoidance constraints and incorporate the energy related modeling. In addition to changing the co…
▽ More
This paper addresses the trade-off between time- and energy-efficiency for the problem of loading and unloading a ship. Container height constraints and energy consumption and regeneration are dealt with. We build upon a previous work that introduced a coordinate system suitable to deal with container avoidance constraints and incorporate the energy related modeling. In addition to changing the coordinate system, standard epigraph reformulations result in an optimal control problem with improved numerical properties. The trade-off is dealt with through the use of weighting of the total time and energy consumption in the cost function. An illustrative example is provided, demonstrating that the energy consumption can be substantially reduced while retaining approximately the same loading time.
△ Less
Submitted 18 April, 2023;
originally announced April 2023.
-
Iterated Filters for Nonlinear Transition Models
Authors:
Anton Kullberg,
Isaac Skog,
Gustaf Hendeby
Abstract:
A new class of iterated linearization-based nonlinear filters, dubbed dynamically iterated filters, is presented. Contrary to regular iterated filters such as the iterated extended Kalman filter (IEKF), iterated unscented Kalman filter (IUKF) and iterated posterior linearization filter (IPLF), dynamically iterated filters also take nonlinearities in the transition model into account. The general f…
▽ More
A new class of iterated linearization-based nonlinear filters, dubbed dynamically iterated filters, is presented. Contrary to regular iterated filters such as the iterated extended Kalman filter (IEKF), iterated unscented Kalman filter (IUKF) and iterated posterior linearization filter (IPLF), dynamically iterated filters also take nonlinearities in the transition model into account. The general filtering algorithm is shown to essentially be a (locally over one time step) iterated Rauch-Tung-Striebel smoother. Three distinct versions of the dynamically iterated filters are especially investigated: analogues to the IEKF, IUKF and IPLF. The developed algorithms are evaluated on 25 different noise configurations of a tracking problem with a nonlinear transition model and linear measurement model, a scenario where conventional iterated filters are not useful. Even in this "simple" scenario, the dynamically iterated filters are shown to have superior root mean-squared error performance as compared with their respective baselines, the EKF and UKF. Particularly, even though the EKF diverges in 22 out of 25 configurations, the dynamically iterated EKF remains stable in 20 out of 25 scenarios, only diverging under high noise.
△ Less
Submitted 14 September, 2023; v1 submitted 27 February, 2023;
originally announced February 2023.
-
Online Joint State Inference and Learning of Partially Unknown State-Space Models
Authors:
Anton Kullberg,
Isaac Skog,
Gustaf Hendeby
Abstract:
A computationally efficient method for online joint state inference and dynamical model learning is presented. The dynamical model combines an a priori known, physically derived, state-space model with a radial basis function expansion representing unknown system dynamics and inherits properties from both physical and data-driven modeling. The method uses an extended Kalman filter approach to join…
▽ More
A computationally efficient method for online joint state inference and dynamical model learning is presented. The dynamical model combines an a priori known, physically derived, state-space model with a radial basis function expansion representing unknown system dynamics and inherits properties from both physical and data-driven modeling. The method uses an extended Kalman filter approach to jointly estimate the state of the system and learn the unknown system dynamics, via the parameters of the basis function expansion. The key contribution is a computational complexity reduction compared to a similar approach with globally supported basis functions. By using compactly supported radial basis functions and an approximate Kalman gain, the computational complexity is considerably reduced and is essentially determined by the support of the basis functions. The approximation works well when the system dynamics exhibit limited correlation between points well separated in the state-space domain. The method is exemplified via two intelligent vehicle applications where it is shown to: (i) have competitive system dynamics estimation performance compared to the globally supported basis function method, and (ii) be real-time applicable to problems with a large-scale state-space.
△ Less
Submitted 9 July, 2021; v1 submitted 15 February, 2021;
originally announced February 2021.
-
Learning Driver Behaviors Using A Gaussian Process Augmented State-Space Model
Authors:
Anton Kullberg,
Isaac Skog,
Gustaf Hendeby
Abstract:
An inference method for Gaussian process augmented state-space models are presented. This class of grey-box models enables domain knowledge to be incorporated in the inference process to guarantee a minimum of performance, still they are flexible enough to permit learning of partially unknown model dynamics and inputs. To facilitate online (recursive) inference of the model a sparse approximation…
▽ More
An inference method for Gaussian process augmented state-space models are presented. This class of grey-box models enables domain knowledge to be incorporated in the inference process to guarantee a minimum of performance, still they are flexible enough to permit learning of partially unknown model dynamics and inputs. To facilitate online (recursive) inference of the model a sparse approximation of the Gaussian process based upon inducing points is presented. To illustrate the application of the model and the inference method, an example where it is used to track the position and learn the behavior of a set of cars passing through an intersection, is presented. Compared to the case when only the state-space model is used, the use of the augmented state-space model gives both a reduced estimation error and bias.
△ Less
Submitted 16 March, 2020;
originally announced March 2020.
-
Levy ratchets in the spatially tempered fractional Fokker-Planck equation
Authors:
A. Kullberg,
D. del-Castillo-Negrete
Abstract:
Lévy ratchets are minimal models of fluctuation-driven transport in the presence of Lévy noise and periodic external potentials with broken spatial symmetry. In these systems, a net ratchet current can appear even in the absence of time dependent perturbations, external tilting forces, or a bias in the noise. The majority of studies on the interaction of Lévy noise with external potentials have as…
▽ More
Lévy ratchets are minimal models of fluctuation-driven transport in the presence of Lévy noise and periodic external potentials with broken spatial symmetry. In these systems, a net ratchet current can appear even in the absence of time dependent perturbations, external tilting forces, or a bias in the noise. The majority of studies on the interaction of Lévy noise with external potentials have assumed $α$-stable Lévy statistics in the Langevin description, which in the continuum limit corresponds to the fractional Fokker-Planck equation. However, the divergence of the low order moments is a potential drawback of $α$-stable distributions because, in applications, the moments represent physical quantities. For example, for $α<1$, the current $J$, in $α$-stable Lévy ratchets is unbounded. To overcome this limitation, we study ratchet transport using truncated Lévy distributions which in the continuum limit correspond to the spatially tempered fractional Fokker-Planck equation. The main object of study is the dependence of the ratchet current on the level of tempering, $λ$. For $λ\neq 0$, the statistics ultimately converges (although very slowly) to Gaussian diffusion in the absence of a potential. However, it is shown here that in the presence of a ratchet potential a finite current persists asymptotically for any finite value of $λ$. The current converges exponentially in time to the steady state value. The steady state current exhibits algebraically decay, $J\sim λ^{-ζ}$, for $α\geq 1.75$. However, for $α\leq 1.5$, the decay is exponential, $J \sim e^{-ξλ}$. In the presence of a bias in the Lévy noise, it is shown that the tempering can lead to a current reversal. A detailed numerical study is presented on the dependence of the current on $λ$ and the physical parameters of the system.
△ Less
Submitted 10 September, 2010;
originally announced September 2010.