-
RoboCup 2023 Humanoid AdultSize Winner NimbRo: NimbRoNet3 Visual Perception and Responsive Gait with Waveform In-walk Kicks
Authors:
Dmytro Pavlichenko,
Grzegorz Ficht,
Angel Villar-Corrales,
Luis Denninger,
Julia Brocker,
Tim Sinen,
Michael Schreiber,
Sven Behnke
Abstract:
The RoboCup Humanoid League holds annual soccer robot world championships towards the long-term objective of winning against the FIFA world champions by 2050. The participating teams continuously improve their systems. This paper presents the upgrades to our humanoid soccer system, leading our team NimbRo to win the Soccer Tournament in the Humanoid AdultSize League at RoboCup 2023 in Bordeaux, Fr…
▽ More
The RoboCup Humanoid League holds annual soccer robot world championships towards the long-term objective of winning against the FIFA world champions by 2050. The participating teams continuously improve their systems. This paper presents the upgrades to our humanoid soccer system, leading our team NimbRo to win the Soccer Tournament in the Humanoid AdultSize League at RoboCup 2023 in Bordeaux, France. The mentioned upgrades consist of: an updated model architecture for visual perception, extended fused angles feedback mechanisms and an additional COM-ZMP controller for walking robustness, and parametric in-walk kicks through waveforms.
△ Less
Submitted 11 January, 2024;
originally announced January 2024.
-
The evolution of a non-autonomous chaotic system under non-periodic forcing: a climate change example
Authors:
Francisco de Melo Viríssimo,
David A. Stainforth,
Jochen Bröcker
Abstract:
Complex Earth System Models are widely utilised to make conditional statements about the future climate under some assumptions about changes in future atmospheric greenhouse gas concentrations; these statements are often referred to as climate projections. The models themselves are high-dimensional nonlinear systems and it is common to discuss their behaviour in terms of attractors and low-dimensi…
▽ More
Complex Earth System Models are widely utilised to make conditional statements about the future climate under some assumptions about changes in future atmospheric greenhouse gas concentrations; these statements are often referred to as climate projections. The models themselves are high-dimensional nonlinear systems and it is common to discuss their behaviour in terms of attractors and low-dimensional nonlinear systems such as the canonical Lorenz `63 system. In a non-autonomous situation, for instance due to anthropogenic climate change, the relevant object is sometimes considered to be the pullback or snapshot attractor. The pullback attractor, however, is a collection of {\em all} plausible states of the system at a given time and therefore does not take into consideration our knowledge of the current state of the Earth System when making climate projections, and are therefore not very informative regarding annual to multi-decadal climate projections. In this article, we approach the problem of measuring and interpreting the mid-term climate of a model by using a low-dimensional, climate-like, nonlinear system with three timescales of variability, and non-periodic forcing. We introduce the concept of an {\em evolution set} which is dependent on the starting state of the system, and explore its links to different types of initial condition uncertainty and the rate of external forcing. We define the {\em convergence time} as the time that it takes for the distribution of one of the dependent variables to lose memory of its initial conditions. We suspect a connection between convergence times and the classical concept of mixing times but the precise nature of this connection needs to be explored. These results have implications for the design of influential climate and Earth System Model ensembles, and raise a number of issues of mathematical interest.
△ Less
Submitted 21 September, 2023;
originally announced October 2023.
-
Linear and fractional response for nonlinear dissipative SPDEs
Authors:
Giulia Carigi,
Tobias Kuna,
Jochen Bröcker
Abstract:
A framework to establish response theory for a class of nonlinear stochastic partial differential equations (SPDEs) is provided. More specifically, it is shown that for a certain class of observables, the averages of those observables against the stationary measure of the SPDE are differentiable (linear response) or, under weaker conditions, locally Hölder continuous (fractional response) as funct…
▽ More
A framework to establish response theory for a class of nonlinear stochastic partial differential equations (SPDEs) is provided. More specifically, it is shown that for a certain class of observables, the averages of those observables against the stationary measure of the SPDE are differentiable (linear response) or, under weaker conditions, locally Hölder continuous (fractional response) as functions of a deterministic additive forcing. The method allows to consider observables that are not necessarily differentiable. For such observables, spectral gap results for the Markov semigroup associated with the SPDE have recently been established that are fairly accessible. This is important here as spectral gaps are a major ingredient for establishing linear response. The results are applied to the 2D stochastic Navier-Stokes equation and the stochastic two-layer quasi-geostrophic model, an intermediate complexity model popular in the geosciences to study atmosphere and ocean dynamics. The physical motivation for studying the response to perturbations in the forcings for models in geophysical fluid dynamics comes from climate change and relate to the question as to whether statistical properties of the dynamics derived under current conditions will be valid under different forcing scenarios.
△ Less
Submitted 21 October, 2022;
originally announced October 2022.
-
Exponential ergodicity for a stochastic two-layer quasi-geostrophic model
Authors:
Giulia Carigi,
Jochen Bröcker,
Tobias Kuna
Abstract:
Ergodic properties of a stochastic medium complexity model for atmosphere and ocean dynamics are analysed. More specifically, a two-layer quasi-geostrophic model for geophysical flows is studied, with the upper layer being perturbed by additive noise. This model is popular in the geosciences, for instance to study the effects of a stochastic wind forcing on the ocean. A rigorous mathematical analy…
▽ More
Ergodic properties of a stochastic medium complexity model for atmosphere and ocean dynamics are analysed. More specifically, a two-layer quasi-geostrophic model for geophysical flows is studied, with the upper layer being perturbed by additive noise. This model is popular in the geosciences, for instance to study the effects of a stochastic wind forcing on the ocean. A rigorous mathematical analysis however meets with the challenge that in the model under study, the noise configuration is spatially degenerate as the stochastic forcing acts only on the top layer. Exponential convergence of solutions laws to the invariant measure is established, implying a spectral gap of the associated Markov semigroup on a space of Hölder continuous functions. The approach provides a general framework for generalised coupling techniques suitable for applications to dissipative SPDEs. In case of the two-layer quasi-geostrophic model, the results require the second layer to obey a certain passivity condition.
△ Less
Submitted 24 January, 2022;
originally announced January 2022.
-
Exponential stability and asymptotic properties of the optimal filter for signals with deterministic hyperbolic dynamics
Authors:
Lea Oljača,
Tobias Kuna,
Jochen Bröcker
Abstract:
The problem of stability of the optimal filter is revisited. The optimal filter (or filtering process) is the conditional probability of the current state of some stochastic process (the signal process), given both present and past values of another process (the observation process). Typically the filtering process satisfies a dynamical equation, and the question investigated here concerns the sta…
▽ More
The problem of stability of the optimal filter is revisited. The optimal filter (or filtering process) is the conditional probability of the current state of some stochastic process (the signal process), given both present and past values of another process (the observation process). Typically the filtering process satisfies a dynamical equation, and the question investigated here concerns the stability of this dynamics. In contrast to previous work, signal processes given by the iterations of a deterministic map** $f$ are considered, with only the initial condition being random. While the stability of the filter may emerge from strong randomness of the signal processes, different and more dynamical effects will be exploited in the present work. More specifically, we consider uniformly hyperbolic $f$ with strong instabilities providing the necessary mixing. This however requires that the filtering process is initialised with densities exhibiting already a certain level of smoothness. Furthermore, $f$ may also have stable directions along which the filtering process will eventually not have a density, a major technical difficulty. Further results show that the filtering process is asymptotically concentrated on the attractor and furthermore will have densities with respect to the invariant (SRB)~measure along instable manifolds of $f$.
△ Less
Submitted 1 March, 2021;
originally announced March 2021.
-
Uniform reliability tests for forecasting systems with small lead time
Authors:
Jochen Bröcker
Abstract:
A long noted difficulty when assessing the reliability (or calibration) of forecasting systems is that reliability, in general, is a hypothesis not about a finite dimensional parameter but about an entire functional relationship. A calibrated probability forecast for binary events for instance should equal the conditional probability of the event given the forecast for {\em any} value of the forec…
▽ More
A long noted difficulty when assessing the reliability (or calibration) of forecasting systems is that reliability, in general, is a hypothesis not about a finite dimensional parameter but about an entire functional relationship. A calibrated probability forecast for binary events for instance should equal the conditional probability of the event given the forecast for {\em any} value of the forecast. Attempts to estimate deviations from calibration at a specific forecast value meet with the difficulty that the probability of the forecast assuming that value is typically zero. Considering the estimated {\em cumulative} deviations from reliability instead however, tests are presented for which the asymptotic distribution of the test statistic can be established rigorously. The distribution turns out to be universal, provided the forecasts "look one step ahead" only, or in other words, verify at the next time step in the future. Furthermore, the tests develop power against a wide class of alternatives. Numerical experiments for both artificial data as well as operational weather forecasting systems are also presented, as are possible extensions to forecasts with longer lead times.
△ Less
Submitted 8 December, 2020;
originally announced December 2020.
-
Existence and Uniqueness For Variational Data Assimilation in Continuous Time
Authors:
Jochen Bröcker
Abstract:
A variant of the optimal control problem is considered which is nonstandard in that the performance index contains "stochastic" integrals, that is, integrals against very irregular functions. The motivation for considering such performance indices comes from dynamical estimation problems where observed time series need to be "fitted" with trajectories of dynamical models. The observations may be c…
▽ More
A variant of the optimal control problem is considered which is nonstandard in that the performance index contains "stochastic" integrals, that is, integrals against very irregular functions. The motivation for considering such performance indices comes from dynamical estimation problems where observed time series need to be "fitted" with trajectories of dynamical models. The observations may be contaminated with white noise, which gives rise to the nonstandard performance indices. Problems of this kind appear in engineering, physics, and the geosciences where this is referred to as data assimilation. Pathwise existence of minimisers is obtained, along with a maximum principle as well as preliminary results in dynamic programming. The results extend previous results on the maximum aposteriori estimator of trajectories of diffusion processes. To obtain these results, classical concepts from optimal control need to be substantially modified due to the nonstandard nature of the performance index, as well the fact that typical models in the geosciences do not satisfy linear growth nor monotonicity conditions.
△ Less
Submitted 23 May, 2018;
originally announced May 2018.
-
Almost sure error bounds for data assimilation in dissipative systems with unbounded observation noise
Authors:
Lea Oljača,
Jochen Bröcker,
Tobias Kuna
Abstract:
Data assimilation is uniquely challenging in weather forecasting due to the high dimensionality of the employed models and the nonlinearity of the governing equations. Although current operational schemes are used successfully, our understanding of their long-term error behaviour is still incomplete. In this work, we study the error of some simple data assimilation schemes in the presence of unbou…
▽ More
Data assimilation is uniquely challenging in weather forecasting due to the high dimensionality of the employed models and the nonlinearity of the governing equations. Although current operational schemes are used successfully, our understanding of their long-term error behaviour is still incomplete. In this work, we study the error of some simple data assimilation schemes in the presence of unbounded (e.g. Gaussian) noise on a wide class of dissipative dynamical systems with certain properties, including the Lorenz models and the 2D incompressible Navier-Stokes equations. We exploit the properties of the dynamics to derive analytic bounds on the long-term error for individual realisations of the noise in time. These bounds are proportional to the amplitude of the noise. Furthermore, we find that the error exhibits a form of stationary behaviour, and in particular an accumulation of error does not occur. This improves on previous results in which either the noise was bounded or the error was considered in expectation only.
△ Less
Submitted 8 May, 2018;
originally announced May 2018.
-
What is the correct cost functional for variational data assimilation?
Authors:
Jochen Bröcker
Abstract:
Variational approaches to data assimilation, and weakly constrained four dimensional variation (WC-4DVar) in particular, are important in the geosciences but also in other communities (often under different names). The cost functions and the resulting optimal trajectories may have a probabilistic interpretation, for instance by linking data assimilation with Maximum Aposteriori (MAP) estimation. T…
▽ More
Variational approaches to data assimilation, and weakly constrained four dimensional variation (WC-4DVar) in particular, are important in the geosciences but also in other communities (often under different names). The cost functions and the resulting optimal trajectories may have a probabilistic interpretation, for instance by linking data assimilation with Maximum Aposteriori (MAP) estimation. This is possible in particular if the unknown trajectory is modelled as the solution of a stochastic differential equation (SDE), as is increasingly the case in weather forecasting and climate modelling. In this case, the MAP estimator (or "most probable path" of the SDE) is obtained by minimising the Onsager--Machlup functional. Although this fact is well known, there seems to be some confusion in the literature, with the energy (or "least squares") functional sometimes been claimed to yield the most probable path. The first aim of this paper is to address this confusion and show that the energy functional does not, in general, provide the most probable path. The second aim is to discuss the implications in practice. Although the mentioned results pertain to stochastic models in continuous time, they do have consequences in practice where SDE's are approximated by discrete time schemes. It turns out that using an approximation to the SDE and calculating its most probable path does not necessarily yield a good approximation to the most probable path of the SDE proper. This suggest that even in discrete time, a version of the Onsager--Machlup functional should be used, rather than the energy functional, at least if the solution is to be interpreted as a MAP estimator.
△ Less
Submitted 17 April, 2018;
originally announced April 2018.
-
Assessing the reliability of ensemble forecasting systems under serial dependence
Authors:
Jochen Bröcker
Abstract:
The problem of testing the reliability of ensemble forecasting systems is revisited. A popular tool to assess the reliability of ensemble forecasting systems (for scalar verifications) is the rank histogram, this histogram is expected to be more or less flat, since for a reliable ensemble, the ranks are uniformly distributed among their possible outcomes. Quantitative tests for flatness (e.g.\ Pea…
▽ More
The problem of testing the reliability of ensemble forecasting systems is revisited. A popular tool to assess the reliability of ensemble forecasting systems (for scalar verifications) is the rank histogram, this histogram is expected to be more or less flat, since for a reliable ensemble, the ranks are uniformly distributed among their possible outcomes. Quantitative tests for flatness (e.g.\ Pearson's goodness--of--fit test) have been suggested, without exception though, these tests assume the ranks to be a sequence of independent random variables, which is not the case in general as can be demonstrated with simple toy examples. In this paper, tests are developed that take the temporal correlations between the ranks into account. A refined analysis shows that exploiting the reliability property, the ranks still exhibit strong decay of correlations. This property is key to the analysis, and the proposed tests are valid for general ensemble forecasting systems with minimal extraneous assumptions.
△ Less
Submitted 16 April, 2018;
originally announced April 2018.
-
Skill of data based predictions versus dynamical models -- case study on extreme temperature anomalies
Authors:
Stefan Siegert,
Jochen Broecker,
Holger Kantz
Abstract:
We compare probabilistic predictions of extreme temperature anomalies issued by two different forecast schemes. One is a dynamical physical weather model, the other a simple data model. We recall the concept of skill scores in order to assess the performance of these two different predictors. Although the result confirms the expectation that the (computationally expensive) weather model outperform…
▽ More
We compare probabilistic predictions of extreme temperature anomalies issued by two different forecast schemes. One is a dynamical physical weather model, the other a simple data model. We recall the concept of skill scores in order to assess the performance of these two different predictors. Although the result confirms the expectation that the (computationally expensive) weather model outperforms the simple data model, the performance of the latter is surprisingly good. More specifically, for some parameter range, it is even better than the uncalibrated weather model. Since probabilistic predictions are not easily interpreted by the end user, we convert them into deterministic yes/no statements and measure the performance of these by ROC statistics. Scored in this way, conclusions about model performance partly change, which illustrates that predictive power depends on how it is quantified.
△ Less
Submitted 16 December, 2013;
originally announced December 2013.
-
Predicting Failures of Point Forecasts
Authors:
S. Hallerberg,
J. Bröcker,
H. Kantz,
L. A. Smith
Abstract:
The predictability of errors in deterministic temperature forecasts is investigated. More precisely, the aim is to issue warnings whenever the differences between forecast and verification exceed a given threshold. The warnings are generated by analyzing the output of an ensemble forecast system in terms of a decision making approach. The quality of the resulting predictions is evaluated by comput…
▽ More
The predictability of errors in deterministic temperature forecasts is investigated. More precisely, the aim is to issue warnings whenever the differences between forecast and verification exceed a given threshold. The warnings are generated by analyzing the output of an ensemble forecast system in terms of a decision making approach. The quality of the resulting predictions is evaluated by computing receiver operating characteristics, the Brier score, and the Ignorance score. Special emphasis is also given to the question whether rare events are better predictable.
△ Less
Submitted 7 December, 2011;
originally announced December 2011.
-
Sensitivity And Out-Of-Sample Error in Continuous Time Data Assimilation
Authors:
Jochen Bröcker,
Ivan G. Szendro
Abstract:
Data assimilation refers to the problem of finding trajectories of a prescribed dynamical model in such a way that the output of the model (usually some function of the model states) follows a given time series of observations. Typically though, these two requirements cannot both be met at the same time--tracking the observations is not possible without the trajectory deviating from the proposed m…
▽ More
Data assimilation refers to the problem of finding trajectories of a prescribed dynamical model in such a way that the output of the model (usually some function of the model states) follows a given time series of observations. Typically though, these two requirements cannot both be met at the same time--tracking the observations is not possible without the trajectory deviating from the proposed model equations, while adherence to the model requires deviations from the observations. Thus, data assimilation faces a trade-off. In this contribution, the sensitivity of the data assimilation with respect to perturbations in the observations is identified as the parameter which controls the trade-off. A relation between the sensitivity and the out-of-sample error is established which allows to calculate the latter under operational conditions. A minimum out-of-sample error is proposed as a criterion to set an appropriate sensitivity and to settle the discussed trade-off. Two approaches to data assimilation are considered, namely variational data assimilation and Newtonian nudging, aka synchronisation. Numerical examples demonstrate the feasibility of the approach.
△ Less
Submitted 29 August, 2011;
originally announced August 2011.
-
On Variational Data Assimilation in Continuous Time
Authors:
Jochen Bröcker
Abstract:
Variational data assimilation in continuous time is revisited. The central techniques applied in this paper are in part adopted from the theory of optimal nonlinear control. Alternatively, the investigated approach can be considered as a continuous time generalisation of what is known as weakly constrained four dimensional variational assimilation (WC--4DVAR) in the geosciences. The technique al…
▽ More
Variational data assimilation in continuous time is revisited. The central techniques applied in this paper are in part adopted from the theory of optimal nonlinear control. Alternatively, the investigated approach can be considered as a continuous time generalisation of what is known as weakly constrained four dimensional variational assimilation (WC--4DVAR) in the geosciences. The technique allows to assimilate trajectories in the case of partial observations and in the presence of model error. Several mathematical aspects of the approach are studied. Computationally, it amounts to solving a two point boundary value problem. For imperfect models, the trade off between small dynamical error (i.e. the trajectory obeys the model dynamics) and small observational error (i.e. the trajectory closely follows the observations) is investigated. For (nearly) perfect models, this trade off turns out to be (nearly) trivial in some sense, yet allowing for some dynamical error is shown to have positive effects even in this situation. The presented formalism is dynamical in character; no assumptions need to be made about the presence (or absence) of dynamical or observational noise, let alone about their statistics.
△ Less
Submitted 18 February, 2010;
originally announced February 2010.
-
A Lower Bound on Arbitrary $f$--Divergences in Terms of the Total Variation
Authors:
Jochen Bröcker
Abstract:
An important tool to quantify the likeness of two probability measures are f-divergences, which have seen widespread application in statistics and information theory. An example is the total variation, which plays an exceptional role among the f-divergences. It is shown that every f-divergence is bounded from below by a monotonous function of the total variation. Under appropriate regularity con…
▽ More
An important tool to quantify the likeness of two probability measures are f-divergences, which have seen widespread application in statistics and information theory. An example is the total variation, which plays an exceptional role among the f-divergences. It is shown that every f-divergence is bounded from below by a monotonous function of the total variation. Under appropriate regularity conditions, this function is shown to be monotonous.
Remark: The proof of the main proposition is relatively easy, whence it is highly likely that the result is known. The author would be very grateful for any information regarding references or related work.
△ Less
Submitted 10 March, 2009;
originally announced March 2009.
-
Generating Probabilities From Numerical Weather Forecasts by Logistic Regression
Authors:
Jochen Bröcker
Abstract:
Logistic models are studied as a tool to convert output from numerical weather forecasting systems (deterministic and ensemble) into probability forecasts for binary events. A logistic model obtains by putting the logarithmic odds ratio equal to a linear combination of the inputs. As any statistical model, logistic models will suffer from over-fitting if the number of inputs is comparable to the…
▽ More
Logistic models are studied as a tool to convert output from numerical weather forecasting systems (deterministic and ensemble) into probability forecasts for binary events. A logistic model obtains by putting the logarithmic odds ratio equal to a linear combination of the inputs. As any statistical model, logistic models will suffer from over-fitting if the number of inputs is comparable to the number of forecast instances. Computational approaches to avoid over-fitting by regularisation are discussed, and efficient approaches for model assessment and selection are presented. A logit version of the so called lasso, which is originally a linear tool, is discussed. In lasso models, less important inputs are identified and discarded, thereby providing an efficient and automatic model reduction procedure. For this reason, lasso models are particularly appealing for diagnostic purposes.
△ Less
Submitted 28 January, 2009;
originally announced January 2009.
-
Reliability, Sufficiency, and the Decomposition of Proper Scores
Authors:
Jochen Bröcker
Abstract:
Scoring rules are an important tool for evaluating the performance of probabilistic forecasting schemes. In the binary case, scoring rules (which are strictly proper) allow for a decomposition into terms related to the resolution and to the reliability of the forecast. This fact is particularly well known for the Brier Score. In this paper, this result is extended to forecasts for finite--valued…
▽ More
Scoring rules are an important tool for evaluating the performance of probabilistic forecasting schemes. In the binary case, scoring rules (which are strictly proper) allow for a decomposition into terms related to the resolution and to the reliability of the forecast. This fact is particularly well known for the Brier Score. In this paper, this result is extended to forecasts for finite--valued targets. Both resolution and reliability are shown to have a positive effect on the score. It is demonstrated that resolution and reliability are directly related to forecast attributes which are desirable on grounds independent of the notion of scores. This finding can be considered an epistemological justification of measuring forecast quality by proper scores. A link is provided to the original work of DeGroot et al (1982), extending their concepts of sufficiency and refinement. The relation to the conjectured sharpness principle of Gneiting et al (2005a) is elucidated.
△ Less
Submitted 1 December, 2008; v1 submitted 4 June, 2008;
originally announced June 2008.
