Showing 1–41 of 41 results for author: Stannat, W

Stochastic Reaction-Diffusion Systems in Biophysics: Towards a Toolbox for Quantitative Model Evaluation

Authors: Gregor Pasemann, Carsten Beta, Wilhelm Stannat

Abstract: We develop a statistical toolbox for a quantitative model evaluation of stochastic reaction-diffusion systems modeling space-time evolution of biophysical quantities on the intracellular level. Starting from space-time data $X_N(t,x)$, as, e.g., provided in fluorescence microscopy recordings, we discuss basic modelling principles for conditional mean trend and fluctuations in the class of stochast… ▽ More We develop a statistical toolbox for a quantitative model evaluation of stochastic reaction-diffusion systems modeling space-time evolution of biophysical quantities on the intracellular level. Starting from space-time data $X_N(t,x)$, as, e.g., provided in fluorescence microscopy recordings, we discuss basic modelling principles for conditional mean trend and fluctuations in the class of stochastic reaction-diffusion systems, and subsequently develop statistical inference methods for parameter estimation. With a view towards application to real data, we discuss estimation errors and confidence intervals, in particular in dependence of spatial resolution of measurements, and investigate the impact of misspecified reaction terms and noise coefficients. We also briefly touch implementation issues of the statistical estimators. As a proof of concept we apply our toolbox to the statistical inference on intracellular actin concentration in the social amoeba Dictyostelium discoideum. △ Less

Submitted 13 July, 2023; originally announced July 2023.

MSC Class: 62F12; 92C05

Approximation of Optimal Feedback Controls for Stochastic Reaction-Diffusion Equations

Authors: Wilhelm Stannat, Alexander Vogler

Abstract: In this paper we present a method to approximate optimal feedback controls for stochastic reaction-diffusion equations. We derive two approximation results providing the theoretical foundation of our approach and allowing for explicit error estimates. The approximation of optimal feedback controls by neural networks is discussed as an explicit application of our method. Finally we provide a numeri… ▽ More In this paper we present a method to approximate optimal feedback controls for stochastic reaction-diffusion equations. We derive two approximation results providing the theoretical foundation of our approach and allowing for explicit error estimates. The approximation of optimal feedback controls by neural networks is discussed as an explicit application of our method. Finally we provide a numerical examples to illustrate our findings. △ Less

Submitted 11 August, 2023; v1 submitted 27 January, 2023; originally announced January 2023.

MSC Class: 93E20; 65K10; 68T07

Neural Network Approximation of Optimal Controls for Stochastic Reaction-Diffusion Equations

Authors: Wilhelm Stannat, Alexander Vogler, Lukas Wessels

Abstract: We present a numerical algorithm that allows the approximation of optimal controls for stochastic reaction-diffusion equations with additive noise by first reducing the problem to controls of feedback form and then approximating the feedback function using finitely based approximations. Using structural assumptions on the finitely based approximations, rates for the approximation error of the cost… ▽ More We present a numerical algorithm that allows the approximation of optimal controls for stochastic reaction-diffusion equations with additive noise by first reducing the problem to controls of feedback form and then approximating the feedback function using finitely based approximations. Using structural assumptions on the finitely based approximations, rates for the approximation error of the cost can be obtained. Our algorithm significantly reduces the computational complexity of finding controls with asymptotically optimal cost. Numerical experiments using artificial neural networks as well as radial basis function networks illustrate the performance of our algorithm. Our approach can also be applied to stochastic control problems for high dimensional stochastic differential equations and more general stochastic partial differential equations. △ Less

Submitted 13 September, 2023; v1 submitted 25 January, 2023; originally announced January 2023.

Comments: 12 figures

Journal ref: Chaos: An Interdisciplinary Journal of Nonlinear Science, Vol. 33, No. 9, 093118, 2023

Analysis of the Ensemble Kalman--Bucy Filter for correlated observation noise

Authors: Sebastian Ertel, Wilhelm Stannat

Abstract: Ensemble Kalman--Bucy filters (EnKBFs) are an important tool in Data Assimilation that aim to approximate the posterior distribution for continuous time filtering problems using an ensemble of interacting particles. In this work we extend a previously derived unifying framework for consistent representations of the posterior distribution to correlated observation noise and use these representation… ▽ More Ensemble Kalman--Bucy filters (EnKBFs) are an important tool in Data Assimilation that aim to approximate the posterior distribution for continuous time filtering problems using an ensemble of interacting particles. In this work we extend a previously derived unifying framework for consistent representations of the posterior distribution to correlated observation noise and use these representations to derive an EnKBF suitable for this setting as a constant gain approximation of these optimal filters. Existence and uniqueness results for both the EnKBF and its mean field limit are provided. The existence and uniqueness of solutions to its limiting McKean-Vlasov equation does not seem to be covered by the existing literature. In the correlated noise case the evolution of the ensemble depends also on the pseudoinverse of its empirical covariance matrix, which has to be controlled for global well posedness. These bounds may also be of independent interest. Finally the convergence to the mean field limit is proven. The results can also be extended to other versions of EnKBFs. △ Less

Submitted 19 July, 2023; v1 submitted 27 May, 2022; originally announced May 2022.

Comments: To appear in the Annals of Applied Probability

MSC Class: 60G35; 65C20; 93E11

Journal ref: Ann. Appl. Probab. 34 (1B), 1072-1107, (February 2024)

Necessary and Sufficient Conditions for Optimal Control of Semilinear Stochastic Partial Differential Equations

Authors: Wilhelm Stannat, Lukas Wessels

Abstract: Using a recently introduced representation of the second order adjoint state as the solution of a function-valued backward stochastic partial differential equation (SPDE), we calculate the viscosity super- and subdifferential of the value function evaluated along an optimal trajectory for controlled semilinear SPDEs. This establishes the well-known connection between Pontryagin's maximum principle… ▽ More Using a recently introduced representation of the second order adjoint state as the solution of a function-valued backward stochastic partial differential equation (SPDE), we calculate the viscosity super- and subdifferential of the value function evaluated along an optimal trajectory for controlled semilinear SPDEs. This establishes the well-known connection between Pontryagin's maximum principle and dynamic programming within the framework of viscosity solutions. As a corollary, we derive that the correction term in the stochastic Hamiltonian arising in non-smooth stochastic control problems is non-positive. These results directly lead us to a stochastic verification theorem for fully nonlinear Hamilton--Jacobi--Bellman equations in the framework of viscosity solutions. △ Less

Submitted 8 December, 2023; v1 submitted 17 December, 2021; originally announced December 2021.

Comments: To appear at Ann. Appl. Probab

Journal ref: Ann. Appl. Probab. 34 (3) 3251 - 3287, June 2024

Analysis of the feedback particle filter with diffusion map based approximation of the gain

Authors: Sahani Pathiraja, Wilhelm Stannat

Abstract: Control-type particle filters have been receiving increasing attention over the last decade as a means of obtaining sample based approximations to the sequential Bayesian filtering problem in the nonlinear setting. Here we analyse one such type, namely the feedback particle filter and a recently proposed approximation of the associated gain function based on diffusion maps. The key purpose is to p… ▽ More Control-type particle filters have been receiving increasing attention over the last decade as a means of obtaining sample based approximations to the sequential Bayesian filtering problem in the nonlinear setting. Here we analyse one such type, namely the feedback particle filter and a recently proposed approximation of the associated gain function based on diffusion maps. The key purpose is to provide analytic insights on the form of the approximate gain, which are of interest in their own right. These are then used to establish a roadmap to obtaining well-posedness and convergence of the finite $N$ system to its mean field limit. A number of possible future research directions are also discussed. △ Less

Submitted 17 November, 2021; v1 submitted 6 September, 2021; originally announced September 2021.

Journal ref: Foundations of Data Science, 3(3), p. 615

Peng's Maximum Principle for Stochastic Partial Differential Equations

Authors: Wilhelm Stannat, Lukas Wessels

Abstract: We extend Peng's maximum principle for semilinear stochastic partial differential equations (SPDEs) in one space-dimension with non-convex control domains and control-dependent diffusion coefficients to the case of general cost functionals with Nemytskii-type coefficients. Our analysis is based on a new approach to the characterization of the second order adjoint state as the solution of a functio… ▽ More We extend Peng's maximum principle for semilinear stochastic partial differential equations (SPDEs) in one space-dimension with non-convex control domains and control-dependent diffusion coefficients to the case of general cost functionals with Nemytskii-type coefficients. Our analysis is based on a new approach to the characterization of the second order adjoint state as the solution of a function-valued backward SPDE. △ Less

Submitted 10 August, 2021; v1 submitted 11 May, 2021; originally announced May 2021.

Comments: 19 pages; accepted for publication in SIAM Journal on Control and Optimization

MSC Class: 93E20; 49K45; 60H15

Journal ref: SIAM J. Control Optim., 59 (2021), 3552-3573

Stability and moment estimates for the stochastic singular $Φ$-Laplace equation

Authors: Florian Seib, Wilhelm Stannat, Jonas M. Tölle

Abstract: We study stability, long-time behavior and moment estimates for stochastic evolution equations with additive Wiener noise and with singular drift given by a divergence type quasilinear diffusion operator which may not necessarily exhibit a homogeneous diffusivity. Our results cover the singular stochastic $p$-Laplace equations and, more generally, singular stochastic $Φ$-Laplace equations with zer… ▽ More We study stability, long-time behavior and moment estimates for stochastic evolution equations with additive Wiener noise and with singular drift given by a divergence type quasilinear diffusion operator which may not necessarily exhibit a homogeneous diffusivity. Our results cover the singular stochastic $p$-Laplace equations and, more generally, singular stochastic $Φ$-Laplace equations with zero Dirichlet boundary conditions. We obtain improved moment estimates and quantitative convergence rates of the ergodic semigroup to the unique invariant measure, classified in a systematic way according to the degree of local degeneracy of the potential at the origin. We obtain new concentration results for the invariant measure and establish maximal dissipativity of the associated Kolmogorov operator. In particular, we recover the results for the curve shortening flow in the plane by Es-Sarhir, von Renesse and Stannat, NoDEA 16(9), 2012, and improve the results by Liu and Tölle, ECP 16, 2011. △ Less

Submitted 27 September, 2023; v1 submitted 4 March, 2021; originally announced March 2021.

Comments: 24 pages, 58 references

MSC Class: Primary: 35K67; 60H15; Secondary: 37A25; 37L40; 47D07

Journal ref: Journal of Differential Equations 377 (2023) 663--693

Analytic theory of Itô-stochastic differential equations with non-smooth coefficients

Authors: Haesung Lee, Wilhelm Stannat, Gerald Trutnau

Abstract: We present a detailed analysis of non-degenerate time-homogeneous Itô-stochastic differential equations with low local regularity assumptions on the coefficients. In particular the drift coefficient may only satisfy a local integrability condition. We discuss non-explosion, irreducibility, Krylov type estimates, regularity of the transition function and resolvent, moment inequalities, recurrence,… ▽ More We present a detailed analysis of non-degenerate time-homogeneous Itô-stochastic differential equations with low local regularity assumptions on the coefficients. In particular the drift coefficient may only satisfy a local integrability condition. We discuss non-explosion, irreducibility, Krylov type estimates, regularity of the transition function and resolvent, moment inequalities, recurrence, transience, long time behavior of the transition function, existence and uniqueness of invariant measures, as well as pathwise uniqueness, strong solutions and uniqueness in law. This analysis shows in particular that sharp explicit conditions for the various mentioned properties can be derived similarly to the case of classical stochastic differential equations with local Lipschitz coefficients. △ Less

Submitted 24 August, 2022; v1 submitted 28 December, 2020; originally announced December 2020.

Comments: 128 pages, revised version, index added

MSC Class: Primary 60H20; 47D07; 60J35; Secondary 31C25; 35J15; 35B65; 60J60

Mean field limit of Ensemble Square Root Filters -- discrete and continuous time

Authors: Theresa Lange, Wilhelm Stannat

Abstract: Consider the class of Ensemble Square Root filtering algorithms for the numerical approximation of the posterior distribution of nonlinear Markovian signals partially observed with linear observations corrupted with independent measurement noise. We analyze the asymptotic behavior of these algorithms in the large ensemble limit both in discrete and continuous time. We identify limiting mean-field… ▽ More Consider the class of Ensemble Square Root filtering algorithms for the numerical approximation of the posterior distribution of nonlinear Markovian signals partially observed with linear observations corrupted with independent measurement noise. We analyze the asymptotic behavior of these algorithms in the large ensemble limit both in discrete and continuous time. We identify limiting mean-field processes on the level of the ensemble members, prove corresponding propagation of chaos results and derive associated convergence rates in terms of the ensemble size. In continuous time we also identify the stochastic partial differential equation driving the distribution of the mean-field process and perform a comparison with the Kushner-Stratonovich equation. △ Less

Submitted 6 January, 2021; v1 submitted 20 November, 2020; originally announced November 2020.

Comments: Accepted for publication in Foundations of Data Science. Revised version: corrected typos, added more explanations, updated Theorem 3.1 (holds for all p >=2)

MSC Class: 60H35; 93E11; 60F99

McKean-Vlasov SDEs in nonlinear filtering

Authors: Sahani Pathiraja, Sebastian Reich, Wilhelm Stannat

Abstract: Various particle filters have been proposed over the last couple of decades with the common feature that the update step is governed by a type of control law. This feature makes them an attractive alternative to traditional sequential Monte Carlo which scales poorly with the state dimension due to weight degeneracy. This article proposes a unifying framework that allows to systematically derive th… ▽ More Various particle filters have been proposed over the last couple of decades with the common feature that the update step is governed by a type of control law. This feature makes them an attractive alternative to traditional sequential Monte Carlo which scales poorly with the state dimension due to weight degeneracy. This article proposes a unifying framework that allows to systematically derive the McKean-Vlasov representations of these filters for the discrete time and continuous time observation case, taking inspiration from the smooth approximation of the data considered in Crisan & Xiong (2010) and Clark & Crisan (2005). We consider three filters that have been proposed in the literature and use this framework to derive Itô representations of their limiting forms as the approximation parameter $δ\rightarrow 0$. All filters require the solution of a Poisson equation defined on $\mathbb{R}^{d}$, for which existence and uniqueness of solutions can be a non-trivial issue. We additionally establish conditions on the signal-observation system that ensures well-posedness of the weighted Poisson equation arising in one of the filters. △ Less

Submitted 17 November, 2021; v1 submitted 24 July, 2020; originally announced July 2020.

Journal ref: SIAM Journal on Control and Optimization, 59(6), pp.4188-4215 (2021)

Diffusivity Estimation for Activator-Inhibitor Models: Theory and Application to Intracellular Dynamics of the Actin Cytoskeleton

Authors: Gregor Pasemann, Sven Flemming, Sergio Alonso, Carsten Beta, Wilhelm Stannat

Abstract: A theory for diffusivity estimation for spatially extended activator-inhibitor dynamics modelling the evolution of intracellular signaling networks is developed in the mathematical framework of stochastic reaction-diffusion systems. In order to account for model uncertainties, we extend the results for parameter estimation for semilinear stochastic partial differential equations, as developed in [… ▽ More A theory for diffusivity estimation for spatially extended activator-inhibitor dynamics modelling the evolution of intracellular signaling networks is developed in the mathematical framework of stochastic reaction-diffusion systems. In order to account for model uncertainties, we extend the results for parameter estimation for semilinear stochastic partial differential equations, as developed in [PS20], to the problem of joint estimation of diffusivity and parametrized reaction terms. Our theoretical findings are applied to the estimation of effective diffusivity of signaling components contributing to intracellular dynamics of the actin cytoskeleton in the model organism Dictyostelium discoideum. △ Less

Submitted 31 January, 2021; v1 submitted 15 May, 2020; originally announced May 2020.

MSC Class: 60H15; 62F10

Journal ref: J Nonlinear Sci 31, 59 (2021)

Fluctuation limits for mean-field interacting nonlinear Hawkes processes

Authors: Sophie Heesen, Wilhelm Stannat

Abstract: We investigate the asymptotic behaviour of networks of interacting non-linear Hawkes processes modeling a homogeneous population of neurons in the large population limit. In particular, we prove a functional central limit theorem for the mean spike-activity thereby characterizing the asymptotic fluctuations in terms of a stochastic Volterra integral equation. Our approach differs from previous app… ▽ More We investigate the asymptotic behaviour of networks of interacting non-linear Hawkes processes modeling a homogeneous population of neurons in the large population limit. In particular, we prove a functional central limit theorem for the mean spike-activity thereby characterizing the asymptotic fluctuations in terms of a stochastic Volterra integral equation. Our approach differs from previous approaches in making use of the associated resolvent in order to represent the fluctutations as Skorokhod continuous map**s of weakly converging martingales. Since the Lipschitz properties of the resolvent are explicit, our analysis in principle also allows to derive approximation errors in terms of driving martingales. △ Less

Submitted 7 May, 2021; v1 submitted 23 December, 2019; originally announced December 2019.

MSC Class: 60H35; 93E11; 60F99

Journal ref: Stochastic Processes Appl. 139, 280-297, 2021

On the continuous time limit of Ensemble Square Root Filters

Authors: Theresa Lange, Wilhelm Stannat

Abstract: We provide a continuous time limit analysis for the class of Ensemble Square Root Filter algorithms with deterministic model perturbations. In the particular linear case, we specify general conditions on the model perturbations implying convergence of the empirical mean and covariance matrix towards their respective counterparts of the Kalman-Bucy Filter. As a second main result we identify additi… ▽ More We provide a continuous time limit analysis for the class of Ensemble Square Root Filter algorithms with deterministic model perturbations. In the particular linear case, we specify general conditions on the model perturbations implying convergence of the empirical mean and covariance matrix towards their respective counterparts of the Kalman-Bucy Filter. As a second main result we identify additional assumptions for the convergence of the whole ensemble towards solutions of the Ensemble Kalman-Bucy filtering equations introduced in [1]. The latter result can be generalized to nonlinear Lipschitz-continuous model operators. A striking implication of our results is the fact that the limiting equations for the ensemble members are universal for a large class of Ensemble Square Root Filters. This yields a mathematically rigorous justification for the analysis of these algorithms with the help of the Ensemble Kalman-Bucy Filter. [1] de Wiljes, Jana, Reich, Sebastian, Stannat, Wilhelm, Long-Time Stability and Accuracy of the Ensemble Kalman-Bucy Filter for Fully Observed Processes and Small Measurement Noise. SIAM Journal on Applied Dynamical Systems, Vol. 17, No. 2, 1152-1181, 2018 △ Less

Submitted 25 January, 2021; v1 submitted 28 October, 2019; originally announced October 2019.

Comments: 31 pages, content adjusted to a recently derived alternative formulation of the algorithms simplifying the structure of the arguments

MSC Class: 60H35; 93E11; 60F99

Journal ref: Commun. Math. Sci. 19 (2021), no. 7, 1855-1880

Deterministic Control of Stochastic Reaction-Diffusion Equations

Authors: Wilhelm Stannat, Lukas Wessels

Abstract: We consider the control of semilinear stochastic partial differential equations (SPDEs) via deterministic controls. In the case of multiplicative noise, existence of optimal controls and necessary conditions for optimality are derived. In the case of additive noise, we obtain a representation for the gradient of the cost functional via adjoint calculus. The restriction to deterministic controls an… ▽ More We consider the control of semilinear stochastic partial differential equations (SPDEs) via deterministic controls. In the case of multiplicative noise, existence of optimal controls and necessary conditions for optimality are derived. In the case of additive noise, we obtain a representation for the gradient of the cost functional via adjoint calculus. The restriction to deterministic controls and additive noise avoids the necessity of introducing a backward SPDE. Based on this novel representation, we present a probabilistic nonlinear conjugate gradient descent method to approximate the optimal control, and apply our results to the stochastic Schlögl model. We also present some analysis in the case where the optimal control for the stochastic system differs from the optimal control for the deterministic system. △ Less

Submitted 13 July, 2020; v1 submitted 22 May, 2019; originally announced May 2019.

Comments: accepted for publication in Evolution Equations & Control Theory; 21 pages, 10 figures

Journal ref: Evol. Equ. Control Theory, 10 (2021), 701-722

Drift Estimation for Stochastic Reaction-Diffusion Systems

Authors: Gregor Pasemann, Wilhelm Stannat

Abstract: A parameter estimation problem for a class of semilinear stochastic evolution equations is considered. Conditions for consistency and asymptotic normality are given in terms of growth and continuity properties of the nonlinear part. Emphasis is put on the case of stochastic reaction-diffusion systems. Robustness results for statistical inference under model uncertainty are provided. A parameter estimation problem for a class of semilinear stochastic evolution equations is considered. Conditions for consistency and asymptotic normality are given in terms of growth and continuity properties of the nonlinear part. Emphasis is put on the case of stochastic reaction-diffusion systems. Robustness results for statistical inference under model uncertainty are provided. △ Less

Submitted 24 February, 2020; v1 submitted 9 April, 2019; originally announced April 2019.

Comments: see journal webpage for published version

Journal ref: Electron. J. Stat. 14 (2020), no. 1, 547-579

Weak Solutions to Vlasov-McKean Equations under Lyapunov-Type Conditions

Authors: Sima Mehri, Wilhelm Stannat

Abstract: We present a Lyapunov type approach to the problem of existence and uniqueness of general law-dependent stochastic differential equations. In the existing literature most results concerning existence and uniqueness are obtained under regularity assumptions of the coefficients w.r.t the Wasserstein distance. Some existence and uniqueness results for irregular coefficients have been obtained by cons… ▽ More We present a Lyapunov type approach to the problem of existence and uniqueness of general law-dependent stochastic differential equations. In the existing literature most results concerning existence and uniqueness are obtained under regularity assumptions of the coefficients w.r.t the Wasserstein distance. Some existence and uniqueness results for irregular coefficients have been obtained by considering the total variation distance. Here we extend this approach to the control of the solution in some weighted total variation distance, that allows us now to derive a rather general weak uniqueness result, merely assuming measurability and certain integrability on the drift coefficient and some non-degeneracy on the dispersion coefficient. We also present an abstract weak existence result for the solution of law-dependent stochastic differential equations with merely measurable coefficients, based on an approximation with law-dependent stochastic differential equations with regular coefficients under Lyapunov type assumptions. △ Less

Submitted 16 November, 2019; v1 submitted 23 January, 2019; originally announced January 2019.

MSC Class: 60J60; 60H30; 93D30; 35Q83

Journal ref: Stochastics and Dynamics 2019

On the continuous time limit of the Ensemble Kalman Filter

Authors: Theresa Lange, Wilhelm Stannat

Abstract: We present recent results on the existence of a continuous time limit for Ensemble Kalman Filter algorithms. In the setting of continuous signal and observation processes, we apply the original Ensemble Kalman Filter algorithm proposed by [1] as well as a recent variant [2] to the respective discretizations and show that in the limit of decreasing stepsize the filter equations converge to an ensem… ▽ More We present recent results on the existence of a continuous time limit for Ensemble Kalman Filter algorithms. In the setting of continuous signal and observation processes, we apply the original Ensemble Kalman Filter algorithm proposed by [1] as well as a recent variant [2] to the respective discretizations and show that in the limit of decreasing stepsize the filter equations converge to an ensemble of interacting (stochastic) differential equations in the ensemble-mean-square sense. Our analysis also allows for the derivation of convergence rates with respect to the stepsize. An application of our analysis is the rigorous derivation of continuous ensemble filtering algorithms consistent with discrete approximation schemes. Conversely, the continuous time limit allows for a better qualitative and quantitative analysis of the time-discrete counterparts using the rich theory of dynamical systems in continuous time. [1] Burgers, G., van Leeuwen, P. J., Evensen, G. (1998). Analysis scheme in the ensemble Kalman filter. Monthly weather review, 126(6), 1719-1724. [2] de Wiljes, J., Reich, S., Stannat, W. (2018). Long-Time Stability and Accuracy of the Ensemble Kalman-Bucy Filter for Fully Observed Processes and Small Measurement Noise. SIAM Journal on Applied Dynamical Systems, 17(2), 1152-1181. △ Less

Submitted 16 January, 2019; originally announced January 2019.

Comments: 33 pages

MSC Class: 60H35; 93E11; 60F99

Journal ref: Math. Comp. 90 (2021), 233-265

Existence, uniqueness and stability of semi-linear rough partial differential equations

Authors: Peter Friz, Torstein Nilssen, Wilhelm Stannat

Abstract: We prove well-posedness and rough path stability of a class of linear and semi-linear rough PDE's on $\mathbb{R}^d$ using the variational approach. This includes well-posedness of (possibly degenerate) linear rough PDE's in $L^p(\mathbb{R}^d)$, and then -- based on a new method -- energy estimates for non-degenerate linear rough PDE's. We accomplish this by controlling the energy in a properly cho… ▽ More We prove well-posedness and rough path stability of a class of linear and semi-linear rough PDE's on $\mathbb{R}^d$ using the variational approach. This includes well-posedness of (possibly degenerate) linear rough PDE's in $L^p(\mathbb{R}^d)$, and then -- based on a new method -- energy estimates for non-degenerate linear rough PDE's. We accomplish this by controlling the energy in a properly chosen weighted $L^2$-space, where the weight is given as a solution of an associated backward equation. These estimates then allow us to extend well-posedness for linear rough PDE's to semi-linear perturbations. △ Less

Submitted 4 September, 2018; originally announced September 2018.

Journal ref: J. Differential Equations 268 (2020), no.4, 1686-1721

Propagation of Chaos for Stochastic Spatially Structured Neuronal Networks with Delay driven by Jump Diffusions

Authors: Sima Mehri, Michael Scheutzow, Wilhelm Stannat, Bijan Z. Zangeneh

Abstract: Spatially structured neural networks driven by jump diffusion noise with monotone coefficients, fully path dependent delay and with a disorder parameter are considered. Well-posedness for the associated McKean-Vlasov equation and a corresponding propagation of chaos result in the infinite population limit are proven. Our existence result for the McKean-Vlasov equation is based on the Euler approxi… ▽ More Spatially structured neural networks driven by jump diffusion noise with monotone coefficients, fully path dependent delay and with a disorder parameter are considered. Well-posedness for the associated McKean-Vlasov equation and a corresponding propagation of chaos result in the infinite population limit are proven. Our existence result for the McKean-Vlasov equation is based on the Euler approximation, that is applied to this type of equation for the first time. △ Less

Submitted 27 May, 2019; v1 submitted 4 May, 2018; originally announced May 2018.

Comments: In this version, a shorter title has been chosen. The manuscript has been accepted for publication in Annals of Applied Probability

MSC Class: primary: 60K35; 92B20 secondary: 65C20; 60F99; 82C80

Journal ref: Ann. Appl. Probab. 30 (2020), no. 1, 175-207

Generalized Burgers equation with rough transport noise

Authors: Antoine Hocquet, Torstein Nilssen, Wilhelm Stannat

Abstract: We introduce a new technique for studying well posedness and energy estimates for evolution equations with a rough transport term. The technique is based on finding suitable space-time weight functions for the equations at hand. As an example we study the well posedness of the generalized viscous Burgers equation perturbed by a rough path transport noise. We introduce a new technique for studying well posedness and energy estimates for evolution equations with a rough transport term. The technique is based on finding suitable space-time weight functions for the equations at hand. As an example we study the well posedness of the generalized viscous Burgers equation perturbed by a rough path transport noise. △ Less

Submitted 4 April, 2018; originally announced April 2018.

MSC Class: 60H15; 47J30; 35K55

Journal ref: Stochastic Processes and their Applications (2019), available online

A complete mean-field theory for dynamics of binary recurrent neural networks

Authors: Farzad Farkhooi, Wilhelm Stannat

Abstract: We develop a unified theory that encompasses the macroscopic dynamics of recurrent interactions of binary units within arbitrary network architectures. Using the martingale theory, our mathematical analysis provides a complete description of nonequilibrium fluctuations in networks with finite size and finite degree of interactions. Our approach allows the investigation of systems for which a deter… ▽ More We develop a unified theory that encompasses the macroscopic dynamics of recurrent interactions of binary units within arbitrary network architectures. Using the martingale theory, our mathematical analysis provides a complete description of nonequilibrium fluctuations in networks with finite size and finite degree of interactions. Our approach allows the investigation of systems for which a deterministic mean-field theory breaks down. To demonstrate this, we uncover a novel dynamic state in which a recurrent network of binary units with statistically inhomogeneous interactions, along with an asynchronous behavior, also exhibits collective nontrivial stochastic fluctuations in the thermodynamical limit. △ Less

Submitted 17 October, 2017; v1 submitted 24 January, 2017; originally announced January 2017.

Comments: 5 pages, 2 figures, Accepted (Physical Review Letters)

MSC Class: 60H15

Journal ref: Phys. Rev. Lett. 119, 208301 (2017)

A Multiscale-Analysis of Stochastic Bistable Reaction-Diffusion Equations

Authors: Jennifer Krüger, Wilhelm Stannat

Abstract: A multiscale analysis of 1D stochastic bistable reaction-diffusion equations with additive noise is carried out w.r.t. travelling waves within the variational approach to stochastic partial differential equations. It is shown with explicit error estimates on appropriate function spaces that up to lower order w.r.t. the noise amplitude, the solution can be decomposed into the orthogonal sum of a tr… ▽ More A multiscale analysis of 1D stochastic bistable reaction-diffusion equations with additive noise is carried out w.r.t. travelling waves within the variational approach to stochastic partial differential equations. It is shown with explicit error estimates on appropriate function spaces that up to lower order w.r.t. the noise amplitude, the solution can be decomposed into the orthogonal sum of a travelling wave moving with random speed and into Gaussian fluctuations. A stochastic differential equation describing the speed of the travelling wave and a linear stochastic partial differential equation describing the fluctuations are derived in terms of the coefficients. Our results extend corresponding results obtained for stochastic neural field equations to the present class of stochastic dynamics. △ Less

Submitted 6 January, 2017; originally announced January 2017.

Journal ref: Nonlinear Analysis, Vol. 162, 197--223, 2017

Long-time stability and accuracy of the ensemble Kalman-Bucy filter for fully observed processes and small measurement noise

Authors: Jana de Wiljes, Sebastian Reich, Wilhelm Stannat

Abstract: The ensemble Kalman filter has become a popular data assimilation technique in the geosciences. However, little is known theoretically about its long term stability and accuracy. In this paper, we investigate the behavior of an ensemble Kalman-Bucy filter applied to continuous-time filtering problems. We derive mean field limiting equations as the ensemble size goes to infinity as well as uniform-… ▽ More The ensemble Kalman filter has become a popular data assimilation technique in the geosciences. However, little is known theoretically about its long term stability and accuracy. In this paper, we investigate the behavior of an ensemble Kalman-Bucy filter applied to continuous-time filtering problems. We derive mean field limiting equations as the ensemble size goes to infinity as well as uniform-in-time accuracy and stability results for finite ensemble sizes. The later results require that the process is fully observed and that the measurement noise is small. We also demonstrate that our ensemble Kalman-Bucy filter is consistent with the classic Kalman-Bucy filter for linear systems and Gaussian processes. We finally verify our theoretical findings for the Lorenz-63 system. △ Less

Submitted 24 November, 2017; v1 submitted 19 December, 2016; originally announced December 2016.

MSC Class: 65C05; 62M20; 93E11; 62F15; 86A22

Journal ref: SIAM J. Appl. Dyn. Syst., Vol. 17, 1152-1181, 2018

Finite-Size Effects on Traveling Wave Solutions to Neural Field Equations

Authors: Eva Lang, Wilhelm Stannat

Abstract: Neural field equations are used to describe the spatiotemporal evolution of the activity in a network of synaptically coupled populations of neurons in the continuum limit. Their heuristic derivation involves two approximation steps. Under the assumption that each population in the network is large, the activity is described in terms of a population average. The discrete network is then approximat… ▽ More Neural field equations are used to describe the spatiotemporal evolution of the activity in a network of synaptically coupled populations of neurons in the continuum limit. Their heuristic derivation involves two approximation steps. Under the assumption that each population in the network is large, the activity is described in terms of a population average. The discrete network is then approximated by a continuum. In this article we make the two approximation steps explicit. Extending a model by Bressloff and Newby, we describe the evolution of the activity in a discrete network of finite populations by a Markov chain. In order to determine finite-size effects - deviations from the mean field limit due to the finite size of the populations in the network - we analyze the fluctuations of this Markov chain and set up an approximating system of diffusion processes. We show that a well-posed stochastic neural field equation with a noise term accounting for finite-size effects on traveling wave solutions is obtained as the strong continuum limit. △ Less

Submitted 22 June, 2016; originally announced June 2016.

MSC Class: 92C20; 34F05; 60H20; 60H25

Journal ref: The Journal of Mathematical Neuroscience, 2017, 7:5

A Fenchel-Moreau-Rockafellar type theorem on the Kantorovich-Wasserstein space with Applications in Partially Observable Markov Decision Processes

Authors: Vaios Laschos, Klaus Obermayer, Yun Shen, Wilhelm Stannat

Abstract: By using the fact that the space of all probability measures with finite support can be somehow completed in two different fashions, one generating the Arens-Eells space and another generating the Kantorovich-Wasserstein (Wasserstein-1) space, and by exploiting the duality relationship between the Arens-Eells space with the space of Lipschitz functions, we provide a dual representation of Fenchel-… ▽ More By using the fact that the space of all probability measures with finite support can be somehow completed in two different fashions, one generating the Arens-Eells space and another generating the Kantorovich-Wasserstein (Wasserstein-1) space, and by exploiting the duality relationship between the Arens-Eells space with the space of Lipschitz functions, we provide a dual representation of Fenchel-Moreau-Rockafellar type for proper convex functionals on Wasserstein-1. We retrieve dual transportation inequalities as a Corollary and we provide examples where the theorem can be used to easily prove dual expressions like the celebrated Donsker-Varadhan variational formula. Finally our result allows to write convex functions as the supremum over all linear functions that are generated by roots of its conjugate dual, something that we apply to the field of Partially observable Markov decision processes (POMDPs) to approximate the value function of a given POMDP by iterating level sets. This extends the method used in Smallwood 1973 for finite state spaces to the case were the state space is a Polish metric space. △ Less

Submitted 5 May, 2019; v1 submitted 9 March, 2016; originally announced March 2016.

Comments: 20 pages

MSC Class: 46E15; 46E27; 90C40; 90C46; 90C25; 46B10

Journal ref: Journal of Mathematical Analysis and Applications Volume 477, Issue 2, 15 September 2019, Pages 1133-1156

$L^2$-Stability of Traveling Wave Solutions to Nonlocal Evolution Equations

Authors: Eva Lang, Wilhelm Stannat

Abstract: Stability of the traveling wave solution to a general class of one-dimensional nonlocal evolution equations is studied in $L^2$-spaces, thereby providing an alternative approach to the usual spectral analysis with respect to the supremum norm. We prove that the linearization around the traveling wave solution satisfies a Lyapunov-type stability condition in a weighted space $L^2(ρ)$ for a naturall… ▽ More Stability of the traveling wave solution to a general class of one-dimensional nonlocal evolution equations is studied in $L^2$-spaces, thereby providing an alternative approach to the usual spectral analysis with respect to the supremum norm. We prove that the linearization around the traveling wave solution satisfies a Lyapunov-type stability condition in a weighted space $L^2(ρ)$ for a naturally associated density $ρ$. The result can be applied to obtain stability of the traveling wave solution under stochastic perturbations of additive or multiplicative type. For small wave speeds, we also prove an alternative Lyapunov-type stability condition in $L^2(\mathfrak{m})$, where $\mathfrak{m}$ is the symmetrizing density for the traveling wave operator, which allows to derive a long-term stochastic stability result. △ Less

Submitted 11 June, 2016; v1 submitted 4 February, 2016; originally announced February 2016.

Comments: in comparison to first version setting in subsection 3.3 changed to stochastic neural field equations with multiplicative noise

Journal ref: J. Differential Equations, Vol. 261, pp. 4275-4297, 2016

Reliability of signal transmission in stochastic nerve axon equations

Authors: Martin Sauer, Wilhelm Stannat

Abstract: We introduce a method for computing probabilities for spontaneous activity and propagation fail- ure of the action potential in spatially extended, conductance-based neuronal models subject to channel noise, based on statistical properties of the membrane potential. We compare different estimators with respect to the quality of detection, computational costs and robustness and propose the integral… ▽ More We introduce a method for computing probabilities for spontaneous activity and propagation fail- ure of the action potential in spatially extended, conductance-based neuronal models subject to channel noise, based on statistical properties of the membrane potential. We compare different estimators with respect to the quality of detection, computational costs and robustness and propose the integral of the membrane potential along the axon as an appropriate estimator to detect both spontaneous activity and propagation failure. Performing a model reduction we achieve a simplified analytical expression based on the linearization at the resting potential (resp. the traveling action potential). This allows to approximate the probabilities for spontaneous activity and propagation failure in terms of (classical) hitting probabilities of one-dimensional linear stochastic differential equations. The quality of the approximation with respect to the noise amplitude is discussed and illustrated with numerical results for the spatially extended Hodgkin-Huxley. △ Less

Submitted 21 March, 2016; v1 submitted 15 February, 2015; originally announced February 2015.

Comments: 9 pages, 7 figures

Journal ref: J Comput Neurosci, vol. 40, pp. 103-111, 2016

Transition from Gaussian to non-Gaussian fluctuations for mean-field diffusions in spatial interaction

Authors: Eric Luçon, Wilhelm Stannat

Abstract: We consider a system of $N$ disordered mean-field interacting diffusions within spatial constraints: each particle $θ_i$ is attached to one site $x_i$ of a periodic lattice and the interaction between particles $θ_i$ and $θ_j$ decreases as $| x_i-x_j|^{-α}$ for $α\in[0,1)$. In a previous work, it was shown that the empirical measure of the particles converges in large population to the solution of… ▽ More We consider a system of $N$ disordered mean-field interacting diffusions within spatial constraints: each particle $θ_i$ is attached to one site $x_i$ of a periodic lattice and the interaction between particles $θ_i$ and $θ_j$ decreases as $| x_i-x_j|^{-α}$ for $α\in[0,1)$. In a previous work, it was shown that the empirical measure of the particles converges in large population to the solution of a nonlinear partial differential equation of McKean-Vlasov type. The purpose of the present paper is to study the fluctuations associated to this convergence. We exhibit in particular a phase transition in the scaling and in the nature of the fluctuations: when $α\in[0,\frac{1}{2})$, the fluctuations are Gaussian, governed by a linear SPDE, with scaling $\sqrt{N}$ whereas the fluctuations are deterministic with scaling $N^{1-α}$ in the case $α\in(\frac{1}{2},1)$. △ Less

Submitted 2 February, 2015; originally announced February 2015.

Comments: 56 pages

MSC Class: 60F05; 60G57; 60H15; 82C20; 92B25

Journal ref: Ann. Appl. Probab. Vol. 26, 3840-3909, 2016

Stochastic partial differential equations: a rough path view

Authors: Joscha Diehl, Peter K. Friz, Wilhelm Stannat

Abstract: We discuss regular and weak solutions to rough partial differential equations (RPDEs), thereby providing a (rough path-)wise view on important classes of SPDEs. In contrast to many previous works on RPDEs, our definition gives honest meaning to RPDEs as integral equation, based on which we are able to obtain existence, uniqueness and stability results. The case of weak "rough" forward equations, m… ▽ More We discuss regular and weak solutions to rough partial differential equations (RPDEs), thereby providing a (rough path-)wise view on important classes of SPDEs. In contrast to many previous works on RPDEs, our definition gives honest meaning to RPDEs as integral equation, based on which we are able to obtain existence, uniqueness and stability results. The case of weak "rough" forward equations, may be seen as robustification of the (measure-valued) Zakai equation in the rough path sense. Feynman-Kac representation for RPDEs, in formal analogy to similar classical results in SPDE theory, play an important role. △ Less

Submitted 19 December, 2014; originally announced December 2014.

MSC Class: 60H15

Journal ref: Annales de la Faculte des Sciences de Toulouse Ser. 6, Vol. XXVI, 911-947, 2017

Front Propagation in Stochastic Neural Fields: A Rigorous Mathematical Framework

Authors: Jennifer Krüger, Wilhelm Stannat

Abstract: We develop a complete and rigorous mathematical framework for the analysis of stochastic neural field equations under the influence of spatially extended additive noise. By comparing a solution to a fixed deterministic front profile it is possible to realise the difference as strong solution to an $L^2(\mathbb{R})$-valued SDE. A multiscale analysis of this process then allows us to obtain rigorous… ▽ More We develop a complete and rigorous mathematical framework for the analysis of stochastic neural field equations under the influence of spatially extended additive noise. By comparing a solution to a fixed deterministic front profile it is possible to realise the difference as strong solution to an $L^2(\mathbb{R})$-valued SDE. A multiscale analysis of this process then allows us to obtain rigorous stability results. Here a new representation formula for stochastic convolutions in the semigroup approach to linear function-valued SDE with adapted random drift is applied. Additionally, we introduce a dynamic phase-adaption process of gradient type. △ Less

Submitted 10 June, 2014; originally announced June 2014.

Comments: 17 pages. Accepted for publication in SIAM Journal on Applied Dynamical Systems (SIADS)

MSC Class: 60H20; 60H25; 92C20

Journal ref: SIAM J. Appl. Dyn. Syst., Vol. 13, 1293-1310,2014

Stability of travelling waves in stochastic bistable reaction-diffusion equations

Authors: Wilhelm Stannat

Abstract: We extend the result on the stability of travelling waves for stochastic Nagumo equations in [St] to general bistable reaction-diffusion equations with both additive and multiplicative noise, using a variational approach based on functional inequalities. Our analysis yields explicit estimates on the rate of stability that can be shown in special examples to be optimal. [St] Stannat, W., Stabilit… ▽ More We extend the result on the stability of travelling waves for stochastic Nagumo equations in [St] to general bistable reaction-diffusion equations with both additive and multiplicative noise, using a variational approach based on functional inequalities. Our analysis yields explicit estimates on the rate of stability that can be shown in special examples to be optimal. [St] Stannat, W., Stability of travelling waves in stochastic Nagumo equations, arXiv:1301.6378, 2013. △ Less

Submitted 30 April, 2014; v1 submitted 15 April, 2014; originally announced April 2014.

Comments: Proposition 5.1 and Lemma 5.2 corrected, as well as constant C_* in Theorem 1.5. No further results affected

On Average Risk-sensitive Markov Control Processes

Authors: Yun Shen, Klaus Obermayer, Wilhelm Stannat

Abstract: We introduce the Lyapunov approach to optimal control problems of average risk-sensitive Markov control processes with general risk maps. Motivated by applications in particular to behavioral economics, we consider possibly non-convex risk maps, modeling behavior with mixed risk preference. We introduce classical objective functions to the risk-sensitive setting and we are in particular interested… ▽ More We introduce the Lyapunov approach to optimal control problems of average risk-sensitive Markov control processes with general risk maps. Motivated by applications in particular to behavioral economics, we consider possibly non-convex risk maps, modeling behavior with mixed risk preference. We introduce classical objective functions to the risk-sensitive setting and we are in particular interested in optimizing the average risk in the infinite-time horizon for Markov Control Processes on general, possibly non-compact, state spaces allowing also unbounded cost. Existence and uniqueness of an optimal control is obtained with a fixed point theorem applied to the nonlinear map modeling the risk-sensitive expected total cost. The necessary contraction is obtained in a suitable chosen seminorm under a new set of conditions: 1) Lyapunov-type conditions on both risk maps and cost functions that control the growth of iterations, and 2) Doeblin-type conditions, known for Markov chains, generalized to nonlinear map**s. In the particular case of the entropic risk map, the above conditions can be replaced by the existence of a Lyapunov function, a local Doeblin-type condition for the underlying Markov chain, and a growth condition on the cost functions. △ Less

Submitted 22 July, 2015; v1 submitted 13 March, 2014; originally announced March 2014.

Comments: 37 pages, submitted to SIAM J. on Control and Optimization

MSC Class: 60J05; 93E20; 93C55; 47H07; 91B06

Analysis and Approximation of Stochastic Nerve Axon Equations

Authors: Martin Sauer, Wilhelm Stannat

Abstract: We consider spatially extended conductance based neuronal models with noise described by a stochastic reaction diffusion equation with additive noise coupled to a control variable with multiplicative noise but no diffusion. We only assume a local Lipschitz condition on the nonlinearities together with a certain physiologically reasonable monotonicity to derive crucial $L^\infty$-bounds for the sol… ▽ More We consider spatially extended conductance based neuronal models with noise described by a stochastic reaction diffusion equation with additive noise coupled to a control variable with multiplicative noise but no diffusion. We only assume a local Lipschitz condition on the nonlinearities together with a certain physiologically reasonable monotonicity to derive crucial $L^\infty$-bounds for the solution. These play an essential role in both the proof of existence and uniqueness of solutions as well as the error analysis of the finite difference approximation in space. We derive explicit error estimates, in particular a pathwise convergence rate of $\sqrt{\frac{1}{n}}-$ and a strong convergence rate of $\frac1n$ in special cases. As applications, the Hodgkin-Huxley and FitzHugh-Nagumo systems with noise are considered. △ Less

Submitted 19 February, 2014; originally announced February 2014.

Comments: 25 pages

MSC Class: Primary 60H15; 60H35; Secondary 35R60; 65C30; 92C20

Journal ref: Math. Comp. 85 (2016), no. 301, 2457-2481

Mean field limit for disordered diffusions with singular interactions

Authors: Eric Luçon, Wilhelm Stannat

Abstract: Motivated by considerations from neuroscience (macroscopic behavior of large ensembles of interacting neurons), we consider a population of mean field interacting diffusions in $\mathbf {R}^m$ in the presence of a random environment and with spatial extension: each diffusion is attached to one site of the lattice $\mathbf {Z}^d$, and the interaction between two diffusions is attenuated by a spatia… ▽ More Motivated by considerations from neuroscience (macroscopic behavior of large ensembles of interacting neurons), we consider a population of mean field interacting diffusions in $\mathbf {R}^m$ in the presence of a random environment and with spatial extension: each diffusion is attached to one site of the lattice $\mathbf {Z}^d$, and the interaction between two diffusions is attenuated by a spatial weight that depends on their positions. For a general class of singular weights (including the case already considered in the physical literature when interactions obey to a power-law of parameter $0<α<d$), we address the convergence as $N\to\infty$ of the empirical measure of the diffusions to the solution of a deterministic McKean-Vlasov equation and prove well-posedness of this equation, even in the degenerate case without noise. We provide also precise estimates of the speed of this convergence, in terms of an appropriate weighted Wasserstein distance, exhibiting in particular nontrivial fluctuations in the power-law case when $\frac{d}{2}\leqα<d$. Our framework covers the case of polynomially bounded monotone dynamics that are especially encountered in the main models of neural oscillators. △ Less

Submitted 2 July, 2014; v1 submitted 28 January, 2013; originally announced January 2013.

Comments: Published in at http://dx.doi.org/10.1214/13-AAP968 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AAP-AAP968

Journal ref: Annals of Applied Probability 2014, Vol. 24, No. 5, 1946-1993

Stability of travelling waves in stochastic Nagumo equations

Authors: Wilhelm Stannat

Abstract: Stability of travelling waves for the Nagumo equation on the whole line is proven using a new approach via functional inequalities and an implicitely defined phase adaption. The approach can be carried over to obtain pathwise stability of travelling wave solutions in the case of the stochastic Nagumo equation as well. The noise term considered is of multiplicative type with variance proportional t… ▽ More Stability of travelling waves for the Nagumo equation on the whole line is proven using a new approach via functional inequalities and an implicitely defined phase adaption. The approach can be carried over to obtain pathwise stability of travelling wave solutions in the case of the stochastic Nagumo equation as well. The noise term considered is of multiplicative type with variance proportional to the distance of the solution to the orbit of the travelling wave solutions. △ Less

Submitted 12 December, 2013; v1 submitted 27 January, 2013; originally announced January 2013.

Comments: Improved version including stochastic stability for all admissible parameters

MSC Class: 60H15; 35R60; 35B35; 35K55; 92A09

Lattice Approximation for Stochastic Reaction Diffusion Equations with One-Sided Lipschitz Condition

Authors: Martin Sauer, Wilhelm Stannat

Abstract: We consider strong convergence of the finite differences approximation in space for stochastic reaction diffusion equations with multiplicative noise under a one-sided Lipschitz condition only. We derive convergence with an implicit rate depending on the regularity of the exact solution. This can be made explicit if the variational solution has more than its canonical spatial regularity. As an app… ▽ More We consider strong convergence of the finite differences approximation in space for stochastic reaction diffusion equations with multiplicative noise under a one-sided Lipschitz condition only. We derive convergence with an implicit rate depending on the regularity of the exact solution. This can be made explicit if the variational solution has more than its canonical spatial regularity. As an application, spatially extended FitzHugh-Nagumo systems with noise are considered. △ Less

Submitted 6 October, 2014; v1 submitted 27 January, 2013; originally announced January 2013.

Comments: 24 pages, 1 figure. This is the prepublication draft of the article published online in Math. Comp. (2014)

MSC Class: 60H15; 35R60; 60H35; 65C30; 92C20

Journal ref: Math. Comp. 84 (2015), 743-766

Stability of the optimal filter in a hidden Markov model with multiplicative noise

Authors: Birgit Debrabant, Wilhelm Stannat

Abstract: We consider a hidden Markov model with multiplicative noise emerging from studies of software reliability. We show the stability of the optimal filter with respect to general initial conditions in the total variation- and $L^p$-norm and deduce explicit rates. Remarkably, stability turns out to be independent of the ergodic behavior of the signal. We consider a hidden Markov model with multiplicative noise emerging from studies of software reliability. We show the stability of the optimal filter with respect to general initial conditions in the total variation- and $L^p$-norm and deduce explicit rates. Remarkably, stability turns out to be independent of the ergodic behavior of the signal. △ Less

Submitted 18 January, 2013; originally announced January 2013.

Comments: 11 pages

MSC Class: 93E11; 93E15; 60G35

Risk-sensitive Markov control processes

Authors: Yun Shen, Wilhelm Stannat, Klaus Obermayer

Abstract: We introduce a general framework for measuring risk in the context of Markov control processes with risk maps on general Borel spaces that generalize known concepts of risk measures in mathematical finance, operations research and behavioral economics. Within the framework, applying weighted norm spaces to incorporate also unbounded costs, we study two types of infinite-horizon risk-sensitive crit… ▽ More We introduce a general framework for measuring risk in the context of Markov control processes with risk maps on general Borel spaces that generalize known concepts of risk measures in mathematical finance, operations research and behavioral economics. Within the framework, applying weighted norm spaces to incorporate also unbounded costs, we study two types of infinite-horizon risk-sensitive criteria, discounted total risk and average risk, and solve the associated optimization problems by dynamic programming. For the discounted case, we propose a new discount scheme, which is different from the conventional form but consistent with the existing literature, while for the average risk criterion, we state Lyapunov-like stability conditions that generalize known conditions for Markov chains to ensure the existence of solutions to the optimality equation. △ Less

Submitted 23 January, 2014; v1 submitted 28 October, 2011; originally announced October 2011.

Comments: 21 pages

MSC Class: 60J05; 93E20; 93C55; 47H07; 91B06

Journal ref: SIAM J. Control Optim., 51(5), 3652-3672, 2013

Estimates for the ergodic measure and polynomial stability of plane stochastic curve shortening flow

Authors: Abelhadi Es-Sarhir, Max von Renesse, Wilhelm Stannat

Abstract: We establish moment estimates for the invariant measure of a stochastic partial differential equation describing motion by mean curvature flow in (1+1) dimension, leading to polynomial stability of the associated Markov semigroup. We also prove maximal dissipativity for the related Kolmogorov operator. We establish moment estimates for the invariant measure of a stochastic partial differential equation describing motion by mean curvature flow in (1+1) dimension, leading to polynomial stability of the associated Markov semigroup. We also prove maximal dissipativity for the related Kolmogorov operator. △ Less

Submitted 11 August, 2010; originally announced August 2010.

MSC Class: 47D07; 60H15; 35R60

Journal ref: NoDEA Nonlinear Differential Equations Appl. 19 (2012), no. 6, 663-675

Improved moment estimates for invariant measures of semilinear diffusions in Hilbert spaces and applications

Authors: Abdelhadi Es-Sarhir, Wilhelm Stannat

Abstract: We study regularity properties for invariant measures of semilinear diffusions in a separable Hilbert space. Based on a pathwise estimate for the underlying stochastic convolution, we prove a priori estimates on such invariant measures. As an application, we combine such estimates with a new technique to prove the $L^1$-uniqueness of the induced Kolmogorov operator, defined on a space of cylindr… ▽ More We study regularity properties for invariant measures of semilinear diffusions in a separable Hilbert space. Based on a pathwise estimate for the underlying stochastic convolution, we prove a priori estimates on such invariant measures. As an application, we combine such estimates with a new technique to prove the $L^1$-uniqueness of the induced Kolmogorov operator, defined on a space of cylindrical functions. Finally, examples of stochastic Burgers equations and thin-film growth models are given to illustrate our abstract result. △ Less

Submitted 11 March, 2010; v1 submitted 6 November, 2009; originally announced November 2009.

Comments: 19 pages

MSC Class: 47D07; 35K90; 60H15; 35R60

Journal ref: J. Funct. Anal. 259 (2010), no. 5, 1248--1272