-
Estimation When Both Covariance And Precision Matrices Are Sparse
Authors:
Shev Macnamara,
Erik Schlögl,
Zdravko I. Botev
Abstract:
We offer a method to estimate a covariance matrix in the special case that \textit{both} the covariance matrix and the precision matrix are sparse --- a constraint we call double sparsity. The estimation method is maximum likelihood, subject to the double sparsity constraint. In our method, only a particular class of sparsity pattern is allowed: both the matrix and its inverse must be subordinate…
▽ More
We offer a method to estimate a covariance matrix in the special case that \textit{both} the covariance matrix and the precision matrix are sparse --- a constraint we call double sparsity. The estimation method is maximum likelihood, subject to the double sparsity constraint. In our method, only a particular class of sparsity pattern is allowed: both the matrix and its inverse must be subordinate to the same chordal graph. Compared to a naive enforcement of double sparsity, our chordal graph approach exploits a special algebraic local inverse formula. This local inverse property makes computations that would usually involve an inverse (of either precision matrix or covariance matrix) much faster. In the context of estimation of covariance matrices, our proposal appears to be the first to find such special pairs of covariance and precision matrices.
△ Less
Submitted 14 August, 2021;
originally announced August 2021.
-
Positivity-preserving methods for population models
Authors:
Sergio Blanes,
Arieh Iserles,
Shev Macnamara
Abstract:
Many important applications are modelled by differential equations with positive solutions. However, it remains an outstanding open problem to develop numerical methods that are both (i) of a high order of accuracy and (ii) capable of preserving positivity. It is known that the two main families of numerical methods, Runge-Kutta methods and multistep methods, face an order barrier: if they preserv…
▽ More
Many important applications are modelled by differential equations with positive solutions. However, it remains an outstanding open problem to develop numerical methods that are both (i) of a high order of accuracy and (ii) capable of preserving positivity. It is known that the two main families of numerical methods, Runge-Kutta methods and multistep methods, face an order barrier: if they preserve positivity, then they are constrained to low accuracy: they cannot be better than first order. We propose novel methods that overcome this barrier: our methods are of second order, and they are guaranteed to preserve positivity. Our methods apply to a large class of differential equations that have a special graph Laplacian structure, which we elucidate. The equations need be neither linear nor autonomous and the graph Laplacian need not be symmetric. This algebraic structure arises naturally in many important applications where positivity is required. We showcase our new methods on applications where standard high order methods fail to preserve positivity, including infectious diseases, Markov processes, master equations and chemical reactions.
△ Less
Submitted 2 May, 2022; v1 submitted 16 February, 2021;
originally announced February 2021.
-
The reflectionless properties of Toeplitz waves and Hankel waves: an analysis via Bessel functions
Authors:
Kevin Burrage,
Pamela Burrage,
Shev MacNamara
Abstract:
We study reflectionless properties at the boundary for the wave equation in one space dimension and time, in terms of a well-known matrix that arises from a simple discretisation of space. It is known that all matrix functions of the familiar second difference matrix representing the Laplacian in this setting are the sum of a Toeplitz matrix and a Hankel matrix. The solution to the wave equation i…
▽ More
We study reflectionless properties at the boundary for the wave equation in one space dimension and time, in terms of a well-known matrix that arises from a simple discretisation of space. It is known that all matrix functions of the familiar second difference matrix representing the Laplacian in this setting are the sum of a Toeplitz matrix and a Hankel matrix. The solution to the wave equation is one such matrix function. Here, we study the behaviour of the corresponding waves that we call Toeplitz waves and Hankel waves. We show that these waves can be written as certain linear combinations of even Bessel functions of the first kind. We find exact and explicit formulae for these waves. We also show that the Toeplitz and Hankel waves are reflectionless on even, respectively odd, traversals of the domain. Our analysis naturally suggests a new method of computer simulation that allows control, so that it is possible to choose -- in advance -- the number of reflections. An attractive result that comes out of our analysis is the appearance of the well-known shift matrix, and also other matrices that might be thought of as Hankel versions of the shift matrix. By revealing the algebraic structure of the solution in terms of shift matrices, we make it clear how the Toeplitz and Hankel waves are indeed reflectionless at the boundary on even or odd traversals. Although the subject of the reflectionless boundary condition has a long history, we believe the point of view that we adopt here in terms of matrix functions is new.
△ Less
Submitted 9 May, 2020;
originally announced May 2020.
-
Kernel Density Estimation with Linked Boundary Conditions
Authors:
Matthew J. Colbrook,
Zdravko I. Botev,
Karsten Kuritz,
Shev MacNamara
Abstract:
Kernel density estimation on a finite interval poses an outstanding challenge because of the well-recognized bias at the boundaries of the interval. Motivated by an application in cancer research, we consider a boundary constraint linking the values of the unknown target density function at the boundaries. We provide a kernel density estimator (KDE) that successfully incorporates this linked bound…
▽ More
Kernel density estimation on a finite interval poses an outstanding challenge because of the well-recognized bias at the boundaries of the interval. Motivated by an application in cancer research, we consider a boundary constraint linking the values of the unknown target density function at the boundaries. We provide a kernel density estimator (KDE) that successfully incorporates this linked boundary condition, leading to a non-self-adjoint diffusion process and expansions in non-separable generalized eigenfunctions. The solution is rigorously analyzed through an integral representation given by the unified transform (or Fokas method). The new KDE possesses many desirable properties, such as consistency, asymptotically negligible bias at the boundaries, and an increased rate of approximation, as measured by the AMISE. We apply our method to the motivating example in biology and provide numerical experiments with synthetic data, including comparisons with state-of-the-art KDEs (which currently cannot handle linked boundary constraints). Results suggest that the new method is fast and accurate. Furthermore, we demonstrate how to build statistical estimators of the boundary conditions satisfied by the target function without apriori knowledge. Our analysis can also be extended to more general boundary conditions that may be encountered in applications.
△ Less
Submitted 2 June, 2020; v1 submitted 20 September, 2018;
originally announced September 2018.
-
Wider contours and adaptive contours
Authors:
Shev MacNamara,
William McLean,
Kevin Burrage
Abstract:
Contour integrals in the complex plane are the basis of effective numerical methods for computing matrix functions, such as the matrix exponential and the Mittag-Leffler function. These methods provide successful ways to solve partial differential equations, such as convection--diffusion models. Part of the success of these methods comes from exploiting the freedom to choose the contour, by appeal…
▽ More
Contour integrals in the complex plane are the basis of effective numerical methods for computing matrix functions, such as the matrix exponential and the Mittag-Leffler function. These methods provide successful ways to solve partial differential equations, such as convection--diffusion models. Part of the success of these methods comes from exploiting the freedom to choose the contour, by appealing to Cauchy's theorem. However, the pseudospectra of non-normal matrices or operators present a challenge for these methods: if the contour is too close to regions where the norm of the resolvent matrix is large, then the accuracy suffers. Important applications that involve non-normal matrices or operators include the Black--Scholes equation of finance, and Fokker--Planck equations for stochastic models arising in biology. Consequently, it is crucial to choose the contour carefully. As a remedy, we discuss choosing a contour that is wider than it might otherwise have been for a normal matrix or operator. We also suggest a semi-analytic approach to adapting the contour, in the form of a parabolic bound that is derived by estimating the field of values. To demonstrate the utility of the approaches that we advocate, we study three models in biology: a monomolecular reaction, a bimolecular reaction and a trimolecular reaction. Modelling and simulation of these reactions is done within the framework of Markov processes. We also consider non-Markov generalisations that have Mittag-Leffler waiting times instead of the usual exponential waiting times of a Markov process.
△ Less
Submitted 19 December, 2017;
originally announced December 2017.
-
Magnus expansions and pseudospectra of Master Equations
Authors:
Arieh Iserles,
Shev MacNamara
Abstract:
New directions in research on master equations are showcased by example. Magnus expansions, time-varying rates, and pseudospectra are highlighted. Exact eigenvalues are found and contrasted with the large errors produced by standard numerical methods in some cases. Isomerisation provides a running example and an illustrative application to chemical kinetics. We also give a brief example of the tot…
▽ More
New directions in research on master equations are showcased by example. Magnus expansions, time-varying rates, and pseudospectra are highlighted. Exact eigenvalues are found and contrasted with the large errors produced by standard numerical methods in some cases. Isomerisation provides a running example and an illustrative application to chemical kinetics. We also give a brief example of the totally asymmetric exclusion process.
△ Less
Submitted 10 January, 2017;
originally announced January 2017.
-
Error Control for Exponential Integration of the Master Equation
Authors:
Katharina Kormann,
Shev MacNamara
Abstract:
Error estimates for the numerical solution of the master equation are presented. Estimates are based on adjoint methods. We find that a good estimate can often be computed without spending computational effort on a dual problem. Estimates are applicable to both settings with time-independent, and time-dependent propensity functions. The Finite State Projection algorithm reduces the dimensionality…
▽ More
Error estimates for the numerical solution of the master equation are presented. Estimates are based on adjoint methods. We find that a good estimate can often be computed without spending computational effort on a dual problem. Estimates are applicable to both settings with time-independent, and time-dependent propensity functions. The Finite State Projection algorithm reduces the dimensionality of the problem and time propagation is based on an Arnoldi exponential integrator, which in the time-dependent setting is combined with a Magnus method. Local error estimates are devised for the truncation of both the Magnus expansion and the Krylov subspace in the Arnoldi algorithm. An issue with existing methods is that error estimates for truncation of the state space depend on measuring a loss of probability mass in a way that is not usually compatible with the approximation of the exponential. We suggest an alternative error estimate that is compatible with a Krylov approximation to the matrix exponential. Finally, we apply the new error estimates to develop an adaptive simulation algorithm. Numerical examples demonstrate the benefits of the approach.
△ Less
Submitted 11 October, 2016;
originally announced October 2016.
-
Robustness analysis of spatiotemporal models in the presence of extrinsic fluctuations
Authors:
Andreas Hellander,
Jan Klosa,
Per Lötstedt,
Shev MacNamara
Abstract:
We analyze the governing partial differential equations of a model of pole-to-pole oscillations of the MinD protein in a bacterial cell. The sensitivity to extrinsic noise in the parameters of the model is explored. Our analysis shows that overall, the oscillations are robust to extrinsic perturbations in the sense that small perturbations in reaction coefficients result in small differences in th…
▽ More
We analyze the governing partial differential equations of a model of pole-to-pole oscillations of the MinD protein in a bacterial cell. The sensitivity to extrinsic noise in the parameters of the model is explored. Our analysis shows that overall, the oscillations are robust to extrinsic perturbations in the sense that small perturbations in reaction coefficients result in small differences in the frequency and in the amplitude. However, a combination of analysis and simulation also reveals that the oscillations are more sensitive to some extrinsic time-scales than to others.
△ Less
Submitted 5 October, 2016;
originally announced October 2016.
-
A Local Inverse Formula and a Factorization
Authors:
Gilbert Strang,
Shev MacNamara
Abstract:
When a matrix has a banded inverse there is a remarkable formula that quickly computes that inverse, using only local information in the original matrix. This local inverse formula holds more generally, for matrices with sparsity patterns that are examples of chordal graphs or perfect eliminators. The formula has a long history going back at least as far as the completion problem for covariance ma…
▽ More
When a matrix has a banded inverse there is a remarkable formula that quickly computes that inverse, using only local information in the original matrix. This local inverse formula holds more generally, for matrices with sparsity patterns that are examples of chordal graphs or perfect eliminators. The formula has a long history going back at least as far as the completion problem for covariance matrices with missing data. Maximum entropy estimates, log-determinants, rank conditions, the Nullity Theorem and wavelets are all closely related, and the formula has found wide applications in machine learning and graphical models. We describe that local inverse and explain how it can be understood as a matrix factorization.
△ Less
Submitted 4 October, 2016;
originally announced October 2016.
-
Fractional Euler Limits and Their Applications
Authors:
Shev MacNamara,
Bruce I Henry,
William McLean
Abstract:
Generalisations of the classical Euler formula to the setting of fractional calculus are discussed. Compound interest and fractional compound interest serve as motivation. Connections to fractional master equations are highlighted. An application to the Schlogl reactions with Mittag-Leffler waiting times is described.
Generalisations of the classical Euler formula to the setting of fractional calculus are discussed. Compound interest and fractional compound interest serve as motivation. Connections to fractional master equations are highlighted. An application to the Schlogl reactions with Mittag-Leffler waiting times is described.
△ Less
Submitted 10 September, 2016;
originally announced September 2016.
