-
Moment Analysis of Stochastic Hybrid Systems Using Semidefinite Programming
Authors:
Khem Raj Ghusinga,
Andrew Lamperski,
Abhyudai Singh
Abstract:
This paper proposes a semidefinite programming based method for estimating moments of a stochastic hybrid system (SHS). For polynomial SHSs -- which consist of polynomial continuous vector fields, reset maps, and transition intensities -- the dynamics of moments evolve according to a system of linear ordinary differential equations. However, it is generally not possible to solve the system exactly…
▽ More
This paper proposes a semidefinite programming based method for estimating moments of a stochastic hybrid system (SHS). For polynomial SHSs -- which consist of polynomial continuous vector fields, reset maps, and transition intensities -- the dynamics of moments evolve according to a system of linear ordinary differential equations. However, it is generally not possible to solve the system exactly since time evolution of a specific moment may depend upon moments of order higher than it. One way to overcome this problem is to employ so-called moment closure methods that give point approximations to moments, but these are limited in that accuracy of the estimations is unknown. We find lower and upper bounds on a moment of interest via a semidefinite program that includes linear constraints obtained from moment dynamics, along with semidefinite constraints that arise from the non-negativity of moment matrices. These bounds are further shown to improve as the size of semidefinite program is increased. The key insight in the method is a reduction from stochastic hybrid systems with multiple discrete modes to a single-mode hybrid system with algebraic constraints. We further extend the scope of the proposed method to a class of non-polynomial SHSs which can be recast to polynomial SHSs via augmentation of additional states. Finally, we illustrate the applicability of results via examples of SHSs drawn from different disciplines.
△ Less
Submitted 1 February, 2018;
originally announced February 2018.
-
Estimating stationary characteristic functions of stochastic systems via semidefinite programming
Authors:
Khem Raj Ghusinga,
Andrew Lamperski,
Abhyudai Singh
Abstract:
This paper proposes a methodology to estimate characteristic functions of stochastic differential equations that are defined over polynomials and driven by Lévy noise. For such systems, the time evolution of the characteristic function is governed by a partial differential equation; consequently, the stationary characteristic function can be obtained by solving an ordinary differential equation (O…
▽ More
This paper proposes a methodology to estimate characteristic functions of stochastic differential equations that are defined over polynomials and driven by Lévy noise. For such systems, the time evolution of the characteristic function is governed by a partial differential equation; consequently, the stationary characteristic function can be obtained by solving an ordinary differential equation (ODE). However, except for a few special cases such as linear systems, the solution to the ODE consists of unknown coefficients. These coefficients are closely related with the stationary moments of the process, and bounds on these can be obtained by utilizing the fact that the characteristic function is positive definite. These bounds can be further used to find bounds on other higher order stationary moments and also estimate the stationary characteristic function itself. The method is finally illustrated via examples.
△ Less
Submitted 16 November, 2017;
originally announced November 2017.
-
Driving an Ornstein--Uhlenbeck Process to Desired First-Passage Time Statistics
Authors:
Khem Raj Ghusinga,
Vaibhav Srivastava,
Abhyudai Singh
Abstract:
First-passage time (FPT) of an Ornstein-Uhlenbeck (OU) process is of immense interest in a variety of contexts. This paper considers an OU process with two boundaries, one of which is absorbing while the other one could be either reflecting or absorbing, and studies the control strategies that can lead to desired FPT moments. Our analysis shows that the FPT distribution of an OU process is scale i…
▽ More
First-passage time (FPT) of an Ornstein-Uhlenbeck (OU) process is of immense interest in a variety of contexts. This paper considers an OU process with two boundaries, one of which is absorbing while the other one could be either reflecting or absorbing, and studies the control strategies that can lead to desired FPT moments. Our analysis shows that the FPT distribution of an OU process is scale invariant with respect to the drift parameter, i.e., the drift parameter just controls the mean FPT and doesn't affect the shape of the distribution. This allows to independently control the mean and coefficient of variation (CV) of the FPT. We show that that increasing the threshold may increase or decrease CV of the FPT, depending upon whether or not one of the threshold is reflecting. We also explore the effect of control parameters on the FPT distribution, and find parameters that minimize the distance between the FPT distribution and a desired distribution.
△ Less
Submitted 26 March, 2017;
originally announced March 2017.
-
Approximate moment dynamics for polynomial and trigonometric stochastic systems
Authors:
Khem Raj Ghusinga,
Mohammad Soltani,
Andrew Lamperski,
Sairaj Dhople,
Abhyudai Singh
Abstract:
Stochastic dynamical systems often contain nonlinearities which make it hard to compute probability density functions or statistical moments of these systems. For the moment computations, nonlinearities in the dynamics lead to unclosed moment dynamics; in particular, the time evolution of a moment of a specific order may depend both on moments of order higher than it and on some nonlinear function…
▽ More
Stochastic dynamical systems often contain nonlinearities which make it hard to compute probability density functions or statistical moments of these systems. For the moment computations, nonlinearities in the dynamics lead to unclosed moment dynamics; in particular, the time evolution of a moment of a specific order may depend both on moments of order higher than it and on some nonlinear function of other moments. The moment closure techniques are used to find an approximate, close system of equations the moment dynamics. In this work, we extend a moment closure technique based on derivative matching that was originally proposed for polynomial stochastic systems with discrete states to continuous state stochastic systems to continuous state stochastic differential equations, with both polynomial and trigonometric nonlinearities. We validate the technique using two examples of nonlinear stochastic systems.
△ Less
Submitted 26 March, 2017;
originally announced March 2017.
-
Analysis and Control of Stochastic Systems using Semidefinite Programming over Moments
Authors:
Andrew Lamperski,
Khem Raj Ghusinga,
Abhyudai Singh
Abstract:
This paper develops a unified methodology for probabilistic analysis and optimal control design for jump diffusion processes defined by polynomials. For such systems, the evolution of the moments of the state can be described via a system of linear ordinary differential equations. Typically, however, the moments are not closed and an infinite system of equations is required to compute statistical…
▽ More
This paper develops a unified methodology for probabilistic analysis and optimal control design for jump diffusion processes defined by polynomials. For such systems, the evolution of the moments of the state can be described via a system of linear ordinary differential equations. Typically, however, the moments are not closed and an infinite system of equations is required to compute statistical moments exactly. Existing methods for stochastic analysis, known as closure methods, focus on approximating this infinite system of equations with a finite dimensional system. This work develops an alternative approach in which the higher order terms, which are approximated in closure methods, are viewed as inputs to a finite-dimensional linear control system. Under this interpretation, upper and lower bounds of statistical moments can be computed via convex linear optimal control problems with semidefinite constraints. For analysis of steady-state distributions, this optimal control problem reduces to a static semidefinite program. These same optimization problems extend automatically to stochastic optimal control problems. For minimization problems, the methodology leads to guaranteed lower bounds on the true optimal value. Furthermore, we show how an approximate optimal control strategy can be constructed from the solution of the semidefinite program. The results are illustrated using numerous examples.
△ Less
Submitted 1 February, 2017;
originally announced February 2017.
-
Bounds on stationary moments in stochastic chemical kinetics
Authors:
Khem Raj Ghusinga,
Cesar A. Vargas-Garcia,
Andrew Lamperski,
Abhyudai Singh
Abstract:
In the stochastic formulation of chemical kinetics, the stationary moments of the population count of species can be described via a set of linear equations. However, except for some specific cases such as systems with linear reaction propensities, the moment equations are underdetermined as a lower order moment might depend upon a higher order moment. Here, we propose a method to find lower, and…
▽ More
In the stochastic formulation of chemical kinetics, the stationary moments of the population count of species can be described via a set of linear equations. However, except for some specific cases such as systems with linear reaction propensities, the moment equations are underdetermined as a lower order moment might depend upon a higher order moment. Here, we propose a method to find lower, and upper bounds on stationary moments of molecular counts in a chemical reaction system. The method exploits the fact that statistical moments of any positive-valued random variable must satisfy some constraints. Such constraints can be expressed as nonlinear inequalities on moments in terms of their lower order moments, and solving them in conjugation with the stationary moment equations results in bounds on the moments. Using two examples of biochemical systems, we illustrate that not only one obtains upper and lower bounds on a given stationary moment, but these bounds also improve as one uses more moment equations and utilizes the inequalities for the corresponding higher order moments. Our results provide avenues for development of moment approximations that provide explicit bounds on moment dynamics for systems whose dynamics are otherwise intractable.
△ Less
Submitted 30 December, 2016;
originally announced December 2016.
-
Effect of gene-expression bursts on stochastic timing of cellular events
Authors:
Khem Raj Ghusinga,
Abhyudai Singh
Abstract:
Gene expression is inherently a noisy process which manifests as cell-to-cell variability in time evolution of proteins. Consequently, events that trigger at critical threshold levels of regulatory proteins exhibit stochasticity in their timing. An important contributor to the noise in gene expression is translation bursts which correspond to randomness in number of proteins produced in a single m…
▽ More
Gene expression is inherently a noisy process which manifests as cell-to-cell variability in time evolution of proteins. Consequently, events that trigger at critical threshold levels of regulatory proteins exhibit stochasticity in their timing. An important contributor to the noise in gene expression is translation bursts which correspond to randomness in number of proteins produced in a single mRNA lifetime. Modeling timing of an event as a first-passage time (FPT) problem, we explore the effect of burst size distribution on event timing. Towards this end, the probability density function of FPT is computed for a gene expression model with burst size drawn from a generic non-negative distribution. Analytical formulas for FPT moments are provided in terms of known vectors and inverse of a matrix. The effect of burst size distribution is investigated by looking at how the feedback regulation strategy that minimizes noise in timing around a given time deviates from the case when burst is deterministic. Interestingly, results show that the feedback strategy for deterministic burst case is quite robust to change in burst size distribution, and deviations from it are confined to about 20% of the optimal value. These findings facilitate an improved understanding of noise regulation in event timing.
△ Less
Submitted 23 September, 2016;
originally announced September 2016.
-
Stochastic optimal control using semidefinite programming for moment dynamics
Authors:
Andrew Lamperski,
Khem Raj Ghusinga,
Abhyudai Singh
Abstract:
This paper presents a method to approximately solve stochastic optimal control problems in which the cost function and the system dynamics are polynomial. For stochastic systems with polynomial dynamics, the moments of the state can be expressed as a, possibly infinite, system of deterministic linear ordinary differential equations. By casting the problem as a deterministic control problem in mome…
▽ More
This paper presents a method to approximately solve stochastic optimal control problems in which the cost function and the system dynamics are polynomial. For stochastic systems with polynomial dynamics, the moments of the state can be expressed as a, possibly infinite, system of deterministic linear ordinary differential equations. By casting the problem as a deterministic control problem in moment space, semidefinite programming is used to find a lower bound on the optimal solution. The constraints in the semidefinite program are imposed by the ordinary differential equations for moment dynamics and semidefiniteness of the outer product of moments. From the solution to the semidefinite program, an approximate optimal control strategy can be constructed using a least squares method. In the linear quadratic case, the method gives an exact solution to the optimal control problem. In more complex problems, an infinite number of moment differential equations would be required to compute the optimal control law. In this case, we give a procedure to increase the size of the semidefinite program, leading to increasingly accurate approximations to the true optimal control strategy.
△ Less
Submitted 20 March, 2016;
originally announced March 2016.
-
A mechanistic first--passage time framework for bacterial cell-division timing
Authors:
Khem Raj Ghusinga,
Cesar A. Vargas-Garcia,
Abhyudai Singh
Abstract:
How exponentially growing cells maintain size homeostasis is an important fundamental problem. Recent single-cell studies in prokaryotes have uncovered the adder principle, where cells on average, add a fixed size (volume) from birth to division. Interestingly, this added volume differs considerably among genetically-identical newborn cells with similar sizes suggesting a stochastic component in t…
▽ More
How exponentially growing cells maintain size homeostasis is an important fundamental problem. Recent single-cell studies in prokaryotes have uncovered the adder principle, where cells on average, add a fixed size (volume) from birth to division. Interestingly, this added volume differs considerably among genetically-identical newborn cells with similar sizes suggesting a stochastic component in the timing of cell-division. To mechanistically explain the adder principle, we consider a time-keeper protein that begins to get stochastically expressed after cell birth at a rate proportional to the volume. Cell-division time is formulated as the first-passage time for protein copy numbers to hit a fixed threshold. Consistent with data, the model predicts that while the mean cell-division time decreases with increasing size of newborns, the noise in timing increases with size at birth. Intriguingly, our results show that the distribution of the volume added between successive cell-division events is independent of the newborn cell size. This was dramatically seen in experimental studies, where histograms of the added volume corresponding to different newborn sizes collapsed on top of each other. The model provides further insights consistent with experimental observations: the distributions of the added volume and the cell-division time when scaled by their respective means become invariant of the growth rate. Finally, we discuss various modifications to the proposed model that lead to deviations from the adder principle. In summary, our simple yet elegant model explains key experimental findings and suggests a mechanism for regulating both the mean and fluctuations in cell-division timing for size control.
△ Less
Submitted 24 December, 2015;
originally announced December 2015.
-
Optimal regulation of protein degradation to schedule cellular events with precision
Authors:
Khem Raj Ghusinga,
Abhyudai Singh
Abstract:
An important occurrence in many cellular contexts is the crossing of a prescribed threshold by a regulatory protein. The timing of such events is stochastic as a consequence of the innate randomness in gene expression. A question of interest is to understand how gene expression is regulated to achieve precision in event timing. To address this, we model event timing using the first-passage time fr…
▽ More
An important occurrence in many cellular contexts is the crossing of a prescribed threshold by a regulatory protein. The timing of such events is stochastic as a consequence of the innate randomness in gene expression. A question of interest is to understand how gene expression is regulated to achieve precision in event timing. To address this, we model event timing using the first-passage time framework - a mathe- matical tool to analyze the time when a stochastic process first crosses a specific threshold. The protein evolution is described via a simple stochastic model of gene expression. Moreover, we consider the feedback regulation of protein degradation to be a possible noise control mechanism employed to achieve the precision. Exact analytical formulas are developed for the distribution and moments of the first-passage time. Using these expressions, we investigate for the optimal feedback strategy such that noise (coefficient of variation squared) in event timing is minimized around a given fixed mean time. Our results show that the minimum noise is achieved when the protein degradation rate is zero for all protein levels. Lastly, the implications of this finding are discussed.
△ Less
Submitted 2 October, 2015;
originally announced October 2015.
-
Optimal first-passage time in gene regulatory networks
Authors:
Khem Raj Ghusinga,
Abhyudai Singh
Abstract:
The inherent probabilistic nature of the biochemical reactions, and low copy number of species can lead to stochasticity in gene expression across identical cells. As a result, after induction of gene expression, the time at which a specific protein count is reached is stochastic as well. Therefore events taking place at a critical protein level will see stochasticity in their timing. First-passag…
▽ More
The inherent probabilistic nature of the biochemical reactions, and low copy number of species can lead to stochasticity in gene expression across identical cells. As a result, after induction of gene expression, the time at which a specific protein count is reached is stochastic as well. Therefore events taking place at a critical protein level will see stochasticity in their timing. First-passage time (FPT), the time at which a stochastic process hits a critical threshold, provides a framework to model such events. Here, we investigate stochasticity in FPT. Particularly, we consider events for which controlling stochasticity is advantageous. As a possible regulatory mechanism, we also investigate effect of auto-regulation, where the transcription rate of gene depends on protein count, on stochasticity of FPT. Specifically, we investigate for an optimal auto-regulation which minimizes stochasticity in FPT, given fixed mean FPT and threshold.
For this purpose, we model the gene expression at a single cell level. We find analytic formulas for statistical moments of the FPT in terms of model parameters. Moreover, we examine the gene expression model with auto-regulation. Interestingly, our results show that the stochasticity in FPT, for a fixed mean, is minimized when the transcription rate is independent of protein count. Further, we discuss the results in context of lysis time of an \textit{E. coli} cell infected by a $λ$ phage virus. An optimal lysis time provides evolutionary advantage to the $λ$ phage, suggesting a possible regulation to minimize its stochasticity. Our results indicate that there is no auto-regulation of the protein responsible for lysis. Moreover, congruent to experimental evidences, our analysis predicts that the expression of the lysis protein should have a small burst size.
△ Less
Submitted 13 May, 2014;
originally announced May 2014.
