-
Effective filtering approach for joint parameter-state estimation in SDEs via Rao-Blackwellization and modularization
Authors:
Zhou Fang,
Ankit Gupta,
Mustafa Khammash
Abstract:
Stochastic filtering is a vibrant area of research in both control theory and statistics, with broad applications in many scientific fields. Despite its extensive historical development, there still lacks an effective method for joint parameter-state estimation in SDEs. The state-of-the-art particle filtering methods suffer from either sample degeneracy or information loss, with both issues stemmi…
▽ More
Stochastic filtering is a vibrant area of research in both control theory and statistics, with broad applications in many scientific fields. Despite its extensive historical development, there still lacks an effective method for joint parameter-state estimation in SDEs. The state-of-the-art particle filtering methods suffer from either sample degeneracy or information loss, with both issues stemming from the dynamics of the particles generated to represent system parameters.
This paper provides a novel and effective approach for joint parameter-state estimation in SDEs via Rao-Blackwellization and modularization. Our method operates in two layers: the first layer estimates the system states using a bootstrap particle filter, and the second layer marginalizes out system parameters explicitly. This strategy circumvents the need to generate particles representing system parameters, thereby mitigating their associated problems of sample degeneracy and information loss. Moreover, our method employs a modularization approach when integrating out the parameters, which significantly reduces the computational complexity. All these designs ensure the superior performance of our method. Finally, a numerical example is presented to illustrate that our method outperforms existing approaches by a large margin.
△ Less
Submitted 1 November, 2023;
originally announced November 2023.
-
Noise in Biomolecular Systems: Modeling, Analysis, and Control Implications
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
While noise is generally associated with uncertainties and often has a negative connotation in engineering, living organisms have evolved to adapt to (and even exploit) such uncertainty to ensure the survival of a species or implement certain functions that would have been difficult or even impossible otherwise. In this article, we review the role and impact of noise in systems and synthetic biolo…
▽ More
While noise is generally associated with uncertainties and often has a negative connotation in engineering, living organisms have evolved to adapt to (and even exploit) such uncertainty to ensure the survival of a species or implement certain functions that would have been difficult or even impossible otherwise. In this article, we review the role and impact of noise in systems and synthetic biology, with a particular emphasis on its role in the genetic control of biological systems, an area we refer to as Cybergenetics. The main modeling paradigm is that of stochastic reaction networks, whose applicability goes beyond biology, as these networks can represent any population dynamics system, including ecological, epidemiological, and opinion dynamics networks. We review different ways to mathematically represent these systems, and we notably argue that the concept of ergodicity presents a particularly suitable way to characterize their stability. We then discuss noise-induced properties and show that noise can be both an asset and a nuisance in this setting. Finally, we discuss recent results on (stochastic) Cybergenetics and explore their relationships to noise. Along the way, we detail the different technical and biological constraints that need to be respected when designing synthetic biological circuits. Finally, we discuss the concepts, problems, and solutions exposed in the article; raise criticisms and concerns about current ideas and approaches; suggest current (open) problems with potential solutions; and provide some ideas for future research directions.
△ Less
Submitted 28 September, 2022;
originally announced September 2022.
-
On the Innocuousness of Deterministic p-type Antithetic Integral Controllers Arising in Integral Rein Control
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
The innocuousness property of a controller is that property that makes the closed-loop system stable regardless the values of the controller parameters. In other words, the closed-loop system exhibits some structural stability property with respect to the parameters of the controller. The innocuousness property was first emphasized in [Briat, Gupta, and Khammash, Cell Systems, 2016] where it was s…
▽ More
The innocuousness property of a controller is that property that makes the closed-loop system stable regardless the values of the controller parameters. In other words, the closed-loop system exhibits some structural stability property with respect to the parameters of the controller. The innocuousness property was first emphasized in [Briat, Gupta, and Khammash, Cell Systems, 2016] where it was shown that for stochastic unimolecular networks, the Antithetic Integral Controller (AIC) is innocuous under very mild conditions on the controlled network; namely the ergodicity and the output-controllability of the open-loop network, and the admissibility of the set-point value. We show here that the class of p-type AIC controllers arising in the use of Antithetic Integral Rein Controllers (AIRC) also exhibit such a property. It is shown in the unimolecular reaction network case that the closed-loop network is structurally stable with respect to the controller parameters provided that the open-loop dynamics is stable and that the set-point is admissible. Those results are then extended to the case of so-called output unstable linear systems and to stable nonlinear networks. Analogous results are obtained for exponential and logistic integral controllers. Some examples are given for illustration.
△ Less
Submitted 1 March, 2022; v1 submitted 31 January, 2022;
originally announced January 2022.
-
Design of a synthetic integral feedback circuit: dynamic analysis and DNA implementation
Authors:
Corentin Briat,
Christoph Zechner,
Mustafa Khammash
Abstract:
The design and implementation of regulation motifs ensuring robust perfect adaptation are challenging problems in synthetic biology. Indeed, the design of high-yield robust metabolic pathways producing, for instance, drug precursors and biofuels, could be easily imagined to rely on such a control strategy in order to optimize production levels and reduce production costs, despite the presence of e…
▽ More
The design and implementation of regulation motifs ensuring robust perfect adaptation are challenging problems in synthetic biology. Indeed, the design of high-yield robust metabolic pathways producing, for instance, drug precursors and biofuels, could be easily imagined to rely on such a control strategy in order to optimize production levels and reduce production costs, despite the presence of environmental disturbance and model uncertainty. We propose here a motif that ensures tracking and robust perfect adaptation for the controlled reaction network through integral feedback. Its metabolic load on the host is fully tunable and can be made arbitrarily close to the constitutive limit, the universal minimal metabolic load of all possible controllers. A DNA implementation of the controller network is finally provided. Computer simulations using realistic parameters demonstrate the good agreement between the DNA implementation and the ideal controller dynamics.
△ Less
Submitted 19 December, 2021;
originally announced December 2021.
-
Optimal and $H_\infty$ Control of Stochastic Reaction Networks
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
Stochastic reaction networks is a powerful class of models for the representation a wide variety of population models including biochemistry. The control of such networks has been recently considered due to their important implications for the control of biological systems. Their optimal control, however, has been relatively few studied until now. The continuous-time finite-horizon optimal control…
▽ More
Stochastic reaction networks is a powerful class of models for the representation a wide variety of population models including biochemistry. The control of such networks has been recently considered due to their important implications for the control of biological systems. Their optimal control, however, has been relatively few studied until now. The continuous-time finite-horizon optimal control problem is formulated first and explicitly solved in the case of unimolecular reaction networks. The problems of the optimal sampled-data control, the continuous $H_\infty$ control, and the sampled-data $H_\infty$ control of such networks are addressed next. The results in the unimolecular case take the form of nonstandard Riccati differential equations or differential Lyapunov equations coupled with difference Riccati equations, which can all be solved numerically by backward-in-time integration.
△ Less
Submitted 14 July, 2023; v1 submitted 29 November, 2021;
originally announced November 2021.
-
Stochastic filters based on hybrid approximations of multiscale stochastic reaction networks
Authors:
Zhou Fang,
Ankit Gupta,
Mustafa Khammash
Abstract:
We consider the problem of estimating the dynamic latent states of an intracellular multiscale stochastic reaction network from time-course measurements of fluorescent reporters. We first prove that accurate solutions to the filtering problem can be constructed by solving the filtering problem for a reduced model that represents the dynamics as a hybrid process. The model reduction is based on exp…
▽ More
We consider the problem of estimating the dynamic latent states of an intracellular multiscale stochastic reaction network from time-course measurements of fluorescent reporters. We first prove that accurate solutions to the filtering problem can be constructed by solving the filtering problem for a reduced model that represents the dynamics as a hybrid process. The model reduction is based on exploiting the time-scale separations in the original network, and it can greatly reduce the computational effort required to simulate the dynamics. This enables us to develop efficient particle filters to solve the filtering problem for the original model by applying particle filters to the reduced model. We illustrate the accuracy and the computational efficiency of our approach using a numerical example.
△ Less
Submitted 8 September, 2020; v1 submitted 26 August, 2020;
originally announced August 2020.
-
Ergodicity, Output-Controllability, and Antithetic Integral Control of Uncertain Stochastic Reaction Networks
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
The ergodicity and the output-controllability of stochastic reaction networks have been shown to be essential properties to fulfill to enable their control using, for instance, antithetic integral control. We propose here to extend those properties to the case of uncertain networks. To this aim, the notions of interval, robust, sign, and structural ergodicity/output-controllability are introduced.…
▽ More
The ergodicity and the output-controllability of stochastic reaction networks have been shown to be essential properties to fulfill to enable their control using, for instance, antithetic integral control. We propose here to extend those properties to the case of uncertain networks. To this aim, the notions of interval, robust, sign, and structural ergodicity/output-controllability are introduced. The obtained results lie in the same spirit as those obtained in [Briat, Gupta & Khammash, Cell Systems, 2016] where those properties are characterized in terms of control theoretic concepts, linear algebraic conditions, linear programs, and graph-theoretic/algebraic conditions. An important conclusion is that all those properties can be characterized by linear programs. Two examples are given for illustration.
△ Less
Submitted 23 June, 2020; v1 submitted 3 January, 2020;
originally announced January 2020.
-
A hidden integral structure endows Absolute Concentration Robust systems with resilience to dynamical concentration disturbances
Authors:
Daniele Cappelletti,
Ankit Gupta,
Mustafa Khammash
Abstract:
Biochemical systems that express certain chemical species of interest at the same level at any positive equilibrium are called "absolute concentration robust" (ACR). These species behave in a stable, predictable way, in the sense that their expression is robust with respect to sudden changes in the species concentration, regardless the new positive equilibrium reached by the system. Such a propert…
▽ More
Biochemical systems that express certain chemical species of interest at the same level at any positive equilibrium are called "absolute concentration robust" (ACR). These species behave in a stable, predictable way, in the sense that their expression is robust with respect to sudden changes in the species concentration, regardless the new positive equilibrium reached by the system. Such a property has been proven to be fundamentally important in certain gene regulatory networks and signaling systems. In the present paper, we mathematically prove that a well-known class of ACR systems studied by Shinar and Feinberg in 2010 hides an internal integral structure. This structure confers these systems with a higher degree of robustness that what was previously unknown. In particular, disturbances much more general than sudden changes in the species concentrations can be rejected, and robust perfect adaptation is achieved. Significantly, we show that these properties are maintained when the system is interconnected with other chemical reaction networks. This key feature enables design of insulator devices that are able to buffer the loading effect from downstream systems - a crucial requirement for modular circuit design in synthetic biology.
△ Less
Submitted 12 October, 2019;
originally announced October 2019.
-
A finite state projection method for steady-state sensitivity analysis of stochastic reaction networks
Authors:
Patrik Dürrenberger,
Ankit Gupta,
Mustafa Khammash
Abstract:
Consider the standard stochastic reaction network model where the dynamics is given by a continuous-time Markov chain over a discrete lattice. For such models, estimation of parameter sensitivities is an important problem, but the existing computational approaches to solve this problem usually require time-consuming Monte Carlo simulations of the reaction dynamics. Therefore these simulation-based…
▽ More
Consider the standard stochastic reaction network model where the dynamics is given by a continuous-time Markov chain over a discrete lattice. For such models, estimation of parameter sensitivities is an important problem, but the existing computational approaches to solve this problem usually require time-consuming Monte Carlo simulations of the reaction dynamics. Therefore these simulation-based approaches can only be expected to work over finite time-intervals, while it is often of interest in applications to examine the sensitivity values at the steady-state after the Markov chain has relaxed to its stationary distribution. The aim of this paper is to present a computational method for the estimation of steady-state parameter sensitivities, which instead of using simulations, relies on the recently developed stationary Finite State Projection (sFSP) algorithm [J. Chem. Phys. 147, 154101 (2017)] that provides an accurate estimate of the stationary distribution at a fixed set of parameters. We show that sensitivity values at these parameters can be estimated from the solution of a Poisson equation associated with the infinitesimal generator of the Markov chain. We develop an approach to numerically solve the Poisson equation and this yields an efficient estimator for steady-state parameter sensitivities. We illustrate this method using several examples.
△ Less
Submitted 11 December, 2018;
originally announced December 2018.
-
Ergodicity analysis and antithetic integral control of a class of stochastic reaction networks with delays
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
Delays are an important phenomenon arising in a wide variety of real world systems. They occur in biological models because of diffusion effects or as simplifying modeling elements. We propose here to consider delayed stochastic reaction networks. The difficulty here lies in the fact that the state-space of a delayed reaction network is infinite-dimensional, which makes their analysis more involve…
▽ More
Delays are an important phenomenon arising in a wide variety of real world systems. They occur in biological models because of diffusion effects or as simplifying modeling elements. We propose here to consider delayed stochastic reaction networks. The difficulty here lies in the fact that the state-space of a delayed reaction network is infinite-dimensional, which makes their analysis more involved. We demonstrate here that a particular class of stochastic time-varying delays, namely those that follow a phase-type distribution, can be exactly implemented in terms of a chemical reaction network. Hence, any delay-free network can be augmented to incorporate those delays through the addition of delay-species and delay-reactions. Hence, for this class of stochastic delays, which can be used to approximate any delay distribution arbitrarily accurately, the state-space remains finite-dimensional and, therefore, standard tools developed for standard reaction network still apply. In particular, we demonstrate that for unimolecular mass-action reaction networks that the delayed stochastic reaction network is ergodic if and only if the non-delayed network is ergodic as well. Bimolecular reactions are more difficult to consider but an analogous result is also obtained. These results tell us that delays that are phase-type distributed, regardless of their distribution, are not harmful to the ergodicity property of reaction networks. We also prove that the presence of those delays adds convolution terms in the moment equation but does not change the value of the stationary means compared to the delay-free case. Finally, the control of a certain class of delayed stochastic reaction network using a delayed antithetic integral controller is considered. It is proven that this controller achieves its goal provided that the delay-free network satisfy the conditions of ergodicity and output-controllability.
△ Less
Submitted 23 April, 2020; v1 submitted 22 November, 2018;
originally announced November 2018.
-
In-Silico Proportional-Integral Moment Control of Stochastic Gene Expression
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
The problem of controlling the mean and the variance of a species of interest in a simple gene expression is addressed. It is shown that the protein mean level can be globally and robustly tracked to any desired value using a simple PI controller that satisfies certain sufficient conditions. Controlling both the mean and variance however requires an additional control input, e.g. the mRNA degradat…
▽ More
The problem of controlling the mean and the variance of a species of interest in a simple gene expression is addressed. It is shown that the protein mean level can be globally and robustly tracked to any desired value using a simple PI controller that satisfies certain sufficient conditions. Controlling both the mean and variance however requires an additional control input, e.g. the mRNA degradation rate, and local robust tracking of mean and variance is proved to be achievable using multivariable PI control, provided that the reference point satisfies necessary conditions imposed by the system. Even more importantly, it is shown that there exist PI controllers that locally, robustly and simultaneously stabilize all the equilibrium points inside the admissible region. The results are then extended to the mean control of a gene expression with protein dimerization. It is shown that the moment closure problem can be circumvented without invoking any moment closure technique. Local stabilization and convergence of the average dimer population to any desired reference value is ensured using a pure integral control law. Explicit bounds on the controller gain are provided and shown to be valid for any reference value. As a byproduct, an explicit upper-bound of the variance of the monomer species, acting on the system as unknown input due to the moment openness, is obtained. The results are illustrated by simulation.
△ Less
Submitted 21 April, 2020; v1 submitted 27 October, 2018;
originally announced October 2018.
-
Sensitivity analysis for multiscale stochastic reaction networks using hybrid approximations
Authors:
Ankit Gupta,
Mustafa Khammash
Abstract:
We consider the problem of estimating parameter sensitivities for stochastic models of multiscale reaction networks. These sensitivity values are important for model analysis, and, the methods that currently exist for sensitivity estimation mostly rely on simulations of the stochastic dynamics. This is problematic because these simulations become computationally infeasible for multiscale networks…
▽ More
We consider the problem of estimating parameter sensitivities for stochastic models of multiscale reaction networks. These sensitivity values are important for model analysis, and, the methods that currently exist for sensitivity estimation mostly rely on simulations of the stochastic dynamics. This is problematic because these simulations become computationally infeasible for multiscale networks due to reactions firing at several different timescales. However it is often possible to exploit the multiscale property to derive a "model reduction" and approximate the dynamics as a Piecewise Deterministic Markov process (PDMP), which is a hybrid process consisting of both discrete and continuous components. The aim of this paper is to show that such PDMP approximations can be used to accurately and efficiently estimate the parameter sensitivity for the original multiscale stochastic model. We prove the convergence of the original sensitivity to the corresponding PDMP sensitivity, in the limit where the PDMP approximation becomes exact. Moreover we establish a representation of the PDMP parameter sensitivity that separates the contributions of discrete and continuous components in the dynamics, and allows one to efficiently estimate both contributions.
△ Less
Submitted 29 September, 2018; v1 submitted 15 January, 2018;
originally announced January 2018.
-
Variance reduction for antithetic integral control of stochastic reaction networks
Authors:
Corentin Briat,
Ankit Gupta,
Mustafa Khammash
Abstract:
The antithetic integral feedback motif recently introduced in Briat, Gupta & Khammash (Cell Systems, 2017) is known to ensure robust perfect adaptation for the mean dynamics of a given molecular species involved in a complex stochastic biomolecular reaction network. However, it was observed that it also leads to a higher variance in the controlled network than that obtained when using a constituti…
▽ More
The antithetic integral feedback motif recently introduced in Briat, Gupta & Khammash (Cell Systems, 2017) is known to ensure robust perfect adaptation for the mean dynamics of a given molecular species involved in a complex stochastic biomolecular reaction network. However, it was observed that it also leads to a higher variance in the controlled network than that obtained when using a constitutive (i.e. open-loop) control strategy. This was interpreted as the cost of the adaptation property and may be viewed as a performance deterioration for the overall controlled network. To decrease this variance and improve the performance, we propose to combine the antithetic integral feedback motif with a negative feedback strategy. Both theoretical and numerical results are obtained. The theoretical ones are based on a tailored moment closure method allowing one to obtain approximate expressions for the stationary variance for the controlled network and predict that the variance can indeed be decreased by increasing the strength of the negative feedback. Numerical results verify the accuracy of this approximation and show that the controlled species variance can indeed be decreased, sometimes below its constitutive level. Three molecular networks are considered in order to verify the wide applicability of two types of negative feedback strategies. The main conclusion is that there is a trade-off between the speed of the settling-time of the mean trajectories and the stationary variance of the controlled species; i.e. smaller variance is associated with larger settling-time.
△ Less
Submitted 22 November, 2017;
originally announced November 2017.
-
Dynamic disorder in simple enzymatic reactions induces stochastic amplification of substrate
Authors:
Ankit Gupta,
Andreas Milias-Argeitis,
Mustafa Khammash
Abstract:
A growing amount of evidence points to the fact that many enzymes exhibit fluctuations in their catalytic activity, which are associated with conformational changes on a broad range of timescales. The experimental study of this phenomenon, termed dynamic disorder, has become possible due to advances in single-molecule enzymology measurement techniques, through which the catalytic activity of indiv…
▽ More
A growing amount of evidence points to the fact that many enzymes exhibit fluctuations in their catalytic activity, which are associated with conformational changes on a broad range of timescales. The experimental study of this phenomenon, termed dynamic disorder, has become possible due to advances in single-molecule enzymology measurement techniques, through which the catalytic activity of individual enzyme molecules can be tracked in time. The biological role and importance of these fluctuations in a system with a small number of enzymes such as a living cell have only recently started being explored. In this work, we examine a simple stochastic reaction system consisting of an inflowing substrate and an enzyme with a randomly fluctuating catalytic reaction rate that converts the substrate into an outflowing product. To describe analytically the effect of rate fluctuations on the average substrate abundance at steady-state, we derive an explicit formula that connects the relative speed of enzymatic fluctuations with the mean substrate level. We demonstrate that the relative speed of rate fluctuations can have a dramatic effect on the mean substrate, and lead to large positive deviations from predictions based on the assumption of deterministic enzyme activity. Our results also establish an interesting connection between the amplification effect and the mixing properties of the Markov process describing the enzymatic activity fluctuations, which can be used to easily predict the fluctuation speed above which such deviations become negligible. As the techniques of single-molecule enzymology continuously evolve, it may soon be possible to study the stochastic phenomena due to enzymatic activity fluctuations within living cells. Our work can be used to formulate experimentally testable hypotheses regarding the magnitude of these fluctuations, as well as their phenotypic consequences.
△ Less
Submitted 27 July, 2017; v1 submitted 28 April, 2017;
originally announced April 2017.
-
A finite state projection algorithm for the stationary solution of the chemical master equation
Authors:
Ankit Gupta,
Jan Mikelson,
Mustafa Khammash
Abstract:
The chemical master equation (CME) is frequently used in systems biology to quantify the effects of stochastic fluctuations that arise due to biomolecular species with low copy numbers. The CME is a system of ordinary differential equations that describes the evolution of probability density for each population vector in the state-space of the stochastic reaction dynamics. For many examples of int…
▽ More
The chemical master equation (CME) is frequently used in systems biology to quantify the effects of stochastic fluctuations that arise due to biomolecular species with low copy numbers. The CME is a system of ordinary differential equations that describes the evolution of probability density for each population vector in the state-space of the stochastic reaction dynamics. For many examples of interest, this state-space is infinite, making it difficult to obtain exact solutions of the CME. To deal with this problem, the Finite State Projection (FSP) algorithm was developed by Munsky and Khammash (Jour. Chem. Phys. 2006), to provide approximate solutions to the CME by truncating the state-space. The FSP works well for finite time-periods but it cannot be used for estimating the stationary solutions of CMEs, which are often of interest in systems biology. The aim of this paper is to develop a version of FSP which we refer to as the stationary FSP (sFSP) that allows one to obtain accurate approximations of the stationary solutions of a CME by solving a finite linear-algebraic system that yields the stationary distribution of a continuous-time Markov chain over the truncated state-space. We derive bounds for the approximation error incurred by sFSP and we establish that under certain stability conditions, these errors can be made arbitrarily small by appropriately expanding the truncated state-space. We provide several examples to illustrate our sFSP method and demonstrate its efficiency in estimating the stationary distributions. In particular, we show that using a quantised tensor train (QTT) implementation of our sFSP method, problems admitting more than 100 million states can be efficiently solved.
△ Less
Submitted 20 September, 2017; v1 submitted 24 April, 2017;
originally announced April 2017.
-
Simple interval observers for linear impulsive systems with applications to sampled-data and switched systems
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
Sufficient conditions for the design of a simple class of interval observers for linear impulsive systems subject to minimum and range dwell-time constraints are obtained and formulated in terms of infinite-dimensional linear programs. The proposed approach is fully constructive in the sense that suitable observer gains can be extracted from the solution of the optimization problems and is flexibl…
▽ More
Sufficient conditions for the design of a simple class of interval observers for linear impulsive systems subject to minimum and range dwell-time constraints are obtained and formulated in terms of infinite-dimensional linear programs. The proposed approach is fully constructive in the sense that suitable observer gains can be extracted from the solution of the optimization problems and is flexible enough to be extended to include performance constraints and parametric uncertainties. In order to be solvable, the infinite-dimensional linear programs are relaxed using a method based on sum of squares which is known to be asymptotically exact in the present case. Three examples are given for illustration: the first one pertains on the interval observation of an impulsive system under a minimum dwell-time constraint, the second one is about the interval observation of an aperiodic sampled-data system and the last one is about the interval observation of a linear switched system.
△ Less
Submitted 29 March, 2017; v1 submitted 11 March, 2017;
originally announced March 2017.
-
Stability analysis of LPV systems with piecewise differentiable parameters
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
Linear Parameter-Varying (LPV) systems with piecewise differentiable parameters is a class of LPV systems for which no proper analysis conditions have been obtained so far. To fill this gap, we propose an approach based on the theory of hybrid systems. The underlying idea is to reformulate the considered LPV system as an equivalent hybrid system that will incorporate, through a suitable state augm…
▽ More
Linear Parameter-Varying (LPV) systems with piecewise differentiable parameters is a class of LPV systems for which no proper analysis conditions have been obtained so far. To fill this gap, we propose an approach based on the theory of hybrid systems. The underlying idea is to reformulate the considered LPV system as an equivalent hybrid system that will incorporate, through a suitable state augmentation, information on both the dynamics of the state of the system and the considered class of parameter trajectories. Then, using a result pertaining on the stability of hybrid systems, two stability conditions are established and shown to naturally generalize and unify the well-known quadratic and robust stability criteria together. The obtained conditions being infinite-dimensional, a relaxation approach based on sum of squares programming is used in order to obtain tractable finite-dimensional conditions. The approach is finally illustrated on two examples from the literature.
△ Less
Submitted 11 March, 2017; v1 submitted 8 March, 2017;
originally announced March 2017.
-
Estimation of parameter sensitivities for stochastic reaction networks using tau-leap simulations
Authors:
Ankit Gupta,
Muruhan Rathinam,
Mustafa Khammash
Abstract:
We consider the important problem of estimating parameter sensitivities for stochastic models of reaction networks that describe the dynamics as a continuous-time Markov process over a discrete lattice. These sensitivity values are useful for understanding network properties, validating their design and identifying the pivotal model parameters. Many methods for sensitivity estimation have been dev…
▽ More
We consider the important problem of estimating parameter sensitivities for stochastic models of reaction networks that describe the dynamics as a continuous-time Markov process over a discrete lattice. These sensitivity values are useful for understanding network properties, validating their design and identifying the pivotal model parameters. Many methods for sensitivity estimation have been developed, but their computational feasibility suffers from the critical bottleneck of requiring time-consuming Monte Carlo simulations of the exact reaction dynamics. To circumvent this problem one needs to devise methods that speed up the computations while suffering acceptable and quantifiable loss of accuracy. We develop such a method by first deriving a novel integral representation of parameter sensitivity and then demonstrating that this integral may be approximated by any convergent tau-leap method. Our method is easy to implement, works with any tau-leap simulation scheme and its accuracy is proved to be similar to that of the underlying tau-leap scheme. We demonstrate the efficiency of our methods through numerical examples. We also compare our method with the tau-leap versions of certain finite-difference schemes that are commonly used for sensitivity estimations.
△ Less
Submitted 11 January, 2018; v1 submitted 1 March, 2017;
originally announced March 2017.
-
Robust and structural ergodicity analysis of stochastic biomolecular networks involving synthetic antithetic integral controllers
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
Ergodicity and output controllability have been shown to be fundamental concepts for the analysis and synthetic design of closed-loop stochastic reaction networks, as exemplified by the use of antithetic integral feedback controllers. In [Gupta, Briat & Khammash, PLoS Comput. Biol., 2014], some ergodicity and output controllability conditions for unimolecular and certain classes of bimolecular rea…
▽ More
Ergodicity and output controllability have been shown to be fundamental concepts for the analysis and synthetic design of closed-loop stochastic reaction networks, as exemplified by the use of antithetic integral feedback controllers. In [Gupta, Briat & Khammash, PLoS Comput. Biol., 2014], some ergodicity and output controllability conditions for unimolecular and certain classes of bimolecular reaction networks were obtained and formulated through linear programs. To account for context dependence, these conditions were later extended in [Briat & Khammash, CDC, 2016] to reaction networks with uncertain rate parameters using simple and tractable, yet potentially conservative, methods. Here we develop some exact theoretical methods for verifying, in a robust setting, the original ergodicity and output controllability conditions based on algebraic and polynomial techniques. Some examples are given for illustration.
△ Less
Submitted 27 November, 2018; v1 submitted 1 March, 2017;
originally announced March 2017.
-
Robust ergodicity and tracking in antithetic integral control of stochastic biochemical reaction networks
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
Controlling stochastic reactions networks is a challenging problem with important implications in various fields such as systems and synthetic biology. Various regulation motifs have been discovered or posited over the recent years, the most recent one being the so-called Antithetic Integral Control (AIC) motif in Briat et al. (Cell Systems, 2016). Several favorable properties for the AIC motif ha…
▽ More
Controlling stochastic reactions networks is a challenging problem with important implications in various fields such as systems and synthetic biology. Various regulation motifs have been discovered or posited over the recent years, the most recent one being the so-called Antithetic Integral Control (AIC) motif in Briat et al. (Cell Systems, 2016). Several favorable properties for the AIC motif have been demonstrated for classes of reaction networks that satisfy certain irreducibility, ergodicity and output controllability conditions. Here we address the problem of verifying these conditions for large sets of reaction networks with fixed topology using two different approaches. The first one is quantitative and relies on the notion of interval matrices while the second one is qualitative and is based on sign properties of matrices. The obtained results lie in the same spirit as those obtained in Briat et al. (Cell Systems, 2016) where properties of reaction networks are independently characterized in terms of control theoretic concepts, linear programming conditions and graph theoretic conditions.
△ Less
Submitted 27 November, 2018; v1 submitted 24 July, 2016;
originally announced July 2016.
-
Interval peak-to-peak observers for continuous- and discrete-time systems with persistent inputs and delays
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
While the design of optimal peak-to-peak controllers/observers for linear systems is known to be a difficult problem, this problem becomes interestingly much easier in the context of interval observers because of the positive nature of the error dynamics. Indeed, by exploiting several recent results on positive systems, we propose a novel and non-conservative approach formulated in terms of tracta…
▽ More
While the design of optimal peak-to-peak controllers/observers for linear systems is known to be a difficult problem, this problem becomes interestingly much easier in the context of interval observers because of the positive nature of the error dynamics. Indeed, by exploiting several recent results on positive systems, we propose a novel and non-conservative approach formulated in terms of tractable finite-dimensional linear programs for designing a class of interval observers achieving minimum peak-to-peak gain. The optimal observer is notably shown to be uniform over the set of all possible map**s between observation errors and their weighted versions, which parallels a recent result on the stabilization of linear positive systems. Results pertaining on the interval observation of time-delay and discrete-time systems are then obtained as a direct application of the proposed method, emphasizing then its versatility. Several examples on the interval observation of linear and nonlinear systems are finally given for illustration.
△ Less
Submitted 29 July, 2016; v1 submitted 24 November, 2015;
originally announced November 2015.
-
Computational identification of irreducible state-spaces for stochastic reaction networks
Authors:
Ankit Gupta,
Mustafa Khammash
Abstract:
Stochastic models of reaction networks are becoming increasingly important in Systems Biology. In these models, the dynamics is generally represented by a continuous-time Markov chain whose states denote the copy-numbers of the constituent species. The state-space on which this process resides is a subset of non-negative integer lattice and for many examples of interest, this state-space is counta…
▽ More
Stochastic models of reaction networks are becoming increasingly important in Systems Biology. In these models, the dynamics is generally represented by a continuous-time Markov chain whose states denote the copy-numbers of the constituent species. The state-space on which this process resides is a subset of non-negative integer lattice and for many examples of interest, this state-space is countably infinite. This causes numerous problems in analyzing the Markov chain and understanding its long-term behavior. These problems are further confounded by the presence of conservation relations among species which constrain the dynamics in complicated ways. In this paper we provide a linear-algebraic procedure to disentangle these conservation relations and represent the state-space in a special decomposed form, based on the copy-number ranges of various species and dependencies among them. This decomposed form is advantageous for analyzing the stochastic model and for a large class of networks we demonstrate how this form can be used for finding all the closed communication classes for the Markov chain within the infinite state-space. Such communication classes are irreducible state-spaces for the dynamics and they support all the extremal stationary distributions for the Markov chain. Hence our results provide important insights into the long-term behavior and stability properties of stochastic models of reaction networks. We discuss how the knowledge of these irreducible state-spaces can be used in many ways such as speeding-up stochastic simulations of multiscale networks or in identifying the stationary distributions of complex-balanced networks. We illustrate our results with several examples of gene-expression networks from Systems Biology.
△ Less
Submitted 9 February, 2018; v1 submitted 25 May, 2015;
originally announced May 2015.
-
Optimization-based Lyapunov function construction for continuous-time Markov chains with affine transition rates
Authors:
Andreas Milias-Argeitis,
Mustafa Khammash
Abstract:
We address the problem of Lyapunov function construction for a class of continuous-time Markov chains with affine transition rates, typically encountered in stochastic chemical kinetics. Following an optimization approach, we take advantage of existing bounds from the Foster-Lyapunov stability theory to obtain functions that enable us to estimate the region of high stationary probability, as well…
▽ More
We address the problem of Lyapunov function construction for a class of continuous-time Markov chains with affine transition rates, typically encountered in stochastic chemical kinetics. Following an optimization approach, we take advantage of existing bounds from the Foster-Lyapunov stability theory to obtain functions that enable us to estimate the region of high stationary probability, as well as provide upper bounds on moments of the chain. Our method can be used to study the stationary behavior of a given chain without resorting to stochastic simulation, in a fast and efficient manner.
△ Less
Submitted 24 December, 2014;
originally announced December 2014.
-
Antithetic Integral Feedback ensures robust perfect adaptation in noisy biomolecular networks
Authors:
Corentin Briat,
Ankit Gupta,
Mustafa Khammash
Abstract:
Homeostasis is a running theme in biology. Often achieved through feedback regulation strategies, homeostasis allows living cells to control their internal environment as a means for surviving changing and unfavourable environments. While many endogenous homeostatic motifs have been studied in living cells, some other motifs may remain under-explored or even undiscovered. At the same time, known r…
▽ More
Homeostasis is a running theme in biology. Often achieved through feedback regulation strategies, homeostasis allows living cells to control their internal environment as a means for surviving changing and unfavourable environments. While many endogenous homeostatic motifs have been studied in living cells, some other motifs may remain under-explored or even undiscovered. At the same time, known regulatory motifs have been mostly analyzed at the deterministic level, and the effect of noise on their regulatory function has received low attention. Here we lay the foundation for a regulation theory at the molecular level that explicitly takes into account the noisy nature of biochemical reactions and provides novel tools for the analysis and design of robust homeostatic circuits. Using these ideas, we propose a new regulation motif, which we refer to as {\em antithetic integral feedback, and demonstrate its effectiveness as a strategy for generically regulating a wide class of reaction networks. By combining tools from probability and control theory, we show that the proposed motif preserves the stability of the overall network, steers the population of any regulated species to a desired set point, and achieves robust perfect adaptation -- all with low prior knowledge of reaction rates. Moreover, our proposed regulatory motif can be implemented using a very small number of molecules and hence has a negligible metabolic load. Strikingly, the regulatory motif exploits stochastic noise, leading to enhanced regulation in scenarios where noise-free implementations result in dysregulation. Finally, we discuss the possible manifestation of the proposed antithetic integral feedback motif in endogenous biological circuits and its realization in synthetic circuits.
△ Less
Submitted 13 January, 2016; v1 submitted 22 October, 2014;
originally announced October 2014.
-
Unbiased estimation of second-order parameter sensitivities for stochastic reaction networks
Authors:
Ankit Gupta,
Mustafa Khammash
Abstract:
This paper deals with the problem of estimating second-order parameter sensitivities for stochastic reaction networks, where the reaction dynamics is modeled as a continuous time Markov chain over a discrete state space. Estimation of such second-order sensitivities (the Hessian) is necessary for implementing the Newton-Raphson scheme for optimization over the parameter space. To perform this esti…
▽ More
This paper deals with the problem of estimating second-order parameter sensitivities for stochastic reaction networks, where the reaction dynamics is modeled as a continuous time Markov chain over a discrete state space. Estimation of such second-order sensitivities (the Hessian) is necessary for implementing the Newton-Raphson scheme for optimization over the parameter space. To perform this estimation, Wolf and Anderson have proposed an efficient finite-difference method, that uses a coupling of perturbed processes to reduce the estimator variance. The aim of this paper is to illustrate that the same coupling can be exploited to derive an exact representation for second-order parameter sensitivity. Furthermore with this representation one can construct an unbiased estimator which is easy to implement. The ideas contained in this paper are extensions of the ideas presented in our recent papers on first-order parameter sensitivity estimation.
△ Less
Submitted 28 July, 2014;
originally announced July 2014.
-
Adaptive Hybrid Simulations for Multiscale Stochastic Reaction Networks
Authors:
Benjamin Hepp,
Ankit Gupta,
Mustafa Khammash
Abstract:
The probability distribution describing the state of a Stochastic Reaction Network evolves according to the Chemical Master Equation (CME). It is common to estimated its solution using Monte Carlo methods such as the Stochastic Simulation Algorithm (SSA). In many cases these simulations can take an impractical amount of computational time. Therefore many methods have been developed that approximat…
▽ More
The probability distribution describing the state of a Stochastic Reaction Network evolves according to the Chemical Master Equation (CME). It is common to estimated its solution using Monte Carlo methods such as the Stochastic Simulation Algorithm (SSA). In many cases these simulations can take an impractical amount of computational time. Therefore many methods have been developed that approximate the Stochastic Process underlying the Chemical Master Equation. Prominent strategies are Hybrid Models that regard the firing of some reaction channels as being continuous and applying the quasi-stationary assumption to approximate the dynamics of fast subnetworks. However as the dynamics of a Stochastic Reaction Network changes with time these approximations might have to be adapted during the simulation. We develop a method that approximates the solution of a CME by automatically partitioning the reaction dynamics into discrete/continuous components and applying the quasi-stationary assumption on identifiable fast subnetworks. Our method does not require user intervention and it adapts to exploit the changing timescale separation between reactions and/or changing magnitudes of copy numbers of constituent species. We demonstrate the efficiency of the proposed method by considering examples from Systems Biology and showing that very good approximations to the exact probability distributions can be achieved in significantly less computational time.
△ Less
Submitted 5 January, 2015; v1 submitted 14 February, 2014;
originally announced February 2014.
-
An efficient and unbiased method for sensitivity analysis of stochastic reaction networks
Authors:
Ankit Gupta,
Mustafa Khammash
Abstract:
We consider the problem of estimating parameter sensitivity for Markovian models of reaction networks. Sensitivity values measure the responsiveness of an output to the model parameters. They help in analyzing the network, understanding its robustness properties and identifying the important reactions for a specific output. Sensitivity values are commonly estimated using methods that perform finit…
▽ More
We consider the problem of estimating parameter sensitivity for Markovian models of reaction networks. Sensitivity values measure the responsiveness of an output to the model parameters. They help in analyzing the network, understanding its robustness properties and identifying the important reactions for a specific output. Sensitivity values are commonly estimated using methods that perform finite-difference computations along with Monte Carlo simulations of the reaction dynamics. These methods are computationally efficient and easy to implement, but they produce a biased estimate which can be unreliable for certain applications. Moreover the size of the bias is generally unknown and hence the accuracy of these methods cannot be easily determined. There also exist unbiased schemes for sensitivity estimation but these schemes can be computationally infeasible, even for simple networks. Our goal in this paper is to present a new method for sensitivity estimation, which combines the computational efficiency of finite-difference methods with the accuracy of unbiased schemes. Our method is easy to implement and it relies on an exact representation of parameter sensitivity that we recently proved in an earlier paper. Through examples we demonstrate that the proposed method can outperform the existing methods, both biased and unbiased, in many situations.
△ Less
Submitted 17 April, 2014; v1 submitted 13 February, 2014;
originally announced February 2014.
-
Variance reduction for steady-state simulation and sensitivity analysis of stochastic chemical systems
Authors:
Andreas Milias-Argeitis,
John Lygeros,
Mustafa Khammash
Abstract:
We address the problem of estimating steady-state quantities associated to systems of stochastic chemical kinetics. In most cases of interest these systems are analytically intractable, and one has to resort to computational methods to estimate stationary values of cost functions. In this work we consider a previously introduced variance reduction method and present an algorithm for its applicatio…
▽ More
We address the problem of estimating steady-state quantities associated to systems of stochastic chemical kinetics. In most cases of interest these systems are analytically intractable, and one has to resort to computational methods to estimate stationary values of cost functions. In this work we consider a previously introduced variance reduction method and present an algorithm for its application in the context of stochastic chemical kinetics. Using two numerical examples, we test the efficiency of the method for the calculation of steady-state parametric sensitivities and evaluate its performance in comparison to other estimation methods.
△ Less
Submitted 20 January, 2014;
originally announced January 2014.
-
Determining the long-term behavior of cell populations: A new procedure for detecting ergodicity in large stochastic reaction networks
Authors:
Ankit Gupta,
Mustafa Khammash
Abstract:
A reaction network consists of a finite number of species, which interact through predefined reaction channels. Traditionally such networks were modeled deterministically, but it is now well-established that when reactant copy numbers are small, the random timing of the reactions create internal noise that can significantly affect the macroscopic properties of the system. To understand the role of…
▽ More
A reaction network consists of a finite number of species, which interact through predefined reaction channels. Traditionally such networks were modeled deterministically, but it is now well-established that when reactant copy numbers are small, the random timing of the reactions create internal noise that can significantly affect the macroscopic properties of the system. To understand the role of noise and quantify its effects, stochastic models are necessary. In the stochastic setting, the population is described by a probability distribution, which evolves according to a set of ordinary differential equations known as the Chemical Master Equation (CME). This set is infinite in most cases making the CME practically unsolvable. In many applications, it is important to determine if the solution of a CME has a globally attracting fixed point. This property is called ergodicity and its presence leads to several important insights about the underlying dynamics. The goal of this paper is to present a simple procedure to verify ergodicity in stochastic reaction networks. We provide a set of simple linear-algebraic conditions which are sufficient for the network to be ergodic. In particular, our main condition can be cast as a Linear Feasibility Problem (LFP) which is essentially the problem of determining the existence of a vector satisfying certain linear constraints. The inherent scalability of LFPs make our approach efficient, even for very large networks. We illustrate our procedure through an example from systems biology.
△ Less
Submitted 10 December, 2013;
originally announced December 2013.
-
Sensitivity analysis for stochastic chemical reaction networks with multiple time-scales
Authors:
Ankit Gupta,
Mustafa Khammash
Abstract:
Stochastic models for chemical reaction networks have become very popular in recent years. For such models, the estimation of parameter sensitivities is an important and challenging problem. Sensitivity values help in analyzing the network, understanding its robustness properties and also in identifying the key reactions for a given outcome. Most of the methods that exist in the literature for the…
▽ More
Stochastic models for chemical reaction networks have become very popular in recent years. For such models, the estimation of parameter sensitivities is an important and challenging problem. Sensitivity values help in analyzing the network, understanding its robustness properties and also in identifying the key reactions for a given outcome. Most of the methods that exist in the literature for the estimation of parameter sensitivities, rely on Monte Carlo simulations using Gillespie's stochastic simulation algorithm or its variants. It is well-known that such simulation methods can be prohibitively expensive when the network contains reactions firing at different time-scales, which is a feature of many important biochemical networks. For such networks, it is often possible to exploit the time-scale separation and approximately capture the original dynamics by simulating a "reduced" model, which is obtained by eliminating the fast reactions in a certain way. The aim of this paper is to tie these model reduction techniques with sensitivity analysis. We prove that under some conditions, the sensitivity values of the reduced model can be used to approximately recover the sensitivity values for the original model. Through an example we illustrate how our result can help in sharply reducing the computational costs for the estimation of parameter sensitivities for reaction networks with multiple time-scales. To prove our result, we use coupling arguments based on the random time change representation of Kurtz. We also exploit certain connections between the distributions of the occupation times of Markov chains and multi-dimensional wave equations.
△ Less
Submitted 7 October, 2013;
originally announced October 2013.
-
Integral population control of a quadratic dimerization process
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
Moment control of a simple quadratic reaction network describing a dimerization process is addressed. It is shown that the moment closure problem can be circumvented without invoking any moment closure technique. Local stabilization and convergence of the average dimer population to any desired reference value is ensured using a pure integral control law. Explicit bounds on the controller gain are…
▽ More
Moment control of a simple quadratic reaction network describing a dimerization process is addressed. It is shown that the moment closure problem can be circumvented without invoking any moment closure technique. Local stabilization and convergence of the average dimer population to any desired reference value is ensured using a pure integral control law. Explicit bounds on the controller gain are provided and shown to be valid for any reference value. As a byproduct, an explicit upper-bound of the variance of the monomer species, acting on the system as unknown input due to the moment openness, is obtained. The obtained results are illustrated by an example relying on the simulation of a cell population using stochastic simulation algorithms.
△ Less
Submitted 13 August, 2013; v1 submitted 24 July, 2013;
originally announced July 2013.
-
A scalable computational framework for establishing long-term behavior of stochastic reaction networks
Authors:
Ankit Gupta,
Corentin Briat,
Mustafa Khammash
Abstract:
Reaction networks are systems in which the populations of a finite number of species evolve through predefined interactions. Such networks are found as modeling tools in many biological disciplines such as biochemistry, ecology, epidemiology, immunology, systems biology and synthetic biology. It is now well-established that, for small population sizes, stochastic models for biochemical reaction ne…
▽ More
Reaction networks are systems in which the populations of a finite number of species evolve through predefined interactions. Such networks are found as modeling tools in many biological disciplines such as biochemistry, ecology, epidemiology, immunology, systems biology and synthetic biology. It is now well-established that, for small population sizes, stochastic models for biochemical reaction networks are necessary to capture randomness in the interactions. The tools for analyzing such models, however, still lag far behind their deterministic counterparts. In this paper, we bridge this gap by develo** a constructive framework for examining the long-term behavior and stability properties of the reaction dynamics in a stochastic setting. In particular, we address the problems of determining ergodicity of the reaction dynamics, which is analogous to having a globally attracting fixed point for deterministic dynamics. We also examine when the statistical moments of the underlying process remain bounded with time and when they converge to their steady state values. The framework we develop relies on a blend of ideas from probability theory, linear algebra and optimization theory. We demonstrate that the stability properties of a wide class of biological networks can be assessed from our sufficient theoretical conditions that can be recast as efficient and scalable linear programs, well-known for their tractability. It is notably shown that the computational complexity is often linear in the number of species. We illustrate the validity, the efficiency and the wide applicability of our results on several reaction networks arising in biochemistry, systems biology, epidemiology and ecology. The biological implications of the results as well as an example of a non-ergodic biological network are also discussed.
△ Less
Submitted 5 May, 2014; v1 submitted 19 April, 2013;
originally announced April 2013.
-
Automatic crosswind flight of tethered wings for airborne wind energy: modeling, control design and experimental results
Authors:
Lorenzo Fagiano,
Aldo U. Zgraggen,
Manfred Morari,
Mustafa Khammash
Abstract:
An approach to control tethered wings for airborne wind energy is proposed. A fixed length of the lines is considered, and the aim of the control system is to obtain figure-eight crosswind trajectories. The proposed technique is based on the notion of the wing's "velocity angle" and, in contrast with most existing approaches, it does not require a measurement of the wind speed or of the effective…
▽ More
An approach to control tethered wings for airborne wind energy is proposed. A fixed length of the lines is considered, and the aim of the control system is to obtain figure-eight crosswind trajectories. The proposed technique is based on the notion of the wing's "velocity angle" and, in contrast with most existing approaches, it does not require a measurement of the wind speed or of the effective wind at the wing's location. Moreover, the proposed approach features few parameters, whose effects on the system's behavior are very intuitive, hence simplifying tuning procedures. A simplified model of the steering dynamics of the wing is derived from first-principle laws, compared with experimental data and used for the control design. The control algorithm is divided into a low-level loop for the velocity angle and a high-level guidance strategy to achieve the desired flight patterns. The robustness of the inner loop is verified analytically, and the overall control system is tested experimentally on a small-scale prototype, with varying wind conditions and using different wings.
△ Less
Submitted 26 August, 2013; v1 submitted 6 January, 2013;
originally announced January 2013.
-
On sensor fusion for airborne wind energy systems
Authors:
Lorenzo Fagiano,
Khahn Huynh,
Bassam Bamieh,
Mustafa Khammash
Abstract:
A study on filtering aspects of airborne wind energy generators is presented. This class of renewable energy systems aims to convert the aerodynamic forces generated by tethered wings, flying in closed paths transverse to the wind flow, into electricity. The accurate reconstruction of the wing's position, velocity and heading is of fundamental importance for the automatic control of these kinds of…
▽ More
A study on filtering aspects of airborne wind energy generators is presented. This class of renewable energy systems aims to convert the aerodynamic forces generated by tethered wings, flying in closed paths transverse to the wind flow, into electricity. The accurate reconstruction of the wing's position, velocity and heading is of fundamental importance for the automatic control of these kinds of systems. The difficulty of the estimation problem arises from the nonlinear dynamics, wide speed range, large accelerations and fast changes of direction that the wing experiences during operation. It is shown that the overall nonlinear system has a specific structure allowing its partitioning into sub-systems, hence leading to a series of simpler filtering problems. Different sensor setups are then considered, and the related sensor fusion algorithms are presented. The results of experimental tests carried out with a small-scale prototype and wings of different sizes are discussed. The designed filtering algorithms rely purely on kinematic laws, hence they are independent from features like wing area, aerodynamic efficiency, mass, etc. Therefore, the presented results are representative also of systems with larger size and different wing design, different number of tethers and/or rigid wings.
△ Less
Submitted 12 July, 2013; v1 submitted 21 November, 2012;
originally announced November 2012.
-
Unbiased estimation of parameter sensitivities for stochastic chemical reaction networks
Authors:
Ankit Gupta,
Mustafa Khammash
Abstract:
Estimation of parameter sensitivities for stochastic chemical reaction networks is an important and challenging problem. Sensitivity values are important in the analysis, modeling and design of chemical networks. They help in understanding the robustness properties of the system and also in identifying the key reactions for a given outcome. In a discrete setting, most of the methods that exist in…
▽ More
Estimation of parameter sensitivities for stochastic chemical reaction networks is an important and challenging problem. Sensitivity values are important in the analysis, modeling and design of chemical networks. They help in understanding the robustness properties of the system and also in identifying the key reactions for a given outcome. In a discrete setting, most of the methods that exist in the literature for the estimation of parameter sensitivities rely on Monte Carlo simulations along with finite difference computations. However these methods introduce a bias in the sensitivity estimate and in most cases the size or direction of the bias remains unknown, potentially damaging the accuracy of the analysis. In this paper, we use the random time change representation of Kurtz to derive an exact formula for parameter sensitivity. This formula allows us to construct an unbiased estimator for parameter sensitivity, which can be efficiently evaluated using a suitably devised Monte Carlo scheme. The existing literature contains only one method to produce such an unbiased estimator. This method was proposed by Plyasunov and Arkin and it is based on the Girsanov measure transformation. By taking a couple of examples we compare our method to this existing method. Our results indicate that our method can be much faster than the existing method while computing sensitivity with respect to a reaction rate constant which is small in magnitude. This rate constant could correspond to a reaction which is slow in the reference time-scale of the system. Since many biological systems have such slow reactions, our method can be a useful tool for sensitivity analysis.
△ Less
Submitted 20 December, 2012; v1 submitted 12 October, 2012;
originally announced October 2012.
-
Computer control of gene expression: Robust setpoint tracking of protein mean and variance using integral feedback
Authors:
Corentin Briat,
Mustafa Khammash
Abstract:
Protein mean and variance levels in a simple stochastic gene expression circuit are controlled using proportional integral feedback. It is shown that the protein mean level can be globally and robustly tracked to any desired value using a simple PI controller that satisfies explicit sufficient conditions. Controlling both the mean and variance on the other hand requires the use of an additional co…
▽ More
Protein mean and variance levels in a simple stochastic gene expression circuit are controlled using proportional integral feedback. It is shown that the protein mean level can be globally and robustly tracked to any desired value using a simple PI controller that satisfies explicit sufficient conditions. Controlling both the mean and variance on the other hand requires the use of an additional control input, chosen here as the mRNA degradation rate. Local robust tracking of mean and variance is proved to be achievable using multivariable PI control, provided that the reference point satisfies necessary conditions imposed by the system. Even more importantly, it is shown that there exist PI controllers that locally, robustly and simultaneously stabilize all the equilibrium points inside the admissible region. Simulation examples illustrate the results.
△ Less
Submitted 19 July, 2012;
originally announced July 2012.
-
Simulation of stochastic systems via polynomial chaos expansions and convex optimization
Authors:
Lorenzo Fagiano,
Mustafa Khammash
Abstract:
Polynomial Chaos Expansions represent a powerful tool to simulate stochastic models of dynamical systems. Yet, deriving the expansion's coefficients for complex systems might require a significant and non-trivial manipulation of the model, or the computation of large numbers of simulation runs, rendering the approach too time consuming and impracticable for applications with more than a handful of…
▽ More
Polynomial Chaos Expansions represent a powerful tool to simulate stochastic models of dynamical systems. Yet, deriving the expansion's coefficients for complex systems might require a significant and non-trivial manipulation of the model, or the computation of large numbers of simulation runs, rendering the approach too time consuming and impracticable for applications with more than a handful of random variables. We introduce a novel computationally tractable technique for computing the coefficients of polynomial chaos expansions. The approach exploits a regularization technique with a particular choice of weighting matrices, which allow to take into account the specific features of Polynomial Chaos expansions. The method, completely based on convex optimization, can be applied to problems with a large number of random variables and uses a modest number of Monte Carlo simulations, while avoiding model manipulations. Additional information on the stochastic process, when available, can be also incorporated in the approach by means of convex constraints. We show the effectiveness of the proposed technique in three applications in diverse fields, including the analysis of a nonlinear electric circuit, a chaotic model of organizational behavior, finally a chemical oscillator.
△ Less
Submitted 10 November, 2012; v1 submitted 3 February, 2012;
originally announced February 2012.
-
Flow Cytometry Based State Aggregation of a Stochastic Model of Protein Expression
Authors:
Anahita Mirtabatabaei,
Francesco Bullo,
Mustafa Khammash
Abstract:
In this article, we introduce the new approach "fluorescence grid based aggregation (FGBA)" to justify a dynamical model of protein expression using experimental fluorescence histograms. In this approach, first, we describe the dynamics of the gene-protein system by a chemical master equation (CME), while the protein production rates are unknown. Then, we aggregate the states of the CME into unkno…
▽ More
In this article, we introduce the new approach "fluorescence grid based aggregation (FGBA)" to justify a dynamical model of protein expression using experimental fluorescence histograms. In this approach, first, we describe the dynamics of the gene-protein system by a chemical master equation (CME), while the protein production rates are unknown. Then, we aggregate the states of the CME into unknown group sizes. We show that these unknown values can be replaced by the data from the experimental fluorescence histograms. Consequently, final probability distributions correspond to the experimental fluorescence histograms.
△ Less
Submitted 10 April, 2011;
originally announced April 2011.