Showing 1–46 of 46 results for author: Khammash, M

Effective filtering approach for joint parameter-state estimation in SDEs via Rao-Blackwellization and modularization

Authors: Zhou Fang, Ankit Gupta, Mustafa Khammash

Abstract: Stochastic filtering is a vibrant area of research in both control theory and statistics, with broad applications in many scientific fields. Despite its extensive historical development, there still lacks an effective method for joint parameter-state estimation in SDEs. The state-of-the-art particle filtering methods suffer from either sample degeneracy or information loss, with both issues stemmi… ▽ More Stochastic filtering is a vibrant area of research in both control theory and statistics, with broad applications in many scientific fields. Despite its extensive historical development, there still lacks an effective method for joint parameter-state estimation in SDEs. The state-of-the-art particle filtering methods suffer from either sample degeneracy or information loss, with both issues stemming from the dynamics of the particles generated to represent system parameters. This paper provides a novel and effective approach for joint parameter-state estimation in SDEs via Rao-Blackwellization and modularization. Our method operates in two layers: the first layer estimates the system states using a bootstrap particle filter, and the second layer marginalizes out system parameters explicitly. This strategy circumvents the need to generate particles representing system parameters, thereby mitigating their associated problems of sample degeneracy and information loss. Moreover, our method employs a modularization approach when integrating out the parameters, which significantly reduces the computational complexity. All these designs ensure the superior performance of our method. Finally, a numerical example is presented to illustrate that our method outperforms existing approaches by a large margin. △ Less

Submitted 1 November, 2023; originally announced November 2023.

Comments: 8 pages, 2 figures

MSC Class: 62M20; 62F15; 65C05; 92-08; 93E11

Complete characterization of robust perfect adaptation in biochemical reaction networks

Authors: Yuji Hirono, Ankit Gupta, Mustafa Khammash

Abstract: Perfect adaptation is a phenomenon whereby the output variables of a system can maintain certain values despite external disturbances. Robust perfect adaptation (RPA) refers to an adaptation property that does not require fine-tuning of system parameters. RPA plays a vital role for the survival of living systems in unpredictable environments. However, complex interaction patterns in biochemical sy… ▽ More Perfect adaptation is a phenomenon whereby the output variables of a system can maintain certain values despite external disturbances. Robust perfect adaptation (RPA) refers to an adaptation property that does not require fine-tuning of system parameters. RPA plays a vital role for the survival of living systems in unpredictable environments. However, complex interaction patterns in biochemical systems pose a significant challenge in identifying RPA and associated regulatory mechanisms. The goal of this paper is to present a novel approach for finding all RPA properties that are realized for a generic choice of kinetics for general deterministic chemical reaction systems. This is accomplished by proving that an RPA property is represented by a subnetwork with certain topological features. This connection is exploited to show that these structures generate all kinetics-independent RPA properties, allowing us to systematically identify all RPA properties by enumerating these subnetworks. An efficient method is developed for this enumeration, and we provide a computational package for this purpose. We pinpoint the integral feedback controllers that work in concert to realize each RPA property, casting our results into the familiar control-theoretic paradigm of the Internal Model Principle. We further generalize the regulation problem to the multi-output scenario where the target values belong to a manifold of nonzero dimension, and provide a sufficient condition for this. The present work significantly advances our understanding of regulatory mechanisms that lead to RPA in endogenous biochemical systems, and it also provides rational design principles for synthetic controllers. The present results indicate that an RPA property is essentially equivalent to the existence of a "topological invariant", which is an instance of what we call the "Robust Adaptation is Topological"(RAT) principle. △ Less

Submitted 14 July, 2023; originally announced July 2023.

Comments: 65 pages, 16 figures

Report number: KUNS-2973, RIKEN-iTHEMS-Report-23

Noise in Biomolecular Systems: Modeling, Analysis, and Control Implications

Authors: Corentin Briat, Mustafa Khammash

Abstract: While noise is generally associated with uncertainties and often has a negative connotation in engineering, living organisms have evolved to adapt to (and even exploit) such uncertainty to ensure the survival of a species or implement certain functions that would have been difficult or even impossible otherwise. In this article, we review the role and impact of noise in systems and synthetic biolo… ▽ More While noise is generally associated with uncertainties and often has a negative connotation in engineering, living organisms have evolved to adapt to (and even exploit) such uncertainty to ensure the survival of a species or implement certain functions that would have been difficult or even impossible otherwise. In this article, we review the role and impact of noise in systems and synthetic biology, with a particular emphasis on its role in the genetic control of biological systems, an area we refer to as Cybergenetics. The main modeling paradigm is that of stochastic reaction networks, whose applicability goes beyond biology, as these networks can represent any population dynamics system, including ecological, epidemiological, and opinion dynamics networks. We review different ways to mathematically represent these systems, and we notably argue that the concept of ergodicity presents a particularly suitable way to characterize their stability. We then discuss noise-induced properties and show that noise can be both an asset and a nuisance in this setting. Finally, we discuss recent results on (stochastic) Cybergenetics and explore their relationships to noise. Along the way, we detail the different technical and biological constraints that need to be respected when designing synthetic biological circuits. Finally, we discuss the concepts, problems, and solutions exposed in the article; raise criticisms and concerns about current ideas and approaches; suggest current (open) problems with potential solutions; and provide some ideas for future research directions. △ Less

Submitted 28 September, 2022; originally announced September 2022.

Comments: 36 pages; 6 Figures

On the Innocuousness of Deterministic p-type Antithetic Integral Controllers Arising in Integral Rein Control

Authors: Corentin Briat, Mustafa Khammash

Abstract: The innocuousness property of a controller is that property that makes the closed-loop system stable regardless the values of the controller parameters. In other words, the closed-loop system exhibits some structural stability property with respect to the parameters of the controller. The innocuousness property was first emphasized in [Briat, Gupta, and Khammash, Cell Systems, 2016] where it was s… ▽ More The innocuousness property of a controller is that property that makes the closed-loop system stable regardless the values of the controller parameters. In other words, the closed-loop system exhibits some structural stability property with respect to the parameters of the controller. The innocuousness property was first emphasized in [Briat, Gupta, and Khammash, Cell Systems, 2016] where it was shown that for stochastic unimolecular networks, the Antithetic Integral Controller (AIC) is innocuous under very mild conditions on the controlled network; namely the ergodicity and the output-controllability of the open-loop network, and the admissibility of the set-point value. We show here that the class of p-type AIC controllers arising in the use of Antithetic Integral Rein Controllers (AIRC) also exhibit such a property. It is shown in the unimolecular reaction network case that the closed-loop network is structurally stable with respect to the controller parameters provided that the open-loop dynamics is stable and that the set-point is admissible. Those results are then extended to the case of so-called output unstable linear systems and to stable nonlinear networks. Analogous results are obtained for exponential and logistic integral controllers. Some examples are given for illustration. △ Less

Submitted 1 March, 2022; v1 submitted 31 January, 2022; originally announced January 2022.

Comments: 23 pages, 1 figure

Design of a synthetic integral feedback circuit: dynamic analysis and DNA implementation

Authors: Corentin Briat, Christoph Zechner, Mustafa Khammash

Abstract: The design and implementation of regulation motifs ensuring robust perfect adaptation are challenging problems in synthetic biology. Indeed, the design of high-yield robust metabolic pathways producing, for instance, drug precursors and biofuels, could be easily imagined to rely on such a control strategy in order to optimize production levels and reduce production costs, despite the presence of e… ▽ More The design and implementation of regulation motifs ensuring robust perfect adaptation are challenging problems in synthetic biology. Indeed, the design of high-yield robust metabolic pathways producing, for instance, drug precursors and biofuels, could be easily imagined to rely on such a control strategy in order to optimize production levels and reduce production costs, despite the presence of environmental disturbance and model uncertainty. We propose here a motif that ensures tracking and robust perfect adaptation for the controlled reaction network through integral feedback. Its metabolic load on the host is fully tunable and can be made arbitrarily close to the constitutive limit, the universal minimal metabolic load of all possible controllers. A DNA implementation of the controller network is finally provided. Computer simulations using realistic parameters demonstrate the good agreement between the DNA implementation and the ideal controller dynamics. △ Less

Submitted 19 December, 2021; originally announced December 2021.

Comments: 31 pages, 8 figures

Optimal and $H_\infty$ Control of Stochastic Reaction Networks

Authors: Corentin Briat, Mustafa Khammash

Abstract: Stochastic reaction networks is a powerful class of models for the representation a wide variety of population models including biochemistry. The control of such networks has been recently considered due to their important implications for the control of biological systems. Their optimal control, however, has been relatively few studied until now. The continuous-time finite-horizon optimal control… ▽ More Stochastic reaction networks is a powerful class of models for the representation a wide variety of population models including biochemistry. The control of such networks has been recently considered due to their important implications for the control of biological systems. Their optimal control, however, has been relatively few studied until now. The continuous-time finite-horizon optimal control problem is formulated first and explicitly solved in the case of unimolecular reaction networks. The problems of the optimal sampled-data control, the continuous $H_\infty$ control, and the sampled-data $H_\infty$ control of such networks are addressed next. The results in the unimolecular case take the form of nonstandard Riccati differential equations or differential Lyapunov equations coupled with difference Riccati equations, which can all be solved numerically by backward-in-time integration. △ Less

Submitted 14 July, 2023; v1 submitted 29 November, 2021; originally announced November 2021.

Comments: Withdrawn for major revisions and improvements

Convergence of regularized particle filters for stochastic reaction networks

Authors: Zhou Fang, Ankit Gupta, Mustafa Khammash

Abstract: Filtering for stochastic reaction networks (SRNs) is an important problem in systems/synthetic biology aiming to estimate the state of unobserved chemical species. A good solution to it can provide scientists valuable information about the hidden dynamic state and enable optimal feedback control. Usually, the model parameters need to be inferred simultaneously with state variables, and a conventio… ▽ More Filtering for stochastic reaction networks (SRNs) is an important problem in systems/synthetic biology aiming to estimate the state of unobserved chemical species. A good solution to it can provide scientists valuable information about the hidden dynamic state and enable optimal feedback control. Usually, the model parameters need to be inferred simultaneously with state variables, and a conventional particle filter can fail to solve this problem accurately due to sample degeneracy. In this case, the regularized particle filter (RPF) is preferred to the conventional ones, as the RPF can mitigate sample degeneracy by perturbing particles with artificial noise. However, the artificial noise introduces an additional bias to the estimate, and, thus, it is questionable whether the RPF can provide reliable results for SRNs. In this paper, we aim to identify conditions under which the RPF converges to the exact filter in the filtering problem determined by a bimolecular network. First, we establish computationally efficient RPFs for SRNs on different scales using different dynamical models, including the continuous-time Markov process, tau-lea** model, and piecewise deterministic process. Then, by parameter sensitivity analyses, we show that the established RPFs converge to the exact filters if all reactions leading to an increase of the molecular population have linearly growing propensities and some other mild conditions are satisfied simultaneously. This ensures the performance of the RPF for a large class of SRNs, and several numerical examples are presented to illustrate our results. △ Less

Submitted 14 October, 2021; originally announced October 2021.

Comments: 28 pages, 6 figures

MSC Class: 60J22; 62M20; 65C05; 92-08; 93E11

Stochastic filtering for multiscale stochastic reaction networks based on hybrid approximations

Authors: Zhou Fang, Ankit Gupta, Mustafa Khammash

Abstract: In the past few decades, the development of fluorescent technologies and microscopic techniques has greatly improved scientists' ability to observe real-time single-cell activities. In this paper, we consider the filtering problem associate with these advanced technologies, i.e., how to estimate latent dynamic states of an intracellular multiscale stochastic reaction network from time-course measu… ▽ More In the past few decades, the development of fluorescent technologies and microscopic techniques has greatly improved scientists' ability to observe real-time single-cell activities. In this paper, we consider the filtering problem associate with these advanced technologies, i.e., how to estimate latent dynamic states of an intracellular multiscale stochastic reaction network from time-course measurements of fluorescent reporters. A good solution to this problem can further improve scientists' ability to extract information about intracellular systems from time-course experiments. A straightforward approach to this filtering problem is to use a particle filter where particles are generated by simulation of the full model and weighted according to observations. However, the exact simulation of the full dynamic model usually takes an impractical amount of computational time and prevents this type of particle filters from being used for real-time applications, such as transcription regulation networks. Inspired by the recent development of hybrid approximations to multiscale chemical reaction networks, we approach the filtering problem in an alternative way. We first prove that accurate solutions to the filtering problem can be constructed by solving the filtering problem for a reduced model that represents the dynamics as a hybrid process. The model reduction is based on exploiting the time-scale separations in the original network and, therefore, can greatly reduce the computational effort required to simulate the dynamics. As a result, we are able to develop efficient particle filters to solve the filtering problem for the original model by applying particle filters to the reduced model. We illustrate the accuracy and the computational efficiency of our approach using several numerical examples. △ Less

Submitted 9 July, 2022; v1 submitted 6 June, 2021; originally announced June 2021.

Comments: 8 figures, 33 pages. Accepted to the Journal of Computational Physics

MSC Class: 60J22; 62M20; 65C05; 92-08; 93E11

Stochastic filters based on hybrid approximations of multiscale stochastic reaction networks

Authors: Zhou Fang, Ankit Gupta, Mustafa Khammash

Abstract: We consider the problem of estimating the dynamic latent states of an intracellular multiscale stochastic reaction network from time-course measurements of fluorescent reporters. We first prove that accurate solutions to the filtering problem can be constructed by solving the filtering problem for a reduced model that represents the dynamics as a hybrid process. The model reduction is based on exp… ▽ More We consider the problem of estimating the dynamic latent states of an intracellular multiscale stochastic reaction network from time-course measurements of fluorescent reporters. We first prove that accurate solutions to the filtering problem can be constructed by solving the filtering problem for a reduced model that represents the dynamics as a hybrid process. The model reduction is based on exploiting the time-scale separations in the original network, and it can greatly reduce the computational effort required to simulate the dynamics. This enables us to develop efficient particle filters to solve the filtering problem for the original model by applying particle filters to the reduced model. We illustrate the accuracy and the computational efficiency of our approach using a numerical example. △ Less

Submitted 8 September, 2020; v1 submitted 26 August, 2020; originally announced August 2020.

Comments: 6 pages, 1 figure. Accepted to CDC 2020

MSC Class: 60J22; 62M20; 65C05; 92-08; 93E11

Ergodicity, Output-Controllability, and Antithetic Integral Control of Uncertain Stochastic Reaction Networks

Authors: Corentin Briat, Mustafa Khammash

Abstract: The ergodicity and the output-controllability of stochastic reaction networks have been shown to be essential properties to fulfill to enable their control using, for instance, antithetic integral control. We propose here to extend those properties to the case of uncertain networks. To this aim, the notions of interval, robust, sign, and structural ergodicity/output-controllability are introduced.… ▽ More The ergodicity and the output-controllability of stochastic reaction networks have been shown to be essential properties to fulfill to enable their control using, for instance, antithetic integral control. We propose here to extend those properties to the case of uncertain networks. To this aim, the notions of interval, robust, sign, and structural ergodicity/output-controllability are introduced. The obtained results lie in the same spirit as those obtained in [Briat, Gupta & Khammash, Cell Systems, 2016] where those properties are characterized in terms of control theoretic concepts, linear algebraic conditions, linear programs, and graph-theoretic/algebraic conditions. An important conclusion is that all those properties can be characterized by linear programs. Two examples are given for illustration. △ Less

Submitted 23 June, 2020; v1 submitted 3 January, 2020; originally announced January 2020.

Comments: 29 pages. arXiv admin note: text overlap with arXiv:1703.00319

A hidden integral structure endows Absolute Concentration Robust systems with resilience to dynamical concentration disturbances

Authors: Daniele Cappelletti, Ankit Gupta, Mustafa Khammash

Abstract: Biochemical systems that express certain chemical species of interest at the same level at any positive equilibrium are called "absolute concentration robust" (ACR). These species behave in a stable, predictable way, in the sense that their expression is robust with respect to sudden changes in the species concentration, regardless the new positive equilibrium reached by the system. Such a propert… ▽ More Biochemical systems that express certain chemical species of interest at the same level at any positive equilibrium are called "absolute concentration robust" (ACR). These species behave in a stable, predictable way, in the sense that their expression is robust with respect to sudden changes in the species concentration, regardless the new positive equilibrium reached by the system. Such a property has been proven to be fundamentally important in certain gene regulatory networks and signaling systems. In the present paper, we mathematically prove that a well-known class of ACR systems studied by Shinar and Feinberg in 2010 hides an internal integral structure. This structure confers these systems with a higher degree of robustness that what was previously unknown. In particular, disturbances much more general than sudden changes in the species concentrations can be rejected, and robust perfect adaptation is achieved. Significantly, we show that these properties are maintained when the system is interconnected with other chemical reaction networks. This key feature enables design of insulator devices that are able to buffer the loading effect from downstream systems - a crucial requirement for modular circuit design in synthetic biology. △ Less

Submitted 12 October, 2019; originally announced October 2019.

MSC Class: 92B05; 37N25; 37N35; 93D09; 93D21; 93B52; 34D20; 37C20

A finite state projection method for steady-state sensitivity analysis of stochastic reaction networks

Authors: Patrik Dürrenberger, Ankit Gupta, Mustafa Khammash

Abstract: Consider the standard stochastic reaction network model where the dynamics is given by a continuous-time Markov chain over a discrete lattice. For such models, estimation of parameter sensitivities is an important problem, but the existing computational approaches to solve this problem usually require time-consuming Monte Carlo simulations of the reaction dynamics. Therefore these simulation-based… ▽ More Consider the standard stochastic reaction network model where the dynamics is given by a continuous-time Markov chain over a discrete lattice. For such models, estimation of parameter sensitivities is an important problem, but the existing computational approaches to solve this problem usually require time-consuming Monte Carlo simulations of the reaction dynamics. Therefore these simulation-based approaches can only be expected to work over finite time-intervals, while it is often of interest in applications to examine the sensitivity values at the steady-state after the Markov chain has relaxed to its stationary distribution. The aim of this paper is to present a computational method for the estimation of steady-state parameter sensitivities, which instead of using simulations, relies on the recently developed stationary Finite State Projection (sFSP) algorithm [J. Chem. Phys. 147, 154101 (2017)] that provides an accurate estimate of the stationary distribution at a fixed set of parameters. We show that sensitivity values at these parameters can be estimated from the solution of a Poisson equation associated with the infinitesimal generator of the Markov chain. We develop an approach to numerically solve the Poisson equation and this yields an efficient estimator for steady-state parameter sensitivities. We illustrate this method using several examples. △ Less

Submitted 11 December, 2018; originally announced December 2018.

Comments: 5 figures

MSC Class: 60J22; 60J27; 60H35; 65C40; 92E20

Ergodicity analysis and antithetic integral control of a class of stochastic reaction networks with delays

Authors: Corentin Briat, Mustafa Khammash

Abstract: Delays are an important phenomenon arising in a wide variety of real world systems. They occur in biological models because of diffusion effects or as simplifying modeling elements. We propose here to consider delayed stochastic reaction networks. The difficulty here lies in the fact that the state-space of a delayed reaction network is infinite-dimensional, which makes their analysis more involve… ▽ More Delays are an important phenomenon arising in a wide variety of real world systems. They occur in biological models because of diffusion effects or as simplifying modeling elements. We propose here to consider delayed stochastic reaction networks. The difficulty here lies in the fact that the state-space of a delayed reaction network is infinite-dimensional, which makes their analysis more involved. We demonstrate here that a particular class of stochastic time-varying delays, namely those that follow a phase-type distribution, can be exactly implemented in terms of a chemical reaction network. Hence, any delay-free network can be augmented to incorporate those delays through the addition of delay-species and delay-reactions. Hence, for this class of stochastic delays, which can be used to approximate any delay distribution arbitrarily accurately, the state-space remains finite-dimensional and, therefore, standard tools developed for standard reaction network still apply. In particular, we demonstrate that for unimolecular mass-action reaction networks that the delayed stochastic reaction network is ergodic if and only if the non-delayed network is ergodic as well. Bimolecular reactions are more difficult to consider but an analogous result is also obtained. These results tell us that delays that are phase-type distributed, regardless of their distribution, are not harmful to the ergodicity property of reaction networks. We also prove that the presence of those delays adds convolution terms in the moment equation but does not change the value of the stationary means compared to the delay-free case. Finally, the control of a certain class of delayed stochastic reaction network using a delayed antithetic integral controller is considered. It is proven that this controller achieves its goal provided that the delay-free network satisfy the conditions of ergodicity and output-controllability. △ Less

Submitted 23 April, 2020; v1 submitted 22 November, 2018; originally announced November 2018.

Comments: 42 pages, 4 figures

In-Silico Proportional-Integral Moment Control of Stochastic Gene Expression

Authors: Corentin Briat, Mustafa Khammash

Abstract: The problem of controlling the mean and the variance of a species of interest in a simple gene expression is addressed. It is shown that the protein mean level can be globally and robustly tracked to any desired value using a simple PI controller that satisfies certain sufficient conditions. Controlling both the mean and variance however requires an additional control input, e.g. the mRNA degradat… ▽ More The problem of controlling the mean and the variance of a species of interest in a simple gene expression is addressed. It is shown that the protein mean level can be globally and robustly tracked to any desired value using a simple PI controller that satisfies certain sufficient conditions. Controlling both the mean and variance however requires an additional control input, e.g. the mRNA degradation rate, and local robust tracking of mean and variance is proved to be achievable using multivariable PI control, provided that the reference point satisfies necessary conditions imposed by the system. Even more importantly, it is shown that there exist PI controllers that locally, robustly and simultaneously stabilize all the equilibrium points inside the admissible region. The results are then extended to the mean control of a gene expression with protein dimerization. It is shown that the moment closure problem can be circumvented without invoking any moment closure technique. Local stabilization and convergence of the average dimer population to any desired reference value is ensured using a pure integral control law. Explicit bounds on the controller gain are provided and shown to be valid for any reference value. As a byproduct, an explicit upper-bound of the variance of the monomer species, acting on the system as unknown input due to the moment openness, is obtained. The results are illustrated by simulation. △ Less

Submitted 21 April, 2020; v1 submitted 27 October, 2018; originally announced October 2018.

Comments: 28 pages; 9 Figures. arXiv admin note: substantial text overlap with arXiv:1207.4766, arXiv:1307.6446

Sensitivity analysis for multiscale stochastic reaction networks using hybrid approximations

Authors: Ankit Gupta, Mustafa Khammash

Abstract: We consider the problem of estimating parameter sensitivities for stochastic models of multiscale reaction networks. These sensitivity values are important for model analysis, and, the methods that currently exist for sensitivity estimation mostly rely on simulations of the stochastic dynamics. This is problematic because these simulations become computationally infeasible for multiscale networks… ▽ More We consider the problem of estimating parameter sensitivities for stochastic models of multiscale reaction networks. These sensitivity values are important for model analysis, and, the methods that currently exist for sensitivity estimation mostly rely on simulations of the stochastic dynamics. This is problematic because these simulations become computationally infeasible for multiscale networks due to reactions firing at several different timescales. However it is often possible to exploit the multiscale property to derive a "model reduction" and approximate the dynamics as a Piecewise Deterministic Markov process (PDMP), which is a hybrid process consisting of both discrete and continuous components. The aim of this paper is to show that such PDMP approximations can be used to accurately and efficiently estimate the parameter sensitivity for the original multiscale stochastic model. We prove the convergence of the original sensitivity to the corresponding PDMP sensitivity, in the limit where the PDMP approximation becomes exact. Moreover we establish a representation of the PDMP parameter sensitivity that separates the contributions of discrete and continuous components in the dynamics, and allows one to efficiently estimate both contributions. △ Less

Submitted 29 September, 2018; v1 submitted 15 January, 2018; originally announced January 2018.

Comments: 34 pages, 4 figures

MSC Class: 60J10; 60J22; 60J27; 60H35; 65C05

Variance reduction for antithetic integral control of stochastic reaction networks

Authors: Corentin Briat, Ankit Gupta, Mustafa Khammash

Abstract: The antithetic integral feedback motif recently introduced in Briat, Gupta & Khammash (Cell Systems, 2017) is known to ensure robust perfect adaptation for the mean dynamics of a given molecular species involved in a complex stochastic biomolecular reaction network. However, it was observed that it also leads to a higher variance in the controlled network than that obtained when using a constituti… ▽ More The antithetic integral feedback motif recently introduced in Briat, Gupta & Khammash (Cell Systems, 2017) is known to ensure robust perfect adaptation for the mean dynamics of a given molecular species involved in a complex stochastic biomolecular reaction network. However, it was observed that it also leads to a higher variance in the controlled network than that obtained when using a constitutive (i.e. open-loop) control strategy. This was interpreted as the cost of the adaptation property and may be viewed as a performance deterioration for the overall controlled network. To decrease this variance and improve the performance, we propose to combine the antithetic integral feedback motif with a negative feedback strategy. Both theoretical and numerical results are obtained. The theoretical ones are based on a tailored moment closure method allowing one to obtain approximate expressions for the stationary variance for the controlled network and predict that the variance can indeed be decreased by increasing the strength of the negative feedback. Numerical results verify the accuracy of this approximation and show that the controlled species variance can indeed be decreased, sometimes below its constitutive level. Three molecular networks are considered in order to verify the wide applicability of two types of negative feedback strategies. The main conclusion is that there is a trade-off between the speed of the settling-time of the mean trajectories and the stationary variance of the controlled species; i.e. smaller variance is associated with larger settling-time. △ Less

Submitted 22 November, 2017; originally announced November 2017.

Comments: 41 pages, 33 figures, 2 tables

Fundamental Limits and Tradeoffs in Autocatalytic Pathways

Authors: Milad Siami, Nader Motee, Gentian Buzi, Bassam Bamieh, Mustafa Khammash, John C. Doyle

Abstract: This paper develops some basic principles to study autocatalytic networks and exploit their structural properties in order to characterize their inherent fundamental limits and tradeoffs. In a dynamical system with autocatalytic structure, the system's output is necessary to catalyze its own production. We consider a simplified model of Glycolysis pathway as our motivating application. First, the… ▽ More This paper develops some basic principles to study autocatalytic networks and exploit their structural properties in order to characterize their inherent fundamental limits and tradeoffs. In a dynamical system with autocatalytic structure, the system's output is necessary to catalyze its own production. We consider a simplified model of Glycolysis pathway as our motivating application. First, the properties of these class of pathways are investigated through a simplified two-state model, which is obtained by lum** all the intermediate reactions into a single intermediate reaction. Then, we generalize our results to autocatalytic pathways that are composed of a chain of enzymatically catalyzed intermediate reactions. We explicitly derive a hard limit on the minimum achievable $\mathcal L_2$-gain disturbance attenuation and a hard limit on its minimum required output energy. Finally, we show how these resulting hard limits lead to some fundamental tradeoffs between transient and steady-state behavior of the network and its net production. △ Less

Submitted 29 June, 2017; originally announced June 2017.

Dynamic disorder in simple enzymatic reactions induces stochastic amplification of substrate

Authors: Ankit Gupta, Andreas Milias-Argeitis, Mustafa Khammash

Abstract: A growing amount of evidence points to the fact that many enzymes exhibit fluctuations in their catalytic activity, which are associated with conformational changes on a broad range of timescales. The experimental study of this phenomenon, termed dynamic disorder, has become possible due to advances in single-molecule enzymology measurement techniques, through which the catalytic activity of indiv… ▽ More A growing amount of evidence points to the fact that many enzymes exhibit fluctuations in their catalytic activity, which are associated with conformational changes on a broad range of timescales. The experimental study of this phenomenon, termed dynamic disorder, has become possible due to advances in single-molecule enzymology measurement techniques, through which the catalytic activity of individual enzyme molecules can be tracked in time. The biological role and importance of these fluctuations in a system with a small number of enzymes such as a living cell have only recently started being explored. In this work, we examine a simple stochastic reaction system consisting of an inflowing substrate and an enzyme with a randomly fluctuating catalytic reaction rate that converts the substrate into an outflowing product. To describe analytically the effect of rate fluctuations on the average substrate abundance at steady-state, we derive an explicit formula that connects the relative speed of enzymatic fluctuations with the mean substrate level. We demonstrate that the relative speed of rate fluctuations can have a dramatic effect on the mean substrate, and lead to large positive deviations from predictions based on the assumption of deterministic enzyme activity. Our results also establish an interesting connection between the amplification effect and the mixing properties of the Markov process describing the enzymatic activity fluctuations, which can be used to easily predict the fluctuation speed above which such deviations become negligible. As the techniques of single-molecule enzymology continuously evolve, it may soon be possible to study the stochastic phenomena due to enzymatic activity fluctuations within living cells. Our work can be used to formulate experimentally testable hypotheses regarding the magnitude of these fluctuations, as well as their phenotypic consequences. △ Less

Submitted 27 July, 2017; v1 submitted 28 April, 2017; originally announced April 2017.

Comments: 7 Figures

MSC Class: 92C42; 92C45; 60J22; 60J28; 65C40

A finite state projection algorithm for the stationary solution of the chemical master equation

Authors: Ankit Gupta, Jan Mikelson, Mustafa Khammash

Abstract: The chemical master equation (CME) is frequently used in systems biology to quantify the effects of stochastic fluctuations that arise due to biomolecular species with low copy numbers. The CME is a system of ordinary differential equations that describes the evolution of probability density for each population vector in the state-space of the stochastic reaction dynamics. For many examples of int… ▽ More The chemical master equation (CME) is frequently used in systems biology to quantify the effects of stochastic fluctuations that arise due to biomolecular species with low copy numbers. The CME is a system of ordinary differential equations that describes the evolution of probability density for each population vector in the state-space of the stochastic reaction dynamics. For many examples of interest, this state-space is infinite, making it difficult to obtain exact solutions of the CME. To deal with this problem, the Finite State Projection (FSP) algorithm was developed by Munsky and Khammash (Jour. Chem. Phys. 2006), to provide approximate solutions to the CME by truncating the state-space. The FSP works well for finite time-periods but it cannot be used for estimating the stationary solutions of CMEs, which are often of interest in systems biology. The aim of this paper is to develop a version of FSP which we refer to as the stationary FSP (sFSP) that allows one to obtain accurate approximations of the stationary solutions of a CME by solving a finite linear-algebraic system that yields the stationary distribution of a continuous-time Markov chain over the truncated state-space. We derive bounds for the approximation error incurred by sFSP and we establish that under certain stability conditions, these errors can be made arbitrarily small by appropriately expanding the truncated state-space. We provide several examples to illustrate our sFSP method and demonstrate its efficiency in estimating the stationary distributions. In particular, we show that using a quantised tensor train (QTT) implementation of our sFSP method, problems admitting more than 100 million states can be efficiently solved. △ Less

Submitted 20 September, 2017; v1 submitted 24 April, 2017; originally announced April 2017.

Comments: 8 figures

MSC Class: 60J22; 60J27; 60H35; 65C40; 92E20

Simple interval observers for linear impulsive systems with applications to sampled-data and switched systems

Authors: Corentin Briat, Mustafa Khammash

Abstract: Sufficient conditions for the design of a simple class of interval observers for linear impulsive systems subject to minimum and range dwell-time constraints are obtained and formulated in terms of infinite-dimensional linear programs. The proposed approach is fully constructive in the sense that suitable observer gains can be extracted from the solution of the optimization problems and is flexibl… ▽ More Sufficient conditions for the design of a simple class of interval observers for linear impulsive systems subject to minimum and range dwell-time constraints are obtained and formulated in terms of infinite-dimensional linear programs. The proposed approach is fully constructive in the sense that suitable observer gains can be extracted from the solution of the optimization problems and is flexible enough to be extended to include performance constraints and parametric uncertainties. In order to be solvable, the infinite-dimensional linear programs are relaxed using a method based on sum of squares which is known to be asymptotically exact in the present case. Three examples are given for illustration: the first one pertains on the interval observation of an impulsive system under a minimum dwell-time constraint, the second one is about the interval observation of an aperiodic sampled-data system and the last one is about the interval observation of a linear switched system. △ Less

Submitted 29 March, 2017; v1 submitted 11 March, 2017; originally announced March 2017.

Comments: 14 pages, 1 figure

Stability analysis of LPV systems with piecewise differentiable parameters

Authors: Corentin Briat, Mustafa Khammash

Abstract: Linear Parameter-Varying (LPV) systems with piecewise differentiable parameters is a class of LPV systems for which no proper analysis conditions have been obtained so far. To fill this gap, we propose an approach based on the theory of hybrid systems. The underlying idea is to reformulate the considered LPV system as an equivalent hybrid system that will incorporate, through a suitable state augm… ▽ More Linear Parameter-Varying (LPV) systems with piecewise differentiable parameters is a class of LPV systems for which no proper analysis conditions have been obtained so far. To fill this gap, we propose an approach based on the theory of hybrid systems. The underlying idea is to reformulate the considered LPV system as an equivalent hybrid system that will incorporate, through a suitable state augmentation, information on both the dynamics of the state of the system and the considered class of parameter trajectories. Then, using a result pertaining on the stability of hybrid systems, two stability conditions are established and shown to naturally generalize and unify the well-known quadratic and robust stability criteria together. The obtained conditions being infinite-dimensional, a relaxation approach based on sum of squares programming is used in order to obtain tractable finite-dimensional conditions. The approach is finally illustrated on two examples from the literature. △ Less

Submitted 11 March, 2017; v1 submitted 8 March, 2017; originally announced March 2017.

Comments: 14 pages, 2 figures, 1 table

Estimation of parameter sensitivities for stochastic reaction networks using tau-leap simulations

Authors: Ankit Gupta, Muruhan Rathinam, Mustafa Khammash

Abstract: We consider the important problem of estimating parameter sensitivities for stochastic models of reaction networks that describe the dynamics as a continuous-time Markov process over a discrete lattice. These sensitivity values are useful for understanding network properties, validating their design and identifying the pivotal model parameters. Many methods for sensitivity estimation have been dev… ▽ More We consider the important problem of estimating parameter sensitivities for stochastic models of reaction networks that describe the dynamics as a continuous-time Markov process over a discrete lattice. These sensitivity values are useful for understanding network properties, validating their design and identifying the pivotal model parameters. Many methods for sensitivity estimation have been developed, but their computational feasibility suffers from the critical bottleneck of requiring time-consuming Monte Carlo simulations of the exact reaction dynamics. To circumvent this problem one needs to devise methods that speed up the computations while suffering acceptable and quantifiable loss of accuracy. We develop such a method by first deriving a novel integral representation of parameter sensitivity and then demonstrating that this integral may be approximated by any convergent tau-leap method. Our method is easy to implement, works with any tau-leap simulation scheme and its accuracy is proved to be similar to that of the underlying tau-leap scheme. We demonstrate the efficiency of our methods through numerical examples. We also compare our method with the tau-leap versions of certain finite-difference schemes that are commonly used for sensitivity estimations. △ Less

Submitted 11 January, 2018; v1 submitted 1 March, 2017; originally announced March 2017.

Comments: 31 pages, 4 figures

MSC Class: 60J22; 60J27; 60H35; 65C05

Robust and structural ergodicity analysis of stochastic biomolecular networks involving synthetic antithetic integral controllers

Authors: Corentin Briat, Mustafa Khammash

Abstract: Ergodicity and output controllability have been shown to be fundamental concepts for the analysis and synthetic design of closed-loop stochastic reaction networks, as exemplified by the use of antithetic integral feedback controllers. In [Gupta, Briat & Khammash, PLoS Comput. Biol., 2014], some ergodicity and output controllability conditions for unimolecular and certain classes of bimolecular rea… ▽ More Ergodicity and output controllability have been shown to be fundamental concepts for the analysis and synthetic design of closed-loop stochastic reaction networks, as exemplified by the use of antithetic integral feedback controllers. In [Gupta, Briat & Khammash, PLoS Comput. Biol., 2014], some ergodicity and output controllability conditions for unimolecular and certain classes of bimolecular reaction networks were obtained and formulated through linear programs. To account for context dependence, these conditions were later extended in [Briat & Khammash, CDC, 2016] to reaction networks with uncertain rate parameters using simple and tractable, yet potentially conservative, methods. Here we develop some exact theoretical methods for verifying, in a robust setting, the original ergodicity and output controllability conditions based on algebraic and polynomial techniques. Some examples are given for illustration. △ Less

Submitted 27 November, 2018; v1 submitted 1 March, 2017; originally announced March 2017.

Comments: 18 pages; 1 Figure

A Molecular Implementation of the Least Mean Squares Estimator

Authors: Christoph Zechner, Mustafa Khammash

Abstract: In order to function reliably, synthetic molecular circuits require mechanisms that allow them to adapt to environmental disturbances. Least mean squares (LMS) schemes, such as commonly encountered in signal processing and control, provide a powerful means to accomplish that goal. In this paper we show how the traditional LMS algorithm can be implemented at the molecular level using only a few ele… ▽ More In order to function reliably, synthetic molecular circuits require mechanisms that allow them to adapt to environmental disturbances. Least mean squares (LMS) schemes, such as commonly encountered in signal processing and control, provide a powerful means to accomplish that goal. In this paper we show how the traditional LMS algorithm can be implemented at the molecular level using only a few elementary biomolecular reactions. We demonstrate our approach using several simulation studies and discuss its relevance to synthetic biology. △ Less

Submitted 3 January, 2017; originally announced January 2017.

Comments: Molecular circuits, synthetic biology, least mean squares estimator, adaptive systems

Journal ref: 2016 IEEE 55th Conference on Decision and Control (CDC)

Robust ergodicity and tracking in antithetic integral control of stochastic biochemical reaction networks

Authors: Corentin Briat, Mustafa Khammash

Abstract: Controlling stochastic reactions networks is a challenging problem with important implications in various fields such as systems and synthetic biology. Various regulation motifs have been discovered or posited over the recent years, the most recent one being the so-called Antithetic Integral Control (AIC) motif in Briat et al. (Cell Systems, 2016). Several favorable properties for the AIC motif ha… ▽ More Controlling stochastic reactions networks is a challenging problem with important implications in various fields such as systems and synthetic biology. Various regulation motifs have been discovered or posited over the recent years, the most recent one being the so-called Antithetic Integral Control (AIC) motif in Briat et al. (Cell Systems, 2016). Several favorable properties for the AIC motif have been demonstrated for classes of reaction networks that satisfy certain irreducibility, ergodicity and output controllability conditions. Here we address the problem of verifying these conditions for large sets of reaction networks with fixed topology using two different approaches. The first one is quantitative and relies on the notion of interval matrices while the second one is qualitative and is based on sign properties of matrices. The obtained results lie in the same spirit as those obtained in Briat et al. (Cell Systems, 2016) where properties of reaction networks are independently characterized in terms of control theoretic concepts, linear programming conditions and graph theoretic conditions. △ Less

Submitted 27 November, 2018; v1 submitted 24 July, 2016; originally announced July 2016.

Comments: 6 pages, 1 table

A parallelizable sampling method for parameter inference of large biochemical reaction models

Authors: Jan Mikelson, Mustafa Khammash

Abstract: The development of mechanistic models of biological systems is a central part of Systems Biology. One major task in develo** these models is the inference of the correct model parameters. Due to the size of most realistic models and their possibly complex dynamical behaviour one must usually rely on sample based methods. In this paper we present a novel algorithm that reliably estimates model pa… ▽ More The development of mechanistic models of biological systems is a central part of Systems Biology. One major task in develo** these models is the inference of the correct model parameters. Due to the size of most realistic models and their possibly complex dynamical behaviour one must usually rely on sample based methods. In this paper we present a novel algorithm that reliably estimates model parameters for deterministic as well as stochastic models from trajectory data. Our algorithm samples iteratively independent particles from the level sets of the likelihood and recovers the posterior from these level sets. The presented approach is easily parallelizable and, by utilizing density estimation through Dirichlet Process Gaussian Mixture Models, can deal with high dimensional parameter spaces. We illustrate that our algorithm is applicable to large, realistic deterministic and stochastic models and succeeds in inferring the correct posterior from a given number of observed trajectories. This algorithm presents a novel, computationally feasible approach to identify parameters of large biochemical reaction models based on sample path data. △ Less

Submitted 27 June, 2016; originally announced June 2016.

Parameter inference method for stochastic single-cell dynamics from tree-structured data

Authors: Irena Kuzmanovska, Andreas Milias-Argeitis, Christoph Zechner, Mustafa Khammash

Abstract: With the advance of experimental techniques such as time-lapse fluorescence microscopy, the availability of single-cell trajectory data has vastly increased, and so has the demand for computational methods suitable for parameter inference with this type of data. However, most of the currently available methods treat single-cell trajectories independently, ignoring the mother-daughter relationships… ▽ More With the advance of experimental techniques such as time-lapse fluorescence microscopy, the availability of single-cell trajectory data has vastly increased, and so has the demand for computational methods suitable for parameter inference with this type of data. However, most of the currently available methods treat single-cell trajectories independently, ignoring the mother-daughter relationships and the information provided by population structure. This information is however essential if a process of interest happens at cell division, or if it evolves slowly compared to the duration of the cell cycle. In this work, we highlight the importance of tracking cell lineage trees and propose a Bayesian framework for parameter inference on tree-structured data. Our method relies on a combination of Sequential Monte Carlo for likelihood approximation and Markov Chain Monte Carlo for parameter sampling. We demonstrate the capabilities of our inference framework on two simple examples in which the lineage tree information is necessary: one in which the cell phenotype can only switch at cell division and another where the cell type fluctuates randomly over timescales that extend well beyond the lifetime of a single cell. △ Less

Submitted 5 July, 2016; v1 submitted 18 May, 2016; originally announced May 2016.

Interval peak-to-peak observers for continuous- and discrete-time systems with persistent inputs and delays

Authors: Corentin Briat, Mustafa Khammash

Abstract: While the design of optimal peak-to-peak controllers/observers for linear systems is known to be a difficult problem, this problem becomes interestingly much easier in the context of interval observers because of the positive nature of the error dynamics. Indeed, by exploiting several recent results on positive systems, we propose a novel and non-conservative approach formulated in terms of tracta… ▽ More While the design of optimal peak-to-peak controllers/observers for linear systems is known to be a difficult problem, this problem becomes interestingly much easier in the context of interval observers because of the positive nature of the error dynamics. Indeed, by exploiting several recent results on positive systems, we propose a novel and non-conservative approach formulated in terms of tractable finite-dimensional linear programs for designing a class of interval observers achieving minimum peak-to-peak gain. The optimal observer is notably shown to be uniform over the set of all possible map**s between observation errors and their weighted versions, which parallels a recent result on the stabilization of linear positive systems. Results pertaining on the interval observation of time-delay and discrete-time systems are then obtained as a direct application of the proposed method, emphasizing then its versatility. Several examples on the interval observation of linear and nonlinear systems are finally given for illustration. △ Less

Submitted 29 July, 2016; v1 submitted 24 November, 2015; originally announced November 2015.

Comments: 10 pages, 4 figures

Computational identification of irreducible state-spaces for stochastic reaction networks

Authors: Ankit Gupta, Mustafa Khammash

Abstract: Stochastic models of reaction networks are becoming increasingly important in Systems Biology. In these models, the dynamics is generally represented by a continuous-time Markov chain whose states denote the copy-numbers of the constituent species. The state-space on which this process resides is a subset of non-negative integer lattice and for many examples of interest, this state-space is counta… ▽ More Stochastic models of reaction networks are becoming increasingly important in Systems Biology. In these models, the dynamics is generally represented by a continuous-time Markov chain whose states denote the copy-numbers of the constituent species. The state-space on which this process resides is a subset of non-negative integer lattice and for many examples of interest, this state-space is countably infinite. This causes numerous problems in analyzing the Markov chain and understanding its long-term behavior. These problems are further confounded by the presence of conservation relations among species which constrain the dynamics in complicated ways. In this paper we provide a linear-algebraic procedure to disentangle these conservation relations and represent the state-space in a special decomposed form, based on the copy-number ranges of various species and dependencies among them. This decomposed form is advantageous for analyzing the stochastic model and for a large class of networks we demonstrate how this form can be used for finding all the closed communication classes for the Markov chain within the infinite state-space. Such communication classes are irreducible state-spaces for the dynamics and they support all the extremal stationary distributions for the Markov chain. Hence our results provide important insights into the long-term behavior and stability properties of stochastic models of reaction networks. We discuss how the knowledge of these irreducible state-spaces can be used in many ways such as speeding-up stochastic simulations of multiscale networks or in identifying the stationary distributions of complex-balanced networks. We illustrate our results with several examples of gene-expression networks from Systems Biology. △ Less

Submitted 9 February, 2018; v1 submitted 25 May, 2015; originally announced May 2015.

MSC Class: 60J22; 60J27; 60H35; 65C05

Stochastic focusing coupled with negative feedback enables robust regulation in biochemical reaction networks

Authors: Andreas Milias-Argeitis, Stefan Engblom, Pavol Bauer, Mustafa Khammash

Abstract: Nature presents multiple intriguing examples of processes which proceed at high precision and regularity. This remarkable stability is frequently counter to modelers' experience with the inherent stochasticity of chemical reactions in the regime of low copy numbers. Moreover, the effects of noise and nonlinearities can lead to "counter-intuitive" behavior, as demonstrated for a basic enzymatic rea… ▽ More Nature presents multiple intriguing examples of processes which proceed at high precision and regularity. This remarkable stability is frequently counter to modelers' experience with the inherent stochasticity of chemical reactions in the regime of low copy numbers. Moreover, the effects of noise and nonlinearities can lead to "counter-intuitive" behavior, as demonstrated for a basic enzymatic reaction scheme that can display stochastic focusing (SF). Under the assumption of rapid signal fluctuations, SF has been shown to convert a graded response into a threshold mechanism, thus attenuating the detrimental effects of signal noise. However, when the rapid fluctuation assumption is violated, this gain in sensitivity is generally obtained at the cost of very large product variance, and this unpredictable behavior may be one possible explanation of why, more than a decade after its introduction, SF has still not been observed in real biochemical systems. In this work we explore the noise properties of a simple enzymatic reaction mechanism with a small and fluctuating number of active enzymes that behaves as a high-gain, noisy amplifier due to SF caused by slow enzyme fluctuations. We then show that the inclusion of a plausible negative feedback mechanism turns the system from a noisy signal detector to a strong homeostatic mechanism by exchanging high gain with strong attenuation in output noise and robustness to parameter variations. Moreover, we observe that the discrepancy between deterministic and stochastic descriptions of stochastically focused systems in the evolution of the means almost completely disappears, despite very low molecule counts and the additional nonlinearity due to feedback. The reaction mechanism considered here can provide a possible resolution to the apparent conflict between intrinsic noise and high precision in critical intracellular processes. △ Less

Submitted 29 September, 2015; v1 submitted 30 April, 2015; originally announced April 2015.

Journal ref: J. R. Soc. Interface 12(113), pp. 1-10 (2015)

Optimization-based Lyapunov function construction for continuous-time Markov chains with affine transition rates

Authors: Andreas Milias-Argeitis, Mustafa Khammash

Abstract: We address the problem of Lyapunov function construction for a class of continuous-time Markov chains with affine transition rates, typically encountered in stochastic chemical kinetics. Following an optimization approach, we take advantage of existing bounds from the Foster-Lyapunov stability theory to obtain functions that enable us to estimate the region of high stationary probability, as well… ▽ More We address the problem of Lyapunov function construction for a class of continuous-time Markov chains with affine transition rates, typically encountered in stochastic chemical kinetics. Following an optimization approach, we take advantage of existing bounds from the Foster-Lyapunov stability theory to obtain functions that enable us to estimate the region of high stationary probability, as well as provide upper bounds on moments of the chain. Our method can be used to study the stationary behavior of a given chain without resorting to stochastic simulation, in a fast and efficient manner. △ Less

Submitted 24 December, 2014; originally announced December 2014.

Antithetic Integral Feedback ensures robust perfect adaptation in noisy biomolecular networks

Authors: Corentin Briat, Ankit Gupta, Mustafa Khammash

Abstract: Homeostasis is a running theme in biology. Often achieved through feedback regulation strategies, homeostasis allows living cells to control their internal environment as a means for surviving changing and unfavourable environments. While many endogenous homeostatic motifs have been studied in living cells, some other motifs may remain under-explored or even undiscovered. At the same time, known r… ▽ More Homeostasis is a running theme in biology. Often achieved through feedback regulation strategies, homeostasis allows living cells to control their internal environment as a means for surviving changing and unfavourable environments. While many endogenous homeostatic motifs have been studied in living cells, some other motifs may remain under-explored or even undiscovered. At the same time, known regulatory motifs have been mostly analyzed at the deterministic level, and the effect of noise on their regulatory function has received low attention. Here we lay the foundation for a regulation theory at the molecular level that explicitly takes into account the noisy nature of biochemical reactions and provides novel tools for the analysis and design of robust homeostatic circuits. Using these ideas, we propose a new regulation motif, which we refer to as {\em antithetic integral feedback, and demonstrate its effectiveness as a strategy for generically regulating a wide class of reaction networks. By combining tools from probability and control theory, we show that the proposed motif preserves the stability of the overall network, steers the population of any regulated species to a desired set point, and achieves robust perfect adaptation -- all with low prior knowledge of reaction rates. Moreover, our proposed regulatory motif can be implemented using a very small number of molecules and hence has a negligible metabolic load. Strikingly, the regulatory motif exploits stochastic noise, leading to enhanced regulation in scenarios where noise-free implementations result in dysregulation. Finally, we discuss the possible manifestation of the proposed antithetic integral feedback motif in endogenous biological circuits and its realization in synthetic circuits. △ Less

Submitted 13 January, 2016; v1 submitted 22 October, 2014; originally announced October 2014.

Comments: 20 pages, 5 figures

Unbiased estimation of second-order parameter sensitivities for stochastic reaction networks

Authors: Ankit Gupta, Mustafa Khammash

Abstract: This paper deals with the problem of estimating second-order parameter sensitivities for stochastic reaction networks, where the reaction dynamics is modeled as a continuous time Markov chain over a discrete state space. Estimation of such second-order sensitivities (the Hessian) is necessary for implementing the Newton-Raphson scheme for optimization over the parameter space. To perform this esti… ▽ More This paper deals with the problem of estimating second-order parameter sensitivities for stochastic reaction networks, where the reaction dynamics is modeled as a continuous time Markov chain over a discrete state space. Estimation of such second-order sensitivities (the Hessian) is necessary for implementing the Newton-Raphson scheme for optimization over the parameter space. To perform this estimation, Wolf and Anderson have proposed an efficient finite-difference method, that uses a coupling of perturbed processes to reduce the estimator variance. The aim of this paper is to illustrate that the same coupling can be exploited to derive an exact representation for second-order parameter sensitivity. Furthermore with this representation one can construct an unbiased estimator which is easy to implement. The ideas contained in this paper are extensions of the ideas presented in our recent papers on first-order parameter sensitivity estimation. △ Less

Submitted 28 July, 2014; originally announced July 2014.

Comments: Work in progress. Any feedback from the readers is welcome

Adaptive Hybrid Simulations for Multiscale Stochastic Reaction Networks

Authors: Benjamin Hepp, Ankit Gupta, Mustafa Khammash

Abstract: The probability distribution describing the state of a Stochastic Reaction Network evolves according to the Chemical Master Equation (CME). It is common to estimated its solution using Monte Carlo methods such as the Stochastic Simulation Algorithm (SSA). In many cases these simulations can take an impractical amount of computational time. Therefore many methods have been developed that approximat… ▽ More The probability distribution describing the state of a Stochastic Reaction Network evolves according to the Chemical Master Equation (CME). It is common to estimated its solution using Monte Carlo methods such as the Stochastic Simulation Algorithm (SSA). In many cases these simulations can take an impractical amount of computational time. Therefore many methods have been developed that approximate the Stochastic Process underlying the Chemical Master Equation. Prominent strategies are Hybrid Models that regard the firing of some reaction channels as being continuous and applying the quasi-stationary assumption to approximate the dynamics of fast subnetworks. However as the dynamics of a Stochastic Reaction Network changes with time these approximations might have to be adapted during the simulation. We develop a method that approximates the solution of a CME by automatically partitioning the reaction dynamics into discrete/continuous components and applying the quasi-stationary assumption on identifiable fast subnetworks. Our method does not require user intervention and it adapts to exploit the changing timescale separation between reactions and/or changing magnitudes of copy numbers of constituent species. We demonstrate the efficiency of the proposed method by considering examples from Systems Biology and showing that very good approximations to the exact probability distributions can be achieved in significantly less computational time. △ Less

Submitted 5 January, 2015; v1 submitted 14 February, 2014; originally announced February 2014.

Comments: 43 pages, 12 figures, 5 tables

An efficient and unbiased method for sensitivity analysis of stochastic reaction networks

Authors: Ankit Gupta, Mustafa Khammash

Abstract: We consider the problem of estimating parameter sensitivity for Markovian models of reaction networks. Sensitivity values measure the responsiveness of an output to the model parameters. They help in analyzing the network, understanding its robustness properties and identifying the important reactions for a specific output. Sensitivity values are commonly estimated using methods that perform finit… ▽ More We consider the problem of estimating parameter sensitivity for Markovian models of reaction networks. Sensitivity values measure the responsiveness of an output to the model parameters. They help in analyzing the network, understanding its robustness properties and identifying the important reactions for a specific output. Sensitivity values are commonly estimated using methods that perform finite-difference computations along with Monte Carlo simulations of the reaction dynamics. These methods are computationally efficient and easy to implement, but they produce a biased estimate which can be unreliable for certain applications. Moreover the size of the bias is generally unknown and hence the accuracy of these methods cannot be easily determined. There also exist unbiased schemes for sensitivity estimation but these schemes can be computationally infeasible, even for simple networks. Our goal in this paper is to present a new method for sensitivity estimation, which combines the computational efficiency of finite-difference methods with the accuracy of unbiased schemes. Our method is easy to implement and it relies on an exact representation of parameter sensitivity that we recently proved in an earlier paper. Through examples we demonstrate that the proposed method can outperform the existing methods, both biased and unbiased, in many situations. △ Less

Submitted 17 April, 2014; v1 submitted 13 February, 2014; originally announced February 2014.

MSC Class: 60J22; 60J27; 60H35; 65C05

Variance reduction for steady-state simulation and sensitivity analysis of stochastic chemical systems

Authors: Andreas Milias-Argeitis, John Lygeros, Mustafa Khammash

Abstract: We address the problem of estimating steady-state quantities associated to systems of stochastic chemical kinetics. In most cases of interest these systems are analytically intractable, and one has to resort to computational methods to estimate stationary values of cost functions. In this work we consider a previously introduced variance reduction method and present an algorithm for its applicatio… ▽ More We address the problem of estimating steady-state quantities associated to systems of stochastic chemical kinetics. In most cases of interest these systems are analytically intractable, and one has to resort to computational methods to estimate stationary values of cost functions. In this work we consider a previously introduced variance reduction method and present an algorithm for its application in the context of stochastic chemical kinetics. Using two numerical examples, we test the efficiency of the method for the calculation of steady-state parametric sensitivities and evaluate its performance in comparison to other estimation methods. △ Less

Submitted 20 January, 2014; originally announced January 2014.

Determining the long-term behavior of cell populations: A new procedure for detecting ergodicity in large stochastic reaction networks

Authors: Ankit Gupta, Mustafa Khammash

Abstract: A reaction network consists of a finite number of species, which interact through predefined reaction channels. Traditionally such networks were modeled deterministically, but it is now well-established that when reactant copy numbers are small, the random timing of the reactions create internal noise that can significantly affect the macroscopic properties of the system. To understand the role of… ▽ More A reaction network consists of a finite number of species, which interact through predefined reaction channels. Traditionally such networks were modeled deterministically, but it is now well-established that when reactant copy numbers are small, the random timing of the reactions create internal noise that can significantly affect the macroscopic properties of the system. To understand the role of noise and quantify its effects, stochastic models are necessary. In the stochastic setting, the population is described by a probability distribution, which evolves according to a set of ordinary differential equations known as the Chemical Master Equation (CME). This set is infinite in most cases making the CME practically unsolvable. In many applications, it is important to determine if the solution of a CME has a globally attracting fixed point. This property is called ergodicity and its presence leads to several important insights about the underlying dynamics. The goal of this paper is to present a simple procedure to verify ergodicity in stochastic reaction networks. We provide a set of simple linear-algebraic conditions which are sufficient for the network to be ergodic. In particular, our main condition can be cast as a Linear Feasibility Problem (LFP) which is essentially the problem of determining the existence of a vector satisfying certain linear constraints. The inherent scalability of LFPs make our approach efficient, even for very large networks. We illustrate our procedure through an example from systems biology. △ Less

Submitted 10 December, 2013; originally announced December 2013.

Comments: 10 pages

MSC Class: 60J27; 60J22

Sensitivity analysis for stochastic chemical reaction networks with multiple time-scales

Authors: Ankit Gupta, Mustafa Khammash

Abstract: Stochastic models for chemical reaction networks have become very popular in recent years. For such models, the estimation of parameter sensitivities is an important and challenging problem. Sensitivity values help in analyzing the network, understanding its robustness properties and also in identifying the key reactions for a given outcome. Most of the methods that exist in the literature for the… ▽ More Stochastic models for chemical reaction networks have become very popular in recent years. For such models, the estimation of parameter sensitivities is an important and challenging problem. Sensitivity values help in analyzing the network, understanding its robustness properties and also in identifying the key reactions for a given outcome. Most of the methods that exist in the literature for the estimation of parameter sensitivities, rely on Monte Carlo simulations using Gillespie's stochastic simulation algorithm or its variants. It is well-known that such simulation methods can be prohibitively expensive when the network contains reactions firing at different time-scales, which is a feature of many important biochemical networks. For such networks, it is often possible to exploit the time-scale separation and approximately capture the original dynamics by simulating a "reduced" model, which is obtained by eliminating the fast reactions in a certain way. The aim of this paper is to tie these model reduction techniques with sensitivity analysis. We prove that under some conditions, the sensitivity values of the reduced model can be used to approximately recover the sensitivity values for the original model. Through an example we illustrate how our result can help in sharply reducing the computational costs for the estimation of parameter sensitivities for reaction networks with multiple time-scales. To prove our result, we use coupling arguments based on the random time change representation of Kurtz. We also exploit certain connections between the distributions of the occupation times of Markov chains and multi-dimensional wave equations. △ Less

Submitted 7 October, 2013; originally announced October 2013.

MSC Class: 60J10; 60J22; 60J27; 60H35; 65C05

Integral population control of a quadratic dimerization process

Authors: Corentin Briat, Mustafa Khammash

Abstract: Moment control of a simple quadratic reaction network describing a dimerization process is addressed. It is shown that the moment closure problem can be circumvented without invoking any moment closure technique. Local stabilization and convergence of the average dimer population to any desired reference value is ensured using a pure integral control law. Explicit bounds on the controller gain are… ▽ More Moment control of a simple quadratic reaction network describing a dimerization process is addressed. It is shown that the moment closure problem can be circumvented without invoking any moment closure technique. Local stabilization and convergence of the average dimer population to any desired reference value is ensured using a pure integral control law. Explicit bounds on the controller gain are provided and shown to be valid for any reference value. As a byproduct, an explicit upper-bound of the variance of the monomer species, acting on the system as unknown input due to the moment openness, is obtained. The obtained results are illustrated by an example relying on the simulation of a cell population using stochastic simulation algorithms. △ Less

Submitted 13 August, 2013; v1 submitted 24 July, 2013; originally announced July 2013.

Comments: 7 pages; 3 figures; accepted at the 52nd IEEE Conference on Decision and Control

A scalable computational framework for establishing long-term behavior of stochastic reaction networks

Authors: Ankit Gupta, Corentin Briat, Mustafa Khammash

Abstract: Reaction networks are systems in which the populations of a finite number of species evolve through predefined interactions. Such networks are found as modeling tools in many biological disciplines such as biochemistry, ecology, epidemiology, immunology, systems biology and synthetic biology. It is now well-established that, for small population sizes, stochastic models for biochemical reaction ne… ▽ More Reaction networks are systems in which the populations of a finite number of species evolve through predefined interactions. Such networks are found as modeling tools in many biological disciplines such as biochemistry, ecology, epidemiology, immunology, systems biology and synthetic biology. It is now well-established that, for small population sizes, stochastic models for biochemical reaction networks are necessary to capture randomness in the interactions. The tools for analyzing such models, however, still lag far behind their deterministic counterparts. In this paper, we bridge this gap by develo** a constructive framework for examining the long-term behavior and stability properties of the reaction dynamics in a stochastic setting. In particular, we address the problems of determining ergodicity of the reaction dynamics, which is analogous to having a globally attracting fixed point for deterministic dynamics. We also examine when the statistical moments of the underlying process remain bounded with time and when they converge to their steady state values. The framework we develop relies on a blend of ideas from probability theory, linear algebra and optimization theory. We demonstrate that the stability properties of a wide class of biological networks can be assessed from our sufficient theoretical conditions that can be recast as efficient and scalable linear programs, well-known for their tractability. It is notably shown that the computational complexity is often linear in the number of species. We illustrate the validity, the efficiency and the wide applicability of our results on several reaction networks arising in biochemistry, systems biology, epidemiology and ecology. The biological implications of the results as well as an example of a non-ergodic biological network are also discussed. △ Less

Submitted 5 May, 2014; v1 submitted 19 April, 2013; originally announced April 2013.

Comments: 31 pages, 9 figures

Automatic crosswind flight of tethered wings for airborne wind energy: modeling, control design and experimental results

Authors: Lorenzo Fagiano, Aldo U. Zgraggen, Manfred Morari, Mustafa Khammash

Abstract: An approach to control tethered wings for airborne wind energy is proposed. A fixed length of the lines is considered, and the aim of the control system is to obtain figure-eight crosswind trajectories. The proposed technique is based on the notion of the wing's "velocity angle" and, in contrast with most existing approaches, it does not require a measurement of the wind speed or of the effective… ▽ More An approach to control tethered wings for airborne wind energy is proposed. A fixed length of the lines is considered, and the aim of the control system is to obtain figure-eight crosswind trajectories. The proposed technique is based on the notion of the wing's "velocity angle" and, in contrast with most existing approaches, it does not require a measurement of the wind speed or of the effective wind at the wing's location. Moreover, the proposed approach features few parameters, whose effects on the system's behavior are very intuitive, hence simplifying tuning procedures. A simplified model of the steering dynamics of the wing is derived from first-principle laws, compared with experimental data and used for the control design. The control algorithm is divided into a low-level loop for the velocity angle and a high-level guidance strategy to achieve the desired flight patterns. The robustness of the inner loop is verified analytically, and the overall control system is tested experimentally on a small-scale prototype, with varying wind conditions and using different wings. △ Less

Submitted 26 August, 2013; v1 submitted 6 January, 2013; originally announced January 2013.

Comments: This manuscript is a preprint of a paper accepted for publication on the IEEE Transactions on Control Systems Technology and is subject to IEEE Copyright. The copy of record is available at IEEEXplore library: http://ieeexplore.ieee.org/

On sensor fusion for airborne wind energy systems

Authors: Lorenzo Fagiano, Khahn Huynh, Bassam Bamieh, Mustafa Khammash

Abstract: A study on filtering aspects of airborne wind energy generators is presented. This class of renewable energy systems aims to convert the aerodynamic forces generated by tethered wings, flying in closed paths transverse to the wind flow, into electricity. The accurate reconstruction of the wing's position, velocity and heading is of fundamental importance for the automatic control of these kinds of… ▽ More A study on filtering aspects of airborne wind energy generators is presented. This class of renewable energy systems aims to convert the aerodynamic forces generated by tethered wings, flying in closed paths transverse to the wind flow, into electricity. The accurate reconstruction of the wing's position, velocity and heading is of fundamental importance for the automatic control of these kinds of systems. The difficulty of the estimation problem arises from the nonlinear dynamics, wide speed range, large accelerations and fast changes of direction that the wing experiences during operation. It is shown that the overall nonlinear system has a specific structure allowing its partitioning into sub-systems, hence leading to a series of simpler filtering problems. Different sensor setups are then considered, and the related sensor fusion algorithms are presented. The results of experimental tests carried out with a small-scale prototype and wings of different sizes are discussed. The designed filtering algorithms rely purely on kinematic laws, hence they are independent from features like wing area, aerodynamic efficiency, mass, etc. Therefore, the presented results are representative also of systems with larger size and different wing design, different number of tethers and/or rigid wings. △ Less

Submitted 12 July, 2013; v1 submitted 21 November, 2012; originally announced November 2012.

Comments: This manuscript is a preprint of a paper accepted for publication on the IEEE Transactions on Control Systems Technology and is subject to IEEE Copyright. The copy of record is available at IEEEXplore library: http://ieeexplore.ieee.org/

Unbiased estimation of parameter sensitivities for stochastic chemical reaction networks

Authors: Ankit Gupta, Mustafa Khammash

Abstract: Estimation of parameter sensitivities for stochastic chemical reaction networks is an important and challenging problem. Sensitivity values are important in the analysis, modeling and design of chemical networks. They help in understanding the robustness properties of the system and also in identifying the key reactions for a given outcome. In a discrete setting, most of the methods that exist in… ▽ More Estimation of parameter sensitivities for stochastic chemical reaction networks is an important and challenging problem. Sensitivity values are important in the analysis, modeling and design of chemical networks. They help in understanding the robustness properties of the system and also in identifying the key reactions for a given outcome. In a discrete setting, most of the methods that exist in the literature for the estimation of parameter sensitivities rely on Monte Carlo simulations along with finite difference computations. However these methods introduce a bias in the sensitivity estimate and in most cases the size or direction of the bias remains unknown, potentially damaging the accuracy of the analysis. In this paper, we use the random time change representation of Kurtz to derive an exact formula for parameter sensitivity. This formula allows us to construct an unbiased estimator for parameter sensitivity, which can be efficiently evaluated using a suitably devised Monte Carlo scheme. The existing literature contains only one method to produce such an unbiased estimator. This method was proposed by Plyasunov and Arkin and it is based on the Girsanov measure transformation. By taking a couple of examples we compare our method to this existing method. Our results indicate that our method can be much faster than the existing method while computing sensitivity with respect to a reaction rate constant which is small in magnitude. This rate constant could correspond to a reaction which is slow in the reference time-scale of the system. Since many biological systems have such slow reactions, our method can be a useful tool for sensitivity analysis. △ Less

Submitted 20 December, 2012; v1 submitted 12 October, 2012; originally announced October 2012.

Comments: Submitted

MSC Class: 60J22; 60J27; 60H35; 65C05

Computer control of gene expression: Robust setpoint tracking of protein mean and variance using integral feedback

Authors: Corentin Briat, Mustafa Khammash

Abstract: Protein mean and variance levels in a simple stochastic gene expression circuit are controlled using proportional integral feedback. It is shown that the protein mean level can be globally and robustly tracked to any desired value using a simple PI controller that satisfies explicit sufficient conditions. Controlling both the mean and variance on the other hand requires the use of an additional co… ▽ More Protein mean and variance levels in a simple stochastic gene expression circuit are controlled using proportional integral feedback. It is shown that the protein mean level can be globally and robustly tracked to any desired value using a simple PI controller that satisfies explicit sufficient conditions. Controlling both the mean and variance on the other hand requires the use of an additional control input, chosen here as the mRNA degradation rate. Local robust tracking of mean and variance is proved to be achievable using multivariable PI control, provided that the reference point satisfies necessary conditions imposed by the system. Even more importantly, it is shown that there exist PI controllers that locally, robustly and simultaneously stabilize all the equilibrium points inside the admissible region. Simulation examples illustrate the results. △ Less

Submitted 19 July, 2012; originally announced July 2012.

Comments: 8 pages; 4 figures; Accepted for publication at the 51st IEEE Conference on Decision and Control, Maui, Hawaii, USA, December 2012

Simulation of stochastic systems via polynomial chaos expansions and convex optimization

Authors: Lorenzo Fagiano, Mustafa Khammash

Abstract: Polynomial Chaos Expansions represent a powerful tool to simulate stochastic models of dynamical systems. Yet, deriving the expansion's coefficients for complex systems might require a significant and non-trivial manipulation of the model, or the computation of large numbers of simulation runs, rendering the approach too time consuming and impracticable for applications with more than a handful of… ▽ More Polynomial Chaos Expansions represent a powerful tool to simulate stochastic models of dynamical systems. Yet, deriving the expansion's coefficients for complex systems might require a significant and non-trivial manipulation of the model, or the computation of large numbers of simulation runs, rendering the approach too time consuming and impracticable for applications with more than a handful of random variables. We introduce a novel computationally tractable technique for computing the coefficients of polynomial chaos expansions. The approach exploits a regularization technique with a particular choice of weighting matrices, which allow to take into account the specific features of Polynomial Chaos expansions. The method, completely based on convex optimization, can be applied to problems with a large number of random variables and uses a modest number of Monte Carlo simulations, while avoiding model manipulations. Additional information on the stochastic process, when available, can be also incorporated in the approach by means of convex constraints. We show the effectiveness of the proposed technique in three applications in diverse fields, including the analysis of a nonlinear electric circuit, a chaotic model of organizational behavior, finally a chemical oscillator. △ Less

Submitted 10 November, 2012; v1 submitted 3 February, 2012; originally announced February 2012.

Comments: This manuscript is a preprint of a paper published on Physical Reviews E and is subject to American Physical Society copyright. The copy of record is available at http://pre.aps.org. http://link.aps.org/doi/10.1103/PhysRevE.86.036702

Journal ref: Physical Reviews E, Volume 86, Issue 3, 036702, 2012

Flow Cytometry Based State Aggregation of a Stochastic Model of Protein Expression

Authors: Anahita Mirtabatabaei, Francesco Bullo, Mustafa Khammash

Abstract: In this article, we introduce the new approach "fluorescence grid based aggregation (FGBA)" to justify a dynamical model of protein expression using experimental fluorescence histograms. In this approach, first, we describe the dynamics of the gene-protein system by a chemical master equation (CME), while the protein production rates are unknown. Then, we aggregate the states of the CME into unkno… ▽ More In this article, we introduce the new approach "fluorescence grid based aggregation (FGBA)" to justify a dynamical model of protein expression using experimental fluorescence histograms. In this approach, first, we describe the dynamics of the gene-protein system by a chemical master equation (CME), while the protein production rates are unknown. Then, we aggregate the states of the CME into unknown group sizes. We show that these unknown values can be replaced by the data from the experimental fluorescence histograms. Consequently, final probability distributions correspond to the experimental fluorescence histograms. △ Less

Submitted 10 April, 2011; originally announced April 2011.

Comments: 7 pages, submitted to CDC2011