-
Compositional Models for Power Systems
Authors:
John S. Nolan,
Blake S. Pollard,
Spencer Breiner,
Dhananjay Anand,
Eswaran Subrahmanian
Abstract:
The problem of integrating multiple overlap** models and data is pervasive in engineering, though often implicit. We consider this issue of model management in the context of the electrical power grid as it transitions towards a modern 'Smart Grid.' We present a methodology for specifying, managing, and reasoning within multiple models of distributed energy resources (DERs), entities which produ…
▽ More
The problem of integrating multiple overlap** models and data is pervasive in engineering, though often implicit. We consider this issue of model management in the context of the electrical power grid as it transitions towards a modern 'Smart Grid.' We present a methodology for specifying, managing, and reasoning within multiple models of distributed energy resources (DERs), entities which produce, consume, or store power, using categorical databases and symmetric monoidal categories. Considering the problem of distributing power on the grid in the presence of DERs, we show how to connect a generic problem specification with implementation-specific numerical solvers using the paradigm of categorical databases.
△ Less
Submitted 14 September, 2020;
originally announced September 2020.
-
Future Automation Engineering using Structural Graph Convolutional Neural Networks
Authors:
Jiang Wan,
Blake S. Pollard,
Sujit Rokka Chhetri,
Palash Goyal,
Mohammad Abdullah Al Faruque,
Arquimedes Canedo
Abstract:
The digitalization of automation engineering generates large quantities of engineering data that is interlinked in knowledge graphs. Classifying and clustering subgraphs according to their functionality is useful to discover functionally equivalent engineering artifacts that exhibit different graph structures. This paper presents a new graph learning algorithm designed to classify engineering data…
▽ More
The digitalization of automation engineering generates large quantities of engineering data that is interlinked in knowledge graphs. Classifying and clustering subgraphs according to their functionality is useful to discover functionally equivalent engineering artifacts that exhibit different graph structures. This paper presents a new graph learning algorithm designed to classify engineering data artifacts -- represented in the form of graphs -- according to their structure and neighborhood features. Our Structural Graph Convolutional Neural Network (SGCNN) is capable of learning graphs and subgraphs with a novel graph invariant convolution kernel and downsampling/pooling algorithm. On a realistic engineering-related dataset, we show that SGCNN is capable of achieving ~91% classification accuracy.
△ Less
Submitted 24 August, 2018;
originally announced August 2018.
-
Biochemical Coupling Through Emergent Conservation Laws
Authors:
John C. Baez,
Blake S. Pollard,
Jonathan Lorand,
Maru Sarazola
Abstract:
Bazhin has analyzed ATP coupling in terms of quasiequilibrium states where fast reactions have reached an approximate steady state while slow reactions have not yet reached equilibrium. After an expository introduction to the relevant aspects of reaction network theory, we review his work and explain the role of emergent conserved quantities in coupling. These are quantities, left unchanged by fas…
▽ More
Bazhin has analyzed ATP coupling in terms of quasiequilibrium states where fast reactions have reached an approximate steady state while slow reactions have not yet reached equilibrium. After an expository introduction to the relevant aspects of reaction network theory, we review his work and explain the role of emergent conserved quantities in coupling. These are quantities, left unchanged by fast reactions, whose conservation forces exergonic processes such as ATP hydrolysis to drive desired endergonic processes.
△ Less
Submitted 28 June, 2018;
originally announced June 2018.
-
Network Models
Authors:
John C. Baez,
John Foley,
Joe Moeller,
Blake S. Pollard
Abstract:
Networks can be combined in various ways, such as overlaying one on top of another or setting two side by side. We introduce "network models" to encode these ways of combining networks. Different network models describe different kinds of networks. We show that each network model gives rise to an operad, whose operations are ways of assembling a network of the given kind from smaller parts. Such o…
▽ More
Networks can be combined in various ways, such as overlaying one on top of another or setting two side by side. We introduce "network models" to encode these ways of combining networks. Different network models describe different kinds of networks. We show that each network model gives rise to an operad, whose operations are ways of assembling a network of the given kind from smaller parts. Such operads, and their algebras, can serve as tools for designing networks. Technically, a network model is a lax symmetric monoidal functor from the free symmetric monoidal category on some set to $\mathbf{Cat}$, and the construction of the corresponding operad proceeds via a symmetric monoidal version of the Grothendieck construction.
△ Less
Submitted 20 July, 2020; v1 submitted 31 October, 2017;
originally announced November 2017.
-
Open Markov Processes and Reaction Networks
Authors:
Blake S. Pollard
Abstract:
We define the concept of an `open' Markov process, a continuous-time Markov chain equipped with specified boundary states through which probability can flow in and out of the system. External couplings which fix the probabilities of boundary states induce non-equilibrium steady states characterized by non-zero probability currents flowing through the system. We show that these non-equilibrium stea…
▽ More
We define the concept of an `open' Markov process, a continuous-time Markov chain equipped with specified boundary states through which probability can flow in and out of the system. External couplings which fix the probabilities of boundary states induce non-equilibrium steady states characterized by non-zero probability currents flowing through the system. We show that these non-equilibrium steady states minimize a quadratic form which we call `dissipation.' This is closely related to Prigogine's principle of minimum entropy production. We bound the rate of change of the entropy of a driven non-equilibrium steady state relative to the underlying equilibrium state in terms of the flow of probability through the boundary of the process.
We then consider open Markov processes as morphisms in a symmetric monoidal category by splitting up their boundary states into certain sets of `inputs' and `outputs.' Composition corresponds to gluing the outputs of one such open Markov process onto the inputs of another so that the probability flowing out of the first process is equal to the probability flowing into the second. We construct a `black-box' functor characterizing the behavior of an open Markov process in terms of the space of possible steady state probabilities and probability currents along the boundary. The fact that this is a functor means that the behavior of a composite open Markov process can be computed by composing the behaviors of the open Markov processes from which it is composed. We prove a similar black-boxing theorem for reaction networks whose dynamics are given by the non-linear rate equation. Along the way we describe a more general category of open dynamical systems where composition corresponds to gluing together open dynamical systems.
△ Less
Submitted 29 September, 2017; v1 submitted 27 September, 2017;
originally announced September 2017.
-
A Compositional Framework for Reaction Networks
Authors:
John C. Baez,
Blake S. Pollard
Abstract:
Reaction networks, or equivalently Petri nets, are a general framework for describing processes in which entities of various kinds interact and turn into other entities. In chemistry, where the reactions are assigned "rate constants", any reaction network gives rise to a nonlinear dynamical system called its "rate equation". Here we generalize these ideas to "open" reaction networks, which allow e…
▽ More
Reaction networks, or equivalently Petri nets, are a general framework for describing processes in which entities of various kinds interact and turn into other entities. In chemistry, where the reactions are assigned "rate constants", any reaction network gives rise to a nonlinear dynamical system called its "rate equation". Here we generalize these ideas to "open" reaction networks, which allow entities to flow in and out at certain designated inputs and outputs. We treat open reaction networks as morphisms in a category. Composing two such morphisms connects the outputs of the first to the inputs of the second. We construct a functor sending any open reaction network to its corresponding "open dynamical system". This provides a compositional framework for studying the dynamics of reaction networks. We then turn to statics: that is, steady state solutions of open dynamical systems. We construct a "black-boxing" functor that sends any open dynamical system to the relation that it imposes between input and output variables in steady states. This extends our earlier work on black-boxing for Markov processes.
△ Less
Submitted 8 September, 2020; v1 submitted 6 April, 2017;
originally announced April 2017.
-
Open Markov processes: A compositional perspective on non-equilibrium steady states in biology
Authors:
Blake S. Pollard
Abstract:
In recent work, Baez, Fong and the author introduced a framework for describing Markov processes equipped with a detailed balanced equilibrium as open systems of a certain type. These `open Markov processes' serve as the building blocks for more complicated processes. In this paper, we describe the potential application of this framework in the modeling of biological systems as open systems mainta…
▽ More
In recent work, Baez, Fong and the author introduced a framework for describing Markov processes equipped with a detailed balanced equilibrium as open systems of a certain type. These `open Markov processes' serve as the building blocks for more complicated processes. In this paper, we describe the potential application of this framework in the modeling of biological systems as open systems maintained away from equilibrium. We show that non-equilibrium steady states emerge in open systems of this type, even when the rates of the underlying process are such that a detailed balanced equilibrium is permitted. It is shown that these non-equilibrium steady states minimize a quadratic form which we call `dissipation.' In some circumstances, the dissipation is approximately equal to the rate of change of relative entropy plus a correction term. On the other hand, Prigogine's principle of minimum entropy production generally fails for non-equilibrium steady states. We use a simple model of membrane transport to illustrate these concepts.
△ Less
Submitted 4 January, 2016;
originally announced January 2016.
-
Relative Entropy in Biological Systems
Authors:
John C. Baez,
Blake S. Pollard
Abstract:
In this paper we review various information-theoretic characterizations of the approach to equilibrium in biological systems. The replicator equation, evolutionary game theory, Markov processes and chemical reaction networks all describe the dynamics of a population or probability distribution. Under suitable assumptions, the distribution will approach an equilibrium with the passage of time. Rela…
▽ More
In this paper we review various information-theoretic characterizations of the approach to equilibrium in biological systems. The replicator equation, evolutionary game theory, Markov processes and chemical reaction networks all describe the dynamics of a population or probability distribution. Under suitable assumptions, the distribution will approach an equilibrium with the passage of time. Relative entropy - that is, the Kullback--Leibler divergence, or various generalizations of this - provides a quantitative measure of how far from equilibrium the system is. We explain various theorems that give conditions under which relative entropy is nonincreasing. In biochemical applications these results can be seen as versions of the Second Law of Thermodynamics, stating that free energy can never increase with the passage of time. In ecological applications, they make precise the notion that a population gains information from its environment as it approaches equilibrium.
△ Less
Submitted 12 February, 2016; v1 submitted 8 December, 2015;
originally announced December 2015.
-
A Compositional Framework for Markov Processes
Authors:
John C. Baez,
Brendan Fong,
Blake S. Pollard
Abstract:
We define the concept of an "open" Markov process, or more precisely, continuous-time Markov chain, which is one where probability can flow in or out of certain states called "inputs" and "outputs". One can build up a Markov process from smaller open pieces. This process is formalized by making open Markov processes into the morphisms of a dagger compact category. We show that the behavior of a de…
▽ More
We define the concept of an "open" Markov process, or more precisely, continuous-time Markov chain, which is one where probability can flow in or out of certain states called "inputs" and "outputs". One can build up a Markov process from smaller open pieces. This process is formalized by making open Markov processes into the morphisms of a dagger compact category. We show that the behavior of a detailed balanced open Markov process is determined by a principle of minimum dissipation, closely related to Prigogine's principle of minimum entropy production. Using this fact, we set up a functor map** open detailed balanced Markov processes to open circuits made of linear resistors. We also describe how to "black box" an open Markov process, obtaining the linear relation between input and output data that holds in any steady state, including nonequilibrium steady states with a nonzero flow of probability through the system. We prove that black boxing gives a symmetric monoidal dagger functor sending open detailed balanced Markov processes to Lagrangian relations between symplectic vector spaces. This allows us to compute the steady state behavior of an open detailed balanced Markov process from the behaviors of smaller pieces from which it is built. We relate this black box functor to a previously constructed black box functor for circuits.
△ Less
Submitted 21 March, 2016; v1 submitted 26 August, 2015;
originally announced August 2015.
-
A Second Law for Open Markov Processes
Authors:
Blake S. Pollard
Abstract:
In this paper we define the notion of an open Markov process. An open Markov process is a generalization of an ordinary Markov process in which populations are allowed to flow in and out of the system at certain boundary states. We show that the rate of change of relative entropy in an open Markov process is less than or equal to the flow of relative entropy through its boundary states. This can b…
▽ More
In this paper we define the notion of an open Markov process. An open Markov process is a generalization of an ordinary Markov process in which populations are allowed to flow in and out of the system at certain boundary states. We show that the rate of change of relative entropy in an open Markov process is less than or equal to the flow of relative entropy through its boundary states. This can be viewed as a generalization of the Second Law for open Markov processes. In the case of a Markov process whose equilibrium obeys detailed balance, this inequality puts an upper bound on the rate of change of the free energy for any non-equilibrium distribution.
△ Less
Submitted 25 June, 2015; v1 submitted 23 October, 2014;
originally announced October 2014.
-
Quantropy
Authors:
John C. Baez,
Blake S. Pollard
Abstract:
There is a well-known analogy between statistical and quantum mechanics. In statistical mechanics, Boltzmann realized that the probability for a system in thermal equilibrium to occupy a given state is proportional to exp(-E/kT) where E is the energy of that state. In quantum mechanics, Feynman realized that the amplitude for a system to undergo a given history is proportional to exp(-S/i hbar) wh…
▽ More
There is a well-known analogy between statistical and quantum mechanics. In statistical mechanics, Boltzmann realized that the probability for a system in thermal equilibrium to occupy a given state is proportional to exp(-E/kT) where E is the energy of that state. In quantum mechanics, Feynman realized that the amplitude for a system to undergo a given history is proportional to exp(-S/i hbar) where S is the action of that history. In statistical mechanics we can recover Boltzmann's formula by maximizing entropy subject to a constraint on the expected energy. This raises the question: what is the quantum mechanical analogue of entropy? We give a formula for this quantity, which we call "quantropy". We recover Feynman's formula from assuming that histories have complex amplitudes, that these amplitudes sum to one, and that the amplitudes give a stationary point of quantropy subject to a constraint on the expected action. Alternatively, we can assume the amplitudes sum to one and that they give a stationary point of a quantity we call "free action", which is analogous to free energy in statistical mechanics. We compute the quantropy, expected action and free action for a free particle, and draw some conclusions from the results.
△ Less
Submitted 2 December, 2019; v1 submitted 4 November, 2013;
originally announced November 2013.
