-
Automating Transfer of Robot Task Plans using Functorial Data Migrations
Authors:
Angeline Aguinaldo,
Evan Patterson,
William Regli
Abstract:
This paper introduces a novel approach to ontology-based robot plan transfer using functorial data migrations from category theory. Functors provide structured maps between domain types and predicates which can be used to transfer plans from a source domain to a target domain without the need for replanning. Unlike methods that create models for transferring specific plans, our approach can be app…
▽ More
This paper introduces a novel approach to ontology-based robot plan transfer using functorial data migrations from category theory. Functors provide structured maps between domain types and predicates which can be used to transfer plans from a source domain to a target domain without the need for replanning. Unlike methods that create models for transferring specific plans, our approach can be applied to any plan within a given domain. We demonstrate this approach by transferring a task plan from the canonical Blocksworld domain to one compatible with the AI2-THOR Kitchen environment. In addition, we discuss practical applications that may enhance the adaptability of robotic task planning in general.
△ Less
Submitted 22 June, 2024;
originally announced June 2024.
-
Transposing cartesian and other structure in double categories
Authors:
Evan Patterson
Abstract:
The cartesian structure possessed by relations, spans, profunctors, and other such morphisms is elegantly expressed by universal properties in double categories. Though cartesian double categories were inspired in part by the older program of cartesian bicategories, the precise relationship between the double-categorical and bicategorical approaches has so far remained mysterious, except in specia…
▽ More
The cartesian structure possessed by relations, spans, profunctors, and other such morphisms is elegantly expressed by universal properties in double categories. Though cartesian double categories were inspired in part by the older program of cartesian bicategories, the precise relationship between the double-categorical and bicategorical approaches has so far remained mysterious, except in special cases. We provide a formal connection by showing that every double category with iso-strong finite products, and in particular every cartesian equipment, has an underlying cartesian bicategory. To do so, we develop broadly applicable techniques for transposing natural transformations and adjunctions between double categories, extending a line of previous work rooted in the concepts of companions and conjoints.
△ Less
Submitted 17 June, 2024; v1 submitted 12 April, 2024;
originally announced April 2024.
-
GATlab: Modeling and Programming with Generalized Algebraic Theories
Authors:
Owen Lynch,
Kris Brown,
James Fairbanks,
Evan Patterson
Abstract:
Categories and categorical structures are increasingly recognized as useful abstractions for modeling in science and engineering. To uniformly implement category-theoretic mathematical models in software, we introduce GATlab, a domain-specific language for algebraic specification embedded in a technical programming language. GATlab is based on generalized algebraic theories (GATs), a logical syste…
▽ More
Categories and categorical structures are increasingly recognized as useful abstractions for modeling in science and engineering. To uniformly implement category-theoretic mathematical models in software, we introduce GATlab, a domain-specific language for algebraic specification embedded in a technical programming language. GATlab is based on generalized algebraic theories (GATs), a logical system extending algebraic theories with dependent types so as to encompass category theory. Using GATlab, the programmer can specify generalized algebraic theories and their models, including both free models, based on symbolic expressions, and computational models, defined by arbitrary code in the host language. Moreover, the programmer can define maps between theories and use them to declaratively migrate models of one theory to models of another. In short, GATlab aims to provide a unified environment for both computer algebra and software interface design with generalized algebraic theories. In this paper, we describe the design, implementation, and applications of GATlab.
△ Less
Submitted 8 June, 2024; v1 submitted 7 April, 2024;
originally announced April 2024.
-
Representing Knowledge and Querying Data using Double-Functorial Semantics
Authors:
Michael Lambert,
Evan Patterson
Abstract:
Category theory offers a mathematical foundation for knowledge representation and database systems. Popular existing approaches model a database instance as a functor into the category of sets and functions, or as a 2-functor into the 2-category of sets, relations, and implications. The functional and relational models are unified by double functors into the double category of sets, functions, rel…
▽ More
Category theory offers a mathematical foundation for knowledge representation and database systems. Popular existing approaches model a database instance as a functor into the category of sets and functions, or as a 2-functor into the 2-category of sets, relations, and implications. The functional and relational models are unified by double functors into the double category of sets, functions, relations, and implications. In an accessible, example-driven style, we show that the abstract structure of a 'double category of relations' is a flexible and expressive language in which to represent knowledge, and we show how queries on data in the spirit of Codd's relational algebra are captured by double-functorial semantics.
△ Less
Submitted 17 June, 2024; v1 submitted 28 March, 2024;
originally announced March 2024.
-
A Compositional Framework for First-Order Optimization
Authors:
Tyler Hanks,
Matthew Klawonn,
Evan Patterson,
Matthew Hale,
James Fairbanks
Abstract:
Optimization decomposition methods are a fundamental tool to develop distributed solution algorithms for large scale optimization problems arising in fields such as machine learning and optimal control. In this paper, we present an algebraic framework for hierarchically composing optimization problems defined on hypergraphs and automatically generating distributed solution algorithms that respect…
▽ More
Optimization decomposition methods are a fundamental tool to develop distributed solution algorithms for large scale optimization problems arising in fields such as machine learning and optimal control. In this paper, we present an algebraic framework for hierarchically composing optimization problems defined on hypergraphs and automatically generating distributed solution algorithms that respect the given hierarchical structure. The central abstractions of our framework are operads, operad algebras, and algebra morphisms, which formalize notions of syntax, semantics, and structure preserving semantic transformations respectively. These abstractions allow us to formally relate composite optimization problems to the distributed algorithms that solve them. Specifically, we show that certain classes of optimization problems form operad algebras, and a collection of first-order solution methods, namely gradient descent, Uzawa's algorithm (also called gradient ascent-descent), and their subgradient variants, yield algebra morphisms from these problem algebras to algebras of dynamical systems. Primal and dual decomposition methods are then recovered by applying these morphisms to certain classes of composite problems. Using this framework, we also derive a novel sufficient condition for when a problem defined by compositional data is solvable by a decomposition method. We show that the minimum cost network flow problem satisfies this condition, thereby allowing us to automatically derive a hierarchical dual decomposition algorithm for finding minimum cost flows on composite flow networks. We implement our operads, algebras, and algebra morphisms in a Julia package called AlgebraicOptimization.jl and use our implementation to empirically demonstrate that hierarchical dual decomposition outperforms standard dual decomposition on classes of flow networks with hierarchical structure.
△ Less
Submitted 8 March, 2024;
originally announced March 2024.
-
Decapodes: A Diagrammatic Tool for Representing, Composing, and Computing Spatialized Partial Differential Equations
Authors:
Luke Morris,
Andrew Baas,
Jesus Arias,
Maia Gatlin,
Evan Patterson,
James P. Fairbanks
Abstract:
We present Decapodes, a diagrammatic tool for representing, composing, and solving partial differential equations. Decapodes provides an intuitive diagrammatic representation of the relationships between variables in a system of equations, a method for composing systems of partial differential equations using an operad of wiring diagrams, and an algorithm for deriving solvers using hypergraphs and…
▽ More
We present Decapodes, a diagrammatic tool for representing, composing, and solving partial differential equations. Decapodes provides an intuitive diagrammatic representation of the relationships between variables in a system of equations, a method for composing systems of partial differential equations using an operad of wiring diagrams, and an algorithm for deriving solvers using hypergraphs and string diagrams. The string diagrams are in turn compiled into executable programs using the techniques of categorical data migration, graph traversal, and the discrete exterior calculus. The generated solvers produce numerical solutions consistent with state-of-the-art open source tools as demonstrated by benchmark comparisons with SU2. These numerical experiments demonstrate the feasibility of this approach to multiphysics simulation and identify areas requiring further development.
△ Less
Submitted 30 January, 2024;
originally announced January 2024.
-
The diagrammatic presentation of equations in categories
Authors:
Kevin Arlin,
James Fairbanks,
Tim Hosgood,
Evan Patterson
Abstract:
Lifts of categorical diagrams $D\colon\mathsf{J}\to\mathsf{X}$ against discrete opfibrations $π\colon\mathsf{E}\to\mathsf{X}$ can be interpreted as presenting solutions to systems of equations. With this interpretation in mind, it is natural to ask if there is a notion of equivalence of diagrams $D\simeq D'$ that precisely captures the idea of the two diagrams "having the same solutions''. We give…
▽ More
Lifts of categorical diagrams $D\colon\mathsf{J}\to\mathsf{X}$ against discrete opfibrations $π\colon\mathsf{E}\to\mathsf{X}$ can be interpreted as presenting solutions to systems of equations. With this interpretation in mind, it is natural to ask if there is a notion of equivalence of diagrams $D\simeq D'$ that precisely captures the idea of the two diagrams "having the same solutions''. We give such a definition, and then show how the localisation of the category of diagrams in $\mathsf{X}$ along such equivalences is isomorphic to the localisation of the slice category $\mathsf{Cat}/\mathsf{X}$ along the class of initial functors. Finally, we extend this result to the 2-categorical setting, proving the analogous statement for any locally presentable 2-category in place of $\mathsf{Cat}$.
△ Less
Submitted 22 January, 2024; v1 submitted 18 January, 2024;
originally announced January 2024.
-
Products in double categories, revisited
Authors:
Evan Patterson
Abstract:
Products in double categories, as found in cartesian double categories, are an elegant concept with numerous applications, yet also have a few puzzling aspects. In this paper, we revisit double-categorical products from an unbiased perspective, following up an original idea by Paré to employ a double-categorical analogue of the family construction, or free product completion. Defined in this way,…
▽ More
Products in double categories, as found in cartesian double categories, are an elegant concept with numerous applications, yet also have a few puzzling aspects. In this paper, we revisit double-categorical products from an unbiased perspective, following up an original idea by Paré to employ a double-categorical analogue of the family construction, or free product completion. Defined in this way, double categories with finite products are strictly more expressive than cartesian double categories, while being governed by a single universal property that is no more difficult to work with. We develop the basic theory and examples of such products and, by duality, of coproducts in double categories. As an application, we introduce finite-product double theories, a categorification of finite-product theories that extends recent work by Lambert and the author on cartesian double theories, and we construct the virtual double category of models of a finite-product double theory.
△ Less
Submitted 17 January, 2024;
originally announced January 2024.
-
Cartesian double theories: A double-categorical framework for categorical doctrines
Authors:
Michael Lambert,
Evan Patterson
Abstract:
The categorified theories known as "doctrines" specify a category equipped with extra structure, analogous to how ordinary theories specify a set with extra structure. We introduce a new framework for doctrines based on double category theory. A cartesian double theory is defined to be a small double category with finite products and a model of a cartesian double theory to be a finite product-pres…
▽ More
The categorified theories known as "doctrines" specify a category equipped with extra structure, analogous to how ordinary theories specify a set with extra structure. We introduce a new framework for doctrines based on double category theory. A cartesian double theory is defined to be a small double category with finite products and a model of a cartesian double theory to be a finite product-preserving lax functor out of it. Many familiar categorical structures are models of cartesian double theories, including categories, presheaves, monoidal categories, braided and symmetric monoidal categories, 2-groups, multicategories, and cartesian and cocartesian categories. We show that every cartesian double theory has a unital virtual double category of models, with lax maps between models given by cartesian lax natural transformations, bimodules between models given by cartesian modules, and multicells given by multimodulations. In many cases, the virtual double category of models is representable, hence is a genuine double category. Moreover, when restricted to pseudo maps, every cartesian double theory has a virtual equipment of models, hence an equipment of models in the representable case. Compared with 2-monads, double theories have the advantage of being straightforwardly presentable by generators and relations, as we illustrate through a large number of examples.
△ Less
Submitted 7 April, 2024; v1 submitted 8 October, 2023;
originally announced October 2023.
-
Unruh phenomena and thermalization for qudit detectors
Authors:
Caroline Lima,
Everett Patterson,
Erickson Tjoa,
Robert B. Mann
Abstract:
We study Unruh phenomena for a qudit detector coupled to a quantized scalar field, comparing its response to that of a standard qubit-based Unruh-DeWitt detector. We show that there are limitations to the utility of the detailed balance condition as an indicator for Unruh thermality of higher-dimensional qudit detector models. This can be traced to the fact that a qudit has multiple possible trans…
▽ More
We study Unruh phenomena for a qudit detector coupled to a quantized scalar field, comparing its response to that of a standard qubit-based Unruh-DeWitt detector. We show that there are limitations to the utility of the detailed balance condition as an indicator for Unruh thermality of higher-dimensional qudit detector models. This can be traced to the fact that a qudit has multiple possible transition channels between its energy levels, in contrast to the 2-level qubit model. We illustrate these limitations using two types of qutrit detector models based on the spin-1 representations of $SU(2)$ and the non-Hermitian generalization of the Pauli observables (the Heisenberg-Weyl operators).
△ Less
Submitted 12 February, 2024; v1 submitted 8 September, 2023;
originally announced September 2023.
-
A Categorical Representation Language and Computational System for Knowledge-Based Planning
Authors:
Angeline Aguinaldo,
Evan Patterson,
James Fairbanks,
William Regli,
Jaime Ruiz
Abstract:
Classical planning representation languages based on first-order logic have preliminarily been used to model and solve robotic task planning problems. Wider adoption of these representation languages, however, is hindered by the limitations present when managing implicit world changes with concise action models. To address this problem, we propose an alternative approach to representing and managi…
▽ More
Classical planning representation languages based on first-order logic have preliminarily been used to model and solve robotic task planning problems. Wider adoption of these representation languages, however, is hindered by the limitations present when managing implicit world changes with concise action models. To address this problem, we propose an alternative approach to representing and managing updates to world states during planning. Based on the category-theoretic concepts of $\mathsf{C}$-sets and double-pushout rewriting (DPO), our proposed representation can effectively handle structured knowledge about world states that support domain abstractions at all levels. It formalizes the semantics of predicates according to a user-provided ontology and preserves the semantics when transitioning between world states. This method provides a formal semantics for using knowledge graphs and relational databases to model world states and updates in planning. In this paper, we conceptually compare our category-theoretic representation with the classical planning representation. We show that our proposed representation has advantages over the classical representation in terms of handling implicit preconditions and effects, and provides a more structured framework in which to model and solve planning problems.
△ Less
Submitted 14 November, 2023; v1 submitted 26 May, 2023;
originally announced May 2023.
-
Modeling Model Predictive Control: A Category Theoretic Framework for Multistage Control Problems
Authors:
Tyler Hanks,
Baike She,
Matthew Hale,
Evan Patterson,
Matthew Klawonn,
James Fairbanks
Abstract:
Model predictive control (MPC) is an optimal control technique which involves solving a sequence of constrained optimization problems across a given time horizon. In this paper, we introduce a category theoretic framework for constructing complex MPC problem formulations by composing subproblems. Specifically, we construct a monoidal category - called Para(Conv) - whose objects are Euclidean space…
▽ More
Model predictive control (MPC) is an optimal control technique which involves solving a sequence of constrained optimization problems across a given time horizon. In this paper, we introduce a category theoretic framework for constructing complex MPC problem formulations by composing subproblems. Specifically, we construct a monoidal category - called Para(Conv) - whose objects are Euclidean spaces and whose morphisms represent constrained convex optimization problems. We then show that the multistage structure of typical MPC problems arises from sequential composition in Para(Conv), while parallel composition can be used to model constraints across multiple stages of the prediction horizon. This framework comes equipped with a rigorous, diagrammatic syntax, allowing for easy visualization and modification of complex problems. Finally, we show how this framework allows a simple software realization in the Julia programming language by integrating with existing mathematical programming libraries to provide high-level, graphical abstractions for MPC.
△ Less
Submitted 9 March, 2024; v1 submitted 5 May, 2023;
originally announced May 2023.
-
Structured and Decorated Cospans from the Viewpoint of Double Category Theory
Authors:
Evan Patterson
Abstract:
Structured and decorated cospans are broadly applicable frameworks for building bicategories or double categories of open systems. We streamline and generalize these frameworks using central concepts of double category theory. We show that, under mild hypotheses, double categories of structured cospans are cocartesian (have finite double-categorical coproducts) and are equipments. The proofs are s…
▽ More
Structured and decorated cospans are broadly applicable frameworks for building bicategories or double categories of open systems. We streamline and generalize these frameworks using central concepts of double category theory. We show that, under mild hypotheses, double categories of structured cospans are cocartesian (have finite double-categorical coproducts) and are equipments. The proofs are simple as they utilize appropriate double-categorical universal properties. Maps between double categories of structured cospans are studied from the same perspective. We then give a new construction of the double category of decorated cospans using the recently introduced double Grothendieck construction. Besides its conceptual value, this reconstruction leads to a natural generalization of decorated cospans, which we illustrate through an example motivated by statistical theories and other theories of processes.
△ Less
Submitted 14 December, 2023; v1 submitted 2 April, 2023;
originally announced April 2023.
-
A compositional account of motifs, mechanisms, and dynamics in biochemical regulatory networks
Authors:
Rebekah Aduddell,
James Fairbanks,
Amit Kumar,
Pablo S. Ocal,
Evan Patterson,
Brandon T. Shapiro
Abstract:
Regulatory networks depict promoting or inhibiting interactions between molecules in a biochemical system. We introduce a category-theoretic formalism for regulatory networks, using signed graphs to model the networks and signed functors to describe occurrences of one network in another, especially occurrences of network motifs. With this foundation, we establish functorial map**s between regula…
▽ More
Regulatory networks depict promoting or inhibiting interactions between molecules in a biochemical system. We introduce a category-theoretic formalism for regulatory networks, using signed graphs to model the networks and signed functors to describe occurrences of one network in another, especially occurrences of network motifs. With this foundation, we establish functorial map**s between regulatory networks and other mathematical models in biochemistry. We construct a functor from reaction networks, modeled as Petri nets with signed links, to regulatory networks, enabling us to precisely define when a reaction network could be a physical mechanism underlying a regulatory network. Turning to quantitative models, we associate a regulatory network with a Lotka-Volterra system of differential equations, defining a functor from the category of signed graphs to a category of parameterized dynamical systems. We extend this result from closed to open systems, demonstrating that Lotka-Volterra dynamics respects not only inclusions and collapsings of regulatory networks, but also the process of building up complex regulatory networks by gluing together simpler pieces. Formally, we use the theory of structured cospans to produce a lax double functor from the double category of open signed graphs to that of open parameterized dynamical systems. Throughout the paper, we ground the categorical formalism in examples inspired by systems biology.
△ Less
Submitted 5 May, 2024; v1 submitted 3 January, 2023;
originally announced January 2023.
-
Fisher Information of a Black Hole Spacetime
Authors:
Everett Patterson,
Robert B. Mann
Abstract:
Relativistic quantum metrology is the study of optimal measurement procedures within systems that have both quantum and relativistic components. Here we use Unruh-DeWitt detectors coupled to a massless scalar field as probes of thermal parameters in different spacetimes via a relativistic quantum metrology analysis. We consider both (2+1)-dimensional anti-de Sitter and BTZ black hole spacetimes. W…
▽ More
Relativistic quantum metrology is the study of optimal measurement procedures within systems that have both quantum and relativistic components. Here we use Unruh-DeWitt detectors coupled to a massless scalar field as probes of thermal parameters in different spacetimes via a relativistic quantum metrology analysis. We consider both (2+1)-dimensional anti-de Sitter and BTZ black hole spacetimes. We compute the Fisher information to identify characteristics of the black hole spacetime and to compare it to a uniformly accelerating detector in anti-de Sitter space. We find the dependence of the Fisher information on temperature, detector energy gap, black hole mass, interaction time, and the initial state of the detector. We identify strategies that maximize the Fisher information and therefore the precision of estimation.
△ Less
Submitted 8 March, 2023; v1 submitted 25 July, 2022;
originally announced July 2022.
-
Compositional Modeling with Stock and Flow Diagrams
Authors:
John Baez,
Xiaoyan Li,
Sophie Libkind,
Nathaniel D. Osgood,
Evan Patterson
Abstract:
Stock and flow diagrams are widely used in epidemiology to model the dynamics of populations. Although tools already exist for building these diagrams and simulating the systems they describe, we have created a new package called StockFlow, part of the AlgebraicJulia ecosystem, which uses ideas from category theory to overcome notable limitations of existing software. Compositionality is provided…
▽ More
Stock and flow diagrams are widely used in epidemiology to model the dynamics of populations. Although tools already exist for building these diagrams and simulating the systems they describe, we have created a new package called StockFlow, part of the AlgebraicJulia ecosystem, which uses ideas from category theory to overcome notable limitations of existing software. Compositionality is provided by the theory of decorated cospans: stock and flow diagrams can be composed to form larger ones in an intuitive way formalized by the operad of undirected wiring diagrams. Our approach also cleanly separates the syntax of stock and flow diagrams from the semantics they can be assigned. We consider semantics in ordinary differential equations, although others are possible. As an example, we explain code in StockFlow that implements a simplified version of a COVID-19 model used in Canada.
△ Less
Submitted 31 July, 2023; v1 submitted 9 May, 2022;
originally announced May 2022.
-
A diagrammatic view of differential equations in physics
Authors:
Evan Patterson,
Andrew Baas,
Timothy Hosgood,
James Fairbanks
Abstract:
Presenting systems of differential equations in the form of diagrams has become common in certain parts of physics, especially electromagnetism and computational physics. In this work, we aim to put such use of diagrams on a firm mathematical footing, while also systematizing a broadly applicable framework to reason formally about systems of equations and their solutions. Our main mathematical too…
▽ More
Presenting systems of differential equations in the form of diagrams has become common in certain parts of physics, especially electromagnetism and computational physics. In this work, we aim to put such use of diagrams on a firm mathematical footing, while also systematizing a broadly applicable framework to reason formally about systems of equations and their solutions. Our main mathematical tools are category-theoretic diagrams, which are well known, and morphisms between diagrams, which have been less appreciated. As an application of the diagrammatic framework, we show how complex, multiphysical systems can be modularly constructed from basic physical principles. A wealth of examples, drawn from electromagnetism, transport phenomena, fluid mechanics, and other fields, is included.
△ Less
Submitted 17 June, 2022; v1 submitted 1 April, 2022;
originally announced April 2022.
-
An Algebraic Framework for Structured Epidemic Modeling
Authors:
Sophie Libkind,
Andrew Baas,
Micah Halter,
Evan Patterson,
James Fairbanks
Abstract:
Pandemic management requires that scientists rapidly formulate and analyze epidemiological models in order to forecast the spread of disease and the effects of mitigation strategies. Scientists must modify existing models and create novel ones in light of new biological data and policy changes such as social distancing and vaccination. Traditional scientific modeling workflows detach the structure…
▽ More
Pandemic management requires that scientists rapidly formulate and analyze epidemiological models in order to forecast the spread of disease and the effects of mitigation strategies. Scientists must modify existing models and create novel ones in light of new biological data and policy changes such as social distancing and vaccination. Traditional scientific modeling workflows detach the structure of a model -- its submodels and their interactions -- from its implementation in software. Consequently, incorporating local changes to model components may require global edits to the code-base through a manual, time-intensive, and error-prone process. We propose a compositional modeling framework that uses high-level algebraic structures to capture domain-specific scientific knowledge and bridge the gap between how scientists think about models and the code that implements them. These algebraic structures, grounded in applied category theory, simplify and expedite modeling tasks such as model specification, stratification, analysis, and calibration. With their structure made explicit, models also become easier to communicate, criticize, and refine in light of stakeholder feedback.
△ Less
Submitted 7 May, 2022; v1 submitted 28 February, 2022;
originally announced March 2022.
-
Computing Viscous Flow Along a 3D Open Tube Using the Immerse Interface Method
Authors:
Sarah E Patterson,
Anita T Layton
Abstract:
In a companion study \cite{patterson2020computing2D}, we present a numerical method for simulating 2D viscous flow through an open compliant closed channel, drive by pressure gradient. We consider the highly viscous regime, where fluid dynamics is described by the Stokes equations, and the less viscous regime described by the Navier-Stokes equations. In this study, we extend the method to 3D tubul…
▽ More
In a companion study \cite{patterson2020computing2D}, we present a numerical method for simulating 2D viscous flow through an open compliant closed channel, drive by pressure gradient. We consider the highly viscous regime, where fluid dynamics is described by the Stokes equations, and the less viscous regime described by the Navier-Stokes equations. In this study, we extend the method to 3D tubular flow. The problem is formulated in axisymmetric cylindrical coordinates, an approach that is natural for tubular flow simulations and that substantially reduces computational cost. When the elastic tubular walls are stretched or compressed, they exert forces on the fluid. These singular forces introduce unsmoothness into the fluid solution. As in the companion 2D study \cite{patterson2020computing2D}, we extend the immersed interface method to an open tube, and we compute solution to the model equations using the resulting method. Numerical results indicate that this new method preserves sharp jumps in the solution and its derivatives, and converges with second-order accuracy in both space and time.
△ Less
Submitted 23 December, 2021;
originally announced December 2021.
-
Computational category-theoretic rewriting
Authors:
Kristopher Brown,
Evan Patterson,
Tyler Hanks,
James Fairbanks
Abstract:
We demonstrate how category theory provides specifications that can efficiently be implemented via imperative algorithms and apply this to the field of graph rewriting. By examples, we show how this paradigm of software development makes it easy to quickly write correct and performant code. We provide a modern implementation of graph rewriting techniques at the level of abstraction of finitely-pre…
▽ More
We demonstrate how category theory provides specifications that can efficiently be implemented via imperative algorithms and apply this to the field of graph rewriting. By examples, we show how this paradigm of software development makes it easy to quickly write correct and performant code. We provide a modern implementation of graph rewriting techniques at the level of abstraction of finitely-presented C-sets and clarify the connections between C-sets and the typed graphs supported in existing rewriting software. We emphasize that our open-source library is extensible: by taking new categorical constructions (such as slice categories, structured cospans, and distributed graphs) and relating their limits and colimits to those of their underlying categories, users inherit efficient algorithms for pushout complements and (final) pullback complements. This allows one to perform double-, single-, and sesqui-pushout rewriting over a broad class of data structures.
△ Less
Submitted 31 March, 2023; v1 submitted 2 November, 2021;
originally announced November 2021.
-
Categorical Data Structures for Technical Computing
Authors:
Evan Patterson,
Owen Lynch,
James Fairbanks
Abstract:
Many mathematical objects can be represented as functors from finitely-presented categories $\mathsf{C}$ to $\mathsf{Set}$. For instance, graphs are functors to $\mathsf{Set}$ from the category with two parallel arrows. Such functors are known informally as $\mathsf{C}$-sets. In this paper, we describe and implement an extension of $\mathsf{C}$-sets having data attributes with fixed types, such as…
▽ More
Many mathematical objects can be represented as functors from finitely-presented categories $\mathsf{C}$ to $\mathsf{Set}$. For instance, graphs are functors to $\mathsf{Set}$ from the category with two parallel arrows. Such functors are known informally as $\mathsf{C}$-sets. In this paper, we describe and implement an extension of $\mathsf{C}$-sets having data attributes with fixed types, such as graphs with labeled vertices or real-valued edge weights. We call such structures "acsets," short for "attributed $\mathsf{C}$-sets." Derived from previous work on algebraic databases, acsets are a joint generalization of graphs and data frames. They also encompass more elaborate graph-like objects such as wiring diagrams and Petri nets with rate constants. We develop the mathematical theory of acsets and then describe a generic implementation in the Julia programming language, which uses advanced language features to achieve performance comparable with specialized data structures.
△ Less
Submitted 19 July, 2022; v1 submitted 8 June, 2021;
originally announced June 2021.
-
Operadic Modeling of Dynamical Systems: Mathematics and Computation
Authors:
Sophie Libkind,
Andrew Baas,
Evan Patterson,
James Fairbanks
Abstract:
Dynamical systems are ubiquitous in science and engineering as models of phenomena that evolve over time. Although complex dynamical systems tend to have important modular structure, conventional modeling approaches suppress this structure. Building on recent work in applied category theory, we show how deterministic dynamical systems, discrete and continuous, can be composed in a hierarchical sty…
▽ More
Dynamical systems are ubiquitous in science and engineering as models of phenomena that evolve over time. Although complex dynamical systems tend to have important modular structure, conventional modeling approaches suppress this structure. Building on recent work in applied category theory, we show how deterministic dynamical systems, discrete and continuous, can be composed in a hierarchical style. In mathematical terms, we reformulate some existing operads of wiring diagrams and introduce new ones, using the general formalism of C-sets (copresheaves). We then establish dynamical systems as algebras of these operads. In a computational vein, we show that Euler's method is functorial for undirected systems, extending a previous result for directed systems. All of the ideas in this paper are implemented as practical software using Catlab and the AlgebraicJulia ecosystem, written in the Julia programming language for scientific computing.
△ Less
Submitted 3 November, 2022; v1 submitted 25 May, 2021;
originally announced May 2021.
-
Wiring diagrams as normal forms for computing in symmetric monoidal categories
Authors:
Evan Patterson,
David I. Spivak,
Dmitry Vagner
Abstract:
Applications of category theory often involve symmetric monoidal categories (SMCs), in which abstract processes or operations can be composed in series and parallel. However, in 2020 there remains a dearth of computational tools for working with SMCs. We present an "unbiased" approach to implementing symmetric monoidal categories, based on an operad of directed, acyclic wiring diagrams. Because t…
▽ More
Applications of category theory often involve symmetric monoidal categories (SMCs), in which abstract processes or operations can be composed in series and parallel. However, in 2020 there remains a dearth of computational tools for working with SMCs. We present an "unbiased" approach to implementing symmetric monoidal categories, based on an operad of directed, acyclic wiring diagrams. Because the interchange law and other laws of a SMC hold identically in a wiring diagram, no rewrite rules are needed to compare diagrams. We discuss the mathematics of the operad of wiring diagrams, as well as its implementation in the software package Catlab.
△ Less
Submitted 25 January, 2021;
originally announced January 2021.
-
The algebra and machine representation of statistical models
Authors:
Evan Patterson
Abstract:
As the twin movements of open science and open source bring an ever greater share of the scientific process into the digital realm, new opportunities arise for the meta-scientific study of science itself, including of data science and statistics. Future science will likely see machines play an active role in processing, organizing, and perhaps even creating scientific knowledge. To make this possi…
▽ More
As the twin movements of open science and open source bring an ever greater share of the scientific process into the digital realm, new opportunities arise for the meta-scientific study of science itself, including of data science and statistics. Future science will likely see machines play an active role in processing, organizing, and perhaps even creating scientific knowledge. To make this possible, large engineering efforts must be undertaken to transform scientific artifacts into useful computational resources, and conceptual advances must be made in the organization of scientific theories, models, experiments, and data.
This dissertation takes steps toward digitizing and systematizing two major artifacts of data science, statistical models and data analyses. Using tools from algebra, particularly categorical logic, a precise analogy is drawn between models in statistics and logic, enabling statistical models to be seen as models of theories, in the logical sense. Statistical theories, being algebraic structures, are amenable to machine representation and are equipped with morphisms that formalize the relations between different statistical methods. Turning from mathematics to engineering, a software system for creating machine representations of data analyses, in the form of Python or R programs, is designed and implemented. The representations aim to capture the semantics of data analyses, independent of the programming language and libraries in which they are implemented.
△ Less
Submitted 16 June, 2020;
originally announced June 2020.
-
Compositional Scientific Computing with Catlab and SemanticModels
Authors:
Micah Halter,
Evan Patterson,
Andrew Baas,
James Fairbanks
Abstract:
Scientific computing is currently performed by writing domain specific modeling frameworks for solving special classes of mathematical problems. Since applied category theory provides abstract reasoning machinery for describing and analyzing diverse areas of math, it is a natural platform for building generic and reusable software components for scientific computing. We present Catlab.jl, which pr…
▽ More
Scientific computing is currently performed by writing domain specific modeling frameworks for solving special classes of mathematical problems. Since applied category theory provides abstract reasoning machinery for describing and analyzing diverse areas of math, it is a natural platform for building generic and reusable software components for scientific computing. We present Catlab.jl, which provides the category-theoretic infrastructure for this project, together with SemanticModels.jl, which leverages this infrastructure for particular modeling tasks. This approach enhances and automates scientific computing workflows by applying recent advances in mathematical modeling of interconnected systems as cospan algebras.
△ Less
Submitted 29 June, 2020; v1 submitted 10 May, 2020;
originally announced May 2020.
-
String Diagrams for Assembly Planning
Authors:
Jade Master,
Evan Patterson,
Shahin Yousfi,
Arquimedes Canedo
Abstract:
Assembly planning is a difficult problem for companies. Many disciplines such as design, planning, scheduling, and manufacturing execution need to be carefully engineered and coordinated to create successful product assembly plans. Recent research in the field of design for assembly has proposed new methodologies to design product structures in such a way that their assembly is easier. However, pr…
▽ More
Assembly planning is a difficult problem for companies. Many disciplines such as design, planning, scheduling, and manufacturing execution need to be carefully engineered and coordinated to create successful product assembly plans. Recent research in the field of design for assembly has proposed new methodologies to design product structures in such a way that their assembly is easier. However, present assembly planning approaches lack the engineering tool support to capture all the constraints associated to assembly planning in a unified manner. This paper proposes CompositionalPlanning, a string diagram based framework for assembly planning. In the proposed framework, string diagrams and their compositional properties serve as the foundation for an engineering tool where CAD designs interact with planning and scheduling algorithms to automatically create high-quality assembly plans. These assembly plans are then executed in simulation to measure their performance and to visualize their key build characteristics. We demonstrate the versatility of this approach in the LEGO assembly domain. We developed two reference LEGO CAD models that are processed by CompositionalPlanning's algorithmic pipeline. We compare sequential and parallel assembly plans in a Minecraft simulation and show that the time-to-build performance can be optimized by our algorithms.
△ Less
Submitted 11 May, 2020; v1 submitted 23 September, 2019;
originally announced September 2019.
-
Graph Representation Ensemble Learning
Authors:
Palash Goyal,
Di Huang,
Sujit Rokka Chhetri,
Arquimedes Canedo,
Jaya Shree,
Evan Patterson
Abstract:
Representation learning on graphs has been gaining attention due to its wide applicability in predicting missing links, and classifying and recommending nodes. Most embedding methods aim to preserve certain properties of the original graph in the low dimensional space. However, real world graphs have a combination of several properties which are difficult to characterize and capture by a single ap…
▽ More
Representation learning on graphs has been gaining attention due to its wide applicability in predicting missing links, and classifying and recommending nodes. Most embedding methods aim to preserve certain properties of the original graph in the low dimensional space. However, real world graphs have a combination of several properties which are difficult to characterize and capture by a single approach. In this work, we introduce the problem of graph representation ensemble learning and provide a first of its kind framework to aggregate multiple graph embedding methods efficiently. We provide analysis of our framework and analyze -- theoretically and empirically -- the dependence between state-of-the-art embedding methods. We test our models on the node classification task on four real world graphs and show that proposed ensemble approaches can outperform the state-of-the-art methods by up to 8% on macro-F1. We further show that the approach is even more beneficial for underrepresented classes providing an improvement of up to 12%.
△ Less
Submitted 12 September, 2019; v1 submitted 6 September, 2019;
originally announced September 2019.
-
System-Level Development of a User-Integrated Semi-Autonomous Lawn Mowing System: Problem Overview, Basic Requirements, and Proposed Architecture
Authors:
Albert E. Patterson,
Yang Yuan,
William R. Norris
Abstract:
This concept paper outlines some recent efforts toward the design and development of user-integrated semi-autonomous home-sized lawn mowing systems from a systems engineering perspective. This is an important and emerging field of study within the robotics and systems engineering communities. The work presented includes a review of current progress on this problem, a discussion of the problem from…
▽ More
This concept paper outlines some recent efforts toward the design and development of user-integrated semi-autonomous home-sized lawn mowing systems from a systems engineering perspective. This is an important and emerging field of study within the robotics and systems engineering communities. The work presented includes a review of current progress on this problem, a discussion of the problem from a systems engineering perspective, a general system architecture developed by the authors, and a preliminary set of design requirements. This work is meant to provide a baseline and motivation for the further development and refinement of these systems within the systems engineering and robotics communities and is relevant to both academic and commercial research.
△ Less
Submitted 12 July, 2019;
originally announced July 2019.
-
Hausdorff and Wasserstein metrics on graphs and other structured data
Authors:
Evan Patterson
Abstract:
Optimal transport is widely used in pure and applied mathematics to find probabilistic solutions to hard combinatorial matching problems. We extend the Wasserstein metric and other elements of optimal transport from the matching of sets to the matching of graphs and other structured data. This structure-preserving form of optimal transport relaxes the usual notion of homomorphism between structure…
▽ More
Optimal transport is widely used in pure and applied mathematics to find probabilistic solutions to hard combinatorial matching problems. We extend the Wasserstein metric and other elements of optimal transport from the matching of sets to the matching of graphs and other structured data. This structure-preserving form of optimal transport relaxes the usual notion of homomorphism between structures. It applies to graphs, directed and undirected, labeled and unlabeled, and to any other structure that can be realized as a $C$-set for some finitely presented category $C$. We construct both Hausdorff-style and Wasserstein-style metrics on $C$-sets and we show that the latter are convex relaxations of the former. Like the classical Wasserstein metric, the Wasserstein metric on $C$-sets is the value of a linear program and is therefore efficiently computable.
△ Less
Submitted 12 July, 2019; v1 submitted 29 June, 2019;
originally announced July 2019.
-
Conformalized Quantile Regression
Authors:
Yaniv Romano,
Evan Patterson,
Emmanuel J. Candès
Abstract:
Conformal prediction is a technique for constructing prediction intervals that attain valid coverage in finite samples, without making distributional assumptions. Despite this appeal, existing conformal methods can be unnecessarily conservative because they form intervals of constant or weakly varying length across the input space. In this paper we propose a new method that is fully adaptive to he…
▽ More
Conformal prediction is a technique for constructing prediction intervals that attain valid coverage in finite samples, without making distributional assumptions. Despite this appeal, existing conformal methods can be unnecessarily conservative because they form intervals of constant or weakly varying length across the input space. In this paper we propose a new method that is fully adaptive to heteroscedasticity. It combines conformal prediction with classical quantile regression, inheriting the advantages of both. We establish a theoretical guarantee of valid coverage, supplemented by extensive experiments on popular regression datasets. We compare the efficiency of conformalized quantile regression to other conformal methods, showing that our method tends to produce shorter intervals.
△ Less
Submitted 8 May, 2019;
originally announced May 2019.
-
Automatic Face Aging in Videos via Deep Reinforcement Learning
Authors:
Chi Nhan Duong,
Khoa Luu,
Kha Gia Quach,
Nghia Nguyen,
Eric Patterson,
Tien D. Bui,
Ngan Le
Abstract:
This paper presents a novel approach to synthesize automatically age-progressed facial images in video sequences using Deep Reinforcement Learning. The proposed method models facial structures and the longitudinal face-aging process of given subjects coherently across video frames. The approach is optimized using a long-term reward, Reinforcement Learning function with deep feature extraction from…
▽ More
This paper presents a novel approach to synthesize automatically age-progressed facial images in video sequences using Deep Reinforcement Learning. The proposed method models facial structures and the longitudinal face-aging process of given subjects coherently across video frames. The approach is optimized using a long-term reward, Reinforcement Learning function with deep feature extraction from Deep Convolutional Neural Network. Unlike previous age-progression methods that are only able to synthesize an aged likeness of a face from a single input image, the proposed approach is capable of age-progressing facial likenesses in videos with consistently synthesized facial features across frames. In addition, the deep reinforcement learning method guarantees preservation of the visual identity of input faces after age-progression. Results on videos of our new collected aging face AGFW-v2 database demonstrate the advantages of the proposed solution in terms of both quality of age-progressed faces, temporal smoothness, and cross-age face verification.
△ Less
Submitted 24 April, 2019; v1 submitted 27 November, 2018;
originally announced November 2018.
-
Teaching machines to understand data science code by semantic enrichment of dataflow graphs
Authors:
Evan Patterson,
Ioana Baldini,
Aleksandra Mojsilovic,
Kush R. Varshney
Abstract:
Your computer is continuously executing programs, but does it really understand them? Not in any meaningful sense. That burden falls upon human knowledge workers, who are increasingly asked to write and understand code. They deserve to have intelligent tools that reveal the connections between code and its subject matter. Towards this prospect, we develop an AI system that forms semantic represent…
▽ More
Your computer is continuously executing programs, but does it really understand them? Not in any meaningful sense. That burden falls upon human knowledge workers, who are increasingly asked to write and understand code. They deserve to have intelligent tools that reveal the connections between code and its subject matter. Towards this prospect, we develop an AI system that forms semantic representations of computer programs, using techniques from knowledge representation and program analysis. To create the representations, we introduce an algorithm for enriching dataflow graphs with semantic information. The semantic enrichment algorithm is undergirded by a new ontology language for modeling computer programs and a new ontology about data science, written in this language. Throughout the paper, we focus on code written by data scientists and we locate our work within a larger movement towards collaborative, open, and reproducible science.
△ Less
Submitted 25 January, 2019; v1 submitted 16 July, 2018;
originally announced July 2018.
-
The Inverse Eigenvalue Problem for Entanglement Witnesses
Authors:
Nathaniel Johnston,
Everett Patterson
Abstract:
We consider the inverse eigenvalue problem for entanglement witnesses, which asks for a characterization of their possible spectra (or equivalently, of the possible spectra resulting from positive linear maps of matrices). We completely solve this problem in the two-qubit case and we derive a large family of new necessary conditions on the spectra in arbitrary dimensions. We also establish a natur…
▽ More
We consider the inverse eigenvalue problem for entanglement witnesses, which asks for a characterization of their possible spectra (or equivalently, of the possible spectra resulting from positive linear maps of matrices). We completely solve this problem in the two-qubit case and we derive a large family of new necessary conditions on the spectra in arbitrary dimensions. We also establish a natural duality relationship with the set of absolutely separable states, and we completely characterize witnesses (i.e., separating hyperplanes) of that set when one of the local dimensions is 2.
△ Less
Submitted 19 August, 2017;
originally announced August 2017.
-
Knowledge Representation in Bicategories of Relations
Authors:
Evan Patterson
Abstract:
We introduce the relational ontology log, or relational olog, a knowledge representation system based on the category of sets and relations. It is inspired by Spivak and Kent's olog, a recent categorical framework for knowledge representation. Relational ologs interpolate between ologs and description logic, the dominant formalism for knowledge representation today. In this paper, we investigate r…
▽ More
We introduce the relational ontology log, or relational olog, a knowledge representation system based on the category of sets and relations. It is inspired by Spivak and Kent's olog, a recent categorical framework for knowledge representation. Relational ologs interpolate between ologs and description logic, the dominant formalism for knowledge representation today. In this paper, we investigate relational ologs both for their own sake and to gain insight into the relationship between the algebraic and logical approaches to knowledge representation. On a practical level, we show by example that relational ologs have a friendly and intuitive--yet fully precise--graphical syntax, derived from the string diagrams of monoidal categories. We explain several other useful features of relational ologs not possessed by most description logics, such as a type system and a rich, flexible notion of instance data. In a more theoretical vein, we draw on categorical logic to show how relational ologs can be translated to and from logical theories in a fragment of first-order logic. Although we make extensive use of categorical language, this paper is designed to be self-contained and has considerable expository content. The only prerequisites are knowledge of first-order logic and the rudiments of category theory.
△ Less
Submitted 1 November, 2017; v1 submitted 1 June, 2017;
originally announced June 2017.
-
Modeling the Multiple Myeloma Vicious Cycle: Signaling Across the Bone Marrow Microenvironment
Authors:
Catherine E. Patterson,
Bruce P. Ayati,
Sarah A. Holstein
Abstract:
Multiple myeloma is a plasma cell cancer that leads to a dysregulated bone remodeling process. We present a partial differential equation model describing the dynamics of bone remodeling with the presence of myeloma tumor cells. The model explicitly takes into account the roles of osteoclasts, osteoblasts, precursor cells, stromal cells, osteocytes, and tumor cells. Previous models based on ordina…
▽ More
Multiple myeloma is a plasma cell cancer that leads to a dysregulated bone remodeling process. We present a partial differential equation model describing the dynamics of bone remodeling with the presence of myeloma tumor cells. The model explicitly takes into account the roles of osteoclasts, osteoblasts, precursor cells, stromal cells, osteocytes, and tumor cells. Previous models based on ordinary differential equations make the simplifying assumption that the bone and tumor cells are adjacent to each other. However, in actuality, these cell populations are separated by the bone marrow. Our model takes this separation into account by including the diffusion of chemical factors across the marrow, which can be viewed as communication between the tumor and bone. Additionally, this model incorporates the growth of the tumor and the diminishing bone mass by utilizing a ``moving boundary.'' We present numerical simulations that qualitatively validate our model's description of the cell population dynamics.
△ Less
Submitted 17 November, 2015;
originally announced November 2015.
-
On the Singular Structure of Graph Hypersurfaces
Authors:
Eric Patterson
Abstract:
We show that the singular loci of graph hypersurfaces correspond set-theoretically to their rank loci. The proof holds for all configuration hypersurfaces and depends only on linear algebra. To make the conclusion for the second graph hypersurface, we prove that the second graph polynomial is a configuration polynomial. The result indicates that there may be a fruitful interplay between the curren…
▽ More
We show that the singular loci of graph hypersurfaces correspond set-theoretically to their rank loci. The proof holds for all configuration hypersurfaces and depends only on linear algebra. To make the conclusion for the second graph hypersurface, we prove that the second graph polynomial is a configuration polynomial. The result indicates that there may be a fruitful interplay between the current research in graph hypersurfaces and Stratified Morse Theory.
△ Less
Submitted 8 March, 2011; v1 submitted 28 April, 2010;
originally announced April 2010.
-
The next simplest hyperbolic knots
Authors:
Abhijit Champanerkar,
Ilya Kofman,
Eric Patterson
Abstract:
We complete the project begun by Callahan, Dean and Weeks to identify all knots whose complements are in the SnapPea census of hyperbolic manifolds with seven or fewer tetrahedra. Many of these ``simple'' hyperbolic knots have high crossing number. We also compute their Jones polynomials.
We complete the project begun by Callahan, Dean and Weeks to identify all knots whose complements are in the SnapPea census of hyperbolic manifolds with seven or fewer tetrahedra. Many of these ``simple'' hyperbolic knots have high crossing number. We also compute their Jones polynomials.
△ Less
Submitted 23 May, 2006; v1 submitted 21 November, 2003;
originally announced November 2003.
