-
Moore-Penrose Dagger Categories
Authors:
Robin Cockett,
Jean-Simon Pacaud Lemay
Abstract:
The notion of a Moore-Penrose inverse (M-P inverse) was introduced by Moore in 1920 and rediscovered by Penrose in 1955. The M-P inverse of a complex matrix is a special type of inverse which is unique, always exists, and can be computed using singular value decomposition. In a series of papers in the 1980s, Puystjens and Robinson studied M-P inverses more abstractly in the context of dagger cate…
▽ More
The notion of a Moore-Penrose inverse (M-P inverse) was introduced by Moore in 1920 and rediscovered by Penrose in 1955. The M-P inverse of a complex matrix is a special type of inverse which is unique, always exists, and can be computed using singular value decomposition. In a series of papers in the 1980s, Puystjens and Robinson studied M-P inverses more abstractly in the context of dagger categories. Despite the fact that dagger categories are now a fundamental notion in categorical quantum mechanics, the notion of a M-P inverse has not (to our knowledge) been revisited since their work. One purpose of this paper is, thus, to renew the study of M-P inverses in dagger categories.
Here we introduce the notion of a Moore-Penrose dagger category and provide many examples including complex matrices, finite Hilbert spaces, dagger groupoids, and inverse categories. We also introduce generalized versions of singular value decomposition, compact singular value decomposition, and polar decomposition for maps in a dagger category, and show how, having such a decomposition is equivalent to having M-P inverses. This allows us to provide precise characterizations of which maps have M-P inverses in a dagger idempotent complete category, a dagger kernel category with dagger biproducts (and negatives), and a dagger category with unique square roots.
△ Less
Submitted 31 August, 2023;
originally announced August 2023.
-
Cartesian Differential Kleisli Categories
Authors:
Jean-Simon Pacaud Lemay
Abstract:
Cartesian differential categories come equipped with a differential combinator which axiomatizes the fundamental properties of the total derivative from differential calculus. The objective of this paper is to understand when the Kleisli category of a monad is a Cartesian differential category. We introduce Cartesian differential monads, which are monads whose Kleisli category is a Cartesian diffe…
▽ More
Cartesian differential categories come equipped with a differential combinator which axiomatizes the fundamental properties of the total derivative from differential calculus. The objective of this paper is to understand when the Kleisli category of a monad is a Cartesian differential category. We introduce Cartesian differential monads, which are monads whose Kleisli category is a Cartesian differential category by way of lifting the differential combinator from the base category. Examples of Cartesian differential monads include tangent bundle monads and reader monads. We give a precise characterization of Cartesian differential categories which are Kleisli categories of Cartesian differential monads using abstract Kleisli categories. We also show that the Eilenberg-Moore category of a Cartesian differential monad is a tangent category.
△ Less
Submitted 18 November, 2023; v1 submitted 13 August, 2023;
originally announced August 2023.
-
Classical Distributive Restriction Categories
Authors:
Robin Cockett,
Jean-Simon Pacaud Lemay
Abstract:
In the category of sets and partial functions, $\mathsf{PAR}$, while the disjoint union $\sqcup$ is the usual categorical coproduct, the Cartesian product $\times$ becomes a restriction categorical analogue of the categorical product: a restriction product. Nevertheless, $\mathsf{PAR}$ does have a usual categorical product as well in the form $A \& B := A \sqcup B \sqcup (A \times B)$. Surprisingl…
▽ More
In the category of sets and partial functions, $\mathsf{PAR}$, while the disjoint union $\sqcup$ is the usual categorical coproduct, the Cartesian product $\times$ becomes a restriction categorical analogue of the categorical product: a restriction product. Nevertheless, $\mathsf{PAR}$ does have a usual categorical product as well in the form $A \& B := A \sqcup B \sqcup (A \times B)$. Surprisingly, asking that a distributive restriction category (a restriction category with restriction products $\times$ and coproducts $\oplus$) has $A \& B$ a categorical product is enough to imply that the category is a classical restriction category. This is a restriction category which has joins and relative complements and, thus, supports classical Boolean reasoning. The first and main observation of the paper is that a distributive restriction category is classical if and only if $A \& B := A \oplus B \oplus (A \times B)$ is a categorical product in which case we call $\&$ the ''classical'' product.
In fact, a distributive restriction category has a categorical product if and only if it is a classified restriction category. This is in the sense that every map $A \to B$ factors uniquely through a total map $A \to B \oplus \mathsf{1}$, where $\mathsf{1}$ is the restriction terminal object. This implies the second significant observation of the paper, namely, that a distributive restriction category has a classical product if and only if it is the Kleisli category of the exception monad $\_ \oplus \mathsf{1}$ for an ordinary distributive category.
Thus having a classical product has a significant structural effect on a distributive restriction category. In particular, the classical product not only provides an alternative axiomatization for being classical but also for being the Kleisli category of the exception monad on an ordinary distributive category.
△ Less
Submitted 21 September, 2023; v1 submitted 25 May, 2023;
originally announced May 2023.
-
Graded Differential Categories and Graded Differential Linear Logic
Authors:
Jean-Simon Pacaud Lemay,
Jean-Baptiste Vienney
Abstract:
In Linear Logic ($\mathsf{LL}$), the exponential modality $!$ brings forth a distinction between non-linear proofs and linear proofs, where linear means using an argument exactly once. Differential Linear Logic ($\mathsf{DiLL}$) is an extension of Linear Logic which includes additional rules for $!$ which encode differentiation and the ability of linearizing proofs. On the other hand, Graded Linea…
▽ More
In Linear Logic ($\mathsf{LL}$), the exponential modality $!$ brings forth a distinction between non-linear proofs and linear proofs, where linear means using an argument exactly once. Differential Linear Logic ($\mathsf{DiLL}$) is an extension of Linear Logic which includes additional rules for $!$ which encode differentiation and the ability of linearizing proofs. On the other hand, Graded Linear Logic ($\mathsf{GLL}$) is a variation of Linear Logic in such a way that $!$ is now indexed over a semiring $R$. This $R$-grading allows for non-linear proofs of degree $r \in R$, such that the linear proofs are of degree $1 \in R$. There has been recent interest in combining these two variations of $\mathsf{LL}$ together and develo** Graded Differential Linear Logic ($\mathsf{GDiLL}$). In this paper we present a sequent calculus for $\mathsf{GDiLL}$, as well as introduce its categorical semantics, which we call graded differential categories, using both coderelictions and deriving transformations. We prove that symmetric powers always give graded differential categories, and provide other examples of graded differential categories. We also discuss graded versions of (monoidal) coalgebra modalities, additive bialgebra modalities, and the Seely isomorphisms, as well as their implementations in the sequent calculus of $\mathsf{GDiLL}$.
△ Less
Submitted 31 January, 2024; v1 submitted 19 March, 2023;
originally announced March 2023.
-
Jacobians and Gradients for Cartesian Differential Categories
Authors:
Jean-Simon Pacaud Lemay
Abstract:
Cartesian differential categories come equipped with a differential combinator that formalizes the directional derivative from multivariable calculus. Cartesian differential categories provide a categorical semantics of the differential lambda-calculus and have also found applications in causal computation, incremental computation, game theory, differentiable programming, and machine learning. The…
▽ More
Cartesian differential categories come equipped with a differential combinator that formalizes the directional derivative from multivariable calculus. Cartesian differential categories provide a categorical semantics of the differential lambda-calculus and have also found applications in causal computation, incremental computation, game theory, differentiable programming, and machine learning. There has recently been a desire to provide a (coordinate-free) characterization of Jacobians and gradients in Cartesian differential categories. One's first attempt might be to consider Cartesian differential categories which are Cartesian closed, such as models of the differential lambda-calculus, and then take the curry of the derivative. Unfortunately, this approach excludes numerous important examples of Cartesian differential categories such as the category of real smooth functions. In this paper, we introduce linearly closed Cartesian differential categories, which are Cartesian differential categories that have an internal hom of linear maps, a bilinear evaluation map, and the ability to curry maps which are linear in their second argument. As such, the Jacobian of a map is defined as the curry of its derivative. Many well-known examples of Cartesian differential categories are linearly closed, such as, in particular, the category of real smooth functions. We also explain how a Cartesian closed differential category is linearly closed if and only if a certain linear idempotent on the internal hom splits. To define the gradient of a map, one must be able to define the transpose of the Jacobian, which can be done in a Cartesian reverse differential category. Thus, we define the gradient of a map to be the curry of its reverse derivative and show this equals the transpose of its Jacobian. We also explain how a linearly closed Cartesian reverse differential category is precisely a linearly closed Cartesian differential category with an appropriate notion of transpose.
△ Less
Submitted 3 November, 2022;
originally announced November 2022.
-
Monoidal Reverse Differential Categories
Authors:
Geoffrey Cruttwell,
Jonathan Gallagher,
Jean-Simon Pacaud Lemay,
Dorette Pronk
Abstract:
Cartesian reverse differential categories (CRDCs) are a recently defined structure which categorically model the reverse differentiation operations used in supervised learning. Here we define a related structure called a monoidal reverse differential category, prove important results about its relationship to CRDCs, and provide examples of both structures, including examples coming from models of…
▽ More
Cartesian reverse differential categories (CRDCs) are a recently defined structure which categorically model the reverse differentiation operations used in supervised learning. Here we define a related structure called a monoidal reverse differential category, prove important results about its relationship to CRDCs, and provide examples of both structures, including examples coming from models of quantum computation.
△ Less
Submitted 9 September, 2022; v1 submitted 23 March, 2022;
originally announced March 2022.
-
Cartesian Difference Categories
Authors:
Mario Alvarez-Picallo,
Jean-Simon Pacaud Lemay
Abstract:
Cartesian differential categories are categories equipped with a differential combinator which axiomatizes the directional derivative. Important models of Cartesian differential categories include classical differential calculus of smooth functions and categorical models of the differential $λ$-calculus. However, Cartesian differential categories cannot account for other interesting notions of dif…
▽ More
Cartesian differential categories are categories equipped with a differential combinator which axiomatizes the directional derivative. Important models of Cartesian differential categories include classical differential calculus of smooth functions and categorical models of the differential $λ$-calculus. However, Cartesian differential categories cannot account for other interesting notions of differentiation of a more discrete nature such as the calculus of finite differences. On the other hand, change action models have been shown to capture these examples as well as more "exotic" examples of differentiation. But change action models are very general and do not share the nice properties of Cartesian differential categories. In this paper, we introduce Cartesian difference categories as a bridge between Cartesian differential categories and change action models. We show that every Cartesian differential category is a Cartesian difference category, and how certain well-behaved change action models are Cartesian difference categories. In particular, Cartesian difference categories model both the differential calculus of smooth functions and the calculus of finite differences. Furthermore, every Cartesian difference category comes equipped with a tangent bundle monad whose Kleisli category is again a Cartesian difference category.
△ Less
Submitted 6 September, 2021; v1 submitted 25 November, 2020;
originally announced November 2020.
-
Linearizing Combinators
Authors:
Robin Cockett,
Jean-Simon Pacaud Lemay
Abstract:
In 2017, Bauer, Johnson, Osborne, Riehl, and Tebbe (BJORT) showed that the Abelian functor calculus provides an example of a Cartesian differential category. The definition of a Cartesian differential category is based on a differential combinator which directly formalizes the total derivative from multivariable calculus. However, in the aforementioned work the authors used techniques from Goodwil…
▽ More
In 2017, Bauer, Johnson, Osborne, Riehl, and Tebbe (BJORT) showed that the Abelian functor calculus provides an example of a Cartesian differential category. The definition of a Cartesian differential category is based on a differential combinator which directly formalizes the total derivative from multivariable calculus. However, in the aforementioned work the authors used techniques from Goodwillie's functor calculus to establish a linearization process from which they then derived a differential combinator. This raised the question of what the precise relationship between linearization and having a differential combinator might be.
In this paper, we introduce the notion of a linearizing combinator which abstracts linearization in the Abelian functor calculus. We then use it to provide an alternative axiomatization of a Cartesian differential category. Every Cartesian differential category comes equipped with a canonical linearizing combinator obtained by differentiation at zero. Conversely, a differential combinator can be constructed à la BJORT when one has a system of partial linearizing combinators in each context. Thus, while linearizing combinators do provide an alternative axiomatization of Cartesian differential categories, an explicit notion of partial linearization is required. This is in contrast to the situation for differential combinators where partial differentiation is automatic in the presence of total differentiation. The ability to form a system of partial linearizing combinators from a total linearizing combinator, while not being possible in general, is possible when the setting is Cartesian closed.
△ Less
Submitted 18 February, 2022; v1 submitted 29 October, 2020;
originally announced October 2020.
-
Why FHilb is Not an Interesting (Co)Differential Category
Authors:
Jean-Simon Pacaud Lemay
Abstract:
Differential categories provide an axiomatization of the basics of differentiation and categorical models of differential linear logic. As differentiation is an important tool throughout quantum mechanics and quantum information, it makes sense to study applications of the theory of differential categories to categorical quantum foundations. In categorical quantum foundations, compact closed categ…
▽ More
Differential categories provide an axiomatization of the basics of differentiation and categorical models of differential linear logic. As differentiation is an important tool throughout quantum mechanics and quantum information, it makes sense to study applications of the theory of differential categories to categorical quantum foundations. In categorical quantum foundations, compact closed categories (and therefore traced symmetric monoidal categories) are one of the main objects of study, in particular the category of finite-dimensional Hilbert spaces FHilb. In this paper, we will explain why the only differential category structure on FHilb is the trivial one. This follows from a sort of in-compatibility between the trace of FHilb and possible differential category structure. That said, there are interesting non-trivial examples of traced/compact closed differential categories, which we also discuss.
The goal of this paper is to introduce differential categories to the broader categorical quantum foundation community and hopefully open the door to further work in combining these two fields. While the main result of this paper may seem somewhat "negative" in achieving this goal, we discuss interesting potential applications of differential categories to categorical quantum foundations.
△ Less
Submitted 1 May, 2020;
originally announced May 2020.
-
Cartesian Difference Categories: Extended Report
Authors:
Mario Alvarez-Picallo,
Jean-Simon Pacaud Lemay
Abstract:
Cartesian differential categories are categories equipped with a differential combinator which axiomatizes the directional derivative. Important models of Cartesian differential categories include classical differential calculus of smooth functions and categorical models of the differential lambda-calculus. However, Cartesian differential categories cannot account for other interesting notions of…
▽ More
Cartesian differential categories are categories equipped with a differential combinator which axiomatizes the directional derivative. Important models of Cartesian differential categories include classical differential calculus of smooth functions and categorical models of the differential lambda-calculus. However, Cartesian differential categories cannot account for other interesting notions of differentiation such as the calculus of finite differences or the Boolean differential calculus. On the other hand, change action models have been shown to capture these examples as well as more "exotic" examples of differentiation. However, change action models are very general and do not share the nice properties of a Cartesian differential category. In this paper, we introduce Cartesian difference categories as a bridge between Cartesian differential categories and change action models. We show that every Cartesian differential category is a Cartesian difference category, and how certain well-behaved change action models are Cartesian difference categories. In particular, Cartesian difference categories model both the differential calculus of smooth functions and the calculus of finite differences. Furthermore, every Cartesian difference category comes equipped with a tangent bundle monad whose Kleisli category is again a Cartesian difference category.
△ Less
Submitted 22 July, 2020; v1 submitted 3 February, 2020;
originally announced February 2020.
-
Reverse derivative categories
Authors:
Robin Cockett,
Geoffrey Cruttwell,
Jonathan Gallagher,
Jean-Simon Pacaud Lemay,
Benjamin MacAdam,
Gordon Plotkin,
Dorette Pronk
Abstract:
The reverse derivative is a fundamental operation in machine learning and automatic differentiation. This paper gives a direct axiomatization of a category with a reverse derivative operation, in a similar style to that given by Cartesian differential categories for a forward derivative. Intriguingly, a category with a reverse derivative also has a forward derivative, but the converse is not true.…
▽ More
The reverse derivative is a fundamental operation in machine learning and automatic differentiation. This paper gives a direct axiomatization of a category with a reverse derivative operation, in a similar style to that given by Cartesian differential categories for a forward derivative. Intriguingly, a category with a reverse derivative also has a forward derivative, but the converse is not true. In fact, we show explicitly what a forward derivative is missing: a reverse derivative is equivalent to a forward derivative with a dagger structure on its subcategory of linear maps. Furthermore, we show that these linear maps form an additively enriched category with dagger biproducts.
△ Less
Submitted 15 October, 2019;
originally announced October 2019.
-
Lifting Coalgebra Modalities and $\mathsf{MELL}$ Model Structure to Eilenberg-Moore Categories
Authors:
Jean-Simon Pacaud Lemay
Abstract:
A categorical model of the multiplicative and exponential fragments of intuitionistic linear logic ($\mathsf{MELL}$), known as a \emph{linear category}, is a symmetric monoidal closed category with a monoidal coalgebra modality (also known as a linear exponential comonad). Inspired by Blute and Scott's work on categories of modules of Hopf algebras as models of linear logic, we study categories of…
▽ More
A categorical model of the multiplicative and exponential fragments of intuitionistic linear logic ($\mathsf{MELL}$), known as a \emph{linear category}, is a symmetric monoidal closed category with a monoidal coalgebra modality (also known as a linear exponential comonad). Inspired by Blute and Scott's work on categories of modules of Hopf algebras as models of linear logic, we study categories of algebras of monads (also known as Eilenberg-Moore categories) as models of $\mathsf{MELL}$. We define a $\mathsf{MELL}$ lifting monad on a linear category as a Hopf monad -- in the Brugui{è}res, Lack, and Virelizier sense -- with a special kind of mixed distributive law over the monoidal coalgebra modality. As our main result, we show that the linear category structure lifts to the category of algebras of $\mathsf{MELL}$ lifting monads. We explain how groups in the category of coalgebras of the monoidal coalgebra modality induce $\mathsf{MELL}$ lifting monads and provide a source for such groups from enrichment over abelian groups. Along the way we also define mixed distributive laws of symmetric comonoidal monads over symmetric monoidal comonads and lifting differential category structure.
△ Less
Submitted 6 November, 2019; v1 submitted 30 April, 2018;
originally announced April 2018.
