-
Fermionic Machine Learning
Authors:
Jérémie Gince,
Jean-Michel Pagé,
Marco Armenta,
Ayana Sarkar,
Stefanos Kourtis
Abstract:
We introduce fermionic machine learning (FermiML), a machine learning framework based on fermionic quantum computation. FermiML models are expressed in terms of parameterized matchgate circuits, a restricted class of quantum circuits that map exactly to systems of free Majorana fermions. The FermiML framework allows for building fermionic counterparts of any quantum machine learning (QML) model ba…
▽ More
We introduce fermionic machine learning (FermiML), a machine learning framework based on fermionic quantum computation. FermiML models are expressed in terms of parameterized matchgate circuits, a restricted class of quantum circuits that map exactly to systems of free Majorana fermions. The FermiML framework allows for building fermionic counterparts of any quantum machine learning (QML) model based on parameterized quantum circuits, including models that produce highly entangled quantum states. Importantly, matchgate circuits are efficiently simulable classically, thus rendering FermiML a flexible framework for utility benchmarks of QML methods on large real-world datasets. We initiate the exploration of FermiML by benchmarking it against unrestricted PQCs in the context of classification with random quantum kernels. Through experiments on standard datasets (Digits and Wisconsin Breast Cancer), we demonstrate that FermiML kernels are on-par with unrestricted PQC kernels in classification tasks using support-vector machines. Furthermore, we find that FermiML kernels outperform their unrestricted candidates on multi-class classification, including on datasets with several tens of relevant features. We thus show how FermiML enables us to explore regimes previously inaccessible to QML methods.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
Double framed moduli spaces of quiver representations
Authors:
Marco Armenta,
Thomas Brüstle,
Souheila Hassoun,
Markus Reineke
Abstract:
Motivated by problems in the neural networks setting, we study moduli spaces of double framed quiver representations and give both a linear algebra description and a representation theoretic description of these moduli spaces. We define a network category whose isomorphism classes of objects correspond to the orbits of quiver representations, in which neural networks map input data. We then prove…
▽ More
Motivated by problems in the neural networks setting, we study moduli spaces of double framed quiver representations and give both a linear algebra description and a representation theoretic description of these moduli spaces. We define a network category whose isomorphism classes of objects correspond to the orbits of quiver representations, in which neural networks map input data. We then prove that the output of a neural network depends only on the corresponding point in the moduli space. Finally, we present a different perspective on map** neural networks with a specific activation function, called ReLU, to a moduli space using the symplectic reduction approach to quiver moduli.
△ Less
Submitted 11 October, 2021; v1 submitted 29 September, 2021;
originally announced September 2021.
-
Neural Teleportation
Authors:
Marco Armenta,
Thierry Judge,
Nathan Painchaud,
Youssef Skandarani,
Carl Lemaire,
Gabriel Gibeau Sanchez,
Philippe Spino,
Pierre-Marc Jodoin
Abstract:
In this paper, we explore a process called neural teleportation, a mathematical consequence of applying quiver representation theory to neural networks. Neural teleportation
"teleports" a network to a new position in the weight space and preserves its function. This phenomenon comes directly from the definitions of representation theory applied to neural networks and it turns out to be a very sim…
▽ More
In this paper, we explore a process called neural teleportation, a mathematical consequence of applying quiver representation theory to neural networks. Neural teleportation
"teleports" a network to a new position in the weight space and preserves its function. This phenomenon comes directly from the definitions of representation theory applied to neural networks and it turns out to be a very simple operation that has remarkable properties. We shed light on surprising and counter-intuitive consequences neural teleportation has on the loss landscape. In particular, we show that teleportation can be used to explore loss level curves, that it changes the local loss landscape, sharpens global minima and boosts back-propagated gradients at any moment during the learning process. Our results can be reproduced with the code available here: https://github.com/vitalab/neuralteleportation
△ Less
Submitted 13 August, 2021; v1 submitted 2 December, 2020;
originally announced December 2020.
-
The Representation Theory of Neural Networks
Authors:
Marco Antonio Armenta,
Pierre-Marc Jodoin
Abstract:
In this work, we show that neural networks can be represented via the mathematical theory of quiver representations. More specifically, we prove that a neural network is a quiver representation with activation functions, a mathematical object that we represent using a network quiver. Also, we show that network quivers gently adapt to common neural network concepts such as fully-connected layers, c…
▽ More
In this work, we show that neural networks can be represented via the mathematical theory of quiver representations. More specifically, we prove that a neural network is a quiver representation with activation functions, a mathematical object that we represent using a network quiver. Also, we show that network quivers gently adapt to common neural network concepts such as fully-connected layers, convolution operations, residual connections, batch normalization, pooling operations and even randomly wired neural networks. We show that this mathematical representation is by no means an approximation of what neural networks are as it exactly matches reality. This interpretation is algebraic and can be studied with algebraic methods. We also provide a quiver representation model to understand how a neural network creates representations from the data. We show that a neural network saves the data as quiver representations, and maps it to a geometrical space called the moduli space, which is given in terms of the underlying oriented graph of the network, i.e., its quiver. This results as a consequence of our defined objects and of understanding how the neural network computes a prediction in a combinatorial and algebraic way. Overall, representing neural networks through the quiver representation theory leads to 9 consequences and 4 inquiries for future research that we believe are of great interest to better understand what neural networks are and how they work.
△ Less
Submitted 22 March, 2021; v1 submitted 23 July, 2020;
originally announced July 2020.
-
Can social influence be exploited to compromise security: An online experimental evaluation
Authors:
Soumajyoti Sarkar,
Paulo Shakarian,
Mika Armenta,
Danielle Sanchez,
Kiran Lakkaraju
Abstract:
Social media has enabled users and organizations to obtain information about technology usage like software usage and even security feature usage. However, on the dark side it has also allowed an adversary to potentially exploit the users in a manner to either obtain information from them or influence them towards decisions that might have malicious settings or intents. While there have been subst…
▽ More
Social media has enabled users and organizations to obtain information about technology usage like software usage and even security feature usage. However, on the dark side it has also allowed an adversary to potentially exploit the users in a manner to either obtain information from them or influence them towards decisions that might have malicious settings or intents. While there have been substantial efforts into understanding how social influence affects one's likelihood to adopt a security technology, especially its correlation with the number of friends adopting the same technology, in this study we investigate whether peer influence can dictate what users decide over and above their own knowledge. To this end, we manipulate social signal exposure in an online controlled experiment with human participants to investigate whether social influence can be harnessed in a negative way to steer users towards harmful security choices. We analyze this through a controlled game where each participant selects one option when presented with six security technologies with differing utilities, with one choice having the most utility. Over multiple rounds of the game, we observe that social influence as a tool can be quite powerful in manipulating a user's decision towards adoption of security technologies that are less efficient. However, what stands out more in the process is that the manner in which a user receives social signals from its peers decides the extent to which social influence can be successful in changing a user's behavior.
△ Less
Submitted 4 September, 2019;
originally announced September 2019.
-
Use of a controlled experiment and computational models to measure the impact of sequential peer exposures on decision making
Authors:
Soumajyoti Sarkar,
Ashkan Aleali,
Paulo Shakarian,
Mika Armenta,
Danielle Sanchez,
Kiran Lakkaraju
Abstract:
It is widely believed that one's peers influence product adoption behaviors. This relationship has been linked to the number of signals a decision-maker receives in a social network. But it is unclear if these same principles hold when the pattern by which it receives these signals vary and when peer influence is directed towards choices which are not optimal. To investigate that, we manipulate so…
▽ More
It is widely believed that one's peers influence product adoption behaviors. This relationship has been linked to the number of signals a decision-maker receives in a social network. But it is unclear if these same principles hold when the pattern by which it receives these signals vary and when peer influence is directed towards choices which are not optimal. To investigate that, we manipulate social signal exposure in an online controlled experiment using a game with human participants. Each participant in the game makes a decision among choices with differing utilities. We observe the following: (1) even in the presence of monetary risks and previously acquired knowledge of the choices, decision-makers tend to deviate from the obvious optimal decision when their peers make similar decision which we call the influence decision, (2) when the quantity of social signals vary over time, the forwarding probability of the influence decision and therefore being responsive to social influence does not necessarily correlate proportionally to the absolute quantity of signals. To better understand how these rules of peer influence could be used in modeling applications of real world diffusion and in networked environments, we use our behavioral findings to simulate spreading dynamics in real world case studies. We specifically try to see how cumulative influence plays out in the presence of user uncertainty and measure its outcome on rumor diffusion, which we model as an example of sub-optimal choice diffusion. Together, our simulation results indicate that sequential peer effects from the influence decision overcomes individual uncertainty to guide faster rumor diffusion over time. However, when the rate of diffusion is slow in the beginning, user uncertainty can have a substantial role compared to peer influence in deciding the adoption trajectory of a piece of questionable information.
△ Less
Submitted 5 June, 2020; v1 submitted 3 September, 2019;
originally announced September 2019.
-
On the cap product in Hochschild theory
Authors:
Marco Armenta
Abstract:
In this paper we give an axiomatic characterization of the cap product in the Hochschild theory of associative unital algebras which are projective over a commutative unital ring. We also give an interpretation of the cap product with coefficients in the algebra via chain maps.
In this paper we give an axiomatic characterization of the cap product in the Hochschild theory of associative unital algebras which are projective over a commutative unital ring. We also give an interpretation of the cap product with coefficients in the algebra via chain maps.
△ Less
Submitted 6 August, 2019;
originally announced August 2019.
-
About a counterexample on contractible transformations of graphs
Authors:
Martín-Eduardo Frías Armenta
Abstract:
In [A. V. Ivashchenko, Contractible transformations do not change the homology groups of graphs, Discrete Mathematics 126 (1) (1994) p 159,170], Ivashchenko started with the study of contractible graphs, he began with this because they have application to molecular spaces. But in a second paper [A. V. Ivashchenko, Some properties of contractible transformations on graphs, Discrete Mathematics 133…
▽ More
In [A. V. Ivashchenko, Contractible transformations do not change the homology groups of graphs, Discrete Mathematics 126 (1) (1994) p 159,170], Ivashchenko started with the study of contractible graphs, he began with this because they have application to molecular spaces. But in a second paper [A. V. Ivashchenko, Some properties of contractible transformations on graphs, Discrete Mathematics 133 (1) (1994) p 139,145], he made several mistakes. We show in this paper that the results in that second paper are false or the proofs are wrong.
△ Less
Submitted 22 April, 2019;
originally announced April 2019.
-
Derived invariance of the Tamarkin--Tsygan calculus of an algebra
Authors:
Marco Antonio Armenta,
Bernhard Keller
Abstract:
We prove that derived equivalent algebras have isomorphic differential calculi in the sense of Tamarkin--Tsygan.
We prove that derived equivalent algebras have isomorphic differential calculi in the sense of Tamarkin--Tsygan.
△ Less
Submitted 13 November, 2018; v1 submitted 11 November, 2018;
originally announced November 2018.
-
Batalin-Vilkovisky structure on Hochschild cohomology with coefficients in the dual algebra
Authors:
Marco Antonio Armenta
Abstract:
We prove that Hochschild cohomology with coefficients in $A^*=Hom_k(A,k)$ together with an $A$-structural map $ψ:A^* \otimes_A A^* \to A^*$ is a Batalin-Vilkovisky algebra. This applies to symmetric, Frobenius and monomial path algebras.
We prove that Hochschild cohomology with coefficients in $A^*=Hom_k(A,k)$ together with an $A$-structural map $ψ:A^* \otimes_A A^* \to A^*$ is a Batalin-Vilkovisky algebra. This applies to symmetric, Frobenius and monomial path algebras.
△ Less
Submitted 13 November, 2018; v1 submitted 30 October, 2018;
originally announced October 2018.