Showing 1–11 of 11 results for author: Bukatin, M

Safety without alignment

Authors: András Kornai, Michael Bukatin, Zsolt Zombori

Abstract: Currently, the dominant paradigm in AI safety is alignment with human values. Here we describe progress on develo** an alternative approach to safety, based on ethical rationalism (Gewirth:1978), and propose an inherently safe implementation path via hybrid theorem provers in a sandbox. As AGIs evolve, their alignment may fade, but their rationality can only increase (otherwise more rational one… ▽ More Currently, the dominant paradigm in AI safety is alignment with human values. Here we describe progress on develo** an alternative approach to safety, based on ethical rationalism (Gewirth:1978), and propose an inherently safe implementation path via hybrid theorem provers in a sandbox. As AGIs evolve, their alignment may fade, but their rationality can only increase (otherwise more rational ones will have a significant evolutionary advantage) so an approach that ties their ethics to their rationality has clear long-term advantages. △ Less

Submitted 18 March, 2023; v1 submitted 27 February, 2023; originally announced March 2023.

Dataflow Matrix Machines and V-values: a Bridge between Programs and Neural Nets

Authors: Michael Bukatin, Jon Anthony

Abstract: 1) Dataflow matrix machines (DMMs) generalize neural nets by replacing streams of numbers with linear streams (streams supporting linear combinations), allowing arbitrary input and output arities for activation functions, countable-sized networks with finite dynamically changeable active part capable of unbounded growth, and a very expressive self-referential mechanism. 2) DMMs are suitable for… ▽ More 1) Dataflow matrix machines (DMMs) generalize neural nets by replacing streams of numbers with linear streams (streams supporting linear combinations), allowing arbitrary input and output arities for activation functions, countable-sized networks with finite dynamically changeable active part capable of unbounded growth, and a very expressive self-referential mechanism. 2) DMMs are suitable for general-purpose programming, while retaining the key property of recurrent neural networks: programs are expressed via matrices of real numbers, and continuous changes to those matrices produce arbitrarily small variations in the associated programs. 3) Spaces of V-values (vector-like elements based on nested maps) are particularly useful, enabling DMMs with variadic activation functions and conveniently representing conventional data structures. △ Less

Submitted 23 May, 2018; v1 submitted 20 December, 2017; originally announced December 2017.

Comments: 28 pages, 5 figures; appeared in "K + K = 120: Papers dedicated to Laszlo Kalman and Andras Kornai on the occasion of their 60th birthdays" Festschrift; http://www.nytud.hu/kk120

Dataflow Matrix Machines as a Model of Computations with Linear Streams

Authors: Michael Bukatin, Jon Anthony

Abstract: We overview dataflow matrix machines as a Turing complete generalization of recurrent neural networks and as a programming platform. We describe vector space of finite prefix trees with numerical leaves which allows us to combine expressive power of dataflow matrix machines with simplicity of traditional recurrent neural networks. We overview dataflow matrix machines as a Turing complete generalization of recurrent neural networks and as a programming platform. We describe vector space of finite prefix trees with numerical leaves which allows us to combine expressive power of dataflow matrix machines with simplicity of traditional recurrent neural networks. △ Less

Submitted 3 May, 2017; originally announced June 2017.

Comments: 6 pages, accepted for presentation at LearnAut 2017: Learning and Automata workshop at LICS (Logic in Computer Science) 2017 conference. Preprint original version: April 9, 2017; minor correction: May 1, 2017

Notes on Pure Dataflow Matrix Machines: Programming with Self-referential Matrix Transformations

Authors: Michael Bukatin, Steve Matthews, Andrey Radul

Abstract: Dataflow matrix machines are self-referential generalized recurrent neural nets. The self-referential mechanism is provided via a stream of matrices defining the connectivity and weights of the network in question. A natural question is: what should play the role of untyped lambda-calculus for this programming architecture? The proposed answer is a discipline of programming with only one kind of s… ▽ More Dataflow matrix machines are self-referential generalized recurrent neural nets. The self-referential mechanism is provided via a stream of matrices defining the connectivity and weights of the network in question. A natural question is: what should play the role of untyped lambda-calculus for this programming architecture? The proposed answer is a discipline of programming with only one kind of streams, namely the streams of appropriately shaped matrices. This yields Pure Dataflow Matrix Machines which are networks of transformers of streams of matrices capable of defining a pure dataflow matrix machine. △ Less

Submitted 2 November, 2018; v1 submitted 3 October, 2016; originally announced October 2016.

Comments: 7 pages (v3 - update page 7)

Programming Patterns in Dataflow Matrix Machines and Generalized Recurrent Neural Nets

Authors: Michael Bukatin, Steve Matthews, Andrey Radul

Abstract: Dataflow matrix machines arise naturally in the context of synchronous dataflow programming with linear streams. They can be viewed as a rather powerful generalization of recurrent neural networks. Similarly to recurrent neural networks, large classes of dataflow matrix machines are described by matrices of numbers, and therefore dataflow matrix machines can be synthesized by computing their matri… ▽ More Dataflow matrix machines arise naturally in the context of synchronous dataflow programming with linear streams. They can be viewed as a rather powerful generalization of recurrent neural networks. Similarly to recurrent neural networks, large classes of dataflow matrix machines are described by matrices of numbers, and therefore dataflow matrix machines can be synthesized by computing their matrices. At the same time, the evidence is fairly strong that dataflow matrix machines have sufficient expressive power to be a convenient general-purpose programming platform. Because of the network nature of this platform, programming patterns often correspond to patterns of connectivity in the generalized recurrent neural networks understood as programs. This paper explores a variety of such programming patterns. △ Less

Submitted 3 August, 2018; v1 submitted 30 June, 2016; originally announced June 2016.

Comments: 13 pages (v2 - update references)

Dataflow matrix machines as programmable, dynamically expandable, self-referential generalized recurrent neural networks

Authors: Michael Bukatin, Steve Matthews, Andrey Radul

Abstract: Dataflow matrix machines are a powerful generalization of recurrent neural networks. They work with multiple types of linear streams and multiple types of neurons, including higher-order neurons which dynamically update the matrix describing weights and topology of the network in question while the network is running. It seems that the power of dataflow matrix machines is sufficient for them to be… ▽ More Dataflow matrix machines are a powerful generalization of recurrent neural networks. They work with multiple types of linear streams and multiple types of neurons, including higher-order neurons which dynamically update the matrix describing weights and topology of the network in question while the network is running. It seems that the power of dataflow matrix machines is sufficient for them to be a convenient general purpose programming platform. This paper explores a number of useful programming idioms and constructions arising in this context. △ Less

Submitted 20 June, 2018; v1 submitted 17 May, 2016; originally announced May 2016.

Comments: 9 pages (v2 - update references)

Dataflow Matrix Machines as a Generalization of Recurrent Neural Networks

Authors: Michael Bukatin, Steve Matthews, Andrey Radul

Abstract: Dataflow matrix machines are a powerful generalization of recurrent neural networks. They work with multiple types of arbitrary linear streams, multiple types of powerful neurons, and allow to incorporate higher-order constructions. We expect them to be useful in machine learning and probabilistic programming, and in the synthesis of dynamic systems and of deterministic and probabilistic programs. Dataflow matrix machines are a powerful generalization of recurrent neural networks. They work with multiple types of arbitrary linear streams, multiple types of powerful neurons, and allow to incorporate higher-order constructions. We expect them to be useful in machine learning and probabilistic programming, and in the synthesis of dynamic systems and of deterministic and probabilistic programs. △ Less

Submitted 28 May, 2018; v1 submitted 29 March, 2016; originally announced March 2016.

Comments: 4 pages position paper (v2 - update references)

Dataflow Graphs as Matrices and Programming with Higher-order Matrix Elements

Authors: Michael Bukatin, Steve Matthews

Abstract: We consider dataflow architecture for two classes of computations which admit taking linear combinations of execution runs: probabilistic sampling and generalized animation. We improve the earlier technique of almost continuous program transformations by adopting a discipline of bipartite graphs linking nodes obtained via general transformations and nodes obtained via linear transformations which… ▽ More We consider dataflow architecture for two classes of computations which admit taking linear combinations of execution runs: probabilistic sampling and generalized animation. We improve the earlier technique of almost continuous program transformations by adopting a discipline of bipartite graphs linking nodes obtained via general transformations and nodes obtained via linear transformations which makes it possible to develop and evolve dataflow programs over these classes of computations by continuous program transformations. The use of bipartite graphs allows us to represent the dataflow programs from this class as matrices of real numbers and evolve and modify programs by continuous change of these numbers. We develop a formalism for higher-order dataflow programming for this class of dataflow graphs based on the higher-order matrix elements. Some of our software experiments are briefly discussed. △ Less

Submitted 5 January, 2016; originally announced January 2016.

Comments: 8 pages, August 27, 2015 preprint

Almost Continuous Transformations of Software and Higher-order Dataflow Programming

Authors: Michael Bukatin, Steve Matthews

Abstract: We consider two classes of stream-based computations which admit taking linear combinations of execution runs: probabilistic sampling and generalized animation. The dataflow architecture is a natural platform for programming with streams. The presence of linear combinations allows us to introduce the notion of almost continuous transformation of dataflow graphs. We introduce a new approach to high… ▽ More We consider two classes of stream-based computations which admit taking linear combinations of execution runs: probabilistic sampling and generalized animation. The dataflow architecture is a natural platform for programming with streams. The presence of linear combinations allows us to introduce the notion of almost continuous transformation of dataflow graphs. We introduce a new approach to higher-order dataflow programming: a dynamic dataflow program is a stream of dataflow graphs evolving by almost continuous transformations. A dynamic dataflow program would typically run while it evolves. We introduce Fluid, an experimental open source system for programming with dataflow graphs and almost continuous transformations. △ Less

Submitted 4 January, 2016; originally announced January 2016.

Comments: 12 pages, July 9, 2015 preprint

Linear Models of Computation and Program Learning

Authors: Michael Bukatin, Steve Matthews

Abstract: We consider two classes of computations which admit taking linear combinations of execution runs: probabilistic sampling and generalized animation. We argue that the task of program learning should be more tractable for these architectures than for conventional deterministic programs. We look at the recent advances in the "sampling the samplers" paradigm in higher-order probabilistic programming.… ▽ More We consider two classes of computations which admit taking linear combinations of execution runs: probabilistic sampling and generalized animation. We argue that the task of program learning should be more tractable for these architectures than for conventional deterministic programs. We look at the recent advances in the "sampling the samplers" paradigm in higher-order probabilistic programming. We also discuss connections between partial inconsistency, non-monotonic inference, and vector semantics. △ Less

Submitted 14 December, 2015; originally announced December 2015.

Comments: 13 pages; September 3, 2015 version; to appear in the Proceedings of GCAI 2015, Tbilisi, Georgia, Oct.16-18, 2015

Mathematics of Domains

Authors: Michael A. Bukatin

Abstract: Two groups of naturally arising questions in the mathematical theory of domains for denotational semantics are addressed. Domains are equipped with Scott topology and represent data types. Scott continuous functions represent computable functions and form the most popular continuous model of computations. Covariant Logic of Domains: Domains are represented as sets of theories, and Scott continuo… ▽ More Two groups of naturally arising questions in the mathematical theory of domains for denotational semantics are addressed. Domains are equipped with Scott topology and represent data types. Scott continuous functions represent computable functions and form the most popular continuous model of computations. Covariant Logic of Domains: Domains are represented as sets of theories, and Scott continuous functions are represented as input-output inference engines. The questions addressed are: A. What constitutes a subdomain? Do subdomains of a given domain $A$ form a domain? B. Which retractions are finitary? C. What is the essence of generalizations of information systems based on non-reflexive logics? Are these generalizations restricted to continuous domains? Analysis on Domains: D. How to describe Scott topologies via generalized distance functions satisfying the requirement of Scott continuity ("abstract computability")? The answer is that the axiom $ρ(x, x) = 0$ is incompatible with Scott continuity of distance functions. The resulting \bf relaxed metrics are studied. E. Is it possible to obtain Scott continuous relaxed metrics via measures of domain subsets representing positive and negative information about domain elements? The positive answer is obtained via the discovery of the novel class of co-continuous valuations on the systems of Scott open sets. Some of these natural questions were studied earlier. However, in each case a novel approach is presented, and the answers are supplied with much more compelling and clear justifications, than were known before. △ Less

Submitted 11 December, 2015; originally announced December 2015.

Comments: 135 pages, PhD Thesis, 2002, Department of Computer Science, Brandeis University