-
Network analysis of memristive device circuits: dynamics, stability and correlations
Authors:
Frank Barrows,
Forrest C. Sheldon,
Francesco Caravelli
Abstract:
Networks with memristive devices are a potential basis for the next generation of computing devices. They are also an important model system for basic science, from modeling nanoscale conductivity to providing insight into the information-processing of neurons. The resistance in a memristive device depends on the history of the applied bias and thus displays a type of memory. The interplay of this…
▽ More
Networks with memristive devices are a potential basis for the next generation of computing devices. They are also an important model system for basic science, from modeling nanoscale conductivity to providing insight into the information-processing of neurons. The resistance in a memristive device depends on the history of the applied bias and thus displays a type of memory. The interplay of this memory with the dynamic properties of the network can give rise to new behavior, offering many fascinating theoretical challenges. But methods to analyze general memristive circuits are not well described in the literature. In this paper we develop a general circuit analysis for networks that combine memristive devices alongside resistors, capacitors and inductors and under various types of control. We derive equations of motion for the memory parameters of these circuits and describe the conditions for which a network should display properties characteristic of a resonator system. For the case of a purely memresistive network, we derive Lyapunov functions, which can be used to study the stability of the network dynamics. Surprisingly, analysis of the Lyapunov functions show that these circuits do not always have a stable equilibrium in the case of nonlinear resistance and window functions. The Lyapunov function allows us to study circuit invariances, wherein different circuits give rise to similar equations of motion, which manifest through a gauge freedom and node permutations. Finally, we identify the relation between the graph Laplacian and the operators governing the dynamics of memristor networks operators, and we use these tools to study the correlations between distant memristive devices through the effective resistance.
△ Less
Submitted 25 February, 2024;
originally announced February 2024.
-
Number of attractors in the critical Kauffman model is exponential
Authors:
T. M. A. Fink,
F. C. Sheldon
Abstract:
The Kauffman model is the archetypal model of genetic computation. It highlights the importance of criticality, at which many biological systems seem poised. In a series of advances, researchers have honed in on how the number of attractors in the critical regime grows with network size. But a definitive answer has proved elusive. We prove that, for the critical Kauffman model with connectivity on…
▽ More
The Kauffman model is the archetypal model of genetic computation. It highlights the importance of criticality, at which many biological systems seem poised. In a series of advances, researchers have honed in on how the number of attractors in the critical regime grows with network size. But a definitive answer has proved elusive. We prove that, for the critical Kauffman model with connectivity one, the number of attractors grows at least, and at most, as $(2/\!\sqrt{e})^N$. This is the first proof that the number of attractors in a critical Kauffman model grows exponentially.
△ Less
Submitted 2 June, 2023;
originally announced June 2023.
-
Insights from number theory into the critical Kauffman model with connectivity one
Authors:
F. C. Sheldon,
T. M. A. Fink
Abstract:
The Kauffman model of genetic computation highlights the importance of criticality at the border of order and chaos. The model with connectivity one is of special interest because it is exactly solvable. But our understanding of its behavior is incomplete, and much of what we do know relies on heuristic arguments. Here, we show that the key quantities in the model are intimately related to aspects…
▽ More
The Kauffman model of genetic computation highlights the importance of criticality at the border of order and chaos. The model with connectivity one is of special interest because it is exactly solvable. But our understanding of its behavior is incomplete, and much of what we do know relies on heuristic arguments. Here, we show that the key quantities in the model are intimately related to aspects of number theory. Using these links, we derive improved bounds for the number of attractors as well as the mean attractor length, which is harder to compute. Our work suggests that number theory is the natural language for deducing many properties of the critical Kauffman model with connectivity one, and opens the door to further insight into this deceptively simple model.
△ Less
Submitted 24 April, 2024; v1 submitted 3 March, 2023;
originally announced March 2023.
-
Global minimization via classical tunneling assisted by collective force field formation
Authors:
Francesco Caravelli,
Forrest C. Sheldon,
Fabio L. Traversa
Abstract:
Simple dynamical models can produce intricate behaviors in large networks. These behaviors can often be observed in a wide variety of physical systems captured by the network of interactions. Here we describe a phenomenon where the increase of dimensions self-consistently generates a force field due to dynamical instabilities. This can be understood as an unstable ("rumbling") tunneling mechanism…
▽ More
Simple dynamical models can produce intricate behaviors in large networks. These behaviors can often be observed in a wide variety of physical systems captured by the network of interactions. Here we describe a phenomenon where the increase of dimensions self-consistently generates a force field due to dynamical instabilities. This can be understood as an unstable ("rumbling") tunneling mechanism between minima in an effective potential. We dub this collective and nonperturbative effect a "Lyapunov force" which steers the system towards the global minimum of the potential function, even if the full system has a constellation of equilibrium points growing exponentially with the system size. The system we study has a simple map** to a flow network, equivalent to current-driven memristors. The mechanism is appealing for its physical relevance in nanoscale physics, and to possible applications in optimization, novel Monte Carlo schemes and machine learning.
△ Less
Submitted 6 January, 2022; v1 submitted 5 February, 2021;
originally announced February 2021.
-
Analysing the Social Spread of Behaviour: Integrating Complex Contagions into Network Based Diffusions
Authors:
Josh A. Firth,
Gregory F. Albery,
Kristina B. Beck,
Ivan Jarić,
Lewis G. Spurgin,
Ben C. Sheldon,
Will Hoppitt
Abstract:
The spread of socially-learnt behaviours occurs in many animal species, and understanding how behaviours spread can provide novel insights into the causes and consequences of sociality. Within wild populations, behaviour spread is often assumed to occur as a "simple contagion". Yet, emerging evidence suggests behaviours may frequently spread as "complex contagions", and this holds significant rami…
▽ More
The spread of socially-learnt behaviours occurs in many animal species, and understanding how behaviours spread can provide novel insights into the causes and consequences of sociality. Within wild populations, behaviour spread is often assumed to occur as a "simple contagion". Yet, emerging evidence suggests behaviours may frequently spread as "complex contagions", and this holds significant ramifications for the modes and extent of transmission. We present a new framework enabling comprehensive examination of behavioural contagions by integrating social-learning strategies into network-based diffusion analyses. We show how our approach allows determination of the relationship between social bonds and behavioural transmission, identification of individual-level transmission rules, and examination of population-level social structure effects. We provide resources that allow general applications across diverse systems, and demonstrate how further study-specific developments can be made. Finally, we outline the new opportunities this framework facilitates, the conceptual contributions to understanding sociality, and its applications across fields.
△ Less
Submitted 16 December, 2020;
originally announced December 2020.
-
Fully analog memristive circuits for optimization tasks: a comparison
Authors:
Forrest C. Sheldon,
Francesco Caravelli,
Carleton Coffrin
Abstract:
We introduce a Lyapunov function for the dynamics of memristive circuits, and compare the effectiveness of memristors in minimizing the function to widely used optimization software. We study in particular three classes of problems which can be directly embedded in a circuit topology, and show that memristors effectively attempt at (quickly) extremizing these functionals.
We introduce a Lyapunov function for the dynamics of memristive circuits, and compare the effectiveness of memristors in minimizing the function to widely used optimization software. We study in particular three classes of problems which can be directly embedded in a circuit topology, and show that memristors effectively attempt at (quickly) extremizing these functionals.
△ Less
Submitted 1 September, 2020;
originally announced September 2020.
-
Phases of memristive circuits via an interacting disorder approach
Authors:
Francesco Caravelli,
Forrest C. Sheldon
Abstract:
We study the phase diagram of memristive circuit models in the replica-symmetric case using a novel Lyapunov function for the dynamics of these devices. Effectively, the model we propose is an Ising model with interacting quenched disorder, which we study at the first order in a control parameter. Notwithstanding these limitations, we find a complex phase diagram and a glass-ferromagnetic transiti…
▽ More
We study the phase diagram of memristive circuit models in the replica-symmetric case using a novel Lyapunov function for the dynamics of these devices. Effectively, the model we propose is an Ising model with interacting quenched disorder, which we study at the first order in a control parameter. Notwithstanding these limitations, we find a complex phase diagram and a glass-ferromagnetic transition in the parameter space which generalizes earlier mean-field theory results for a simpler model. Our results suggest a non-trivial landscape of asymptotic states for memristive circuits.
△ Less
Submitted 4 September, 2020; v1 submitted 31 August, 2020;
originally announced September 2020.
-
The Computational Capacity of LRC, Memristive and Hybrid Reservoirs
Authors:
Forrest C. Sheldon,
Artemy Kolchinsky,
Francesco Caravelli
Abstract:
Reservoir computing is a machine learning paradigm that uses a high-dimensional dynamical system, or \emph{reservoir}, to approximate and predict time series data. The scale, speed and power usage of reservoir computers could be enhanced by constructing reservoirs out of electronic circuits, and several experimental studies have demonstrated promise in this direction. However, designing quality re…
▽ More
Reservoir computing is a machine learning paradigm that uses a high-dimensional dynamical system, or \emph{reservoir}, to approximate and predict time series data. The scale, speed and power usage of reservoir computers could be enhanced by constructing reservoirs out of electronic circuits, and several experimental studies have demonstrated promise in this direction. However, designing quality reservoirs requires a precise understanding of how such circuits process and store information. We analyze the feasibility and optimal design of electronic reservoirs that include both linear elements (resistors, inductors, and capacitors) and nonlinear memory elements called memristors. We provide analytic results regarding the feasibility of these reservoirs, and give a systematic characterization of their computational properties by examining the types of input-output relationships that they can approximate. This allows us to design reservoirs with optimal properties. By introducing measures of the total linear and nonlinear computational capacities of the reservoir, we are able to design electronic circuits whose total computational capacity scales extensively with the system size. Our electronic reservoirs can match or exceed the performance of conventional "echo state network" reservoirs in a form that may be directly implemented in hardware.
△ Less
Submitted 26 September, 2022; v1 submitted 31 August, 2020;
originally announced September 2020.
-
Minimization of non common path aberrations at the Palomar telescope using a self-coherent camera
Authors:
Raphael Galicher,
Pierre Baudoz,
Jacques-Robert Delorme,
Dimitry Mawet,
Mike Bottom,
James Kent Wallace,
Eugen Serabyn,
Chris Sheldon
Abstract:
The two main advantages of exoplanet imaging are the discovery of objects in the outer part of stellar systems -- constraining models of planet formation --, and its ability to spectrally characterize the planets -- information on their atmosphere. It is however challenging because exoplanets are up to 1e10 times fainter than their star and separated by a fraction of arcsecond. Current instruments…
▽ More
The two main advantages of exoplanet imaging are the discovery of objects in the outer part of stellar systems -- constraining models of planet formation --, and its ability to spectrally characterize the planets -- information on their atmosphere. It is however challenging because exoplanets are up to 1e10 times fainter than their star and separated by a fraction of arcsecond. Current instruments like SPHERE/VLT or GPI/Gemini detect young and massive planets because they are limited by non-common path aberrations (NCPA) that are not corrected by the adaptive optics system. To probe fainter exoplanets, new instruments capable of minimizing the NCPA is needed. One solution is the self-coherent camera (SCC) focal plane wavefront sensor, whose performance was demonstrated in laboratory attenuating the starlight by factors up to several 1e8 in space-like conditions at angular separations down to 2L/D. In this paper, we demonstrate the SCC on the sky for the first time. We installed an SCC on the stellar double coronagraph (SDC) instrument at the Hale telescope. We used an internal source to minimize the NCPA that limited the vortex coronagraph performance. We then compared to the standard procedure used at Palomar. On internal source, we demonstrated that the SCC improves the coronagraphic detection limit by a factor between 4 and 20 between 1.5 and 5L/D. Using this SCC calibration, the on-sky contrast is improved by a factor of 5 between 2 and 4L/D. These results prove the ability of the SCC to be implemented in an existing instrument. This paper highlights two interests of the self-coherent camera. First, the SCC can minimize the speckle intensity in the field of view especially the ones that are very close to the star where many exoplanets are to be discovered. Then, the SCC has a 100% efficiency with science time as each image can be used for both science and NCPA minimization.
△ Less
Submitted 19 September, 2019;
originally announced September 2019.
-
Critical branching processes in digital memcomputing machines
Authors:
Sean R. B. Bearden,
Forrest C. Sheldon,
Massimiliano Di Ventra
Abstract:
Memcomputing is a novel computing paradigm that employs time non-locality (memory) to solve combinatorial optimization problems. It can be realized in practice by means of non-linear dynamical systems whose point attractors represent the solutions of the original problem. It has been previously shown that during the solution search digital memcomputing machines go through a transient phase of aval…
▽ More
Memcomputing is a novel computing paradigm that employs time non-locality (memory) to solve combinatorial optimization problems. It can be realized in practice by means of non-linear dynamical systems whose point attractors represent the solutions of the original problem. It has been previously shown that during the solution search digital memcomputing machines go through a transient phase of avalanches (instantons) that promote dynamical long-range order. By employing mean-field arguments we predict that the distribution of the avalanche sizes follows a Borel distribution typical of critical branching processes with exponent $τ= 3/2$. We corroborate this analysis by solving various random 3-SAT instances of the Boolean satisfiability problem. The numerical results indicate a power-law distribution with exponent $τ= 1.51 \pm 0.02$, in very good agreement with the mean-field analysis. This indicates that memcomputing machines self-tune to a critical state in which avalanches are characterized by a branching process, and that this state persists across the majority of their evolution.
△ Less
Submitted 22 October, 2019; v1 submitted 9 April, 2019;
originally announced April 2019.
-
Phase Transitions and Duality in Adiabatic Memristive Networks
Authors:
Forrest C. Sheldon,
Massimiliano Di Ventra
Abstract:
The development of neuromorphic systems based on memristive elements - resistors with memory - requires a fundamental understanding of their collective dynamics when organized in networks. Here, we study an experimentally inspired model of two-dimensional disordered memristive networks subject to a slowly ramped voltage and show that they undergo a first-order phase transition in the conductivity…
▽ More
The development of neuromorphic systems based on memristive elements - resistors with memory - requires a fundamental understanding of their collective dynamics when organized in networks. Here, we study an experimentally inspired model of two-dimensional disordered memristive networks subject to a slowly ramped voltage and show that they undergo a first-order phase transition in the conductivity for sufficiently high values of memory, as quantified by the memristive ON/OFF ratio. We investigate the consequences of this transition for the memristive current-voltage characteristics both through simulation and theory, and uncover a duality between forward and reverse switching processes that has also been observed in several experimental systems of this sort. Our work sheds considerable light on the statistical properties of memristive networks that are presently studied both for unconventional computing and as models of neural networks.
△ Less
Submitted 11 August, 2016; v1 submitted 21 January, 2016;
originally announced January 2016.
