Showing 1–13 of 13 results for author: Budzinski, R C

Image segmentation with traveling waves in an exactly solvable recurrent neural network

Authors: Luisa H. B. Liboni, Roberto C. Budzinski, Alexandra N. Busch, Sindy Löwe, Thomas A. Keller, Max Welling, Lyle E. Muller

Abstract: We study image segmentation using spatiotemporal dynamics in a recurrent neural network where the state of each unit is given by a complex number. We show that this network generates sophisticated spatiotemporal dynamics that can effectively divide an image into groups according to a scene's structural characteristics. Using an exact solution of the recurrent network's dynamics, we present a preci… ▽ More We study image segmentation using spatiotemporal dynamics in a recurrent neural network where the state of each unit is given by a complex number. We show that this network generates sophisticated spatiotemporal dynamics that can effectively divide an image into groups according to a scene's structural characteristics. Using an exact solution of the recurrent network's dynamics, we present a precise description of the mechanism underlying object segmentation in this network, providing a clear mathematical interpretation of how the network performs this task. We then demonstrate a simple algorithm for object segmentation that generalizes across inputs ranging from simple geometric objects in grayscale images to natural images. Object segmentation across all images is accomplished with one recurrent neural network that has a single, fixed set of weights. This demonstrates the expressive potential of recurrent neural networks when constructed using a mathematical approach that brings together their structure, dynamics, and computation. △ Less

Submitted 28 November, 2023; originally announced November 2023.

An exact mathematical description of computation with transient spatiotemporal dynamics in a complex-valued neural network

Authors: Roberto C. Budzinski, Alexandra N. Busch, Samuel Mestern, Erwan Martin, Luisa H. B. Liboni, Federico W. Pasini, Ján Mináč, Todd Coleman, Wataru Inoue, Lyle E. Muller

Abstract: We study a complex-valued neural network (cv-NN) with linear, time-delayed interactions. We report the cv-NN displays sophisticated spatiotemporal dynamics, including partially synchronized ``chimera'' states. We then use these spatiotemporal dynamics, in combination with a nonlinear readout, for computation. The cv-NN can instantiate dynamics-based logic gates, encode short-term memories, and med… ▽ More We study a complex-valued neural network (cv-NN) with linear, time-delayed interactions. We report the cv-NN displays sophisticated spatiotemporal dynamics, including partially synchronized ``chimera'' states. We then use these spatiotemporal dynamics, in combination with a nonlinear readout, for computation. The cv-NN can instantiate dynamics-based logic gates, encode short-term memories, and mediate secure message passing through a combination of interactions and time delays. The computations in this system can be fully described in an exact, closed-form mathematical expression. Finally, using direct intracellular recordings of neurons in slices from neocortex, we demonstrate that computations in the cv-NN are decodable by living biological neurons. These results demonstrate that complex-valued linear systems can perform sophisticated computations, while also being exactly solvable. Taken together, these results open future avenues for design of highly adaptable, bio-hybrid computing systems that can interface seamlessly with other neural networks. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Theory of transient chimeras in finite Sakaguchi-Kuramoto networks

Authors: Roberto C. Budzinski, James W. C. Graham, Ján Mináč, Lyle E. Muller

Abstract: Chimera states are a phenomenon in which order and disorder can co-exist within a network that is fully homogeneous. Precisely how transient chimeras emerge in finite networks of Kuramoto oscillators with phase-lag remains unclear. Utilizing an operator-based framework to study nonlinear oscillator networks at finite scale, we reveal the spatiotemporal impact of the adjacency matrix eigenvectors o… ▽ More Chimera states are a phenomenon in which order and disorder can co-exist within a network that is fully homogeneous. Precisely how transient chimeras emerge in finite networks of Kuramoto oscillators with phase-lag remains unclear. Utilizing an operator-based framework to study nonlinear oscillator networks at finite scale, we reveal the spatiotemporal impact of the adjacency matrix eigenvectors on the Sakaguchi-Kuramoto dynamics. We identify a specific condition for the emergence of transient chimeras in these finite networks: the eigenvectors of the network adjacency matrix create a combination of a zero phase-offset mode and low spatial frequency waves traveling in opposite directions. This combination of eigenvectors leads directly to the coherent and incoherent clusters in the chimera. This approach provides two specific analytical predictions: (1) a precise formula predicting the combination of connectivity and phase-lag that creates transient chimeras, (2) a mathematical procedure for rewiring arbitrary networks to produce transient chimeras. △ Less

Submitted 2 November, 2023; originally announced November 2023.

Composed solutions of synchronized patterns in multiplex networks of Kuramoto oscillators

Authors: Priya B. Jain, Tung T. Nguyen, Ján Mináč, Lyle E. Muller, Roberto C. Budzinski

Abstract: Networks with different levels of interactions, including multilayer and multiplex networks, can display a rich diversity of dynamical behaviors and can be used to model and study a wide range of systems. Despite numerous efforts to investigate these networks, obtaining mathematical descriptions for the dynamics of multilayer and multiplex systems is still an open problem. Here, we combine ideas a… ▽ More Networks with different levels of interactions, including multilayer and multiplex networks, can display a rich diversity of dynamical behaviors and can be used to model and study a wide range of systems. Despite numerous efforts to investigate these networks, obtaining mathematical descriptions for the dynamics of multilayer and multiplex systems is still an open problem. Here, we combine ideas and concepts from linear algebra and graph theory with nonlinear dynamics to offer a novel approach to study multiplex networks of Kuramoto oscillators. Our approach allows us to study the dynamics of a large, multiplex network by decomposing it into two smaller systems: one representing the connection scheme within layers (intra-layer), and the other representing the connections between layers (inter-layer). Particularly, we use this approach to compose solutions for multiplex networks of Kuramoto oscillators. These solutions are given by a combination of solutions for the smaller systems given by the intra and inter-layer system and, in addition, our approach allows us to study the linear stability of these solutions. △ Less

Submitted 6 October, 2023; v1 submitted 10 June, 2023; originally announced June 2023.

Dynamical properties and mechanisms of metastability: a perspective in neuroscience

Authors: Kalel L. Rossi, Roberto C. Budzinski, Everton S. Medeiros, Bruno R. R. Boaretto, Lyle Muller, Ulrike Feudel

Abstract: Metastability, characterized by a variability of regimes in time, is a ubiquitous type of neural dynamics. It has been formulated in many different ways in the neuroscience literature, however, which may cause some confusion. In this Perspective, we discuss metastability from the point of view of dynamical systems theory. We extract from the literature a very simple but general definition through… ▽ More Metastability, characterized by a variability of regimes in time, is a ubiquitous type of neural dynamics. It has been formulated in many different ways in the neuroscience literature, however, which may cause some confusion. In this Perspective, we discuss metastability from the point of view of dynamical systems theory. We extract from the literature a very simple but general definition through the concept of metastable regimes as long-lived but transient epochs of activity with unique dynamical properties. This definition serves as an umbrella term that encompasses formulations from other works, and readily connects to concepts from dynamical systems theory. This allows us to examine general dynamical properties of metastable regimes, propose in a didactic manner several dynamics-based mechanisms that generate them, and discuss a theoretical tool to characterize them quantitatively. This perspective leads to insights that help to address issues debated in the literature and also suggest pathways for future research. △ Less

Submitted 21 May, 2024; v1 submitted 9 May, 2023; originally announced May 2023.

Comments: 4 figures

Broadcasting solutions on networked systems of phase oscillators

Authors: Tung T. Nguyen, Roberto C. Budzinski, Federico W. Pasini, Robin Delabays, Ján Mináč, Lyle E. Muller

Abstract: Networked systems have been used to model and investigate the dynamical behavior of a variety of systems. For these systems, different levels of complexity can be considered in the modeling procedure. On one hand, this can offer a more realistic and rich modeling option. On the other hand, it can lead to intrinsic difficulty in analyzing the system. Here, we present an approach to investigate the… ▽ More Networked systems have been used to model and investigate the dynamical behavior of a variety of systems. For these systems, different levels of complexity can be considered in the modeling procedure. On one hand, this can offer a more realistic and rich modeling option. On the other hand, it can lead to intrinsic difficulty in analyzing the system. Here, we present an approach to investigate the dynamics of Kuramoto oscillators on networks with different levels of connections: a network of networks. To do so, we utilize a construction in network theory known as the join of networks, which represents ``intra-area" and ``inter-area" connections. This approach provides a reduced representation of the original, multi-level system, where both systems have equivalent dynamics. Then, we can find solutions for the reduced system and broadcast them to the original network of networks. Moreover, using the same idea we can investigate the stability of these states, where we can obtain information on the Jacobian of the multi-level system by analyzing the reduced one. This approach is general for arbitrary connection schemes between nodes within the same area. Finally, our work opens the possibility of studying the dynamics of networked systems using a simpler representation, thus leading to a better understanding of the dynamical behavior of these systems. △ Less

Submitted 18 January, 2023; v1 submitted 13 September, 2022; originally announced September 2022.

Small changes at single nodes can shift global network dynamics

Authors: Kalel L. Rossi, Roberto C. Budzinski, Bruno R. R. Boaretto, Lyle E. Muller, Ulrike Feudel

Abstract: Understanding the sensitivity of a system's behavior with respect to parameter changes is essential for many applications. This sensitivity may be desired - for instance in the brain, where a large repertoire of different dynamics, particularly different synchronization patterns, is crucial - or may be undesired - for instance in power grids, where disruptions to synchronization may lead to blacko… ▽ More Understanding the sensitivity of a system's behavior with respect to parameter changes is essential for many applications. This sensitivity may be desired - for instance in the brain, where a large repertoire of different dynamics, particularly different synchronization patterns, is crucial - or may be undesired - for instance in power grids, where disruptions to synchronization may lead to blackouts. In this work, we show that the dynamics of networks of phase oscillators can acquire a very large and complex sensitivity to changes made in either their units' parameters or in their connections - even modifications made to a parameter of a single unit can radically alter the global dynamics of the network in an unpredictable manner. As a consequence, each modification leads to a different path to phase synchronization manifested as large fluctuations along that path. This dynamical malleability occurs over a wide parameter region, around the network's two transitions to phase synchronization. One transition is induced by increasing the coupling strength between the units, and another is induced by increasing the prevalence of long-range connections. Specifically, we study Kuramoto phase oscillators connected under either Watts-Strogatz or distance-dependent topologies to analyze the statistical properties of the fluctuations along the paths to phase synchrony. We argue that this increase in the dynamical malleability is a general phenomenon, as suggested by both previous studies and the theory of phase transitions. △ Less

Submitted 3 August, 2022; originally announced August 2022.

Comments: 14 pages, 8 figures

Analytical prediction of specific spatiotemporal patterns in nonlinear oscillator networks with distance-dependent time delays

Authors: Roberto C. Budzinski, Tung T. Nguyen, Gabriel B. Benigno, Jacqueline Doàn, Ján Mináč, Terrence J. Sejnowski, Lyle E. Muller

Abstract: We introduce an analytical approach that allows predictions and mechanistic insights into the dynamics of nonlinear oscillator networks with heterogeneous time delays. We demonstrate that time delays shape the spectrum of a matrix associated to the system, leading to the emergence of waves with a preferred direction. We then create analytical predictions for the specific spatiotemporal patterns ob… ▽ More We introduce an analytical approach that allows predictions and mechanistic insights into the dynamics of nonlinear oscillator networks with heterogeneous time delays. We demonstrate that time delays shape the spectrum of a matrix associated to the system, leading to the emergence of waves with a preferred direction. We then create analytical predictions for the specific spatiotemporal patterns observed in individual simulations of time-delayed Kuramoto networks. This approach generalizes to systems with heterogeneous time delays at finite scales, which permits the study of spatiotemporal dynamics in a broad range of applications. △ Less

Submitted 16 January, 2023; v1 submitted 27 July, 2022; originally announced July 2022.

Equilibria in Kuramoto oscillator networks: An algebraic approach

Authors: Tung T. Nguyen, Roberto C. Budzinski, Jacqueline Doan, Federico W. Pasini, Jan Minac, Lyle E. Muller

Abstract: Kuramoto networks constitute a paradigmatic model for the investigation of collective behavior in networked systems. Despite many advances in recent years, many open questions remain on the solutions for systems composed of coupled Kuramoto oscillators on complex networks. In this article, we describe an algebraic method to find equilibrium points for this kind of system without using standard app… ▽ More Kuramoto networks constitute a paradigmatic model for the investigation of collective behavior in networked systems. Despite many advances in recent years, many open questions remain on the solutions for systems composed of coupled Kuramoto oscillators on complex networks. In this article, we describe an algebraic method to find equilibrium points for this kind of system without using standard approximations in the limit of infinite system size or the continuum limit. To do this, we use a recently introduced algebraic approach to the Kuramoto dynamics, which results in an explicitly solvable complex-valued equation that captures the dynamics of the original Kuramoto model. Using this new approach, we obtain equilibria for both the nonlinear original Kuramoto and complex-valued systems. We then completely classify all equilibria in the case of complete graphs originally studied by Kuramoto. Finally, we go on to study equilibria in networks of coupled oscillators with phase lag, in generalized circulant networks, multi-layer networks, and also random networks. △ Less

Submitted 14 September, 2022; v1 submitted 3 November, 2021; originally announced November 2021.

Comments: To appear in SIAM Journal on Applied Dynamical Systems (SIADS)

Geometry unites synchrony, chimeras, and waves in nonlinear oscillator networks

Authors: Roberto C. Budzinski, Tung T. Nguyen, Jacqueline Doan, Jan Minac, Terrence J. Sejnowski, Lyle E. Muller

Abstract: One of the simplest mathematical models in the study of nonlinear systems is the Kuramoto model, which describes synchronization in systems from swarms of insects to superconductors. We have recently found a connection between the original, real-valued nonlinear Kuramoto model and a corresponding complex-valued system that permits describing the system in terms of a linear operator and iterative u… ▽ More One of the simplest mathematical models in the study of nonlinear systems is the Kuramoto model, which describes synchronization in systems from swarms of insects to superconductors. We have recently found a connection between the original, real-valued nonlinear Kuramoto model and a corresponding complex-valued system that permits describing the system in terms of a linear operator and iterative update rule. We now use this description to investigate three major synchronization phenomena in Kuramoto networks (phase synchronization, chimera states, and traveling waves), not only in terms of steady state solutions but also in terms of transient dynamics and individual simulations. These results provide new mathematical insight into how sophisticated behaviors arise from connection patterns in nonlinear networked systems. △ Less

Submitted 30 March, 2022; v1 submitted 3 November, 2021; originally announced November 2021.

Comments: Final version, published in Chaos: An Interdisciplinary Journal of Nonlinear Science

Journal ref: Chaos 32, 031104 (2022)

Discriminating chaotic and stochastic time series using permutation entropy and artificial neural networks

Authors: B. R. R. Boaretto, R. C. Budzinski, K. L. Rossi, T. L. Prado, S. R. Lopes, C. Masoller

Abstract: Extracting relevant properties of empirical signals generated by nonlinear, stochastic, and high-dimensional systems is a challenge of complex systems research. Open questions are how to differentiate chaotic signals from stochastic ones, and how to quantify nonlinear and/or high-order temporal correlations. Here we propose a new technique to reliably address both problems. Our approach follows tw… ▽ More Extracting relevant properties of empirical signals generated by nonlinear, stochastic, and high-dimensional systems is a challenge of complex systems research. Open questions are how to differentiate chaotic signals from stochastic ones, and how to quantify nonlinear and/or high-order temporal correlations. Here we propose a new technique to reliably address both problems. Our approach follows two steps: first, we train an artificial neural network (ANN) with flicker (colored) noise to predict the value of the parameter, $α$, that determines the strength of the correlation of the noise. To predict $α$ the ANN input features are a set of probabilities that are extracted from the time series by using symbolic ordinal analysis. Then, we input to the trained ANN the probabilities extracted from the time series of interest, and analyze the ANN output. We find that the $α$ value returned by the ANN is informative of the temporal correlations present in the time series. To distinguish between stochastic and chaotic signals, we exploit the fact that the difference between the permutation entropy (PE) of a given time series and the PE of flicker noise with the same $α$ parameter is small when the time series is stochastic, but it is large when the time series is chaotic. We validate our technique by analysing synthetic and empirical time series whose nature is well established. We also demonstrate the robustness of our approach with respect to the length of the time series and to the level of noise. We expect that our algorithm, which is freely available, will be very useful to the community. △ Less

Submitted 6 July, 2021; originally announced July 2021.

Synchronization malleability in neural networks under a distance-dependent coupling

Authors: R. C. Budzinski, K. L. Rossi, B. R. R. Boaretto, T. L. Prado, S. R. Lopes

Abstract: We investigate the synchronization features of a network of spiking neurons under a distance-dependent coupling following a power-law model. The interplay between topology and coupling strength leads to the existence of different spatiotemporal patterns, corresponding to either non-synchronized or phase-synchronized states. Particularly interesting is what we call synchronization malleability, in… ▽ More We investigate the synchronization features of a network of spiking neurons under a distance-dependent coupling following a power-law model. The interplay between topology and coupling strength leads to the existence of different spatiotemporal patterns, corresponding to either non-synchronized or phase-synchronized states. Particularly interesting is what we call synchronization malleability, in which the system depicts significantly different phase synchronization degrees for the same parameters as a consequence of a different ordering of neural inputs. We analyze the functional connectivity of the network by calculating the mutual information between neuronal spike trains, allowing us to characterize the structures of synchronization in the network. We show that these structures are dependent on the ordering of the inputs for the parameter regions where the network presents synchronization malleability and we suggest that this is due to a complex interplay between coupling, connection architecture, and individual neural inputs. △ Less

Submitted 10 November, 2020; v1 submitted 5 June, 2020; originally announced June 2020.

Comments: 13 pages, 10 figures

Symbolic analysis of bursting dynamical regimes of Rulkov neural networks

Authors: R. C. Budzinski, S. R. Lopes, C. Masoller

Abstract: Neurons modeled by the Rulkov map display a variety of dynamic regimes that include tonic spikes and chaotic bursting. Here we study an ensemble of bursting neurons coupled with the Watts-Strogatz small-world topology. We characterize the sequences of bursts using the symbolic method of time-series analysis known as ordinal analysis, which detects nonlinear temporal correlations. We show that the… ▽ More Neurons modeled by the Rulkov map display a variety of dynamic regimes that include tonic spikes and chaotic bursting. Here we study an ensemble of bursting neurons coupled with the Watts-Strogatz small-world topology. We characterize the sequences of bursts using the symbolic method of time-series analysis known as ordinal analysis, which detects nonlinear temporal correlations. We show that the probabilities of the different symbols distinguish different dynamical regimes, which depend on the coupling strength and the network topology. These regimes have different spatio-temporal properties that can be visualized with raster plots. △ Less

Submitted 7 May, 2020; originally announced May 2020.