-
convSeq: Fast and Scalable Method for Detecting Patterns in Spike Data
Authors:
Roman Koshkin,
Tomoki Fukai
Abstract:
Spontaneous neural activity, crucial in memory, learning, and spatial navigation, often manifests itself as repetitive spatiotemporal patterns. Despite their importance, analyzing these patterns in large neural recordings remains challenging due to a lack of efficient and scalable detection methods. Addressing this gap, we introduce convSeq, an unsupervised method that employs backpropagation for…
▽ More
Spontaneous neural activity, crucial in memory, learning, and spatial navigation, often manifests itself as repetitive spatiotemporal patterns. Despite their importance, analyzing these patterns in large neural recordings remains challenging due to a lack of efficient and scalable detection methods. Addressing this gap, we introduce convSeq, an unsupervised method that employs backpropagation for optimizing spatiotemporal filters that effectively identify these neural patterns. Our method's performance is validated on various synthetic data and real neural recordings, revealing spike sequences with unprecedented scalability and efficiency. Significantly surpassing existing methods in speed, convSeq sets a new standard for analyzing spontaneous neural activity, potentially advancing our understanding of information processing in neural circuits.
△ Less
Submitted 13 May, 2024; v1 submitted 1 February, 2024;
originally announced February 2024.
-
METICULOUS: An FPGA-based Main Memory Emulator for System Software Studies
Authors:
Takahiro Hirofuchi,
Takaaki Fukai,
Akram Ben Ahmed,
Ryousei Takano,
Kento Sato
Abstract:
Due to the scaling problem of the DRAM technology, non-volatile memory devices, which are based on different principle of operation than DRAM, are now being intensively developed to expand the main memory of computers. Disaggregated memory is also drawing attention as an emerging technology to scale up the main memory. Although system software studies need to discuss management mechanisms for the…
▽ More
Due to the scaling problem of the DRAM technology, non-volatile memory devices, which are based on different principle of operation than DRAM, are now being intensively developed to expand the main memory of computers. Disaggregated memory is also drawing attention as an emerging technology to scale up the main memory. Although system software studies need to discuss management mechanisms for the new main memory designs incorporating such emerging memory systems, there are no feasible memory emulation mechanisms that efficiently work for large-scale, privileged programs such as operating systems and hypervisors. In this paper, we propose an FPGA-based main memory emulator for system software studies on new main memory systems. It can emulate the main memory incorporating multiple memory regions with different performance characteristics. For the address region of each memory device, it emulates the latencies, bandwidths and bit-flip error rates of read/write operations, respectively. The emulator is implemented at the hardware module of an off-the-self FPGA System-on-Chip board. Any privileged/unprivileged software programs running on its powerful 64-bit CPU cores can access emulated main memory devices at a practical speed through the exactly same interface as normal DRAM main memory. We confirmed that the emulator transparently worked for CPU cores and successfully changed the performance of a memory region according to given emulation parameters; for example, the latencies measured by CPU cores were exactly proportional to the latencies inserted by the emulator, involving the minimum overhead of approximately 240 ns. As a preliminary use case, we confirmed that the emulator allows us to change the bandwidth limit and the inserted latency individually for unmodified software programs, making discussions on latency sensitivity much easier.
△ Less
Submitted 7 September, 2023;
originally announced September 2023.
-
An Inherent Trade-Off in Noisy Neural Communication with Rank-Order Coding
Authors:
Ibrahim Alsolami,
Tomoki Fukai
Abstract:
Rank-order coding, a form of temporal coding, has emerged as a promising scheme to explain the rapid ability of the mammalian brain. Owing to its speed as well as efficiency, rank-order coding is increasingly gaining interest in diverse research areas beyond neuroscience. However, much uncertainty still exists about the performance of rank-order coding under noise. Herein we show what information…
▽ More
Rank-order coding, a form of temporal coding, has emerged as a promising scheme to explain the rapid ability of the mammalian brain. Owing to its speed as well as efficiency, rank-order coding is increasingly gaining interest in diverse research areas beyond neuroscience. However, much uncertainty still exists about the performance of rank-order coding under noise. Herein we show what information rates are fundamentally possible and what trade-offs are at stake. An unexpected finding in this paper is the emergence of a special class of errors that, in a regime, increase with less noise.
△ Less
Submitted 14 August, 2023;
originally announced August 2023.
-
Simplicial Hopfield networks
Authors:
Thomas F Burns,
Tomoki Fukai
Abstract:
Hopfield networks are artificial neural networks which store memory patterns on the states of their neurons by choosing recurrent connection weights and update rules such that the energy landscape of the network forms attractors around the memories. How many stable, sufficiently-attracting memory patterns can we store in such a network using $N$ neurons? The answer depends on the choice of weights…
▽ More
Hopfield networks are artificial neural networks which store memory patterns on the states of their neurons by choosing recurrent connection weights and update rules such that the energy landscape of the network forms attractors around the memories. How many stable, sufficiently-attracting memory patterns can we store in such a network using $N$ neurons? The answer depends on the choice of weights and update rule. Inspired by setwise connectivity in biology, we extend Hopfield networks by adding setwise connections and embedding these connections in a simplicial complex. Simplicial complexes are higher dimensional analogues of graphs which naturally represent collections of pairwise and setwise relationships. We show that our simplicial Hopfield networks increase memory storage capacity. Surprisingly, even when connections are limited to a small random subset of equivalent size to an all-pairwise network, our networks still outperform their pairwise counterparts. Such scenarios include non-trivial simplicial topology. We also test analogous modern continuous Hopfield networks, offering a potentially promising avenue for improving the attention mechanism in Transformer models.
△ Less
Submitted 9 May, 2023;
originally announced May 2023.
-
Goal-oriented inference of environment from redundant observations
Authors:
Kazuki Takahashi,
Tomoki Fukai,
Yutaka Sakai,
Takashi Takekawa
Abstract:
The agent learns to organize decision behavior to achieve a behavioral goal, such as reward maximization, and reinforcement learning is often used for this optimization. Learning an optimal behavioral strategy is difficult under the uncertainty that events necessary for learning are only partially observable, called as Partially Observable Markov Decision Process (POMDP). However, the real-world e…
▽ More
The agent learns to organize decision behavior to achieve a behavioral goal, such as reward maximization, and reinforcement learning is often used for this optimization. Learning an optimal behavioral strategy is difficult under the uncertainty that events necessary for learning are only partially observable, called as Partially Observable Markov Decision Process (POMDP). However, the real-world environment also gives many events irrelevant to reward delivery and an optimal behavioral strategy. The conventional methods in POMDP, which attempt to infer transition rules among the entire observations, including irrelevant states, are ineffective in such an environment. Supposing Redundantly Observable Markov Decision Process (ROMDP), here we propose a method for goal-oriented reinforcement learning to efficiently learn state transition rules among reward-related "core states'' from redundant observations. Starting with a small number of initial core states, our model gradually adds new core states to the transition diagram until it achieves an optimal behavioral strategy consistent with the Bellman equation. We demonstrate that the resultant inference model outperforms the conventional method for POMDP. We emphasize that our model only containing the core states has high explainability. Furthermore, the proposed method suits online learning as it suppresses memory consumption and improves learning speed.
△ Less
Submitted 7 May, 2023;
originally announced May 2023.
-
Analyzing I/O Performance of a Hierarchical HPC Storage System for Distributed Deep Learning
Authors:
Takaaki Fukai,
Kento Sato,
Takahiro Hirofuchi
Abstract:
Today, deep learning is an essential technology for our life. To solve more complex problems with deep learning, both sizes of training datasets and neural networks are increasing. To train a model with large datasets and networks, distributed deep neural network (DDNN) training technique is necessary. For large-scale DDNN training, HPC clusters are a promising computation environment. In large-sc…
▽ More
Today, deep learning is an essential technology for our life. To solve more complex problems with deep learning, both sizes of training datasets and neural networks are increasing. To train a model with large datasets and networks, distributed deep neural network (DDNN) training technique is necessary. For large-scale DDNN training, HPC clusters are a promising computation environment. In large-scale DDNN on HPC clusters, I/O performance is critical because it is becoming a bottleneck. Most flagship-class HPC clusters have hierarchical storage systems. For designing future HPC storage systems, it is necessary to quantify the performance improvement effect of the hierarchical storage system on the workloads. This paper demonstrates the quantitative performance analysis of the hierarchical storage system for DDNN workload in a flagship-class supercomputer. Our analysis shows how much performance improvement and volume increment of the storage will be required to meet the performance goal.
△ Less
Submitted 4 January, 2023;
originally announced January 2023.
-
An Extension of Fisher's Criterion: Theoretical Results with a Neural Network Realization
Authors:
Ibrahim Alsolami,
Tomoki Fukai
Abstract:
Fisher's criterion is a widely used tool in machine learning for feature selection. For large search spaces, Fisher's criterion can provide a scalable solution to select features. A challenging limitation of Fisher's criterion, however, is that it performs poorly when mean values of class-conditional distributions are close to each other. Motivated by this challenge, we propose an extension of Fis…
▽ More
Fisher's criterion is a widely used tool in machine learning for feature selection. For large search spaces, Fisher's criterion can provide a scalable solution to select features. A challenging limitation of Fisher's criterion, however, is that it performs poorly when mean values of class-conditional distributions are close to each other. Motivated by this challenge, we propose an extension of Fisher's criterion to overcome this limitation. The proposed extension utilizes the available heteroscedasticity of class-conditional distributions to distinguish one class from another. Additionally, we describe how our theoretical results can be casted into a neural network framework, and conduct a proof-of-concept experiment to demonstrate the viability of our approach to solve classification problems.
△ Less
Submitted 18 December, 2022;
originally announced December 2022.
-
Modeling the Repetition-based Recovering of Acoustic and Visual Sources with Dendritic Neurons
Authors:
Giorgia Dellaferrera,
Toshitake Asabuki,
Tomoki Fukai
Abstract:
In natural auditory environments, acoustic signals originate from the temporal superimposition of different sound sources. The problem of inferring individual sources from ambiguous mixtures of sounds is known as blind source decomposition. Experiments on humans have demonstrated that the auditory system can identify sound sources as repeating patterns embedded in the acoustic input. Source repeti…
▽ More
In natural auditory environments, acoustic signals originate from the temporal superimposition of different sound sources. The problem of inferring individual sources from ambiguous mixtures of sounds is known as blind source decomposition. Experiments on humans have demonstrated that the auditory system can identify sound sources as repeating patterns embedded in the acoustic input. Source repetition produces temporal regularities that can be detected and used for segregation. Specifically, listeners can identify sounds occurring more than once across different mixtures, but not sounds heard only in a single mixture. However, whether such a behaviour can be computationally modelled has not yet been explored. Here, we propose a biologically inspired computational model to perform blind source separation on sequences of mixtures of acoustic stimuli. Our method relies on a somatodendritic neuron model trained with a Hebbian-like learning rule which can detect spatio-temporal patterns recurring in synaptic inputs. We show that the segregation capabilities of our model are reminiscent of the features of human performance in a variety of experimental settings involving synthesized sounds with naturalistic properties. Furthermore, we extend the study to investigate the properties of segregation on task settings not yet explored with human subjects, namely natural sounds and images. Overall, our work suggests that somatodendritic neuron models offer a promising neuro-inspired learning strategy to account for the characteristics of the brain segregation capabilities as well as to make predictions on yet untested experimental settings.
△ Less
Submitted 16 January, 2022;
originally announced January 2022.
-
MLPerf HPC: A Holistic Benchmark Suite for Scientific Machine Learning on HPC Systems
Authors:
Steven Farrell,
Murali Emani,
Jacob Balma,
Lukas Drescher,
Aleksandr Drozd,
Andreas Fink,
Geoffrey Fox,
David Kanter,
Thorsten Kurth,
Peter Mattson,
Dawei Mu,
Amit Ruhela,
Kento Sato,
Koichi Shirahata,
Tsuguchika Tabaru,
Aristeidis Tsaris,
Jan Balewski,
Ben Cumming,
Takumi Danjo,
Jens Domke,
Takaaki Fukai,
Naoto Fukumoto,
Tatsuya Fukushi,
Balazs Gerofi,
Takumi Honda
, et al. (18 additional authors not shown)
Abstract:
Scientific communities are increasingly adopting machine learning and deep learning models in their applications to accelerate scientific insights. High performance computing systems are pushing the frontiers of performance with a rich diversity of hardware resources and massive scale-out capabilities. There is a critical need to understand fair and effective benchmarking of machine learning appli…
▽ More
Scientific communities are increasingly adopting machine learning and deep learning models in their applications to accelerate scientific insights. High performance computing systems are pushing the frontiers of performance with a rich diversity of hardware resources and massive scale-out capabilities. There is a critical need to understand fair and effective benchmarking of machine learning applications that are representative of real-world scientific use cases. MLPerf is a community-driven standard to benchmark machine learning workloads, focusing on end-to-end performance metrics. In this paper, we introduce MLPerf HPC, a benchmark suite of large-scale scientific machine learning training applications driven by the MLCommons Association. We present the results from the first submission round, including a diverse set of some of the world's largest HPC systems. We develop a systematic framework for their joint analysis and compare them in terms of data staging, algorithmic convergence, and compute performance. As a result, we gain a quantitative understanding of optimizations on different subsystems such as staging and on-node loading of data, compute-unit utilization, and communication scheduling, enabling overall $>10 \times$ (end-to-end) performance improvements through system scaling. Notably, our analysis shows a scale-dependent interplay between the dataset size, a system's memory hierarchy, and training convergence that underlines the importance of near-compute storage. To overcome the data-parallel scalability challenge at large batch sizes, we discuss specific learning techniques and hybrid data-and-model parallelism that are effective on large systems. We conclude by characterizing each benchmark with respect to low-level memory, I/O, and network behavior to parameterize extended roofline performance models in future rounds.
△ Less
Submitted 26 October, 2021; v1 submitted 21 October, 2021;
originally announced October 2021.
-
Initial perturbation matters: implications of geometry-dependent universal Kardar-Parisi-Zhang statistics for spatiotemporal chaos
Authors:
Yohsuke T. Fukai,
Kazumasa A. Takeuchi
Abstract:
Infinitesimal perturbations in various systems showing spatiotemporal chaos (STC) evolve following the power laws of the Kardar-Parisi-Zhang (KPZ) universality class. While universal properties beyond the power-law exponents, such as distributions and correlations, and their geometry dependence, are established for random growth and related KPZ systems, the validity of these findings to determinis…
▽ More
Infinitesimal perturbations in various systems showing spatiotemporal chaos (STC) evolve following the power laws of the Kardar-Parisi-Zhang (KPZ) universality class. While universal properties beyond the power-law exponents, such as distributions and correlations, and their geometry dependence, are established for random growth and related KPZ systems, the validity of these findings to deterministic chaotic perturbations is unknown. Here we fill this gap between stochastic KPZ systems and deterministic STC perturbations by conducting extensive simulations of a prototypical STC system, namely the logistic coupled map lattice. We show that the perturbation interfaces, defined by the logarithm of the modulus of the perturbation vector components, exhibit the universal, geometry-dependent statistical laws of the KPZ class, despite the deterministic nature of STC. We demonstrate that KPZ statistics for three established geometries arise for different initial profiles of the perturbation, namely point (local), uniform, and "pseudo-stationary" initial perturbations, the last being the statistically stationary state of KPZ interfaces given independently of the Lyapunov vector. This geometry dependence lasts until the KPZ correlation length becomes comparable to the system size. Thereafter, perturbation vectors converge to the unique Lyapunov vector, showing characteristic meandering, coalescence, and annihilation of borders of piece-wise regions that remain different from the Lyapunov vector. Our work implies that the KPZ universality for stochastic systems generally characterizes deterministic STC perturbations, providing new insights for STC, such as the universal dependence on initial perturbation and beyond.
△ Less
Submitted 9 November, 2021; v1 submitted 6 September, 2021;
originally announced September 2021.
-
Direct Evidence for Universal Statistics of Stationary Kardar-Parisi-Zhang Interfaces
Authors:
Takayasu Iwatsuka,
Yohsuke T. Fukai,
Kazumasa A. Takeuchi
Abstract:
The nonequilibrium steady state of the one-dimensional (1D) Kardar-Parisi-Zhang (KPZ) universality class is studied in-depth by exact solutions, yet no direct experimental evidence of its characteristic statistical properties has been reported so far. This is arguably because, for an infinitely large system, infinitely long time is needed to reach such a stationary state and also to converge to th…
▽ More
The nonequilibrium steady state of the one-dimensional (1D) Kardar-Parisi-Zhang (KPZ) universality class is studied in-depth by exact solutions, yet no direct experimental evidence of its characteristic statistical properties has been reported so far. This is arguably because, for an infinitely large system, infinitely long time is needed to reach such a stationary state and also to converge to the predicted universal behavior. Here we circumvent this problem in the experimental system of growing liquid-crystal turbulence, by generating an initial condition that possesses a long-range property expected for the KPZ stationary state. The resulting interface fluctuations clearly show characteristic properties of the 1D stationary KPZ interfaces, including the convergence to the Baik-Rains distribution. We also identify finite-time corrections to the KPZ scaling laws, which turn out to play a major role in the direct test of the stationary KPZ interfaces. This paves the way to explore unsolved properties of the stationary KPZ interfaces experimentally, making possible connections to nonlinear fluctuating hydrodynamics and quantum spin chains as recent studies unveiled relation to the stationary KPZ.
△ Less
Submitted 13 July, 2020; v1 submitted 24 April, 2020;
originally announced April 2020.
-
Kardar-Parisi-Zhang Interfaces with Curved Initial Shapes and Variational Formula
Authors:
Yohsuke T. Fukai,
Kazumasa A. Takeuchi
Abstract:
We study fluctuations of interfaces in the Kardar-Parisi-Zhang (KPZ) universality class with curved initial conditions. By simulations of a cluster growth model and experiments of liquid-crystal turbulence, we determine the universal scaling functions that describe the height distribution and the spatial correlation of the interfaces growing outward from a ring. The scaling functions, controlled b…
▽ More
We study fluctuations of interfaces in the Kardar-Parisi-Zhang (KPZ) universality class with curved initial conditions. By simulations of a cluster growth model and experiments of liquid-crystal turbulence, we determine the universal scaling functions that describe the height distribution and the spatial correlation of the interfaces growing outward from a ring. The scaling functions, controlled by a single dimensionless time parameter, show crossover from the statistical properties of the flat interfaces to those of the circular interfaces. Moreover, employing the KPZ variational formula to describe the case of the ring initial condition, we find that the formula, which we numerically evaluate, reproduces the numerical and experimental results precisely without adjustable parameters. This demonstrates that precise numerical evaluation of the variational formula is possible at all, and underlines the practical importance of the formula, which is able to predict the one-point distribution of KPZ interfaces for general initial conditions.
△ Less
Submitted 11 February, 2020; v1 submitted 26 September, 2019;
originally announced September 2019.
-
Extended temporal association memory by inhibitory Hebbian learning
Authors:
Tatsuya Haga,
Tomoki Fukai
Abstract:
Hebbian learning of excitatory synapses plays a central role in storing activity patterns in associative memory models. Furthermore, interstimulus Hebbian learning associates multiple items in the brain by converting temporal correlation to spatial correlation between attractors. However, growing experimental evidence suggests that learning of inhibitory synapses creates "inhibitory engrams", whic…
▽ More
Hebbian learning of excitatory synapses plays a central role in storing activity patterns in associative memory models. Furthermore, interstimulus Hebbian learning associates multiple items in the brain by converting temporal correlation to spatial correlation between attractors. However, growing experimental evidence suggests that learning of inhibitory synapses creates "inhibitory engrams", which presumably balance with the patterns encoded in the excitatory network. Controlling inhibitory engrams may modify the behavior of associative memory in neural networks, but the consequence of such control has not been theoretically understood. Noting that Hebbian learning of inhibitory synapses yields an anti-Hebbian effect, we show that the combination of Hebbian and anti-Hebbian learning can increase the span of temporal association between the correlated attractors. The balance of targetted and global inhibition regulates this span of association in the network. Our results suggest a nontrivial role of anti-Hebbian learning and inhibitory engrams in associative memory.
△ Less
Submitted 14 September, 2018;
originally announced September 2018.
-
Discrete-attractor-like Tracking in Continuous Attractor Neural Networks
Authors:
Chi Chung Alan Fung,
Tomoki Fukai
Abstract:
Continuous attractor neural networks generate a set of smoothly connected attractor states. In memory systems of the brain, these attractor states may represent continuous pieces of information such as spatial locations and head directions of animals. However, during the replay of previous experiences, hippocampal neurons show a discontinuous sequence in which discrete transitions of neural state…
▽ More
Continuous attractor neural networks generate a set of smoothly connected attractor states. In memory systems of the brain, these attractor states may represent continuous pieces of information such as spatial locations and head directions of animals. However, during the replay of previous experiences, hippocampal neurons show a discontinuous sequence in which discrete transitions of neural state are phase-locked with the slow-gamma (30-40 Hz) oscillation. Here, we explored the underlying mechanisms of the discontinuous sequence generation. We found that a continuous attractor neural network has several phases depending on the interactions between external input and local inhibitory feedback. The discrete-attractor-like behavior naturally emerges in one of these phases without any discreteness assumption. We propose that the dynamics of continuous attractor neural networks is the key to generate discontinuous state changes phase-locked to the brain rhythm.
△ Less
Submitted 21 August, 2018;
originally announced August 2018.
-
Quantifying Health Shocks Over the Life Cycle
Authors:
Taiyo Fukai,
Hidehiko Ichimura,
Kyogo Kanazawa
Abstract:
We first show (1) the importance of investigating health expenditure process using the order two Markov chain model, rather than the standard order one model, which is widely used in the literature. Markov chain of order two is the minimal framework that is capable of distinguishing those who experience a certain health expenditure level for the first time from those who have been experiencing tha…
▽ More
We first show (1) the importance of investigating health expenditure process using the order two Markov chain model, rather than the standard order one model, which is widely used in the literature. Markov chain of order two is the minimal framework that is capable of distinguishing those who experience a certain health expenditure level for the first time from those who have been experiencing that or other levels for some time. In addition, using the model we show (2) that the probability of encountering a health shock first de- creases until around age 10, and then increases with age, particularly, after age 40, (3) that health shock distributions among different age groups do not differ until their percentiles reach the median range, but that above the median the health shock distributions of older age groups gradually start to first-order dominate those of younger groups, and (4) that the persistency of health shocks also shows a U-shape in relation to age.
△ Less
Submitted 26 January, 2018;
originally announced January 2018.
-
Spontaneous and stimulus-induced coherent states of critically balanced neuronal networks
Authors:
Takashi Hayakawa,
Tomoki Fukai
Abstract:
How the information microscopically processed by individual neurons is integrated and used in organizing the behavior of an animal is a central question in neuroscience. The coherence of neuronal dynamics over different scales has been suggested as a clue to the mechanisms underlying this integration. Balanced excitation and inhibition may amplify microscopic fluctuations to a macroscopic level, t…
▽ More
How the information microscopically processed by individual neurons is integrated and used in organizing the behavior of an animal is a central question in neuroscience. The coherence of neuronal dynamics over different scales has been suggested as a clue to the mechanisms underlying this integration. Balanced excitation and inhibition may amplify microscopic fluctuations to a macroscopic level, thus providing a mechanism for generating coherent multiscale dynamics. Previous theories of brain dynamics, however, were restricted to cases in which inhibition dominated excitation and suppressed fluctuations in the macroscopic population activity. In the present study, we investigate the dynamics of neuronal networks at a critical point between excitation-dominant and inhibition-dominant states. In these networks, the microscopic fluctuations are amplified by the strong excitation and inhibition to drive the macroscopic dynamics, while the macroscopic dynamics determine the statistics of the microscopic fluctuations. Develo** a novel type of mean-field theory applicable to this class of interscale interactions, we show that the amplification mechanism generates spontaneous, irregular macroscopic rhythms similar to those observed in the brain. Through the same mechanism, microscopic inputs to a small number of neurons effectively entrain the dynamics of the whole network. These network dynamics undergo a probabilistic transition to a coherent state, as the magnitude of either the balanced excitation and inhibition or the external inputs is increased. Our mean-field theory successfully predicts the behavior of this model. Furthermore, we numerically demonstrate that the coherent dynamics can be used for state-dependent read-out of information from the network. These results show a novel form of neuronal information processing that connects neuronal dynamics on different scales.
△ Less
Submitted 12 December, 2019; v1 submitted 27 November, 2017;
originally announced November 2017.
-
Kardar-Parisi-Zhang Interfaces with Inward Growth
Authors:
Yohsuke T. Fukai,
Kazumasa A. Takeuchi
Abstract:
We study the $(1+1)$-dimensional Kardar-Parisi-Zhang (KPZ) interfaces growing inward from ring-shaped initial conditions, experimentally and numerically, using growth of a turbulent state in liquid-crystal electroconvection and an off-lattice Eden model, respectively. To realize the ring initial condition experimentally, we introduce a holography-based technique that allows us to design the initia…
▽ More
We study the $(1+1)$-dimensional Kardar-Parisi-Zhang (KPZ) interfaces growing inward from ring-shaped initial conditions, experimentally and numerically, using growth of a turbulent state in liquid-crystal electroconvection and an off-lattice Eden model, respectively. To realize the ring initial condition experimentally, we introduce a holography-based technique that allows us to design the initial condition arbitrarily. Then, we find that fluctuation properties of ingrowing circular interfaces are distinct from those for the curved or circular KPZ subclass and, instead, are characterized by the flat subclass. More precisely, we find an asymptotic approach to the Tracy-Widom distribution for the Gaussian orthogonal ensemble and the $\text{Airy}_1$ spatial correlation, as long as time is much shorter than the characteristic time determined by the initial curvature. Near this characteristic time, deviation from the flat KPZ subclass is found, which can be explained in terms of the correlation length and the circumference. Our results indicate that the sign of the initial curvature has a crucial role in determining the universal distribution and correlation functions of the KPZ class.
△ Less
Submitted 11 August, 2017; v1 submitted 2 November, 2016;
originally announced November 2016.
-
Temporal precision of spike response to fluctuating input in pulse-coupled networks of oscillating neurons
Authors:
Jun-nosuke Teramae,
Tomoki Fukai
Abstract:
A single neuron is known to generate almost identical spike trains when the same fluctuating input is repeatedly applied. Here, we study the reliability of spike firing in a pulse-coupled network of oscillator neurons receiving fluctuating inputs. We can study the precise responses of the network as synchronization between uncoupled copies of the network by a common noisy input. To study the noi…
▽ More
A single neuron is known to generate almost identical spike trains when the same fluctuating input is repeatedly applied. Here, we study the reliability of spike firing in a pulse-coupled network of oscillator neurons receiving fluctuating inputs. We can study the precise responses of the network as synchronization between uncoupled copies of the network by a common noisy input. To study the noise-induced synchronization between networks, we derive a self-consistent equation for the distribution of spike-time differences between the networks. Solving this equation, we elucidate how the spike precision changes as a function of the coupling strength.
△ Less
Submitted 22 June, 2009;
originally announced June 2009.
-
Reliability of temporal coding on pulse-coupled networks of oscillators
Authors:
Jun-nosuke Teramae,
Tomoki Fukai
Abstract:
We study the reliability of spike output in a general class of pulse-coupled oscillators receiving a fluctuating input. Showing that this problem is equivalent to noise-induced synchronization between identical networks of oscillators, we employ the phase reduction method to analytically derive the average Lyapunov exponent of the synchronized state. We show that a transition occurs between reli…
▽ More
We study the reliability of spike output in a general class of pulse-coupled oscillators receiving a fluctuating input. Showing that this problem is equivalent to noise-induced synchronization between identical networks of oscillators, we employ the phase reduction method to analytically derive the average Lyapunov exponent of the synchronized state. We show that a transition occurs between reliable and unreliable responses at a critical coupling strength, which is determined through the competition between the external input and recurrent input. To our surprise, the critical value does not depend on intrinsic properties of oscillators.
△ Less
Submitted 6 August, 2007;
originally announced August 2007.
-
Synchronization of Excitatory Neurons with Strongly Heterogeneous Phase Responses
Authors:
Yasuhiro Tsubo,
Jun-nosuke Teramae,
Tomoki Fukai
Abstract:
In many real-world oscillator systems, the phase response curves are highly heterogeneous. However, dynamics of heterogeneous oscillator networks has not been seriously addressed. We propose a theoretical framework to analyze such a system by dealing explicitly with the heterogeneous phase response curves. We develop a novel method to solve the self-consistent equations for order parameters by u…
▽ More
In many real-world oscillator systems, the phase response curves are highly heterogeneous. However, dynamics of heterogeneous oscillator networks has not been seriously addressed. We propose a theoretical framework to analyze such a system by dealing explicitly with the heterogeneous phase response curves. We develop a novel method to solve the self-consistent equations for order parameters by using formal complex-valued phase variables, and apply our theory to networks of in vitro cortical neurons. We find a novel state transition that is not observed in previous oscillator network models.
△ Less
Submitted 31 July, 2007; v1 submitted 7 May, 2007;
originally announced May 2007.
