-
Bimodular continuous attractor neural networks with static and moving stimuli
Authors:
Min Yan,
Wen-Hao Zhang,
He Wang,
K. Y. Michael Wong
Abstract:
We investigated the dynamical behaviors of bimodular continuous attractor neural networks, each processing a modality of sensory input and interacting with each other. We found that when bumps coexist in both modules, the position of each bump is shifted towards the other input when the intermodular couplings are excitatory and is shifted away when inhibitory. When one intermodular coupling is exc…
▽ More
We investigated the dynamical behaviors of bimodular continuous attractor neural networks, each processing a modality of sensory input and interacting with each other. We found that when bumps coexist in both modules, the position of each bump is shifted towards the other input when the intermodular couplings are excitatory and is shifted away when inhibitory. When one intermodular coupling is excitatory while another is moderately inhibitory, temporally modulated population spikes can be generated. On further increase of the inhibitory coupling, momentary spikes will emerge. In the regime of bump coexistence, bump heights are primarily strengthened by excitatory intermodular couplings, but there is a lesser weakening effect due to a bump being displaced from the direct input. When bimodular networks serve as decoders of multisensory integration, we extend the Bayesian framework to show that excitatory and inhibitory couplings encode attractive and repulsive priors, respectively. At low disparity, the bump positions decode the posterior means in the Bayesian framework, whereas at high disparity, multiple steady states exist. In the regime of multiple steady states, the less stable state can be accessed if the input causing the more stable state arrives after a sufficiently long delay. When one input is moving, the bump in the corresponding module is pinned when the moving stimulus is weak, unpinned at intermediate stimulus strength, and tracks the input at strong stimulus strength, and the stimulus strengths for these transitions increase with the velocity of the moving stimulus. These results are important to understanding multisensory integration of static and dynamic stimuli.
△ Less
Submitted 16 July, 2023; v1 submitted 16 October, 2019;
originally announced October 2019.
-
Bandwidth Allocation and Resource Adjustment for Stability Enhancement in Complex Networks
Authors:
K. Y. Henry Tsang,
K. Y. Michael Wong
Abstract:
We introduce the discrete Green's function to elucidate how resource fluctuations determine flow fluctuations in a network optimizing a global cost function. To enhance the robustness of the network against fluctuations, we develop the schemes of optimal bandwidth allocation in links and optimal resource adjustment in nodes. With the total bandwidth of the network fixed, the approach of optimal ba…
▽ More
We introduce the discrete Green's function to elucidate how resource fluctuations determine flow fluctuations in a network optimizing a global cost function. To enhance the robustness of the network against fluctuations, we develop the schemes of optimal bandwidth allocation in links and optimal resource adjustment in nodes. With the total bandwidth of the network fixed, the approach of optimal bandwidth allocation is to increase the bandwidth in links such that the number of overloaded links or the amount of excess flows in networks under fluctuations can be minimized. Similarly, the approach of optimal resource adjustment is to minimize the number of overloaded links in networks under fluctuations with the total resource change in the network fixed. Compared with the conventional approach of proportionate bandwidth assignment or resource reduction, it is found that the optimized bandwidth allocation or resource adjustment can highly enhance the stability of the networks against fluctuations. The changes of loads and currents prescribed by the optimal bandwidth allocation and resource adjustment schemes are correlated with each other, except for some nodes that exhibit relay effects.
△ Less
Submitted 5 March, 2020; v1 submitted 27 August, 2019;
originally announced August 2019.
-
Segment-wise Description of the Dynamics of Traffic Congestion
Authors:
T. S. Choi,
Kiwing To,
K. Y. Michael Wong
Abstract:
We compare the point-wise and segment-wise descriptions of the traffic system. Using real data from the Taiwan highway system with a tremendous volume of segment-wise data, we find that the segment-wise description is much more informative of the evolution of the system during congestion. Congestion is characterized by a loopy trajectory in the fundamental diagram. By considering the area enclosed…
▽ More
We compare the point-wise and segment-wise descriptions of the traffic system. Using real data from the Taiwan highway system with a tremendous volume of segment-wise data, we find that the segment-wise description is much more informative of the evolution of the system during congestion. Congestion is characterized by a loopy trajectory in the fundamental diagram. By considering the area enclosed by the loop, we find that there are two types of congestion dynamics -- moderate flow and serious congestion. They are different in terms of whether the area enclosed vanishes. Data extracted from the time delays of individual vehicles show that the area enclosed is a measure of the economic loss due to congestion. The use of the loss area in hel** to understand various road characteristics is also explored.
△ Less
Submitted 5 August, 2018;
originally announced August 2018.
-
Evolving Powergrids in Self-Organized Criticality: An analogy with Sandpile and Earthquakes
Authors:
Ho Fai Po,
Chi Ho Yeung,
An Zeng,
K. Y. Michael Wong
Abstract:
The stability of powergrid is crucial since its disruption affects systems ranging from street lightings to hospital life-support systems. Nevertheless, large blackouts are inevitable if powergrids are in the state of self-organized criticality (SOC). In this paper, we introduce a simple model of evolving powergrid and establish its connection with the sandpile model, i.e. a prototype of SOC, and…
▽ More
The stability of powergrid is crucial since its disruption affects systems ranging from street lightings to hospital life-support systems. Nevertheless, large blackouts are inevitable if powergrids are in the state of self-organized criticality (SOC). In this paper, we introduce a simple model of evolving powergrid and establish its connection with the sandpile model, i.e. a prototype of SOC, and earthquakes, i.e. a system considered to be in SOC. Various aspects are examined, including the power-law distribution of blackout magnitudes, their inter-event waiting time, the predictability of large blackouts, as well as the spatial-temporal rescaling of blackout data. We verified our observations on simulated networks as well as the IEEE 118-bus system, and show that both simulated and empirical blackout waiting times can be rescaled in space and time similarly to those observed between earthquakes. Finally, we suggested proactive maintenance strategies to drive the powergrids away from SOC to suppress large blackouts.
△ Less
Submitted 7 December, 2016;
originally announced December 2016.
-
Optimizing Synchronization Stability of the Kuramoto Model in Complex Networks and Power Grids
Authors:
Bo Li,
K. Y. Michael Wong
Abstract:
Maintaining the stability of synchronization state is crucial for the functioning of many natural and artificial systems. In this study, we develop methods to optimize the synchronization stability of the Kuramoto model by minimizing the dominant Lyapunov exponent. With the help of the recently proposed cut-set space approximation of the steady states, we greatly simplify the objective function, a…
▽ More
Maintaining the stability of synchronization state is crucial for the functioning of many natural and artificial systems. In this study, we develop methods to optimize the synchronization stability of the Kuramoto model by minimizing the dominant Lyapunov exponent. With the help of the recently proposed cut-set space approximation of the steady states, we greatly simplify the objective function, and further derive its gradient and Hessian with respect to natural frequencies, which leads to an efficient algorithm with the quasi-Newton's method. The optimized systems are demonstrated to achieve better synchronization stability for the Kuramoto model with or without inertia in certain regimes. Hence our method is applicable in improving the stability of power grids. It is also viable to adjust the coupling strength of each link to improve the stability of the system. Various operational constraints can also be easily integrated into our scope by employing the interior point method in convex optimization. The properties of the optimized networks are also discussed.
△ Less
Submitted 14 January, 2017; v1 submitted 15 July, 2016;
originally announced July 2016.
-
How Market Structure Drives Commodity Prices
Authors:
Bin Li,
K. Y. Michael Wong,
Amos H. M. Chan,
Tsz Yan So,
Hermanni Heimonen,
Junyi Wei,
David Saad
Abstract:
We introduce an agent-based model, in which agents set their prices to maximize profit. At steady state the market self-organizes into three groups: excess producers, consumers and balanced agents, with prices determined by their own resource level and a couple of macroscopic parameters that emerge naturally from the analysis, akin to mean-field parameters in statistical mechanics. When resources…
▽ More
We introduce an agent-based model, in which agents set their prices to maximize profit. At steady state the market self-organizes into three groups: excess producers, consumers and balanced agents, with prices determined by their own resource level and a couple of macroscopic parameters that emerge naturally from the analysis, akin to mean-field parameters in statistical mechanics. When resources are scarce prices rise sharply below a turning point that marks the disappearance of excess producers. To compare the model with real empirical data, we study the relations between commodity prices and stock-to-use ratios of a range of commodities such as agricultural products and metals. By introducing an elasticity parameter to mitigate noise and long-term changes in commodities data, we confirm the trend of rising prices, provide evidence for turning points, and indicate yield points for less essential commodities.
△ Less
Submitted 2 January, 2018; v1 submitted 14 August, 2015;
originally announced August 2015.
-
Coverage versus Supply Cost in Facility Location: Physics of Frustrated Spin Systems
Authors:
Chi Ho Yeung,
K. Y. Michael Wong,
Bo Li
Abstract:
A comprehensive coverage is crucial for communication, supply and transportation networks, yet it is limited by the requirement of extensive infrastructure and heavy energy consumption. Here we draw an analogy between spins in antiferromagnet and outlets in supply networks, and apply techniques from the studies of disordered systems to elucidate the effects of balancing the coverage and supply cos…
▽ More
A comprehensive coverage is crucial for communication, supply and transportation networks, yet it is limited by the requirement of extensive infrastructure and heavy energy consumption. Here we draw an analogy between spins in antiferromagnet and outlets in supply networks, and apply techniques from the studies of disordered systems to elucidate the effects of balancing the coverage and supply costs on the network behavior. A readily applicable, coverage optimization algorithm is derived. Simulation results show that magnetized and antiferromagnetic domains emerge and coexist to balance the need for coverage and energy saving. The scaling of parameters with system size agrees with the continuum approximation in two dimensions and the tree approximation in random graphs. Due to frustration caused by the competition between coverage and supply cost, a transition between easy and hard computation regimes is observed. We further suggest a local expansion approach to greatly simplify the message updates which shed light on simplifications in other problems.
△ Less
Submitted 23 October, 2014; v1 submitted 18 December, 2013;
originally announced December 2013.
-
From the Physics of Interacting Polymers to Optimizing Routes on the London Underground
Authors:
Chi Ho Yeung,
David Saad,
K. Y. Michael Wong
Abstract:
Optimizing paths on networks is crucial for many applications, from subway traffic to Internet communication. As global path optimization that takes account of all path-choices simultaneously is computationally hard, most existing routing algorithms optimize paths individually, thus providing sub-optimal solutions. We employ the physics of interacting polymers and disordered systems to analyze mac…
▽ More
Optimizing paths on networks is crucial for many applications, from subway traffic to Internet communication. As global path optimization that takes account of all path-choices simultaneously is computationally hard, most existing routing algorithms optimize paths individually, thus providing sub-optimal solutions. We employ the physics of interacting polymers and disordered systems to analyze macroscopic properties of generic path-optimization problems and derive a simple, principled, generic and distributed routing algorithm capable of considering simultaneously all individual path choices. We demonstrate the efficacy of the new algorithm by applying it to: (i) random graphs resembling Internet overlay networks; (ii) travel on the London underground network based on Oyster-card data; and (iii) the global airport network. Analytically derived macroscopic properties give rise to insightful new routing phenomena, including phase transitions and scaling laws, which facilitate better understanding of the appropriate operational regimes and their limitations that are difficult to obtain otherwise.
△ Less
Submitted 3 September, 2013;
originally announced September 2013.
-
Resolution enhancement in neural networks with dynamical synapses
Authors:
C. C. Alan Fung,
He Wang,
Kin Lam,
K. Y. Michael Wong,
Si Wu
Abstract:
Conventionally, information is represented by spike rates in the neural system. Here, we consider the ability of temporally modulated activities in neuronal networks to carry information extra to spike rates. These temporal modulations, commonly known as population spikes, are due to the presence of synaptic depression in a neuronal network model. We discuss its relevance to an experiment on trans…
▽ More
Conventionally, information is represented by spike rates in the neural system. Here, we consider the ability of temporally modulated activities in neuronal networks to carry information extra to spike rates. These temporal modulations, commonly known as population spikes, are due to the presence of synaptic depression in a neuronal network model. We discuss its relevance to an experiment on transparent motions in macaque monkeys by Treue et al. in 2000. They found that if the moving directions of objects are too close, the firing rate profile will be very similar to that with one direction. As the difference in the moving directions of objects is large enough, the neuronal system would respond in such a way that the network enhances the resolution in the moving directions of the objects. In this paper, we propose that this behavior can be reproduced by neural networks with dynamical synapses when there are multiple external inputs. We will demonstrate how resolution enhancement can be achieved, and discuss the conditions under which temporally modulated activities are able to enhance information processing performances in general.
△ Less
Submitted 17 May, 2013;
originally announced May 2013.
-
The network source location problem: ground state energy, entropy and effects of freezing
Authors:
Hai** Huang,
Jack Raymond,
K. Y. Michael Wong
Abstract:
Ground state entropy of the network source location problem is evaluated at both the replica symmetric level and one-step replica symmetry breaking level using the entropic cavity method. The regime that is a focus of this study, is closely related to the vertex cover problem with randomly quenched covered nodes. The resulting entropic message passing inspired decimation and reinforcement algorith…
▽ More
Ground state entropy of the network source location problem is evaluated at both the replica symmetric level and one-step replica symmetry breaking level using the entropic cavity method. The regime that is a focus of this study, is closely related to the vertex cover problem with randomly quenched covered nodes. The resulting entropic message passing inspired decimation and reinforcement algorithms are used to identify the optimal location of sources in single instances of transportation networks. The conventional belief propagation without taking the entropic effect into account is also compared. We find that in the glassy phase the entropic message passing inspired decimation yields a lower ground state energy compared to the belief propagation without taking the entropic effect. Using the extremal optimization algorithm, we study the ground state energy and the fraction of frozen hubs, and extend the algorithm to collect statistics of the entropy. The theoretical results are compared with the extremal optimization results.
△ Less
Submitted 15 April, 2014; v1 submitted 18 September, 2012;
originally announced September 2012.
-
Dynamical Synapses Enhance Neural Information Processing: Gracefulness, Accuracy and Mobility
Authors:
C. C. Alan Fung,
K. Y. Michael Wong,
He Wang,
Si Wu
Abstract:
Experimental data have revealed that neuronal connection efficacy exhibits two forms of short-term plasticity, namely, short-term depression (STD) and short-term facilitation (STF). They have time constants residing between fast neural signaling and rapid learning, and may serve as substrates for neural systems manipulating temporal information on relevant time scales. The present study investigat…
▽ More
Experimental data have revealed that neuronal connection efficacy exhibits two forms of short-term plasticity, namely, short-term depression (STD) and short-term facilitation (STF). They have time constants residing between fast neural signaling and rapid learning, and may serve as substrates for neural systems manipulating temporal information on relevant time scales. The present study investigates the impact of STD and STF on the dynamics of continuous attractor neural networks (CANNs) and their potential roles in neural information processing. We find that STD endows the network with slow-decaying plateau behaviors-the network that is initially being stimulated to an active state decays to a silent state very slowly on the time scale of STD rather than on the time scale of neural signaling. This provides a mechanism for neural systems to hold sensory memory easily and shut off persistent activities gracefully. With STF, we find that the network can hold a memory trace of external inputs in the facilitated neuronal interactions, which provides a way to stabilize the network response to noisy inputs, leading to improved accuracy in population decoding. Furthermore, we find that STD increases the mobility of the network states. The increased mobility enhances the tracking performance of the network in response to time-varying stimuli, leading to anticipative neural responses. In general, we find that STD and STP tend to have opposite effects on network dynamics and complementary computational advantages, suggesting that the brain may employ a strategy of weighting them differentially depending on the computational purpose.
△ Less
Submitted 4 April, 2012; v1 submitted 2 April, 2011;
originally announced April 2011.
-
Attractor Dynamics with Synaptic Depression
Authors:
C. C. Alan Fung,
K. Y. Michael Wong,
He Wang,
Si Wu
Abstract:
Neuronal connection weights exhibit short-term depression (STD). The present study investigates the impact of STD on the dynamics of a continuous attractor neural network (CANN) and its potential roles in neural information processing. We find that the network with STD can generate both static and traveling bumps, and STD enhances the performance of the network in tracking external inputs. In part…
▽ More
Neuronal connection weights exhibit short-term depression (STD). The present study investigates the impact of STD on the dynamics of a continuous attractor neural network (CANN) and its potential roles in neural information processing. We find that the network with STD can generate both static and traveling bumps, and STD enhances the performance of the network in tracking external inputs. In particular, we find that STD endows the network with slow-decaying plateau behaviors, namely, the network being initially stimulated to an active state will decay to silence very slowly in the time scale of STD rather than that of neural signaling. We argue that this provides a mechanism for neural systems to hold short-term memory easily and shut off persistent activities naturally.
△ Less
Submitted 21 November, 2010; v1 submitted 12 September, 2010;
originally announced September 2010.
-
Price Trends in a Simplified Model of the Wealth Game
Authors:
W. Y. Cheung,
K. Y. Michael Wong
Abstract:
We consider a simplified version of the Wealth Game, which is an agent-based financial market model with many interesting features resembling the real stock market. Market makers are not present in the game so that the majority traders are forced to reduce the amount of stocks they trade, in order to have a balance in the supply and demand. The strategy space is also simplified so that the market…
▽ More
We consider a simplified version of the Wealth Game, which is an agent-based financial market model with many interesting features resembling the real stock market. Market makers are not present in the game so that the majority traders are forced to reduce the amount of stocks they trade, in order to have a balance in the supply and demand. The strategy space is also simplified so that the market is only left with strategies resembling the decisions of optimistic or pessimistic fundamentalists and trend-followers in the real stock market. A dynamical phase transition between a trendsetters' phase and a bouncing phase is discovered in the space of price sensitivity and market impact. Analysis based on a semi-empirical approach explains the phase transition and locates the phase boundary. A phase transition is also observed when the fraction of trend-following strategies increases, which can be explained macroscopically by matching the supply and demand of stocks.
△ Less
Submitted 22 September, 2010; v1 submitted 29 October, 2009;
originally announced October 2009.
-
Optimal Resource Allocation in Random Networks with Transportation Bandwidths
Authors:
C. H. Yeung,
K. Y. Michael Wong
Abstract:
We apply statistical physics to study the task of resource allocation in random sparse networks with limited bandwidths for the transportation of resources along the links. Useful algorithms are obtained from recursive relations. Bottlenecks emerge when the bandwidths are small, causing an increase in the fraction of idle links. For a given total bandwidth per node, the efficiency of allocation…
▽ More
We apply statistical physics to study the task of resource allocation in random sparse networks with limited bandwidths for the transportation of resources along the links. Useful algorithms are obtained from recursive relations. Bottlenecks emerge when the bandwidths are small, causing an increase in the fraction of idle links. For a given total bandwidth per node, the efficiency of allocation increases with the network connectivity. In the high connectivity limit, we find a phase transition at a critical bandwidth, above which clusters of balanced nodes appear, characterised by a profile of homogenized resource allocation similar to the Maxwell's construction.
△ Less
Submitted 25 March, 2009; v1 submitted 25 August, 2008;
originally announced August 2008.
-
Models of Financial Markets with Extensive Participation Incentives
Authors:
C. H. Yeung,
K. Y. Michael Wong,
Y. -C. Zhang
Abstract:
We consider models of financial markets in which all parties involved find incentives to participate. Strategies are evaluated directly by their virtual wealths. By tuning the price sensitivity and market impact, a phase diagram with several attractor behaviors resembling those of real markets emerge, reflecting the roles played by the arbitrageurs and trendsetters, and including a phase with ir…
▽ More
We consider models of financial markets in which all parties involved find incentives to participate. Strategies are evaluated directly by their virtual wealths. By tuning the price sensitivity and market impact, a phase diagram with several attractor behaviors resembling those of real markets emerge, reflecting the roles played by the arbitrageurs and trendsetters, and including a phase with irregular price trends and positive sums. The positive-sumness of the players' wealths provides participation incentives for them. Evolution and the bid-ask spread provide mechanisms for the gain in wealth of both the players and market-makers. New players survive in the market if the evolutionary rate is sufficiently slow. We test the applicability of the model on real Hang Seng Index data over 20 years. Comparisons with other models show that our model has a superior average performance when applied to real financial data.
△ Less
Submitted 21 November, 2007; v1 submitted 1 August, 2007;
originally announced August 2007.
-
Effects of payoff functions and preference distributions in an adaptive population
Authors:
H. M. Yang,
Y. S. Ting,
K. Y. Michael Wong
Abstract:
Adaptive populations such as those in financial markets and distributed control can be modeled by the Minority Game. We consider how their dynamics depends on the agents' initial preferences of strategies, when the agents use linear or quadratic payoff functions to evaluate their strategies. We find that the fluctuations of the population making certain decisions (the volatility) depends on the…
▽ More
Adaptive populations such as those in financial markets and distributed control can be modeled by the Minority Game. We consider how their dynamics depends on the agents' initial preferences of strategies, when the agents use linear or quadratic payoff functions to evaluate their strategies. We find that the fluctuations of the population making certain decisions (the volatility) depends on the diversity of the distribution of the initial preferences of strategies. When the diversity decreases, more agents tend to adapt their strategies together. In systems with linear payoffs, this results in dynamical transitions from vanishing volatility to a non-vanishing one. For low signal dimensions, the dynamical transitions for the different signals do not take place at the same critical diversity. Rather, a cascade of dynamical transitions takes place when the diversity is reduced. In contrast, no phase transitions are found in systems with the quadratic payoffs. Instead, a basin boundary of attraction separates two groups of samples in the space of the agents' decisions. Initial states inside this boundary converge to small volatility, while those outside diverge to a large one. Furthermore, when the preference distribution becomes more polarized, the dynamics becomes more erratic. All the above results are supported by good agreement between simulations and theory.
△ Less
Submitted 4 December, 2007; v1 submitted 21 June, 2007;
originally announced June 2007.
-
Cascades of Dynamical Transitions in an Adaptive Population
Authors:
H. M. Yang,
Y. S. Ting,
K. Y. Michael Wong
Abstract:
In an adaptive population which models financial markets and distributed control, we consider how the dynamics depends on the diversity of the agents' initial preferences of strategies. When the diversity decreases, more agents tend to adapt their strategies together. This change in the environment results in dynamical transitions from vanishing to non-vanishing step sizes. When the diversity de…
▽ More
In an adaptive population which models financial markets and distributed control, we consider how the dynamics depends on the diversity of the agents' initial preferences of strategies. When the diversity decreases, more agents tend to adapt their strategies together. This change in the environment results in dynamical transitions from vanishing to non-vanishing step sizes. When the diversity decreases further, we find a cascade of dynamical transitions for the different signal dimensions, supported by good agreement between simulations and theory. Besides, the signal of the largest step size at the steady state is likely to be the initial signal.
△ Less
Submitted 26 September, 2006;
originally announced September 2006.
-
Temporal Effects of Agent Aggregation in the Dynamics of Multiagent Systems
Authors:
C. H. Yeung,
K. Y. Michael Wong
Abstract:
We propose a model of multiagent systems whose agents have a tendency to balance their decisions in time. We find phase transitions to oscillatory behavior, explainable by the aggregation of agents into two groups. On a longer time scale, we find that the aggregation of smart agents is able to explain the lifetime distribution of epochs to 8 decades of probability.
We propose a model of multiagent systems whose agents have a tendency to balance their decisions in time. We find phase transitions to oscillatory behavior, explainable by the aggregation of agents into two groups. On a longer time scale, we find that the aggregation of smart agents is able to explain the lifetime distribution of epochs to 8 decades of probability.
△ Less
Submitted 21 June, 2006; v1 submitted 22 September, 2005;
originally announced September 2005.
