-
Optimal coordination in Minority Game: A solution from reinforcement learning
Authors:
Guozhong Zheng,
Weiran Cai,
Guanxiao Qi,
Jiqiang Zhang,
Li Chen
Abstract:
Efficient allocation is important in nature and human society where individuals often compete for finite resources. The Minority Game is perhaps the simplest model that provides deep insights into how human coordinate to maximize the resource utilization. However, this model assumes the static strategies that are provided a priori, failing to capture their adaptive nature. Here, we turn to the par…
▽ More
Efficient allocation is important in nature and human society where individuals often compete for finite resources. The Minority Game is perhaps the simplest model that provides deep insights into how human coordinate to maximize the resource utilization. However, this model assumes the static strategies that are provided a priori, failing to capture their adaptive nature. Here, we turn to the paradigm of reinforcement learning, where individuals' strategies are evolving by evaluating both the past experience and rewards in the future. Specifically, we adopt the Q-learning algorithm, each player is endowed with a Q-table that guides their decision-making. We reveal that the population is able to reach the optimal allocation when individuals appreciate both the past experience and rewards in the future, and they are able to balance the exploitation of their Q-tables and the exploration by randomly acting. The optimal allocation is ruined when individuals tend to use either exploitation-only or exploration-only, where only partial coordination and even anti-coordination are observed. Mechanism analysis reveals that a moderate level of exploration can escape local minimums of metastable periodic states, and reaches the optimal coordination as the global minimum. Interestingly, the optimal coordination is underlined by a symmetry-breaking of action preferences, where nearly half of the population choose one side while the other half prefer the other side. The emergence of optimal coordination is robust to the population size and other game parameters. Our work therefore provides a natural solution to the Minority Game and sheds insights into the resource allocation problem in general. Besides, our work demonstrates the potential of the proposed reinforcement learning paradigm in deciphering many puzzles in the socio-economic context.
△ Less
Submitted 19 December, 2023;
originally announced December 2023.
-
Theoretical study for 3D quantum Hall effect in a periodic electron system
Authors:
H. Geng,
G. Y. Qi,
L. Sheng,
W. Chen,
D. Y. Xing
Abstract:
The exsitance of three-dimensional Hall effect (3DQHE) due to spontaneous Fermi surface instabilities in strong magnetic field was proposed decades ago, and has stimulated recent progress in experiments. The reports in recent experiments show that the Hall plateaus and vanishing transverse magneto-resistivities (TMRs) (which are two main signatures of 3DQHE) are not easy to be observed in natural…
▽ More
The exsitance of three-dimensional Hall effect (3DQHE) due to spontaneous Fermi surface instabilities in strong magnetic field was proposed decades ago, and has stimulated recent progress in experiments. The reports in recent experiments show that the Hall plateaus and vanishing transverse magneto-resistivities (TMRs) (which are two main signatures of 3DQHE) are not easy to be observed in natural materials. And two main different explanations of the slow varying slope like Hall plateaus and non-vanishing
TMRs (which can be called as quasi-quantized Hall effect (QQHE)) have been proposed. By studying the magneto-transport with a simple effective periodic 3D system, we show how 3DQHE can be achieved in certain parameter regimes at first. We find two new mechanisms that may give rise to QQHE. One mechanism is the "low" Fermi energy effect, and the other is the "strong" impurity effect. Our studies also proved that the artificial superlattice is an ideal platform for realizing 3DQHE with high layer barrier periodic potential.
△ Less
Submitted 29 October, 2021; v1 submitted 26 May, 2021;
originally announced May 2021.
-
Superconducting states and Majorana modes in transition-metal dichalcogenides under inhomogeneous strain
Authors:
Ming-Xun Deng,
G. Y. Qi,
W. Luo,
R. Ma,
Rui-Qiang Wang,
R. Shen,
L. Sheng
Abstract:
We study the effect of inhomogeneous strain on transition-metal dichalcogenides with a large intrinsic gap in their spectrum. It is found that, by tuning the chemical potential, superconductivity can preserve within the strain-induced discrete pseudo Landau levels (LLs), which introduce interesting topological properties to these systems. As we show, the superconductivity for integer fillings is q…
▽ More
We study the effect of inhomogeneous strain on transition-metal dichalcogenides with a large intrinsic gap in their spectrum. It is found that, by tuning the chemical potential, superconductivity can preserve within the strain-induced discrete pseudo Landau levels (LLs), which introduce interesting topological properties to these systems. As we show, the superconductivity for integer fillings is quantum critical, and the quantum critical coupling strength is determined by the spacing between the two LLs closest to the Fermi level. For partial fillings, the superconducting gap is scaled linearly with the coupling strength, and decreases rapidly when the chemical potential shifts away from the middle of each LL. In the presence of a Zeeman field, a pair of Majorana modes emerge simultaneously in the two valleys of strained dichalcogenides. When valley symmetry is further destroyed, a single Majorana mode can be expected to emerge at the edges of the strained monolayer dichalcogenides.
△ Less
Submitted 30 January, 2019;
originally announced January 2019.
-
Quantum Oscillations of The Positive Longitudinal Magnetoconductivity: a Fingerprint for Identifying Weyl Semimetals
Authors:
Ming-Xun Deng,
G. Y. Qi,
R. Ma,
R. Shen,
L. Sheng,
D. Y. Xing
Abstract:
Weyl semimetals (WSMs) host charged Weyl fermions as emergent quasiparticles. We develop a unified analytical theory for the anomalous positive longitudinal magnetoconductance (LMC) in a WSM, which bridges the gap between the classical and ultra-quantum approaches. More interestingly, the LMC is found to exhibit periodic-in-$1/B$ quantum oscillations, originating from the oscillations of the noneq…
▽ More
Weyl semimetals (WSMs) host charged Weyl fermions as emergent quasiparticles. We develop a unified analytical theory for the anomalous positive longitudinal magnetoconductance (LMC) in a WSM, which bridges the gap between the classical and ultra-quantum approaches. More interestingly, the LMC is found to exhibit periodic-in-$1/B$ quantum oscillations, originating from the oscillations of the nonequilibrium chiral chemical potential. The quantum oscillations, superposed on the positive LMC, are a remarkable fingerprint of a WSM phase with chiral anomaly, whose observation is a valid criteria for identifying a WSM material. In fact, such quantum oscillations were already observed by several experiments.
△ Less
Submitted 12 August, 2018;
originally announced August 2018.
