-
Highly Versatile FPGA-Implemented Cyber Coherent Ising Machine
Authors:
Toru Aonishi,
Tatsuya Nagasawa,
Toshiyuki Koizumi,
Mastiyage Don Sudeera Hasaranga Gunathilaka,
Kazushi Mimura,
Masato Okada,
Satoshi Kako,
Yoshihisa Yamamoto
Abstract:
In recent years, quantum Ising machines have drawn a lot of attention, but due to physical implementation constraints, it has been difficult to achieve dense coupling, such as full coupling with sufficient spins to handle practical large-scale applications. Consequently, classically computable equations have been derived from quantum master equations for these quantum Ising machines. Parallel impl…
▽ More
In recent years, quantum Ising machines have drawn a lot of attention, but due to physical implementation constraints, it has been difficult to achieve dense coupling, such as full coupling with sufficient spins to handle practical large-scale applications. Consequently, classically computable equations have been derived from quantum master equations for these quantum Ising machines. Parallel implementations of these algorithms using FPGAs have been used to rapidly find solutions to these problems on a scale that is difficult to achieve in physical systems. We have developed an FPGA implemented cyber coherent Ising machine (cyber CIM) that is much more versatile than previous implementations using FPGAs. Our architecture is versatile since it can be applied to the open-loop CIM, which was proposed when CIM research began, to the closed-loop CIM, which has been used recently, as well as to Jacobi successive over-relaxation method. By modifying the sequence control code for the calculation control module, other algorithms such as Simulated Bifurcation (SB) can also be implemented. Earlier research on large-scale FPGA implementations of SB and CIM used binary or ternary discrete values for connections, whereas the cyber CIM used FP32 values. Also, the cyber CIM utilized Zeeman terms that were represented as FP32, which were not present in other large-scale FPGA systems. Our implementation with continuous interaction realizes N=4096 on a single FPGA, comparable to the single-FPGA implementation of SB with binary interactions, with N=4096. The cyber CIM enables applications such as CDMA multi-user detector and L0 compressed sensing which were not possible with earlier FPGA systems, while enabling superior calculation speeds, more than ten times faster than a GPU implementation. The calculation speed can be further improved by increasing parallelism, such as through clustering.
△ Less
Submitted 8 June, 2024;
originally announced June 2024.
-
L0-regularized compressed sensing with Mean-field Coherent Ising Machines
Authors:
Mastiyage Don Sudeera Hasaranga Gunathilaka,
Yoshitaka Inui,
Satoshi Kako,
Kazushi Mimura,
Masato Okada,
Yoshihisa Yamamoto,
Toru Aonishi
Abstract:
Coherent Ising Machine (CIM) is a network of optical parametric oscillators that solves combinatorial optimization problems by finding the ground state of an Ising Hamiltonian. As a practical application of CIM, Aonishi et al. proposed a quantum-classical hybrid system to solve optimization problems of L0-regularization-based compressed sensing (L0RBCS). Gunathilaka et al. has further enhanced the…
▽ More
Coherent Ising Machine (CIM) is a network of optical parametric oscillators that solves combinatorial optimization problems by finding the ground state of an Ising Hamiltonian. As a practical application of CIM, Aonishi et al. proposed a quantum-classical hybrid system to solve optimization problems of L0-regularization-based compressed sensing (L0RBCS). Gunathilaka et al. has further enhanced the accuracy of the system. However, the computationally expensive CIM's stochastic differential equations (SDEs) limit the use of digital hardware implementations. As an alternative to Gunathilaka et al.'s CIM SDEs used previously, we propose using the mean-field CIM (MF-CIM) model, which is a physics-inspired heuristic solver without quantum noise. MF-CIM surmounts the high computational cost due to the simple nature of the differential equations (DEs). Furthermore, our results indicate that the proposed model has similar performance to physically accurate SDEs in both artificial and magnetic resonance imaging data, paving the way for implementing CIM-based L0RBCS on digital hardware such as Field Programmable Gate Arrays (FPGAs).
△ Less
Submitted 17 June, 2024; v1 submitted 1 May, 2024;
originally announced May 2024.
-
4$f$ electron temperature driven ultrafast electron localization
Authors:
Kohei Yamagami,
Hiroki Ueda,
Urs Staub,
Yujun Zhang,
Kohei Yamamoto,
Sang Han Park,
Soonnam Kwon,
Akihiro Mitsuda,
Hirofumi Wada,
Takayuki Uozumi,
Kojiro Mimura,
Hiroki Wadati
Abstract:
Valence transitions in strongly correlated electron systems are caused by orbital hybridization and Coulomb interactions between localized and delocalized electrons. The transition can be triggered by changes in the electronic structure and is sensitive to temperature variations, applications of magnetic fields, and physical or chemical pressure. Launching the transition by photoelectric fields ca…
▽ More
Valence transitions in strongly correlated electron systems are caused by orbital hybridization and Coulomb interactions between localized and delocalized electrons. The transition can be triggered by changes in the electronic structure and is sensitive to temperature variations, applications of magnetic fields, and physical or chemical pressure. Launching the transition by photoelectric fields can directly excite the electronic states and thus provides an ideal platform to study the correlation among electrons on ultrafast timescales. The EuNi$_2$(Si$_{0.21}$Ge$_{0.79}$)$_2$ mixed-valence metal is an ideal material to investigate the valence transition of the Eu ions via the amplified orbital hybridization by the photoelectric field on sub-picosecond timescales. A direct view on the 4$f$ electron occupancy of the Eu ions is required to understand the microscopic origin of the transition. Here we probe the 4$f$ electron states of EuNi$_2$(Si$_{0.21}$Ge$_{0.79}$)$_2$ at the sub-ps timescale after photoexcitation by X-ray absorption spectroscopy across the Eu $M_5$-absorption edge. The observed spectral changes due to the excitation indicate a population change of total angular momentum multiplet states $J$ = 0, 1, 2, and 3 of Eu$^{3+}$, and the Eu$^{2+}$ $J$ = 7/2 multiplet state caused by an increase in 4$f$ electron temperature that results in a 4$f$ localization process. This electronic temperature increase combined with fluence-dependent screening accounts for the strongly non-linear effective valence change. The data allow us to extract a time-dependent determination of an effective temperature of the 4$f$ shell, which is also of great relevance in the understanding of metallic systems' properties, such as the ultrafast demagnetization of ferromagnetic rare-earth intermetallics and their all-optical magnetization switching.
△ Less
Submitted 27 October, 2023; v1 submitted 12 September, 2023;
originally announced September 2023.
-
Photoemission Orbital Tomography Using Robust Sparse PhaseLift
Authors:
Kaori Niki,
Rena Asano,
Ryuji Sakanoue,
Manabu Hagiwara,
Kazushi Mimura
Abstract:
Photoemission orbital tomography (POT) from photoelectron momentum maps (PMMs) has enabled detailed analysis of the shape and energy of molecular orbitals in the adsorbed state. This study proposes a new POT method based on the PhaseLift. Molecular orbitals, including three-dimensional phases, can be identified from a single PMM by actively providing atomic positions and basis. Moreover, our metho…
▽ More
Photoemission orbital tomography (POT) from photoelectron momentum maps (PMMs) has enabled detailed analysis of the shape and energy of molecular orbitals in the adsorbed state. This study proposes a new POT method based on the PhaseLift. Molecular orbitals, including three-dimensional phases, can be identified from a single PMM by actively providing atomic positions and basis. Moreover, our method is robust to noise and can perfectly discriminate adsorption-induced molecular deformations with an accuracy of 0.05 [angstrom]. Our new method enables simultaneous analysis of the three-dimensional shapes of molecules and molecular orbitals and thus paves the way for advanced quantum-mechanical interpretation of adsorption-induced electronic state changes and photo-excited inter-molecular interactions.
△ Less
Submitted 23 July, 2023;
originally announced July 2023.
-
Bulk superconductivity in Pb-substituted BiS$_{\bf 2}$-based compounds studied by hard-x-ray spectroscopy
Authors:
A. Yamasaki,
T. Oguni,
T. Hayashida,
K. Miyazaki,
N. Tanaka,
K. Nakagawa,
K. Tamura,
K. Mimura,
N. Kawamura,
H. Fujiwara,
G. Nozue,
A. Ose,
Y. Kanai-Nakata,
A. Higashiya,
S. Hamamoto,
K. Tamasaku,
M. Yabashi,
T. Ishikawa,
S. Imada,
A. Sekiyama,
H. Sakata,
S. Demura
Abstract:
In this study, we investigate the bulk electronic structure of Pb-substituted LaO$_{0.5}$F$_{0.5}$BiS$_2$ single crystals, using two types of hard-x-ray spectroscopy. High-energy-resolution fluorescence-detected x-ray absorption spectroscopy revealed a spectral change at low temperatures. Using density functional theory (DFT) simulations, we find that the temperature-induced change originates from…
▽ More
In this study, we investigate the bulk electronic structure of Pb-substituted LaO$_{0.5}$F$_{0.5}$BiS$_2$ single crystals, using two types of hard-x-ray spectroscopy. High-energy-resolution fluorescence-detected x-ray absorption spectroscopy revealed a spectral change at low temperatures. Using density functional theory (DFT) simulations, we find that the temperature-induced change originates from a structural phase transition, similar to the pressure-induced transition in LaO$_{0.5}$F$_{0.5}$BiS$_2$. This finding suggests that the mechanism of bulk superconductivity induced by Pb substitution is the same as that under high pressure. Furthermore, a novel low-valence state with a mixture of divalent and trivalent Bi ions is discovered using hard x-ray photoemission spectroscopy with the aid of DFT calculations.
△ Less
Submitted 4 January, 2024; v1 submitted 31 May, 2023;
originally announced May 2023.
-
Effective implementation of $l_0$-Regularised Compressed Sensing with Chaotic-Amplitude-Controlled Coherent Ising Machines
Authors:
Mastiyage Don Sudeera Hasaranga Gunathilaka,
Satoshi Kako,
Yoshitaka Inui,
Kazushi Mimura,
Masato Okada,
Yoshihisa Yamamoto,
Toru Aonishi
Abstract:
Coherent Ising Machine (CIM) is a network of optical parametric oscillators that can solve large-scale combinatorial optimisation problems by finding the ground state of an Ising Hamiltonian. As a practical application of CIM, Aonishi et al., proposed a quantum-classical hybrid system to solve optimisation problems of $l_0$-regularisation-based compressed sensing. In the hybrid system, the CIM was…
▽ More
Coherent Ising Machine (CIM) is a network of optical parametric oscillators that can solve large-scale combinatorial optimisation problems by finding the ground state of an Ising Hamiltonian. As a practical application of CIM, Aonishi et al., proposed a quantum-classical hybrid system to solve optimisation problems of $l_0$-regularisation-based compressed sensing. In the hybrid system, the CIM was an open-loop system without an amplitude control feedback loop. In this case, the hybrid system is enhanced by using a closed-loop CIM to achieve chaotic behaviour around the target amplitude, which would enable esca** from local minima in the energy landscape. Both artificial and magnetic resonance image data were used for the testing of our proposed closed-loop system. Compared with the open-loop system, the results of this study demonstrate an improved degree of accuracy and a wider range of effectiveness.
△ Less
Submitted 24 February, 2023;
originally announced February 2023.
-
L0 regularization-based compressed sensing with quantum-classical hybrid approach
Authors:
Toru Aonishi,
Kazushi Mimura,
Masato Okada,
Yoshihisa Yamamoto
Abstract:
L0-regularization-based compressed sensing (L0-RBCS) has the potential to outperform L1-regularization-based compressed sensing (L1-RBCS), but the optimization in L0-RBCS is difficult because it is a combinatorial optimization problem. To perform optimization in L0-RBCS, we propose a quantum-classical hybrid system consisting of a quantum machine and a classical digital processor. The coherent Isi…
▽ More
L0-regularization-based compressed sensing (L0-RBCS) has the potential to outperform L1-regularization-based compressed sensing (L1-RBCS), but the optimization in L0-RBCS is difficult because it is a combinatorial optimization problem. To perform optimization in L0-RBCS, we propose a quantum-classical hybrid system consisting of a quantum machine and a classical digital processor. The coherent Ising machine (CIM) is a suitable quantum machine for this system because this optimization problem can only be solved with a densely connected network. To evaluate the performance of the CIM-classical hybrid system theoretically, a truncated Wigner stochastic differential equation (W-SDE) is introduced as a model for the network of degenerate optical parametric oscillators, and macroscopic equations are derived by applying statistical mechanics to the W-SDE. We show that the system performance in principle approaches the theoretical limit of compressed sensing and this hybrid system may exceed the estimation accuracy of L1-RBCS in actual situations, such as in magnetic resonance imaging data analysis.
△ Less
Submitted 6 May, 2022; v1 submitted 22 February, 2021;
originally announced February 2021.
-
Study of photoinduced valence dynamics in EuNi$_2$(Si$_{0.21}$Ge$_{0.79}$)$_2$ through time-resolved X-ray absorption spectroscopy
Authors:
Y. Yokoyama,
K. Kawakami,
Y. Hirata,
K. Takubo,
K. Yamamoto,
K. Abe,
A. Mitsuda,
H. Wada,
T. Uozumi,
S. Yamamoto,
I. Matsuda,
K. Mimura,
H. Wadati
Abstract:
The photoinduced valence dynamics of EuNi$_2$(Si$_{0.21}$Ge$_{0.79}$)$_2$ are investigated using time-resolved X-ray absorption spectroscopy for Eu $M_5$-edge. Through the pump-probe technique with synchrotron X-ray and Ti:sapphire laser pulse, a photoinduced valence transition is observed from Eu$^{3+}$ to Eu$^{2+}$. Because the lifetime of a photoinduced state can be up to 3 ns, a metastable sta…
▽ More
The photoinduced valence dynamics of EuNi$_2$(Si$_{0.21}$Ge$_{0.79}$)$_2$ are investigated using time-resolved X-ray absorption spectroscopy for Eu $M_5$-edge. Through the pump-probe technique with synchrotron X-ray and Ti:sapphire laser pulse, a photoinduced valence transition is observed from Eu$^{3+}$ to Eu$^{2+}$. Because the lifetime of a photoinduced state can be up to 3 ns, a metastable state is considered to be realized. By comparing the experimental results with the theoretical calculations, the photoinduced valence transition between Eu 4$f$ and conduction electrons is quantitatively evaluated.
△ Less
Submitted 10 May, 2019;
originally announced May 2019.
-
Generating Functional Analysis of Iterative Sparse Signal Recovery Algorithms with Divergence-Free Estimators
Authors:
Kazushi Mimura
Abstract:
Approximate message passing (AMP) is an effective iterative sparse recovery algorithm for linear system models. Its performance is characterized by the state evolution (SE) which is a simple scalar recursion. However, depending on a measurement matrix ensemble, AMP may face a convergence problem. To avoid this problem, orthogonal AMP (OAMP), which uses de-correlation linear estimation and divergen…
▽ More
Approximate message passing (AMP) is an effective iterative sparse recovery algorithm for linear system models. Its performance is characterized by the state evolution (SE) which is a simple scalar recursion. However, depending on a measurement matrix ensemble, AMP may face a convergence problem. To avoid this problem, orthogonal AMP (OAMP), which uses de-correlation linear estimation and divergence-free non-linear estimation, was proposed by Ma and **. They also provide the SE analysis for OAMP. In their SE analysis, the following two assumptions were made: (i) The estimated vector of the de-correlation linear estimator consists of i.i.d. zero-mean Gaussian entries independent of the vector to be estimated and (ii) the estimated vector of the divergence-free non-linear estimator consists of i.i.d. entries independent of the measurement matrix and the noise vector. In this paper, we derive a simple scalar recursion to characterize iterative sparse recovery algorithms with divergence-free estimators without such assumptions of independence of messages by using the generating functional analysis (GFA), which allows us to study the dynamics by an exact way in the large system limit.
△ Less
Submitted 28 March, 2018;
originally announced March 2018.
-
Upper Bounds for the Number of Solutions to Spatially Coupled Sudokus
Authors:
Tadahiro Kitazono,
Kazushi Mimura
Abstract:
Based on combinatorics, we evaluate the upper bounds for the number of solutions to spatially coupled Sudokus, which are popular logic puzzles.
Based on combinatorics, we evaluate the upper bounds for the number of solutions to spatially coupled Sudokus, which are popular logic puzzles.
△ Less
Submitted 1 August, 2016;
originally announced August 2016.
-
Linear Complexity Lossy Compressor for Binary Redundant Memoryless Sources
Authors:
Kazushi Mimura
Abstract:
A lossy compression algorithm for binary redundant memoryless sources is presented. The proposed scheme is based on sparse graph codes. By introducing a nonlinear function, redundant memoryless sequences can be compressed. We propose a linear complexity compressor based on the extended belief propagation, into which an inertia term is heuristically introduced, and show that it has near-optimal per…
▽ More
A lossy compression algorithm for binary redundant memoryless sources is presented. The proposed scheme is based on sparse graph codes. By introducing a nonlinear function, redundant memoryless sequences can be compressed. We propose a linear complexity compressor based on the extended belief propagation, into which an inertia term is heuristically introduced, and show that it has near-optimal performance for moderate block lengths.
△ Less
Submitted 15 July, 2011; v1 submitted 8 July, 2011;
originally announced July 2011.
-
Generating Functional Analysis of Iterative Algorithms for Compressed Sensing
Authors:
Kazushi Mimura
Abstract:
It has been shown that approximate message passing algorithm is effective in reconstruction problems for compressed sensing. To evaluate dynamics of such an algorithm, the state evolution (SE) has been proposed. If an algorithm can cancel the correlation between the present messages and their past values, SE can accurately tract its dynamics via a simple one-dimensional map. In this paper, we focu…
▽ More
It has been shown that approximate message passing algorithm is effective in reconstruction problems for compressed sensing. To evaluate dynamics of such an algorithm, the state evolution (SE) has been proposed. If an algorithm can cancel the correlation between the present messages and their past values, SE can accurately tract its dynamics via a simple one-dimensional map. In this paper, we focus on dynamics of algorithms which cannot cancel the correlation and evaluate it by the generating functional analysis (GFA), which allows us to study the dynamics by an exact way in the large system limit.
△ Less
Submitted 1 June, 2011;
originally announced June 2011.
-
Generating Functional Analysis for Iterative CDMA Multiuser Detectors
Authors:
Kazushi Mimura,
Masato Okada
Abstract:
We investigate the detection dynamics of a soft parallel interference canceller (soft-PIC), which includes a hard-PIC as a special case, for code-division multiple-access (CDMA) multiuser detection, applied to a randomly spread, fully synchronous base-band uncoded CDMA channel model with additive white Gaussian noise under perfect power control in the large-system limit. We analyze the detection d…
▽ More
We investigate the detection dynamics of a soft parallel interference canceller (soft-PIC), which includes a hard-PIC as a special case, for code-division multiple-access (CDMA) multiuser detection, applied to a randomly spread, fully synchronous base-band uncoded CDMA channel model with additive white Gaussian noise under perfect power control in the large-system limit. We analyze the detection dynamics of some iterative detectors, namely soft-PIC, the Onsager-reaction-cancelling parallel interference canceller (ORC-PIC) and the belief-propagation-based detector (BP-based detector), by the generating functional analysis (GFA). The GFA allows us to study the asymptotic behavior of the dynamics in the infinitely large system without assuming the independence of messages. We study the detection dynamics and the stationary estimates of an iterative algorithm.
We also show the decoupling principle in iterative multiuser detection algorithms in the large-system limit. For a generic iterative multiuser detection algorithm with binary input, it is shown that the multiuser channel is equivalent to a bank of independent single-user additive non-Gaussian channels, whose signal-to-noise ratio degrades due to both the multiple-access interference and the Onsager reaction, at each stage of the algorithm. If an algorithm cancels the Onsager reaction, the equivalent single-user channels coincide with an additive white Gaussian noise channel. We also discuss ORC-PIC and the BP-based detector.
△ Less
Submitted 10 September, 2013; v1 submitted 8 March, 2011;
originally announced March 2011.
-
Belief Propagation for Error Correcting Codes and Lossy Compression Using Multilayer Perceptrons
Authors:
Kazushi Mimura,
Florent Cousseau,
Masato Okada
Abstract:
The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether the BP can give practical algorithms or not in these schemes. The BP implementations in those kind of fully connected networks unfortunately shows strong limita…
▽ More
The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether the BP can give practical algorithms or not in these schemes. The BP implementations in those kind of fully connected networks unfortunately shows strong limitation, while the theoretical results seems a bit promising. Instead, it reveals it might have a rich and complex structure of the solution space via the BP-based algorithms.
△ Less
Submitted 10 March, 2011; v1 submitted 7 February, 2011;
originally announced February 2011.
-
Parallel dynamics of disordered Ising spin systems on finitely connected directed random graphs with arbitrary degree distributions
Authors:
Kazushi Mimura,
A. C. C. Coolen
Abstract:
We study the stochastic parallel dynamics of Ising spin systems defined on finitely connected directed random graphs with arbitrary degree distributions, using generating functional analysis. For fully asymmetric graphs the dynamics of the system can be completely solved, due to the asymptotic absence of loops. For arbitrary graph symmetry, we solve the dynamics exactly for the first few time st…
▽ More
We study the stochastic parallel dynamics of Ising spin systems defined on finitely connected directed random graphs with arbitrary degree distributions, using generating functional analysis. For fully asymmetric graphs the dynamics of the system can be completely solved, due to the asymptotic absence of loops. For arbitrary graph symmetry, we solve the dynamics exactly for the first few time steps, and we construct approximate stationary solutions.
△ Less
Submitted 23 August, 2009; v1 submitted 9 July, 2009;
originally announced July 2009.
-
Error correcting code using tree-like multilayer perceptron
Authors:
Florent Cousseau,
Kazushi Mimura,
Masato Okada
Abstract:
An error correcting code using a tree-like multilayer perceptron is proposed. An original message $\mbi{s}^0$ is encoded into a codeword $\boldmath{y}_0$ using a tree-like committee machine (committee tree) or a tree-like parity machine (parity tree). Based on these architectures, several schemes featuring monotonic or non-monotonic units are introduced. The codeword $\mbi{y}_0$ is then transmit…
▽ More
An error correcting code using a tree-like multilayer perceptron is proposed. An original message $\mbi{s}^0$ is encoded into a codeword $\boldmath{y}_0$ using a tree-like committee machine (committee tree) or a tree-like parity machine (parity tree). Based on these architectures, several schemes featuring monotonic or non-monotonic units are introduced. The codeword $\mbi{y}_0$ is then transmitted via a Binary Asymmetric Channel (BAC) where it is corrupted by noise. The analytical performance of these schemes is investigated using the replica method of statistical mechanics. Under some specific conditions, some of the proposed schemes are shown to saturate the Shannon bound at the infinite codeword length limit. The influence of the monotonicity of the units on the performance is also discussed.
△ Less
Submitted 16 January, 2010; v1 submitted 21 November, 2008;
originally announced November 2008.
-
Typical Performance of Irregular Low-Density Generator-Matrix Codes for Lossy Compression
Authors:
Kazushi Mimura
Abstract:
We evaluate typical performance of irregular low-density generator-matrix (LDGM) codes, which is defined by sparse matrices with arbitrary irregular bit degree distribution and arbitrary check degree distribution, for lossy compression. We apply the replica method under one-step replica symmetry breaking (1RSB) ansatz to this problem.
We evaluate typical performance of irregular low-density generator-matrix (LDGM) codes, which is defined by sparse matrices with arbitrary irregular bit degree distribution and arbitrary check degree distribution, for lossy compression. We apply the replica method under one-step replica symmetry breaking (1RSB) ansatz to this problem.
△ Less
Submitted 16 February, 2009; v1 submitted 29 October, 2008;
originally announced October 2008.
-
Statistical mechanics of lossy compression for non-monotonic multilayer perceptrons
Authors:
Florent Cousseau,
Kazushi Mimura,
Toshiaki Omori,
Masato Okada
Abstract:
A lossy data compression scheme for uniformly biased Boolean messages is investigated via statistical mechanics techniques. We utilize tree-like committee machine (committee tree) and tree-like parity machine (parity tree) whose transfer functions are non-monotonic. The scheme performance at the infinite code length limit is analyzed using the replica method. Both committee and parity treelike n…
▽ More
A lossy data compression scheme for uniformly biased Boolean messages is investigated via statistical mechanics techniques. We utilize tree-like committee machine (committee tree) and tree-like parity machine (parity tree) whose transfer functions are non-monotonic. The scheme performance at the infinite code length limit is analyzed using the replica method. Both committee and parity treelike networks are shown to saturate the Shannon bound. The AT stability of the Replica Symmetric solution is analyzed, and the tuning of the non-monotonic transfer function is also discussed.
△ Less
Submitted 25 July, 2008;
originally announced July 2008.
-
Parallel dynamics of continuous Hopfield model revisited
Authors:
Kazushi Mimura
Abstract:
We have applied the generating functional analysis (GFA) to the continuous Hopfield model. We have also confirmed that the GFA predictions in some typical cases exhibit good consistency with computer simulation results. When a retarded self-interaction term is omitted, the GFA result becomes identical to that obtained using the statistical neurodynamics as well as the case of the sequential bina…
▽ More
We have applied the generating functional analysis (GFA) to the continuous Hopfield model. We have also confirmed that the GFA predictions in some typical cases exhibit good consistency with computer simulation results. When a retarded self-interaction term is omitted, the GFA result becomes identical to that obtained using the statistical neurodynamics as well as the case of the sequential binary Hopfield model.
△ Less
Submitted 16 January, 2009; v1 submitted 18 July, 2006;
originally announced July 2006.
-
Statistical mechanics of lossy compression using multilayer perceptrons
Authors:
Kazushi Mimura,
Masato Okada
Abstract:
Statistical mechanics is applied to lossy compression using multilayer perceptrons for unbiased Boolean messages. We utilize a tree-like committee machine (committee tree) and tree-like parity machine (parity tree) whose transfer functions are monotonic. For compression using committee tree, a lower bound of achievable distortion becomes small as the number of hidden units K increases. However,…
▽ More
Statistical mechanics is applied to lossy compression using multilayer perceptrons for unbiased Boolean messages. We utilize a tree-like committee machine (committee tree) and tree-like parity machine (parity tree) whose transfer functions are monotonic. For compression using committee tree, a lower bound of achievable distortion becomes small as the number of hidden units K increases. However, it cannot reach the Shannon bound even where K -> infty. For a compression using a parity tree with K >= 2 hidden units, the rate distortion function, which is known as the theoretical limit for compression, is derived where the code length becomes infinity.
△ Less
Submitted 1 May, 2006; v1 submitted 25 August, 2005;
originally announced August 2005.
-
Temperature dependent Eu 3d-4f X-ray Absorption and Resonant Photoemission Study of the Valence Transition in $EuNi_2(Si_{0.2}Ge_{0.8})_2$
Authors:
K. Yamamoto,
K. Horiba,
M. Taguchi,
M. Matsunami,
N. Kamakura,
A. Chainani,
Y. Takata,
K. Mimura,
M. Shiga,
H. Wada,
Y. Senba,
H. Ohashi,
S. Shin
Abstract:
We study the mixed valence transition ($T$$_{v}$ $\sim$80 K) in EuNi$_{2}$(Si$_{0.2}$Ge$_{0.8}$)$_{2}$ using Eu 3$d-4f$ X-ray absorption spectroscopy (XAS) and resonant photoemission spectroscopy (RESPES). The Eu$^{2+}$ and Eu$^{3+}$ main peaks show a giant resonance and the spectral features match very well with atomic multiplet calculations. The spectra show dramatic temperature ($T$)-dependen…
▽ More
We study the mixed valence transition ($T$$_{v}$ $\sim$80 K) in EuNi$_{2}$(Si$_{0.2}$Ge$_{0.8}$)$_{2}$ using Eu 3$d-4f$ X-ray absorption spectroscopy (XAS) and resonant photoemission spectroscopy (RESPES). The Eu$^{2+}$ and Eu$^{3+}$ main peaks show a giant resonance and the spectral features match very well with atomic multiplet calculations. The spectra show dramatic temperature ($T$)-dependent changes over large energies ($\sim$10 eV) in RESPES and XAS. The observed non-integral mean valencies of $\sim$2.35 $\pm$ 0.03 ($T$ = 120 K) and $\sim$2.70 $\pm$ 0.03 ($T$ = 40 K) indicate homogeneous mixed valence above and below $T$$_{v}$. The redistribution between Eu$^{2+}$$4f^7$+$[spd]^0$ and Eu$^{3+}$$4f^6$+$[spd]^1$ states is attributed to a hybridization change coupled to a Kondo-like volume collapse.
△ Less
Submitted 22 July, 2005;
originally announced July 2005.
-
Generating functional analysis of CDMA detection dynamics
Authors:
Kazushi Mimura,
Masato Okada
Abstract:
We investigate the detection dynamics of the parallel interference canceller (PIC) for code-division multiple-access (CDMA) multiuser detection, applied to a randomly spread, fully syncronous base-band uncoded CDMA channel model with additive white Gaussian noise (AWGN) under perfect power control in the large-system limit. It is known that the predictions of the density evolution (DE) can fairl…
▽ More
We investigate the detection dynamics of the parallel interference canceller (PIC) for code-division multiple-access (CDMA) multiuser detection, applied to a randomly spread, fully syncronous base-band uncoded CDMA channel model with additive white Gaussian noise (AWGN) under perfect power control in the large-system limit. It is known that the predictions of the density evolution (DE) can fairly explain the detection dynamics only in the case where the detection dynamics converge. At transients, though, the predictions of DE systematically deviate from computer simulation results. Furthermore, when the detection dynamics fail to convergence, the deviation of the predictions of DE from the results of numerical experiments becomes large. As an alternative, generating functional analysis (GFA) can take into account the effect of the Onsager reaction term exactly and does not need the Gaussian assumption of the local field. We present GFA to evaluate the detection dynamics of PIC for CDMA multiuser detection. The predictions of GFA exhibits good consistency with the computer simulation result for any condition, even if the dynamics fail to convergence.
△ Less
Submitted 7 September, 2005; v1 submitted 19 July, 2005;
originally announced July 2005.
-
The path-integral analysis of an associative memory model storing an infinite number of finite limit cycles
Authors:
Kazushi Mimura,
Masaki Kawamura,
Masato Okada
Abstract:
It is shown that an exact solution of the transient dynamics of an associative memory model storing an infinite number of limit cycles with l finite steps by means of the path-integral analysis. Assuming the Maxwell construction ansatz, we have succeeded in deriving the stationary state equations of the order parameters from the macroscopic recursive equations with respect to the finite-step seq…
▽ More
It is shown that an exact solution of the transient dynamics of an associative memory model storing an infinite number of limit cycles with l finite steps by means of the path-integral analysis. Assuming the Maxwell construction ansatz, we have succeeded in deriving the stationary state equations of the order parameters from the macroscopic recursive equations with respect to the finite-step sequence processing model which has retarded self-interactions. We have also derived the stationary state equations by means of the signal-to-noise analysis (SCSNA). The signal-to-noise analysis must assume that crosstalk noise of an input to spins obeys a Gaussian distribution. On the other hand, the path-integral method does not require such a Gaussian approximation of crosstalk noise. We have found that both the signal-to-noise analysis and the path-integral analysis give the completely same result with respect to the stationary state in the case where the dynamics is deterministic, when we assume the Maxwell construction ansatz.
We have shown the dependence of storage capacity (alpha_c) on the number of patterns per one limit cycle (l). Storage capacity monotonously increases with the number of steps, and converges to alpha_c=0.269 at l ~= 10. The original properties of the finite-step sequence processing model appear as long as the number of steps of the limit cycle has order l=O(1).
△ Less
Submitted 23 April, 2004; v1 submitted 12 October, 2003;
originally announced October 2003.
-
Synapse efficiency diverges due to synaptic pruning following over-growth
Authors:
Kazushi Mimura,
Tomoyuki Kimoto,
Masato Okada
Abstract:
In the development of the brain, it is known that synapses are pruned following over-growth. This pruning following over-growth seems to be a universal phenomenon that occurs in almost all areas -- visual cortex, motor area, association area, and so on. It has been shown numerically that the synapse efficiency is increased by systematic deletion. We discuss the synapse efficiency to evaluate the…
▽ More
In the development of the brain, it is known that synapses are pruned following over-growth. This pruning following over-growth seems to be a universal phenomenon that occurs in almost all areas -- visual cortex, motor area, association area, and so on. It has been shown numerically that the synapse efficiency is increased by systematic deletion. We discuss the synapse efficiency to evaluate the effect of pruning following over-growth, and analytically show that the synapse efficiency diverges as O(log c) at the limit where connecting rate c is extremely small. Under a fixed synapse number criterion, the optimal connecting rate, which maximize memory performance, exists.
△ Less
Submitted 17 August, 2003; v1 submitted 23 July, 2002;
originally announced July 2002.
