Showing 1–50 of 77 results for author: Aurell, E

Random pure Gaussian states and Hawking radiation

Authors: Erik Aurell, Lucas Hackl, Paweł Horodecki, Robert H. Jonsson, Mario Kieburg

Abstract: A black hole evaporates by Hawking radiation. Each mode of that radiation is thermal. If the total state is nevertheless to be pure, modes must be entangled. Estimating the minimum size of this entanglement has been an important outstanding issue. We develop a new theory of constrained random symplectic transformations, based on that the total state is pure and Gaussian with given marginals. In th… ▽ More A black hole evaporates by Hawking radiation. Each mode of that radiation is thermal. If the total state is nevertheless to be pure, modes must be entangled. Estimating the minimum size of this entanglement has been an important outstanding issue. We develop a new theory of constrained random symplectic transformations, based on that the total state is pure and Gaussian with given marginals. In the random constrained symplectic model we then compute the distribution of mode-mode correlations, from which we bound mode-mode entanglement. Modes of frequency much larger than $\frac{k_B T_{H}(t)}{\hbar}$ are not populated at time $t$ and drop out of the analysis. Among the other modes find that correlations and hence entanglement between relatively thinly populated modes (early-time high-frequency modes and/or late modes of any frequency) to be strongly suppressed. Relatively highly populated modes (early-time low-frequency modes) can on the other hand be strongly correlated, but a detailed analysis reveals that they are nevertheless also weakly entangled. Our analysis hence establishes that restoring unitarity after a complete evaporation of a black hole does not require strong quantum entanglement between any pair of Hawking modes. Our analysis further gives exact general expressions for the distribution of mode-mode correlations in random, pure, Gaussian states with given marginals, which may have applications beyond black hole physics. △ Less

Submitted 20 December, 2023; v1 submitted 17 November, 2023; originally announced November 2023.

Comments: Revised version, with supplementary material. Main paper 6 pages, 3 figures. Supplementary material 29 pages, 1 figure

Report number: NORDITA 2023-094 (for co-author RHJ)

A perspective on Lindblad's Non-Equilibrium Entropy

Authors: Erik Aurell, Ryoichi Kawai

Abstract: Göran Lindblad in 1983 published a monograph on non-equilibrium thermodynamics. We here summarize the contents of this book, and provide a perspective on its relation to later developments in statistical physics and quantum physics. We high-light two aspects. The first is the idea that while all unitaries can be allowed in principle, different theories result from limiting which unitary evolutions… ▽ More Göran Lindblad in 1983 published a monograph on non-equilibrium thermodynamics. We here summarize the contents of this book, and provide a perspective on its relation to later developments in statistical physics and quantum physics. We high-light two aspects. The first is the idea that while all unitaries can be allowed in principle, different theories result from limiting which unitary evolutions are realized in the real world. The second is that Lindblad's proposal for thermodynamic entropy (as opposed to information-theoretic entropy) foreshadows much more recent investigations into optimal quantum transport which is a current research focus in several fields. △ Less

Submitted 12 May, 2023; originally announced May 2023.

Comments: 32 pages, one figure. Invited contribution to the Lindblad memorial volume, to be published in Open Systems and Information Dynamics (2023)

A closure for the Master Equation starting from the Dynamic Cavity Method

Authors: Erik Aurell, David Machado Perez, Roberto Mulet

Abstract: We consider classical spin systems evolving in continuous time with interactions given by a locally tree-like graph. Several approximate analysis methods have earlier been reported based on the idea of Belief Propagation / cavity method. We introduce a new such method which can be derived in a more systematic manner, and which performs better on several important classes of problems. We consider classical spin systems evolving in continuous time with interactions given by a locally tree-like graph. Several approximate analysis methods have earlier been reported based on the idea of Belief Propagation / cavity method. We introduce a new such method which can be derived in a more systematic manner, and which performs better on several important classes of problems. △ Less

Submitted 17 November, 2022; originally announced November 2022.

Comments: arXiv admin note: text overlap with arXiv:2205.00750

The mighty force: statistical inference and high-dimensional statistics

Authors: Erik Aurell, Jean Barbier, Aurelien Decelle, Roberto Mulet

Abstract: This is a review to appear as a contribution to the edited volume "Spin Glass Theory & Far Beyond - Replica Symmetry Breaking after 40 Years", World Scientific. It showcases a selection of contributions from the spin glass community at large to high-dimensional statistics, by focusing on three important graph-based models and methodologies having deeply impacted the field: inference of graphs (a.k… ▽ More This is a review to appear as a contribution to the edited volume "Spin Glass Theory & Far Beyond - Replica Symmetry Breaking after 40 Years", World Scientific. It showcases a selection of contributions from the spin glass community at large to high-dimensional statistics, by focusing on three important graph-based models and methodologies having deeply impacted the field: inference of graphs (a.k.a. direct coupling analysis), inference from graphs (the community detection problem), and the dynamic cavity method, which in particular allows for inference from graphs encoding causal relations. △ Less

Submitted 2 May, 2022; originally announced May 2022.

Comments: To appear as a contribution to the edited volume "Spin Glass Theory & Far Beyond - Replica Symmetry Breaking after 40 Years", World Scientific

The quantum network as an environment

Authors: Erik Aurell, Roberto Mulet, Jan Tuziemski

Abstract: quantum system interacting with other quantum systems experiences these other systems asan effective environment. The environment is the result of integrating out all the other degrees of freedom in the network, and can be represented by a Feynman-Vernon influence functional (IF)acting on system of interest. A network is characterized by the constitutive systems, how they interact, and the topolog… ▽ More quantum system interacting with other quantum systems experiences these other systems asan effective environment. The environment is the result of integrating out all the other degrees of freedom in the network, and can be represented by a Feynman-Vernon influence functional (IF)acting on system of interest. A network is characterized by the constitutive systems, how they interact, and the topology of those interactions. Here we show that for networks having the topology of locally tree-like graphs, the Feynman-Vernon influence functional can be determined in a new version of the cavity or Belief Propagation (BP) method. In the BP update stage, cavity IFs are mapped to cavity IFs, while in the BP output stage cavity IFs are combined to output IFs. We compute the fixed point of of this version of BP for harmonic oscillator systems interacting uniformly. We discuss Replica Symmetry and the effects of disorder in this context. △ Less

Submitted 20 July, 2021; originally announced July 2021.

Comments: 5+13 pages, comments are welcome

Statistical Genetics in and out of Quasi-Linkage Equilibrium (Extended)

Authors: Vito Dichio, Hong-Li Zeng, Erik Aurell

Abstract: This review is about statistical genetics, an interdisciplinary topic between statistical physics and population biology. The focus is on the phase of quasi-linkage equilibrium (QLE). Our goals here are to clarify under which conditions the QLE phase can be expected to hold in population biology and how the stability of the QLE phase is lost. The QLE state, which has many similarities to a thermal… ▽ More This review is about statistical genetics, an interdisciplinary topic between statistical physics and population biology. The focus is on the phase of quasi-linkage equilibrium (QLE). Our goals here are to clarify under which conditions the QLE phase can be expected to hold in population biology and how the stability of the QLE phase is lost. The QLE state, which has many similarities to a thermal equilibrium state in statistical mechanics, was discovered by M Kimura for a two-locus two-allele model, and was extended and generalized to the global genome scale by (Neher and Shraiman, 2011). What we will refer to as the Kimura-Neher-Shraiman (KNS) theory describes a population evolving due to the mutations, recombination, natural selection and possibly genetic drift. A QLE phase exists at sufficiently high recombination rate and/or mutation rates with respect to selection strength. We show how in QLE it is possible to infer the epistatic parameters of the fitness function from the knowledge of the (dynamical) distribution of genotypes in a population. We further consider the breakdown of the QLE regime for high enough selection strength. We review recent results for the selection-mutation and selection-recombination dynamics. Finally, we identify and characterize a new phase which we call the non-random coexistence (NRC) where variability persists in the population without either fixating or disappearing. △ Less

Submitted 3 February, 2023; v1 submitted 4 May, 2021; originally announced May 2021.

Comments: 58 pages, 13 figures

Journal ref: 2023 Rep. Prog. Phys. 86 052601

The Vernon transform and its use in quantum thermodynamics

Authors: Erik Aurell, Jan Tuziemski

Abstract: The thermodynamics of a quantum system interacting with an environment that can be assimilated to a harmonic oscillator bath has been extensively investigated theoretically. In recent experiments, the system under study however does not interact directly with the bath, but though a cavity or a transmission line. The influence on the system from the bath is therefore seen through an intermediate sy… ▽ More The thermodynamics of a quantum system interacting with an environment that can be assimilated to a harmonic oscillator bath has been extensively investigated theoretically. In recent experiments, the system under study however does not interact directly with the bath, but though a cavity or a transmission line. The influence on the system from the bath is therefore seen through an intermediate system, which modifies the characteristics of this influence. Here we first show that this problem is elegantly solved by a transform, which we call the Vernon transform, map** influence action kernels on influence action kernels. We also show that the Vernon transform takes a particularly simple form in the Fourier domain, though it then must be interpreted with some care. Second, leveraging results in quantum thermodynamics we show how the Vernon transform can also be used to compute the generating function of energy changes in the environment. We work out the example of a system interacting with two baths of the Caldeira-Leggett type, each of them seen through a cavity. △ Less

Submitted 24 March, 2021; originally announced March 2021.

Comments: 13 pages, 2 figures, comments are welcome

Inferring epistasis from genomic data with comparable mutation and outcrossing rate

Authors: Hong-Li Zeng, Eugenio Mauri, Vito Dichio, Simona Cocco, Remi Monasson, Erik Aurell

Abstract: We consider a population evolving due to mutation, selection and recombination, where selection includes single-locus terms (additive fitness) and two-loci terms (pairwise epistatic fitness). We further consider the problem of inferring fitness in the evolutionary dynamics from one or several snap-shots of the distribution of genotypes in the population. In the recent literature this has been done… ▽ More We consider a population evolving due to mutation, selection and recombination, where selection includes single-locus terms (additive fitness) and two-loci terms (pairwise epistatic fitness). We further consider the problem of inferring fitness in the evolutionary dynamics from one or several snap-shots of the distribution of genotypes in the population. In the recent literature this has been done by applying the Quasi-Linkage Equilibrium (QLE) regime first obtained by Kimura in the limit of high recombination. Here we show that the approach also works in the interesting regime where the effects of mutations are comparable to or larger than recombination. This leads to a modified main epistatic fitness inference formula where the rates of mutation and recombination occur together. We also derive this formula using by a previously developed Gaussian closure that formally remains valid when recombination is absent. The findings are validated through numerical simulations. △ Less

Submitted 4 May, 2021; v1 submitted 30 June, 2020; originally announced June 2020.

Comments: 16 pages, 9 figures. Substantial revision from second version, previous suggestions and comments gratefully acknowledged

Large Deviations and Fluctuation Theorem for the Quantum Heat Current

Authors: Erik Aurell, Brecht Donvil, Kirone Mallick

Abstract: We study the heat current flowing between two baths consisting of harmonic oscillators interacting with a qubit through a spin-boson coupling. An explicit expression for the generating function of the total heat flowing between the hot and cold baths is derived by evaluating the corresponding Feynman-Vernon path integral under the non-interacting blip approximation (NIBA). This generating function… ▽ More We study the heat current flowing between two baths consisting of harmonic oscillators interacting with a qubit through a spin-boson coupling. An explicit expression for the generating function of the total heat flowing between the hot and cold baths is derived by evaluating the corresponding Feynman-Vernon path integral under the non-interacting blip approximation (NIBA). This generating function satisfies the Gallavotti-Cohen fluctuation theorem, both before and after performing the NIBA. We also verify that the heat conductivity is proportional to the variance of the heat current, retrieving the well known fluctuation dissipation relation. Finally, we present numerical results for the heat current. △ Less

Submitted 20 March, 2020; v1 submitted 1 November, 2019; originally announced November 2019.

Comments: 8(+8) pages, 5 figures

Journal ref: Phys. Rev. E 101, 052116 (2020)

An operator derivation of the Feynman-Vernon theory, with applications to the generating function of bath energy changes and to anharmonic baths

Authors: Erik Aurell, Ryoichi Kawai, Ketan Goyal

Abstract: We present a derivation of the Feynman-Vernon approach to open quantum systems in the language of super-operators. We show that this gives a new and more direct derivation of the generating function of energy changes in a bath, or baths. This generating function is given by a Feynman-Vernon-like influence functional, with only time shifts in some of the kernels. We further show that the approach c… ▽ More We present a derivation of the Feynman-Vernon approach to open quantum systems in the language of super-operators. We show that this gives a new and more direct derivation of the generating function of energy changes in a bath, or baths. This generating function is given by a Feynman-Vernon-like influence functional, with only time shifts in some of the kernels. We further show that the approach can be extended to anharmonic baths by an expansion in cumulants. Every non-zero cumulant of certain environment correlation functions thus gives a kernel in a higher-order term in the Feynman-Vernon action. △ Less

Submitted 1 December, 2019; v1 submitted 5 July, 2019; originally announced July 2019.

Comments: 13 pages, 2 figures

A simplified characteristic functions of quantum heat

Authors: Erik Aurell

Abstract: This paper presents a simplified structure of the characteristic function of the distribution of energy changes in a bosonic environment interacting linearly with a quantum system. This characteristic function of quantum heat can be expressed using the same functionals (Feynman-Vernon action) as for the quantum state, with only the cross-terms in the double path integral shifted in time. This paper presents a simplified structure of the characteristic function of the distribution of energy changes in a bosonic environment interacting linearly with a quantum system. This characteristic function of quantum heat can be expressed using the same functionals (Feynman-Vernon action) as for the quantum state, with only the cross-terms in the double path integral shifted in time. △ Less

Submitted 6 April, 2019; originally announced April 2019.

Comments: 3 pages, paper presents a simplification of results presented in E Aurell Phys. Rev. E 97, 062117 (2018) [arXiv:1801.04235]

A theory of non-equilibrium local search on random satisfaction problems

Authors: Erik Aurell, Eduardo Domínguez, David Machado, R. Mulet

Abstract: We study local search algorithms to solve instances of the random $k$-satisfiabi lity problem, equivalent to finding (if they exist) zero-energy ground states of statistical models with disorder on random hypergraphs. It is well known that the best such algorithms are akin to non-equilibrium processes in a high-dimensional space. In particular, algorithms known as focused, and which do not obey de… ▽ More We study local search algorithms to solve instances of the random $k$-satisfiabi lity problem, equivalent to finding (if they exist) zero-energy ground states of statistical models with disorder on random hypergraphs. It is well known that the best such algorithms are akin to non-equilibrium processes in a high-dimensional space. In particular, algorithms known as focused, and which do not obey detailed balance, outperform simulated annealing and related methods in the task of finding the solution to a complex satisfiability problem, that is to find (exactly or approximately) the minimum in a complex energy landscape. A physical question of interest is if the dynamics of these processes can be well predicted by the well-developed theory of equilibrium Gibbs states. While it has been known empirically for some time that this is not the case, an alternative systematic theory that does so has been lacking. In this paper we introduce such a theory based on the recently developed technique of cavity master equations and test it on the paradigmatic random $3$-satisfiability problem. Our theory predicts the solution process very accurately away from the algorithm phase boundary and also predicts the qualitative form of this boundary. △ Less

Submitted 4 March, 2019; originally announced March 2019.

Comments: 4 pages + Supp. Material

Journal ref: Phys. Rev. Lett. 123, 230602 (2019)

Thermal power of heat flow through a qubit

Authors: Erik Aurell, Federica Montana

Abstract: In this paper we consider thermal power of a heat flow through a qubit between two baths. The baths are modeled as set of harmonic oscillators initially at equilibrium, at two temperatures. Heat is defined as the change of energy of the cold bath, and thermal power is defined as expected heat per unit time, in the long-time limit. The qubit and the baths interact as in the spin-boson model, i.e. t… ▽ More In this paper we consider thermal power of a heat flow through a qubit between two baths. The baths are modeled as set of harmonic oscillators initially at equilibrium, at two temperatures. Heat is defined as the change of energy of the cold bath, and thermal power is defined as expected heat per unit time, in the long-time limit. The qubit and the baths interact as in the spin-boson model, i.e. through qubit operator $σ_z$. We compute thermal power in an approximation analogous to `non-interacting blip' (NIBA) and express it in the polaron picture as products of correlation functions of the two baths, and a time derivative of a correlation function of the cold bath. In the limit of weak interaction we recover known results in terms of a sum of correlation functions of the two baths, a correlation functions of the cold bath only, and the energy split. △ Less

Submitted 17 January, 2019; originally announced January 2019.

Comments: 17 pages, several appendices with technical details

Journal ref: Phys. Rev. E 99, 042130 (2019)

DCA for genome-wide epistasis analysis: the statistical genetics perspective

Authors: Chen-Yi Gao, Fabio Cecconi, Angelo Vulpiani, Hai-Jun Zhou, Erik Aurell

Abstract: Direct Coupling Analysis (DCA) is a now widely used method to leverage statistical information from many similar biological systems to draw meaningful conclusions on each system separately. DCA has been applied with great success to sequences of homologous proteins, and also more recently to whole-genome population-wide sequencing data. We here argue that the use of DCA on the genome scale is cont… ▽ More Direct Coupling Analysis (DCA) is a now widely used method to leverage statistical information from many similar biological systems to draw meaningful conclusions on each system separately. DCA has been applied with great success to sequences of homologous proteins, and also more recently to whole-genome population-wide sequencing data. We here argue that the use of DCA on the genome scale is contingent on fundamental issues of population genetics. DCA can be expected to yield meaningful results when a population is in the Quasi-Linkage Equilibrium (QLE) phase studied by Kimura and others, but not, for instance, in a phase of Clonal Competition. We discuss how the exponential (Potts model) distributions emerge in QLE, and compare couplings to correlations obtained in a study of about 3,000 genomes of the human pathogen Streptococcus pneumoniae. △ Less

Submitted 10 August, 2018; originally announced August 2018.

Comments: 9 pages, 5 figures

Exploring the diluted ferromagnetic p-spin model with a Cavity Master Equation

Authors: Erik Aurell, Eduardo Domínguez, David Machado, Roberto Mulet

Abstract: We introduce a new solution to Glauber multi-spin dynamics on random graphs. The solution is based on the recently introduced Cavity Master Equation (CME), a time-closure turning the in principle exact Dynamic Cavity Method into a practical method of analysis and of fast simulation. Running CME once is of comparable computational complexity as one Monte Carlo run on the same problem. We show tha… ▽ More We introduce a new solution to Glauber multi-spin dynamics on random graphs. The solution is based on the recently introduced Cavity Master Equation (CME), a time-closure turning the in principle exact Dynamic Cavity Method into a practical method of analysis and of fast simulation. Running CME once is of comparable computational complexity as one Monte Carlo run on the same problem. We show that CME correctly models the ferromagnetic $p$-spin Glauber dynamics from high temperatures down to and below the spinoidal transition. We also show that CME allows a novel exploration of the low-temperature spin-glass phase of the model. △ Less

Submitted 1 February, 2018; originally announced February 2018.

Journal ref: Phys. Rev. E 97, 050103 (2018)

The characteristic functions of quantum heat with baths at different temperatures

Authors: Erik Aurell

Abstract: This paper is about quantum heat defined as the change in energy of a bath during a process. The presentation takes into account recent developments in classical strong-coupling thermodynamics, and addresses a version of quantum heat which satisfies quantum-classical correspondence. The characteristic function and the full counting statistics of quantum heat are shown to be formally similar. The p… ▽ More This paper is about quantum heat defined as the change in energy of a bath during a process. The presentation takes into account recent developments in classical strong-coupling thermodynamics, and addresses a version of quantum heat which satisfies quantum-classical correspondence. The characteristic function and the full counting statistics of quantum heat are shown to be formally similar. The paper further shows that the method can be extended to more than one bath, e.g. two baths at different temperatures, which opens up the prospect of studying correlations and heat flow. The paper extends earlier results on the expected quantum heat in the setting of one bath (Aurell \& Eichhorn 2015, Aurell 2017). △ Less

Submitted 6 February, 2018; v1 submitted 12 January, 2018; originally announced January 2018.

Comments: Minor update, one new reference and one new subsection in appendix added. Total length now 11 pages, 52 references, no figures

Journal ref: Phys. Rev. E 97, 062117 (2018)

A unified picture of strong coupling stochastic thermodynamics and time reversals

Authors: Erik Aurell

Abstract: Strong-coupling statistical thermodynamics is formulated as Hamiltonian dynamics of an observed system interacting with another unobserved system (a bath). It is shown that the entropy production functional of stochastic thermodynamics, defined as the log-ratio of forward and backward system path probabilities, is in one-to-one relation with the log-ratios of joint initial conditions of the system… ▽ More Strong-coupling statistical thermodynamics is formulated as Hamiltonian dynamics of an observed system interacting with another unobserved system (a bath). It is shown that the entropy production functional of stochastic thermodynamics, defined as the log-ratio of forward and backward system path probabilities, is in one-to-one relation with the log-ratios of joint initial conditions of the system and the bath. A version of strong-coupling statistical thermodynamics where the system-bath interaction vanishes at the beginning and the end of a process is, as is also weak-coupling stochastic thermodynamics, related the bath initially in equilibrium by itself. The heat is then the change of bath energy over the process. It is discussed when this heat is a functional of system history alone. The version of strong-coupling statistical thermodynamics introduced by Seifert and Jarzynski is related to the bath initially in conditional equilibrium with respect to the system. This leads to heat as another functional of system history which needs to be determined by thermodynamic integration. The log-ratio of forward and backward system path probabilities in a stochastic process is finally related to log-ratios of initial conditions of a combined system and bath. It is shown that the entropy production formulas of stochastic processes under general class of time reversals are given by change of a bath energy in a larger underlying Hamiltonian system. The paper highlights the centrality of time reversal in stochastic thermodynamics, also in the case of strong coupling. △ Less

Submitted 2 January, 2018; v1 submitted 21 December, 2017; originally announced December 2017.

Comments: Minor revision. One new equation added (Eq 36). Two new references added (Refs 11 and 12)

Journal ref: Phys. Rev. E 97, 042112 (2018)

Steady diffusion in a drift field: a comparison of large deviation techniques and multiple-scale analysis

Authors: Erik Aurell, Stefano Bo

Abstract: A particle with internal unobserved states diffusing in a force field will generally display effective advection-diffusion. The drift velocity is proportional to the mobility averaged over the internal states, or effective mobility, while the effective diffusion has two terms. One is of the equilibrium type and satisfies an Einstein relation with the effective mobility while the other is quadratic… ▽ More A particle with internal unobserved states diffusing in a force field will generally display effective advection-diffusion. The drift velocity is proportional to the mobility averaged over the internal states, or effective mobility, while the effective diffusion has two terms. One is of the equilibrium type and satisfies an Einstein relation with the effective mobility while the other is quadratic in the applied force. In this contribution we present two new methods to obtain these results, on the one hand using large deviation techniques, and on the other by a multiple-scale analysis, and compare the two. We consider both systems with discrete internal states and continuous internal states. We show that the auxiliary equations in the multiple-scale analysis can also be derived in second-order perturbation theory in a large deviation theory of a generating function (discrete internal states) or generating functional (continuous internal states). We discuss that measuring the two components of the effective diffusion give a way to determine kinetic rates from only first and second moments of the displacement in steady state. △ Less

Submitted 12 October, 2017; v1 submitted 2 June, 2017; originally announced June 2017.

Journal ref: Phys. Rev. E 96, 032140 (2017)

On work and heat in time-dependent strong coupling

Authors: Erik Aurell

Abstract: This paper revisits the classical problem of representing a thermal bath interacting with a system as a large collection of harmonic oscillators initially in thermal equilibrium. As is well known the system then obeys an equation, which in the bulk and in the suitable limit tends to the Kramers-Langevin equation of physical kinetics. I consider time-dependent system-bath coupling and show that thi… ▽ More This paper revisits the classical problem of representing a thermal bath interacting with a system as a large collection of harmonic oscillators initially in thermal equilibrium. As is well known the system then obeys an equation, which in the bulk and in the suitable limit tends to the Kramers-Langevin equation of physical kinetics. I consider time-dependent system-bath coupling and show that this leads to an additional harmonic force acting on the system. When the coupling is switched on and switched off rapidly the force has delta-function support at the initial and final time, an effect that has been observed previously. I further show that the work and heat functionals as recently defined in stochastic thermodynamics at strong coupling contain additional terms depending on the time derivative of the system-bath coupling. I discuss these terms and show that while they can be very large if the system-bath coupling changes quickly they only give a finite contribution to the work that enter in Jarzynski's equality. I also discuss that these corrections to standard work and heat functionals provide an explanation for non-standard terms in the change of the von Neumann entropy of a quantum bath interacting with a quantum system found in an earlier contribution (Aurell \& Eichhorn, 2015). △ Less

Submitted 22 May, 2017; originally announced May 2017.

Journal ref: Entropy 19 (11), 595 (2017)

Statistical properties of interaction parameter estimates in direct coupling analysis

Authors: Yingying Xu, Erik Aurell, Jukka Corander, Yoshiyuki Kabashima

Abstract: We consider the statistical properties of interaction parameter estimates obtained by the direct coupling analysis (DCA) approach to learning interactions from large data sets. Assuming that the data are generated from a random background distribution, we determine the distribution of inferred interactions. Two inference methods are considered: the L2 regularized naive mean-field inference procedu… ▽ More We consider the statistical properties of interaction parameter estimates obtained by the direct coupling analysis (DCA) approach to learning interactions from large data sets. Assuming that the data are generated from a random background distribution, we determine the distribution of inferred interactions. Two inference methods are considered: the L2 regularized naive mean-field inference procedure (regularized least squares, RLS), and the pseudo-likelihood maximization (plmDCA). For RLS we also study a model where the data matrix elements are real numbers, identically and independently generated from a Gaussian distribution; in this setting we analytically find that the distribution of the inferred interactions is Gaussian. For data of Boolean type, more realistic in practice, the inferred interactions do not generally follow a Gaussian. However, extensive numerical simulations indicate that their distribution can be characterized by a single function determined by a few system parameters after normalization by the standard deviation. This property holds for both RLS and plmDCA and may be exploitable for inferring the distribution of extremely large interactions from simulations for smaller system sizes. △ Less

Submitted 5 April, 2017; originally announced April 2017.

Comments: 5 pages, 5 figures

A Cavity Master Equation for the continuous time dynamics of discrete spins models

Authors: Erik Aurell, Gino Del Ferraro, Eduardo Dominguez, Roberto Mulet

Abstract: We present a new method to close the Master Equation representing the continuous time dynamics of Ising interacting spins. The method makes use of the the theory of Random Point Processes to derive a master equation for local conditional probabilities. We analytically test our solution studying two known cases, the dynamics of the mean field ferromagnet and the dynamics of the one dimensional Isin… ▽ More We present a new method to close the Master Equation representing the continuous time dynamics of Ising interacting spins. The method makes use of the the theory of Random Point Processes to derive a master equation for local conditional probabilities. We analytically test our solution studying two known cases, the dynamics of the mean field ferromagnet and the dynamics of the one dimensional Ising system. We then present numerical results comparing our predictions with Monte Carlo simulations in three different models on random graphs with finite connectivity: the Ising ferromagnet, the Random Field Ising model, and the Viana-Bray spin-glass model. △ Less

Submitted 23 July, 2016; originally announced July 2016.

Journal ref: Phys. Rev. E 95, 052119 (2017)

Global estimates of errors in quantum computation by the Feynman-Vernon formalism

Authors: Erik Aurell

Abstract: The operation of a quantum computer is considered as a general quantum operation on a mixed state on many qubits followed by a measurement. The general quantum operation is further represented as a Feynman-Vernon double path integral over the histories of the qubits and of an environment, and afterward tracing out the environment. The qubit histories are taken to be paths on the two-sphere $S^2$ a… ▽ More The operation of a quantum computer is considered as a general quantum operation on a mixed state on many qubits followed by a measurement. The general quantum operation is further represented as a Feynman-Vernon double path integral over the histories of the qubits and of an environment, and afterward tracing out the environment. The qubit histories are taken to be paths on the two-sphere $S^2$ as in Klauder's coherent-state path integralof spin, and the environment is assumed to consist of harmonic oscillators initially in thermal equilibrium, and linearly coupled to to qubit operators $\hat{S}_z$. The environment can then be integrated out to give a Feynman-Vernon influence action coupling the forward and backward histories of the qubits. This representation allows to derive in a simple way estimates that the total error of operation of a quantum computer without error correction scales linearly with the number of qubits and the time of operation. It also allows to discuss Kitaev's toric code interacting with an environment in the same manner. △ Less

Submitted 3 April, 2018; v1 submitted 30 June, 2016; originally announced June 2016.

Comments: 15 pages, no figures, 63 references. Presentation has be revised since second version. One section on quantum noise and one section on relations to the literature have been added. Title and abstract have been revised

Advective-diffusive motion on large scales from small-scale dynamics with an internal symmetry

Authors: Raffaele Marino, Erik Aurell

Abstract: We consider coupled diffusions in $n$-dimensional space and on a compact manifold and the resulting effective advective-diffusive motion on large scales in space. The effective drift (advection) and effective diffusion are determined as a solvability conditions in a multi-scale analysis. As an example we consider coupled diffusions in $3$-dimensional space and on the group manifold $SO(3)$ of prop… ▽ More We consider coupled diffusions in $n$-dimensional space and on a compact manifold and the resulting effective advective-diffusive motion on large scales in space. The effective drift (advection) and effective diffusion are determined as a solvability conditions in a multi-scale analysis. As an example we consider coupled diffusions in $3$-dimensional space and on the group manifold $SO(3)$ of proper rotations, generalizing results obtained by H. Brenner (1981). We show in detail how the analysis can be conveniently be carried out using local charts and invariance arguments. As a further example we consider coupled diffusions in $2$-dimensional complex space and on the group manifold $SU(2)$. We show that although the local operators may be the same as for $SO(3)$, due to the global nature of the solvability conditions the resulting diffusion will be different, and generally more isotropic. △ Less

Submitted 8 June, 2016; v1 submitted 22 March, 2016; originally announced March 2016.

Comments: 20 pages, 4 figures

Journal ref: Phys. Rev. E 93, 062147 (2016)

Diffusion of a Brownian ellipsoid in a force field

Authors: Erik Aurell, Stefano Bo, Marcelo Dias, Ralf Eichhorn, Raffaele Marino

Abstract: We calculate the effective long-term convective velocity and dispersive motion of an ellipsoidal Brownian particle in three dimensions when it is subjected to a constant external force. This long-term motion results as a "net" average behavior from the particle rotation and translation on short time scales. Accordingly, we apply a systematic multi-scale technique to derive the effective equations… ▽ More We calculate the effective long-term convective velocity and dispersive motion of an ellipsoidal Brownian particle in three dimensions when it is subjected to a constant external force. This long-term motion results as a "net" average behavior from the particle rotation and translation on short time scales. Accordingly, we apply a systematic multi-scale technique to derive the effective equations of motion valid on long times. We verify our theoretical results by comparing them to numerical simulations. △ Less

Submitted 15 February, 2016; originally announced February 2016.

Journal ref: EPL (Europhysics Letters), Volume 114, Number 3 (2016)

Causal analysis, Correlation-Response and Dynamic cavity

Authors: Erik Aurell, Gino Del Ferraro

Abstract: The purpose of this note is to point out analogies between causal analysis in statistics and the correlation-response theory in statistical physics. It is further shown that for some systems the dynamic cavity offers a way to compute the stationary state of a non- equilibrium process effectively, which could then be taken an alternative starting point of causal analysis. The purpose of this note is to point out analogies between causal analysis in statistics and the correlation-response theory in statistical physics. It is further shown that for some systems the dynamic cavity offers a way to compute the stationary state of a non- equilibrium process effectively, which could then be taken an alternative starting point of causal analysis. △ Less

Submitted 2 December, 2015; originally announced December 2015.

Comments: 10 pages, 3 figures

Entropy production of a Brownian ellipsoid in the overdamped limit

Authors: Raffaele Marino, Ralf Eichhorn, Erik Aurell

Abstract: We analyze the translational and rotational motion of an ellipsoidal Brownian particle from the viewpoint of stochastic thermodynamics. The particle's Brownian motion is driven by external forces and torques and takes place in an heterogeneous thermal environment where friction coefficients and (local) temperature depend on space and time. Our analysis of the particle's stochastic thermodynamics i… ▽ More We analyze the translational and rotational motion of an ellipsoidal Brownian particle from the viewpoint of stochastic thermodynamics. The particle's Brownian motion is driven by external forces and torques and takes place in an heterogeneous thermal environment where friction coefficients and (local) temperature depend on space and time. Our analysis of the particle's stochastic thermodynamics is based on the entropy production associated with single particle trajectories. It is motivated by the recent discovery that the overdamped limit of vanishing inertia effects (as compared to viscous fricion) produces a so-called "anomalous" contribution to the entropy production, which has no counterpart in the overdamped approximation, when inertia effects are simply discarded. Here, we show that rotational Brownian motion in the overdamped limit generates an additional contribution to the "anomalous" entropy. We calculate its specific form by performing a systematic singular perturbation analysis for the generating function of the entropy production. As a side result, we also obtain the (well-known) equations of motion in the overdamped limit. We furthermore investigate the effects of particle shape and give explicit expressions of the "anomalous entropy" for prolate and oblate spheroids and for near-spherical Brownian particles. △ Less

Submitted 13 January, 2016; v1 submitted 21 September, 2015; originally announced September 2015.

Comments: 17 pages, 1 fig

Journal ref: Physical Review E 93.1 (2016): 012132

On one-step replica symmetry breaking in the Edwards-Anderson spin glass model

Authors: Gino Del Ferraro, Chuang Wang, Hai-Jun Zhou, Erik Aurell

Abstract: We consider a one-step replica symmetry breaking description of the Edwards-Anderson spin glass model in 2D. The ingredients of this description are a Kikuchi approximation to the free energy and a second-level statistical model built on the extremal points of the Kikuchi approximation, which are also fixed points of a Generalized Belief Propagation (GBP) scheme. We show that a generalized free en… ▽ More We consider a one-step replica symmetry breaking description of the Edwards-Anderson spin glass model in 2D. The ingredients of this description are a Kikuchi approximation to the free energy and a second-level statistical model built on the extremal points of the Kikuchi approximation, which are also fixed points of a Generalized Belief Propagation (GBP) scheme. We show that a generalized free energy can be constructed where these extremal points are exponentially weighted by their Kikuchi free energy and a Parisi parameter $y$, and that the Kikuchi approximation of this generalized free energy leads to second-level, one-step replica symmetry breaking (1RSB), GBP equations. We then proceed analogously to Bethe approximation case for tree-like graphs, where it has been shown that 1RSB Belief Propagation equations admit a Survey Propagation solution. We discuss when and how the one-step-replica symmetry breaking GBP equations that we obtain also allow a simpler class of solutions which can be interpreted as a class of Generalized Survey Propagation equations for the single instance graph case. △ Less

Submitted 23 July, 2016; v1 submitted 2 July, 2015; originally announced July 2015.

Comments: 34 pages, 4 figures

Time reversals of irreversible quantum maps

Authors: Erik Aurell, Jakub Zakrzewski, Karol Życzkowski

Abstract: We introduce the notion of time reversal in open quantum systems as represented by linear quantum operations, and a related generalization of classical entropy production in the environment. This functional is the ratio of the probability to observe a transition between two states under the forward and the time reversed dynamics, and leads, as in the classical case, to fluctuation relations as tau… ▽ More We introduce the notion of time reversal in open quantum systems as represented by linear quantum operations, and a related generalization of classical entropy production in the environment. This functional is the ratio of the probability to observe a transition between two states under the forward and the time reversed dynamics, and leads, as in the classical case, to fluctuation relations as tautological identities. As in classical dynamics in contact with a heat bath, time reversal is not unique, and we discuss several possibilities. For any bistochastic map its dual map preserves the trace and describes a legitimate dynamics reversed in time, in that case the entropy production in the environment vanishes. For a generic stochastic map we construct a simple quantum operation which can be interpreted as a time reversal. For instance, the decaying channel, which sends the excited state into the ground state with a certain probability, can be reversed into the channel transforming the ground state into the excited state with the same probability. △ Less

Submitted 17 June, 2015; v1 submitted 9 May, 2015; originally announced May 2015.

Comments: small changes references added

Journal ref: J. Phys. A 48, 38FT01 (2015)

On the von Neumann entropy of a bath linearly coupled to a driven quantum system

Authors: Erik Aurell, Ralf Eichhorn

Abstract: The change of the von Neumann entropy of a set of harmonic oscillators initially in thermal equilibrium and interacting linearly with an externally driven quantum system is computed by adapting the Feynman-Vernon influence functional formalism. This quantum entropy production has the form of the expectation value of three functionals of the forward and backward paths describing the system history… ▽ More The change of the von Neumann entropy of a set of harmonic oscillators initially in thermal equilibrium and interacting linearly with an externally driven quantum system is computed by adapting the Feynman-Vernon influence functional formalism. This quantum entropy production has the form of the expectation value of three functionals of the forward and backward paths describing the system history in the Feynman-Vernon theory. In the classical limit of Kramers-Langevin dynamics (Caldeira-Leggett model) these functionals combine to three terms, where the first is the entropy production functional of stochastic thermodynamics, the classical work done by the system on the environment in units of $k_BT$, the second another functional with no analogue in stochastic thermodynamics, and the third is a boundary term. △ Less

Submitted 22 December, 2014; originally announced December 2014.

Comments: 10 pages, no figures

Journal ref: New Journal of Physics 17 (6), 065007 (2017)

Dynamic message-passing approach for kinetic spin models with reversible dynamics

Authors: Gino Del Ferraro, Erik Aurell

Abstract: A method to approximately close the dynamic cavity equations for synchronous reversible dynamics on a locally tree-like topology is presented. The method builds on $(a)$ a graph expansion to eliminate loops from the normalizations of each step in the dynamics, and $(b)$ an assumption that a set of auxilary probability distributions on histories of pairs of spins mainly have dependencies that are l… ▽ More A method to approximately close the dynamic cavity equations for synchronous reversible dynamics on a locally tree-like topology is presented. The method builds on $(a)$ a graph expansion to eliminate loops from the normalizations of each step in the dynamics, and $(b)$ an assumption that a set of auxilary probability distributions on histories of pairs of spins mainly have dependencies that are local in time. The closure is then effectuated by projecting these probability distributions on $n$-step Markov processes. The method is shown in detail on the level of ordinary Markov processes ($n=1$), and outlined for higher-order approximations ($n>1$). Numerical validations of the technique are provided for the reconstruction of the transient and equilibrium dynamics of the kinetic Ising model on a random graph with arbitrary connectivity symmetry. △ Less

Submitted 2 July, 2015; v1 submitted 16 September, 2014; originally announced September 2014.

Comments: 6 pages, 4 figures

The stochastic thermodynamics of a rotating Brownian particle in a gradient flow

Authors: Yueheng Lan, Erik Aurell

Abstract: We compute the entropy production engendered in the environment from a single Brownian particle which moves in a mean flow, and show that it corresponds in expectation to classical near-equilibrium entropy production in the surrounding fluid with specific mesoscopic transport coefficients. With temperature gradient, extra terms are found which results from the nonlinear interaction between the par… ▽ More We compute the entropy production engendered in the environment from a single Brownian particle which moves in a mean flow, and show that it corresponds in expectation to classical near-equilibrium entropy production in the surrounding fluid with specific mesoscopic transport coefficients. With temperature gradient, extra terms are found which results from the nonlinear interaction between the particle and the non-equilibrated environment. The calculations are carried out in the multi-time formalism and in the advection-dissipation limit where the Stokes number (St) of the flow tends to zero and the Peclet number (Pe) diverges but the combination St times Pe remains constant. △ Less

Submitted 4 May, 2014; originally announced May 2014.

Comments: 6 pages, Supplementary Information file available

Improving contact prediction along three dimensions

Authors: Christoph Feinauer, Marcin J. Skwark, Andrea Pagnani, Erik Aurell

Abstract: Correlation patterns in multiple sequence alignments of homologous proteins can be exploited to infer information on the three-dimensional structure of their members. The typical pipeline to address this task, which we in this paper refer to as the three dimensions of contact prediction, is to: (i) filter and align the raw sequence data representing the evolutionarily related proteins; (ii) choose… ▽ More Correlation patterns in multiple sequence alignments of homologous proteins can be exploited to infer information on the three-dimensional structure of their members. The typical pipeline to address this task, which we in this paper refer to as the three dimensions of contact prediction, is to: (i) filter and align the raw sequence data representing the evolutionarily related proteins; (ii) choose a predictive model to describe a sequence alignment; (iii) infer the model parameters and interpret them in terms of structural properties, such as an accurate contact map. We show here that all three dimensions are important for overall prediction success. In particular, we show that it is possible to improve significantly along the second dimension by going beyond the pair-wise Potts models from statistical physics, which have hitherto been the focus of the field. These (simple) extensions are motivated by multiple sequence alignments often containing long stretches of gaps which, as a data feature, would be rather untypical for independent samples drawn from a Potts model. Using a large test set of proteins we show that the combined improvements along the three dimensions are as large as any reported to date. △ Less

Submitted 5 March, 2014; v1 submitted 3 March, 2014; originally announced March 2014.

Comments: 19 pages, 8 figures in main text; 7 pages, 6 figures in supporting information

MSC Class: 92C40; 62P10; ACM Class: J.3

Perturbative large deviation analysis of non-equilibrium dynamics

Authors: Gino Del Ferraro, Erik Aurell

Abstract: Macroscopic fluctuation theory has shown that a wide class of non-equilibrium stochastic dynamical systems obey a large deviation principle, but except for a few one-dimensional examples these large deviation principles are in general not known in closed form. We consider the problem of constructing successive approximations to an (unknown) large deviation functional and show that the non-equilibr… ▽ More Macroscopic fluctuation theory has shown that a wide class of non-equilibrium stochastic dynamical systems obey a large deviation principle, but except for a few one-dimensional examples these large deviation principles are in general not known in closed form. We consider the problem of constructing successive approximations to an (unknown) large deviation functional and show that the non-equilibrium probability distribution the takes a Gibbs-Boltzmann form with a set of auxiliary (non-physical) energy functions. The expectation values of these auxiliary energy functions and their conjugate quantities satisfy a closed system of equations which can imply a considerable reduction of dimensionality of the dynamics. We show that the accuracy of the approximations can be tested self-consistently without solving the full non- equilibrium equations. We test the general procedure on the simple model problem of a relaxing 1D Ising chain. △ Less

Submitted 19 January, 2014; originally announced January 2014.

Comments: 21 pages, 10 figures

Journal ref: J. Phys. Soc. Jpn., Vol.83, No.8, 2014/7/7

A novel local search based on variable-focusing for random K-SAT

Authors: Rémi Lemoy, Mikko Alava, Erik Aurell

Abstract: We introduce a new local search algorithm for satisfiability problems. Usual approaches focus uniformly on unsatisfied clauses. The new method works by picking uniformly random variables in unsatisfied clauses. A Variable-based Focused Metropolis Search (V-FMS) is then applied to random 3-SAT. We show that it is quite comparable in performance to the clause-based FMS. Consequences for algorithmic… ▽ More We introduce a new local search algorithm for satisfiability problems. Usual approaches focus uniformly on unsatisfied clauses. The new method works by picking uniformly random variables in unsatisfied clauses. A Variable-based Focused Metropolis Search (V-FMS) is then applied to random 3-SAT. We show that it is quite comparable in performance to the clause-based FMS. Consequences for algorithmic design are discussed. △ Less

Submitted 12 December, 2013; v1 submitted 9 October, 2013; originally announced November 2013.

Comments: 7 pages, 3 figures

Optimal stochastic transport in inhomogeneous thermal environments

Authors: Stefano Bo, Erik Aurell, Ralf Eichhorn, Antonio Celani

Abstract: We consider optimization of the average entropy production in inhomogeneous temperature environments within the framework of stochastic thermodynamics. For systems modeled by Langevin equations (e.g. a colloidal particle in a heat bath) it has been recently shown that a space dependent temperature breaks the time reversal symmetry of the fast velocity degrees of freedom resulting in an anomalous c… ▽ More We consider optimization of the average entropy production in inhomogeneous temperature environments within the framework of stochastic thermodynamics. For systems modeled by Langevin equations (e.g. a colloidal particle in a heat bath) it has been recently shown that a space dependent temperature breaks the time reversal symmetry of the fast velocity degrees of freedom resulting in an anomalous contribution to the entropy production of the overdamped dynamics. We show that optimization of entropy production is determined by an auxiliary deterministic problem describing motion on a curved manifold in a potential. The "anomalous contribution" to entropy plays the role of the potential and the inverse of the diffusion tensor is the metric. We also find that entropy production is not minimized by adiabatically slow, quasi-static protocols but there is a finite optimal duration for the transport process. As an example we discuss the case of a linearly space dependent diffusion coefficient. △ Less

Submitted 13 March, 2013; originally announced March 2013.

Comments: 6 pages, 2 figures

Witness of unsatisfiability for a random 3-satisfiability formula

Authors: Lu-Lu Wu, Hai-Jun Zhou, Mikko Alava, Erik Aurell, Pekka Orponen

Abstract: The random 3-satisfiability (3-SAT) problem is in the unsatisfiable (UNSAT) phase when the clause density $α$ exceeds a critical value $α_s \approx 4.267$. However, rigorously proving the unsatisfiability of a given large 3-SAT instance is extremely difficult. In this paper we apply the mean-field theory of statistical physics to the unsatisfiability problem, and show that a specific type of UNSAT… ▽ More The random 3-satisfiability (3-SAT) problem is in the unsatisfiable (UNSAT) phase when the clause density $α$ exceeds a critical value $α_s \approx 4.267$. However, rigorously proving the unsatisfiability of a given large 3-SAT instance is extremely difficult. In this paper we apply the mean-field theory of statistical physics to the unsatisfiability problem, and show that a specific type of UNSAT witnesses (Feige-Kim-Ofek witnesses) can in principle be constructed when the clause density $α> 19$. We then construct Feige-Kim-Ofek witnesses for single 3-SAT instances through a simple random sampling algorithm and a focused local search algorithm. The random sampling algorithm works only when $α$ scales at least linearly with the variable number $N$, but the focused local search algorithm works for clause densty $α> c N^{b}$ with $b \approx 0.59$ and prefactor $c \approx 8$. The exponent $b$ can be further decreased by enlarging the single parameter $S$ of the focused local search algorithm. △ Less

Submitted 10 March, 2013; originally announced March 2013.

Comments: 9 pages, 7 figures included. Submitted to Physical Review E

Journal ref: Physical Review E 87, 052807 (2013)

Improved contact prediction in proteins: Using pseudolikelihoods to infer Potts models

Authors: Magnus Ekeberg, Cecilia Lövkvist, Yueheng Lan, Martin Weigt, Erik Aurell

Abstract: Spatially proximate amino acids in a protein tend to coevolve. A protein's three-dimensional (3D) structure hence leaves an echo of correlations in the evolutionary record. Reverse engineering 3D structures from such correlations is an open problem in structural biology, pursued with increasing vigor as more and more protein sequences continue to fill the data banks. Within this task lies a statis… ▽ More Spatially proximate amino acids in a protein tend to coevolve. A protein's three-dimensional (3D) structure hence leaves an echo of correlations in the evolutionary record. Reverse engineering 3D structures from such correlations is an open problem in structural biology, pursued with increasing vigor as more and more protein sequences continue to fill the data banks. Within this task lies a statistical inference problem, rooted in the following: correlation between two sites in a protein sequence can arise from firsthand interaction but can also be network-propagated via intermediate sites; observed correlation is not enough to guarantee proximity. To separate direct from indirect interactions is an instance of the general problem of inverse statistical mechanics, where the task is to learn model parameters (fields, couplings) from observables (magnetizations, correlations, samples) in large systems. In the context of protein sequences, the approach has been referred to as direct-coupling analysis. Here we show that the pseudolikelihood method, applied to 21-state Potts models describing the statistical properties of families of evolutionarily related proteins, significantly outperforms existing approaches to the direct-coupling analysis, the latter being based on standard mean-field techniques. This improved performance also relies on a modified score for the coupling strength. The results are verified using known crystal structures of specific sequence instances of various protein families. Code implementing the new method can be found at http://plmdca.csc.kth.se/. △ Less

Submitted 12 January, 2013; v1 submitted 6 November, 2012; originally announced November 2012.

Comments: 19 pages, 16 figures, published version

Journal ref: M. Ekeberg, C. Lövkvist, Y. Lan, M. Weigt, E. Aurell, Improved contact prediction in proteins: Using pseudolikelihoods to infer Potts models, Phys. Rev. E 87, 012707 (2013)

Maximum likelihood reconstruction for Ising models with asynchronous updates

Authors: Hong-Li Zeng, Mikko Alava, Erik Aurell, John Hertz, Yasser Roudi

Abstract: We describe how the couplings in an asynchronous kinetic Ising model can be inferred. We consider two cases, one in which we know both the spin history and the update times and one in which we only know the spin history. For the first case, we show that one can average over all possible choices of update times to obtain a learning rule that depends only on spin correlations and can also be derived… ▽ More We describe how the couplings in an asynchronous kinetic Ising model can be inferred. We consider two cases, one in which we know both the spin history and the update times and one in which we only know the spin history. For the first case, we show that one can average over all possible choices of update times to obtain a learning rule that depends only on spin correlations and can also be derived from the equations of motion for the correlations. For the second case, the same rule can be derived within a further decoupling approximation. We study all methods numerically for fully asymmetric Sherrington-Kirkpatrick models, varying the data length, system size, temperature, and external field. Good convergence is observed in accordance with the theoretical expectations. △ Less

Submitted 23 April, 2013; v1 submitted 11 September, 2012; originally announced September 2012.

Quasi-potential landscape in complex multi-stable systems

Authors: Joseph Xu Zhou, M. D. S. Aliyu, Erik Aurell, Sui Huang

Abstract: Developmental dynamics of multicellular organism is a process that takes place in a multi-stable system in which each attractor state represents a cell type and attractor transitions correspond to cell differentiation paths. This new understanding has revived the idea of a quasi-potential landscape, first proposed by Waddington as a metaphor. To describe development one is interested in the "relat… ▽ More Developmental dynamics of multicellular organism is a process that takes place in a multi-stable system in which each attractor state represents a cell type and attractor transitions correspond to cell differentiation paths. This new understanding has revived the idea of a quasi-potential landscape, first proposed by Waddington as a metaphor. To describe development one is interested in the "relative stabilities" of N attractors (N>2). Existing theories of state transition between local minima on some potential landscape deal with the exit in the transition between a pair attractor but do not offer the notion of a global potential function that relate more than two attractors to each other. Several ad hoc methods have been used in systems biology to compute a landscape in non-gradient systems, such as gene regulatory networks. Here we present an overview of the currently available methods, discuss their limitations and propose a new decomposition of vector fields that permit the computation of a quasi-potential function that is equivalent to the Freidlin-Wentzell potential but is not limited to two attractors. Several examples of decomposition are given and the significance of such a quasi-potential function is discussed. △ Less

Submitted 11 June, 2012; originally announced June 2012.

Comments: 30 pages, 6 figures

Anomalous thermodynamics at the micro-scale

Authors: Antonio Celani, Stefano Bo, Ralf Eichhorn, Erik Aurell

Abstract: Particle motion at the micro-scale is an incessant tug-of-war between thermal fluctuations and applied forces on one side, and the strong resistance exerted by fluid viscosity on the other. Friction is so strong that completely neglecting inertia - the overdamped approximation - gives an excellent effective description of the actual particle mechanics. In sharp contrast with this result, here we s… ▽ More Particle motion at the micro-scale is an incessant tug-of-war between thermal fluctuations and applied forces on one side, and the strong resistance exerted by fluid viscosity on the other. Friction is so strong that completely neglecting inertia - the overdamped approximation - gives an excellent effective description of the actual particle mechanics. In sharp contrast with this result, here we show that the overdamped approximation dramatically fails when thermodynamic quantities such as the entropy production in the environment is considered, in presence of temperature gradients. In the limit of vanishingly small, yet finite inertia, we find that the entropy production is dominated by a contribution that is anomalous, i.e. has no counterpart in the overdamped approximation. This phenomenon, that we call entropic anomaly, is due to a symmetry-breaking that occurs when moving to the small, finite inertia limit. Strong production of anomalous entropy is traced back to intense sweeps down the temperature gradient. △ Less

Submitted 29 November, 2012; v1 submitted 8 June, 2012; originally announced June 2012.

Comments: 4 pages, 1 figure, supplementary information uploaded as a separate pdf file (see other formats link)

Refined Second Law of Thermodynamics for fast random processes

Authors: Erik Aurell, Krzysztof Gawȩdzki, Carlos Mejía-Monasterio, Roya Mohayaee, Paolo Muratore-Ginanneschi

Abstract: We establish a refined version of the Second Law of Thermodynamics for Langevin stochastic processes describing mesoscopic systems driven by conservative or non-conservative forces and interacting with thermal noise. The refinement is based on the Monge-Kantorovich optimal mass transport. General discussion is illustrated by numerical analysis of a model for micron-size particle manipulated by opt… ▽ More We establish a refined version of the Second Law of Thermodynamics for Langevin stochastic processes describing mesoscopic systems driven by conservative or non-conservative forces and interacting with thermal noise. The refinement is based on the Monge-Kantorovich optimal mass transport. General discussion is illustrated by numerical analysis of a model for micron-size particle manipulated by optical tweezers. △ Less

Submitted 16 January, 2012; originally announced January 2012.

Comments: 17 pages

Journal ref: Journal of Statistical Physics 147, 487--505 (2012)

Boundary layers in stochastic thermodynamics

Authors: Erik Aurell, Carlos Mejia-Monasterio, Paolo Muratore-Ginanneschi

Abstract: We study the problem of optimizing released heat or dissipated work in stochastic thermodynamics. In the overdamped limit these functionals have singular solutions, previously interpreted as protocol jumps. We show that a regularization, penalizing a properly defined acceleration, changes the jumps into boundary layers of finite width. We show that in the limit of vanishing boundary layer width no… ▽ More We study the problem of optimizing released heat or dissipated work in stochastic thermodynamics. In the overdamped limit these functionals have singular solutions, previously interpreted as protocol jumps. We show that a regularization, penalizing a properly defined acceleration, changes the jumps into boundary layers of finite width. We show that in the limit of vanishing boundary layer width no heat is dissipated in the boundary layer, while work can be done. We further give a new interpretation of the fact that the optimal protocols in the overdamped limit are given by optimal deterministic transport (Burgers equation). △ Less

Submitted 11 November, 2011; originally announced November 2011.

Comments: 5 pages, 2 figures

Dynamic mean-field and cavity methods for diluted Ising systems

Authors: Erik Aurell, Hamed Mahmoudi

Abstract: We compare dynamic mean-field and dynamic cavity as methods to describe the stationary states of dilute kinetic Ising models. We compute dynamic mean-field theory by expanding in interaction strength to third order, and compare to the exact dynamic mean-field theory for fully asymmetric networks. We show that in diluted networks the dynamic cavity method generally predicts magnetizations of indivi… ▽ More We compare dynamic mean-field and dynamic cavity as methods to describe the stationary states of dilute kinetic Ising models. We compute dynamic mean-field theory by expanding in interaction strength to third order, and compare to the exact dynamic mean-field theory for fully asymmetric networks. We show that in diluted networks the dynamic cavity method generally predicts magnetizations of individual spins better than both first order ("naive") and second order ("TAP") dynamic mean field theory. △ Less

Submitted 20 March, 2012; v1 submitted 15 September, 2011; originally announced September 2011.

Journal ref: Phys. Rev. E 85, 031119 (2012)

Inverse Ising inference using all the data

Authors: Erik Aurell, Magnus Ekeberg

Abstract: We show that a method based on logistic regression, using all the data, solves the inverse Ising problem far better than mean-field calculations relying only on sample pairwise correlation functions, while still computationally feasible for hundreds of nodes. The largest improvement in reconstruction occurs for strong interactions. Using two examples, a diluted Sherrington-Kirkpatrick model and a… ▽ More We show that a method based on logistic regression, using all the data, solves the inverse Ising problem far better than mean-field calculations relying only on sample pairwise correlation functions, while still computationally feasible for hundreds of nodes. The largest improvement in reconstruction occurs for strong interactions. Using two examples, a diluted Sherrington-Kirkpatrick model and a two-dimensional lattice, we also show that interaction topologies can be recovered from few samples with good accuracy and that the use of $l_1$-regularization is beneficial in this process, pushing inference abilities further into low-temperature regimes. △ Less

Submitted 12 November, 2012; v1 submitted 18 July, 2011; originally announced July 2011.

Comments: 5 pages, 2 figures. Accepted version

Three lemmas on the dynamic cavity method

Authors: Erik Aurell, Hamed Mahmoudi

Abstract: We study the dynamic cavity method for dilute kinetic Ising models with synchronous update rules. For the parallel update rule we find for fully asymmetric models that the dynamic cavity equations reduce to a Markovian dynamics of the (time-dependent) marginal probabilities. For the random sequential update rule, also an instantiation of a synchronous update rule, we find on the other hand that th… ▽ More We study the dynamic cavity method for dilute kinetic Ising models with synchronous update rules. For the parallel update rule we find for fully asymmetric models that the dynamic cavity equations reduce to a Markovian dynamics of the (time-dependent) marginal probabilities. For the random sequential update rule, also an instantiation of a synchronous update rule, we find on the other hand that the dynamic cavity equations do not reduce to a Markovian dynamics, unless an additional assumption of time factorization is introduced. For symmetric models we show that a fixed point of ordinary Belief propagation is also a fixed point of the dynamic cavity equations in the time factorized approximation. For clarity, the conclusions of the paper are formulated as three lemmas. △ Less

Submitted 4 April, 2011; originally announced April 2011.

A message-passing scheme for non-equilibrium stationary states

Authors: Erik Aurell, Hamed Mahmoudi

Abstract: We study stationary states in a diluted asymmetric (kinetic) Ising model. We apply the recently introduced dynamic cavity method to compute magnetizations of these stationary states. Depending on the update rule, different versions of the dynamic cavity method apply. We here study synchronous updates and random sequential updates, and compare local properties computed by the dynamic cavity method… ▽ More We study stationary states in a diluted asymmetric (kinetic) Ising model. We apply the recently introduced dynamic cavity method to compute magnetizations of these stationary states. Depending on the update rule, different versions of the dynamic cavity method apply. We here study synchronous updates and random sequential updates, and compare local properties computed by the dynamic cavity method to numerical simulations. Using both types of updates, the dynamic cavity method is highly accurate at high enough temperatures. At low enough temperatures, for sequential updates the dynamic cavity method tends to a fixed point, but which does not agree with numerical simulations, while for parallel updates, the dynamic cavity method may display cyclic behavior. When it converges and is accurate, the dynamic cavity method offers a huge speed-up compared to Monte Carlo, particularly for large systems. △ Less

Submitted 20 September, 2011; v1 submitted 15 December, 2010; originally announced December 2010.

Comments: 12 pages, 5 figures

Optimal protocols and optimal transport in stochastic thermodynamics

Authors: Erik Aurell, Carlos Mejia-Monasterio, Paolo Muratore-Ginanneschi

Abstract: Thermodynamics of small systems has become an important field of statistical physics. They are driven out of equilibrium by a control, and the question is naturally posed how such a control can be optimized. We show that optimization problems in small system thermodynamics are solved by (deterministic) optimal transport, for which very efficient numerical methods have been developed, and of which… ▽ More Thermodynamics of small systems has become an important field of statistical physics. They are driven out of equilibrium by a control, and the question is naturally posed how such a control can be optimized. We show that optimization problems in small system thermodynamics are solved by (deterministic) optimal transport, for which very efficient numerical methods have been developed, and of which there are applications in Cosmology, fluid mechanics, logistics, and many other fields. We show, in particular, that minimizing expected heat released or work done during a non-equilibrium transition in finite time is solved by Burgers equation of Cosmology and mass transport by the Burgers velocity field. Our contribution hence considerably extends the range of solvable optimization problems in small system thermodynamics. △ Less

Submitted 9 December, 2010; originally announced December 2010.

Comments: 5 pages, RevTex4-1 format

Journal ref: Phys. Rev. Lett. 106, 250601 (2011)

Network inference using asynchronously updated kinetic Ising Model

Authors: Hong-Li Zeng, Erik Aurell, Mikko Alava, Hamed Mahmoudi

Abstract: Network structures are reconstructed from dynamical data by respectively naive mean field (nMF) and Thouless-Anderson-Palmer (TAP) approximations. For TAP approximation, we use two methods to reconstruct the network: a) iteration method; b) casting the inference formula to a set of cubic equations and solving it directly. We investigate inference of the asymmetric Sherrington- Kirkpatrick (S-K) mo… ▽ More Network structures are reconstructed from dynamical data by respectively naive mean field (nMF) and Thouless-Anderson-Palmer (TAP) approximations. For TAP approximation, we use two methods to reconstruct the network: a) iteration method; b) casting the inference formula to a set of cubic equations and solving it directly. We investigate inference of the asymmetric Sherrington- Kirkpatrick (S-K) model using asynchronous update. The solutions of the sets cubic equation depend of temperature T in the S-K model, and a critical temperature Tc is found around 2.1. For T < Tc, the solutions of the cubic equation sets are composed of 1 real root and two conjugate complex roots while for T > Tc there are three real roots. The iteration method is convergent only if the cubic equations have three real solutions. The two methods give same results when the iteration method is convergent. Compared to nMF, TAP is somewhat better at low temperatures, but approaches the same performance as temperature increase. Both methods behave better for longer data length, but for improvement arises, TAP is well pronounced. △ Less

Submitted 29 November, 2010; originally announced November 2010.

Comments: 6 pages, 4 figures

Dynamics and Performance of Susceptibility Propagation on Synthetic Data

Authors: Erik Aurell, Charles Ollion, Yasser Roudi

Abstract: We study the performance and convergence properties of the Susceptibility Propagation (SusP) algorithm for solving the Inverse Ising problem. We first study how the temperature parameter (T) in a Sherrington-Kirkpatrick model generating the data influences the performance and convergence of the algorithm. We find that at the high temperature regime (T>4), the algorithm performs well and its qualit… ▽ More We study the performance and convergence properties of the Susceptibility Propagation (SusP) algorithm for solving the Inverse Ising problem. We first study how the temperature parameter (T) in a Sherrington-Kirkpatrick model generating the data influences the performance and convergence of the algorithm. We find that at the high temperature regime (T>4), the algorithm performs well and its quality is only limited by the quality of the supplied data. In the low temperature regime (T<4), we find that the algorithm typically does not converge, yielding diverging values for the couplings. However, we show that by stop** the algorithm at the right time before divergence becomes serious, good reconstruction can be achieved down to T~2. We then show that dense connectivity, loopiness of the connectivity, and high absolute magnetization all have deteriorating effects on the performance of the algorithm. When absolute magnetization is high, we show that other methods can be work better than SusP. Finally, we show that for neural data with high absolute magnetization, SusP performs less well than TAP inversion. △ Less

Submitted 20 May, 2010; originally announced May 2010.

Comments: 9 pages, 7 figures

Report number: NORDITA-2010-033

Journal ref: EPJ B 2010

Statistical physics of pairwise probability models

Authors: Yasser Roudi, Erik Aurell, John Hertz

Abstract: Statistical models for describing the probability distribution over the states of biological systems are commonly used for dimensional reduction. Among these models, pairwise models are very attractive in part because they can be fit using a reasonable amount of data: knowledge of the means and correlations between pairs of elements in the system is sufficient. Not surprisingly, then, using pair… ▽ More Statistical models for describing the probability distribution over the states of biological systems are commonly used for dimensional reduction. Among these models, pairwise models are very attractive in part because they can be fit using a reasonable amount of data: knowledge of the means and correlations between pairs of elements in the system is sufficient. Not surprisingly, then, using pairwise models for studying neural data has been the focus of many studies in recent years. In this paper, we describe how tools from statistical physics can be employed for studying and using pairwise models. We build on our previous work on the subject and study the relation between different methods for fitting these models and evaluating their quality. In particular, using data from simulated cortical networks we study how the quality of various approximate methods for inferring the parameters in a pairwise model depends on the time bin chosen for binning the data. We also study the effect of the size of the time bin on the model quality itself, again using simulated data. We show that using finer time bins increases the quality of the pairwise model. We offer new ways of deriving the expressions reported in our previous work for assessing the quality of pairwise models. △ Less

Submitted 9 May, 2009; originally announced May 2009.

Comments: 25 pages, 3 figures

Report number: NORDITA-2009-25

Journal ref: Front. Comput. Neurosci (2009) 3:22