-
Mesoscopic and Macroscopic Entropy Balance Equations in a Stochastic Dynamics and Its Deterministic Limit
Authors:
Hong Qian,
Zhongwei Shen
Abstract:
Entropy, its production, and its change in a dynamical system can be understood from either a fully stochastic dynamic description or from a deterministic dynamics exhibiting chaotic behavior. By taking the former approach based on the general diffusion process with diffusion $\tfrac{1}α{\bf D}(\bf x)$ and drift $\bf b(\bf x)$, where $α$ represents the ``size parameter'' of a system, we show that…
▽ More
Entropy, its production, and its change in a dynamical system can be understood from either a fully stochastic dynamic description or from a deterministic dynamics exhibiting chaotic behavior. By taking the former approach based on the general diffusion process with diffusion $\tfrac{1}α{\bf D}(\bf x)$ and drift $\bf b(\bf x)$, where $α$ represents the ``size parameter'' of a system, we show that there are two distinctly different entropy balance equations. One reads ${\rm d} S^{(α)}/{\rm d} t = e^{(α)}_p + Q^{(α)}_{ex}$ for all $α$. However, the leading $α$-order, ``extensive'', terms of the entropy production rate $e^{(α)}_p$ and heat exchange rate $Q^{(α)}_{ex}$ are exactly cancelled. Therefore, in the asymptotic limit of $α\to\infty$, there is a second, local ${\rm d} S/{\rm d} t = \nabla\cdot{\bf b}({\bf x}(t))+\left({\bf D}:{\bf Σ}^{-1}\right)({\bf x}(t))$ on the order of $O(1)$, where $\tfrac{1}α{\bf D}(\bf x(t))$ represents the randomness generated in the dynamics usually represented by metric entropy, and $\tfrac{1}α{\bf Σ}({\bf x}(t))$ is the covariance matrix of the local Gaussian description at ${\bf x}(t)$, which is a solution to the ordinary differential equation $\dot{\bf x}={\bf b}(\bf x)$ at time $t$. This latter equation is akin to the notions of volume-preserving conservative dynamics and entropy production in the deterministic dynamic approach to nonequilibrium thermodynamics {\it à la} D. Ruelle. As a continuation of [17], mathematical details with sufficient care are given in four Appendices.
△ Less
Submitted 31 May, 2024;
originally announced June 2024.
-
On Thermodynamic Information
Authors:
Bing Miao,
Hong Qian,
Yong-Shi Wu
Abstract:
Information based thermodynamic logic is revisited. It consists of two parts: Part A applies the modern theory of probability in which an arbitrary convex function φis employed as an analytic "device" to express information as statistical dependency contained in the topological sub-σ-algebra structure. Via thermo-doubling, Fenchel-Young equality (FYE) that consists of φ(x) and its conjugate ψ(y) e…
▽ More
Information based thermodynamic logic is revisited. It consists of two parts: Part A applies the modern theory of probability in which an arbitrary convex function φis employed as an analytic "device" to express information as statistical dependency contained in the topological sub-σ-algebra structure. Via thermo-doubling, Fenchel-Young equality (FYE) that consists of φ(x) and its conjugate ψ(y) establishes the notion of equilibrium between x and y through duality symmetry and the principle of maximum entropy/minimum free energy. Part B deals with a given set of repetitive measurements, where an inherent convex function emerges via the mathematics of large deviations. Logarithm-based Shannon entropy with φ(x)=-\log x figures prominently for i.i.d. sample statistics. Information can be a measure of the agreement between a statistical observation and its theoretical models. Maximum likelihood principle arises here and FYE provides a thermodynamic energetic narrative of recurrent data.
△ Less
Submitted 6 December, 2023;
originally announced December 2023.
-
Nonequilibrium Stationary Process and Fluctuation-Dissipation Relations
Authors:
Ying-Jen Yang,
Hong Qian
Abstract:
A stochastic dynamics has a natural decomposition into a drift capturing mean rate of change and a martingale increment capturing randomness. They are two statistically uncorrelated, but not necessarily independent mechanisms contributing to the overall fluctuations of the dynamics, representing the uncertainties in the past and in the future. A generalized Einstein relation is a consequence solel…
▽ More
A stochastic dynamics has a natural decomposition into a drift capturing mean rate of change and a martingale increment capturing randomness. They are two statistically uncorrelated, but not necessarily independent mechanisms contributing to the overall fluctuations of the dynamics, representing the uncertainties in the past and in the future. A generalized Einstein relation is a consequence solely because the dynamics being stationary; and the Green-Kubo formula reflects a balance between the two mechanisms. Equilibrium with reversibility is characterized by a novel covariance symmetry.
△ Less
Submitted 24 June, 2021;
originally announced June 2021.
-
Emergence and Breaking of Duality Symmetry in Generalized Fundamental Thermodynamic Relations
Authors:
Zhiyue Lu,
Hong Qian
Abstract:
Thermodynamics as limiting behaviors of statistics is generalized to arbitrary system with probability {\it a priori} where thermodynamic infinite-size limit is replaced by multiple-measurement limit. A duality symmetry between Massieu's and Gibbs' entropy arises in the limit of infinitely repeated observations, yielding the Gibbs equation and Hill-Gibbs-Duhem equation (HGDE) as dual pair. If a sy…
▽ More
Thermodynamics as limiting behaviors of statistics is generalized to arbitrary system with probability {\it a priori} where thermodynamic infinite-size limit is replaced by multiple-measurement limit. A duality symmetry between Massieu's and Gibbs' entropy arises in the limit of infinitely repeated observations, yielding the Gibbs equation and Hill-Gibbs-Duhem equation (HGDE) as dual pair. If a system has thermodynamic limit satisfying Callen's postulate, entropy being an Eulerian function, the symmetry is lost: the HGDE reduces to the Gibbs-Duhem equation. This theory provides a de-mechanized foundation for classical and nanothermodynamics and offers a framework for distilling emergence from large data, free from underlying details.
△ Less
Submitted 20 March, 2022; v1 submitted 26 September, 2020;
originally announced September 2020.
-
Stochastic limit-cycle oscillations of a nonlinear system under random perturbations
Authors:
Yu-Chen Cheng,
Hong Qian
Abstract:
Dynamical systems with $ε$ small random perturbations appear in both continuous mechanical motions and discrete stochastic chemical kinetics. The present work provides a detailed analysis of the central limit theorem (CLT), with a time-inhomogeneous Gaussian process, near a deterministic limit cycle in $\mathbb{R}^n$. Based on the theory of random perturbations of dynamical systems and the WKB app…
▽ More
Dynamical systems with $ε$ small random perturbations appear in both continuous mechanical motions and discrete stochastic chemical kinetics. The present work provides a detailed analysis of the central limit theorem (CLT), with a time-inhomogeneous Gaussian process, near a deterministic limit cycle in $\mathbb{R}^n$. Based on the theory of random perturbations of dynamical systems and the WKB approximation respectively, results are developed in parallel from both standpoints of stochastic trajectories and transition probability density and their relations are elucidated. We show rigorously the correspondence between the local Gaussian fluctuations and the curvature of the large deviation rate function near its infimum, connecting the CLT and the large deviation principle of diffusion processes. We study uniform asymptotic behavior of stochastic limit cycles through the interchange of limits of time $t\to\infty$ and $ε\to 0$. Three further characterizations of stochastic limit cycle oscillators are obtained: (i) An approximation of the probability flux near the cycle; (ii) Two special features of the vector field for the cyclic motion; (iii) A local entropy balance equation along the cycle with clear physical meanings. Lastly and different from the standard treatment, the origin of the $ε$ in the theory is justified by a novel scaling hypothesis via constructing a sequence of stochastic differential equations.
△ Less
Submitted 7 September, 2020;
originally announced September 2020.
-
Asymptotic Behavior of a Sequence of Conditional Probability Distributions and the Canonical Ensemble
Authors:
Yu-Chen Cheng,
Hong Qian,
Yizhe Zhu
Abstract:
The probability distribution of a function of a subsystem conditioned on the value of the function of the whole, in the limit when the ratio of their values goes to zero, has a limit law: It equals the unconditioned marginal probability distribution weighted by an exponential factor whose exponent is uniquely determined by the condition. We apply this theorem to explain the canonical equilibrium e…
▽ More
The probability distribution of a function of a subsystem conditioned on the value of the function of the whole, in the limit when the ratio of their values goes to zero, has a limit law: It equals the unconditioned marginal probability distribution weighted by an exponential factor whose exponent is uniquely determined by the condition. We apply this theorem to explain the canonical equilibrium ensemble of a system in contact with a heat reservoir. Since the theorem only requires analysis at the level of the function of the subsystem and reservoir, it is applicable even without the knowledge of the composition of the reservoir itself, which extends the applicability of the canonical ensemble. Furthermore, we generalize our theorem to a model with strong interaction that contributes an additional term to the exponent, which is beyond the typical case of approximately additive functions. This result is new in both physics and mathematics, as a theory for the Gibbs conditioning principle for strongly correlated systems. A corollary provides a precise formulation of what a temperature bath is in probabilistic term
△ Less
Submitted 27 December, 2020; v1 submitted 23 December, 2019;
originally announced December 2019.
-
Unified formalism for entropy productions and fluctuation relations
Authors:
Ying-Jen Yang,
Hong Qian
Abstract:
Stochastic entropy production, which quantifies the difference between the probabilities of trajectories of a stochastic dynamics and its time reversals, has a central role in nonequilibrium thermodynamics. In the theory of probability, the change in the statistical properties of observables can be represented by a change in the probability measure. We consider operators on the space of probabilit…
▽ More
Stochastic entropy production, which quantifies the difference between the probabilities of trajectories of a stochastic dynamics and its time reversals, has a central role in nonequilibrium thermodynamics. In the theory of probability, the change in the statistical properties of observables can be represented by a change in the probability measure. We consider operators on the space of probability measure that induce changes in the statistical properties of a process, and formulate entropy productions in terms of these change-of-probability-measure (CPM) operators. This mathematical underpinning of the origin of entropy productions allows us to achieve an organization of various forms of fluctuation relations: All entropy productions have a non-negative mean value, admit the integral fluctuation theorem, and satisfy a rather general fluctuation relation. Other results such as the transient fluctuation theorem and detailed fluctuation theorems then are derived from the general fluctuation relation with more constraints on the operator. We use a discrete-time, discrete-state-space Markov process to draw the contradistinction among three reversals of a process: time reversal, protocol reversal and the dual process. The properties of their corresponding CPM operators are examined, and the domains of validity of various fluctuation relations for entropy productions in physics and chemistry are revealed. We also show that our CPM operator formalism can help us rather easily extend other fluctuations relations for excess work and heat, discuss the martingale properties of entropy productions, and derive the stochastic integral formulas for entropy productions in constant-noise diffusion process with Girsanov theorem. Our formalism provides a general and concise way to study the properties of entropy-related quantities in stochastic thermodynamics and information theory.
△ Less
Submitted 20 January, 2020; v1 submitted 1 April, 2019;
originally announced April 2019.
-
Representations and Divergences in the Space of Probability Measures and Stochastic Thermodynamics
Authors:
Liu Hong,
Hong Qian,
Lowell F. Thompson
Abstract:
Radon-Nikodym (RN) derivative between two measures arises naturally in the affine structure of the space of probability measures with densities. Entropy, free energy, relative entropy, and entropy production as mathematical concepts associated with RN derivatives are introduced. We identify a simple equation that connects two measures with densities as a possible mathematical basis of the entropy…
▽ More
Radon-Nikodym (RN) derivative between two measures arises naturally in the affine structure of the space of probability measures with densities. Entropy, free energy, relative entropy, and entropy production as mathematical concepts associated with RN derivatives are introduced. We identify a simple equation that connects two measures with densities as a possible mathematical basis of the entropy balance equation that is central in nonequilibrium thermodynamics. Application of this formalism to Gibbsian canonical distribution yields many results in classical thermomechanics. An affine structure based on the canonical represenation and two divergences are introduced in the space of probability measures. It is shown that thermodynamic work, as a conditional expectation, is indictive of the RN derivative between two energy represenations being singular. The entropy divergence and the heat divergence yield respectively a Massieu-Planck potential based and a generalized Carnot inequalities.
△ Less
Submitted 13 April, 2020; v1 submitted 26 February, 2019;
originally announced February 2019.
-
Ternary Representation of Stochastic Change and the Origin of Entropy and Its Fluctuations
Authors:
Hong Qian,
Yu-Chen Cheng,
Lowell F. Thompson
Abstract:
A change in a stochastic system has three representations: Probabilistic, statistical, and informational: (i) is based on random variable $u(ω)\to\tilde{u}(ω)$; this induces (ii) the probability distributions $F_u(x)\to F_{\tilde{u}}(x)$, $x\in\mathbb{R}^n$; and (iii) a change in the probability measure $\mathbb{P}\to\tilde{\mathbb{P}}$ under the same observable $u(ω)$. In the informational repres…
▽ More
A change in a stochastic system has three representations: Probabilistic, statistical, and informational: (i) is based on random variable $u(ω)\to\tilde{u}(ω)$; this induces (ii) the probability distributions $F_u(x)\to F_{\tilde{u}}(x)$, $x\in\mathbb{R}^n$; and (iii) a change in the probability measure $\mathbb{P}\to\tilde{\mathbb{P}}$ under the same observable $u(ω)$. In the informational representation a change is quantified by the Radon-Nikodym derivative $\ln\left( \frac{ d \tilde{\mathbb{P}}}{ d\mathbb{P}}(ω)\right)=-\ln\left(\frac{ d F_u}{ d F_{\tilde{u}}}(x)\right)$ when $x=u(ω)$. Substituting a random variable into its own density function creates a fluctuating entropy whose expectation has been given by Shannon. Informational representation of a deterministic transformation on $\mathbb{R}^n$ reveals entropic and energetic terms, and the notions of configurational entropy of Boltzmann and Gibbs, and potential of mean force of Kirkwood. Mutual information arises for correlated $u(ω)$ and $\tilde{u}(ω)$; and a nonequilibrium thermodynamic entropy balance equation is identified.
△ Less
Submitted 25 February, 2019;
originally announced February 2019.
-
Generalized Boltzmann distributions for systems strongly coupled to large finite bath -- a microcanonical approach
Authors:
Yu-Chen Cheng,
Wenning Wang,
Zhiyue Lu,
Hong Qian
Abstract:
The theory of probability shows that, as the fraction $X_n/Y\to 0$, the conditional probability for $X_n$, given $X_n+Y \in h_δ:=[h, h+δ]$, has a limit law $f_{X_n}(x)e^{-ψ_n(h_δ)x}$, where $ψ_n(h_δ) $ equals to $[\partial \ln P(Y \in y_δ)/\partial y]_{y=h}$ plus an additional term, contributed from the correlation between $X_n$ and bath $Y$. By applying this limit law to an isolated composite sys…
▽ More
The theory of probability shows that, as the fraction $X_n/Y\to 0$, the conditional probability for $X_n$, given $X_n+Y \in h_δ:=[h, h+δ]$, has a limit law $f_{X_n}(x)e^{-ψ_n(h_δ)x}$, where $ψ_n(h_δ) $ equals to $[\partial \ln P(Y \in y_δ)/\partial y]_{y=h}$ plus an additional term, contributed from the correlation between $X_n$ and bath $Y$. By applying this limit law to an isolated composite system consisting of two strongly coupled parts, a system of interest and a large but finite bath, we derive the generalized Boltzmann distribution law for the system of interest in the exponential form of a redefined Hamiltonian and corrected Boltzmann temperature that reflects the modification due to strong system-bath coupling and the large but finite bath.
△ Less
Submitted 9 August, 2021; v1 submitted 27 November, 2018;
originally announced November 2018.
-
Kinematic Basis of Emergent Energetics of Complex Dynamics
Authors:
Hong Qian,
Yu-Chen Cheng,
Ying-Jen Yang
Abstract:
Stochastic kinematic description of a complex dynamics is shown to dictate an energetic and thermodynamic structure. An energy function $\varphi(x)$ emerges as the limit of the generalized, nonequilibrium free energy of a Markovian dynamics with vanishing fluctuations. In terms of the $\nabla\varphi$ and its orthogonal field $γ(x)\perp\nabla\varphi$, a general vector field $b(x)$ can be decomposed…
▽ More
Stochastic kinematic description of a complex dynamics is shown to dictate an energetic and thermodynamic structure. An energy function $\varphi(x)$ emerges as the limit of the generalized, nonequilibrium free energy of a Markovian dynamics with vanishing fluctuations. In terms of the $\nabla\varphi$ and its orthogonal field $γ(x)\perp\nabla\varphi$, a general vector field $b(x)$ can be decomposed into $-D(x)\nabla\varphi+γ$, where $\nabla\cdot\big(ω(x)γ(x)\big)=$ $-\nablaωD(x)\nabla\varphi$. The matrix $D(x)$ and scalar $ω(x)$, two additional characteristics to the $b(x)$ alone, represent the local geometry and density of states intrinsic to the statistical motion in the state space at $x$. $\varphi(x)$ and $ω(x)$ are interpreted as the emergent energy and degeneracy of the motion, with an energy balance equation $d\varphi(x(t))/dt=γD^{-1}γ-bD^{-1}b$, reflecting the geometrical $\|D\nabla\varphi\|^2+\|γ\|^2=\|b\|^2$. The partition function employed in statistical mechanics and J. W. Gibbs' method of ensemble change naturally arise; a fluctuation-dissipation theorem is established via the two leading-order asymptotics of entropy production as $ε\to 0$. The present theory provides a mathematical basis for P. W. Anderson's emergent behavior in the hierarchical structure of complexity science.
△ Less
Submitted 31 March, 2020; v1 submitted 22 March, 2017;
originally announced April 2017.
-
Mathematical Formalism of Nonequilibrium Thermodynamics for Nonlinear Chemical Reaction Systems with General Rate Law
Authors:
Hao Ge,
Hong Qian
Abstract:
This paper studies a mathematical formalism of nonequilibrium thermodynamics for chemical reaction models with $N$ species, $M$ reactions, and general rate law. We establish a mathematical basis for J. W. Gibbs' macroscopic chemical thermodynamics under G. N. Lewis' kinetic law of entire equilibrium (detailed balance in nonlinear chemistry kinetics). In doing so, the equilibrium thermodynamics is…
▽ More
This paper studies a mathematical formalism of nonequilibrium thermodynamics for chemical reaction models with $N$ species, $M$ reactions, and general rate law. We establish a mathematical basis for J. W. Gibbs' macroscopic chemical thermodynamics under G. N. Lewis' kinetic law of entire equilibrium (detailed balance in nonlinear chemistry kinetics). In doing so, the equilibrium thermodynamics is then naturally generalized to nonequilibrium settings without detailed balance. The kinetic models are represented by a Markovian jum** process. A generalized macroscopic chemical free energy function and its associated balance equation with nonnegative source and sink are the major discoveries. The proof is based on the large deviation principle of this type of Markov processes. A general fluctuation dissipation theorem for stochastic reaction kinetics is also proved. The mathematical theory illustrates how a novel macroscopic dynamic law can emerges from the mesoscopic kinetics in a multi-scale system.
△ Less
Submitted 24 September, 2016; v1 submitted 24 April, 2016;
originally announced April 2016.
-
Thermodynamics of the General Diffusion Process: Equilibrium Supercurrent and Nonequilibrium Driven Circulation with Dissipation
Authors:
Hong Qian
Abstract:
Unbalanced probability circulation, which yields cyclic motions in phase space, is the defining characteristics of a stationary diffusion process without detailed balance. In over-damped soft matter systems, such behavior is a hallmark of the presence of a sustained external driving force accompanied with dissipations. In an under-damped and strongly correlated system, however, cyclic motions are…
▽ More
Unbalanced probability circulation, which yields cyclic motions in phase space, is the defining characteristics of a stationary diffusion process without detailed balance. In over-damped soft matter systems, such behavior is a hallmark of the presence of a sustained external driving force accompanied with dissipations. In an under-damped and strongly correlated system, however, cyclic motions are often the consequences of a conservative dynamics. In the present paper, we give a novel interpretation of a class of diffusion processes with stationary circulation in terms of a Maxwell-Boltzmann equilibrium in which cyclic motions are on the level set of stationary probability density function thus non-dissipative, e.g., a supercurrent. This implies an orthogonality between stationary circulation $J^{ss}(x)$ and the gradient of stationary probability density $f^{ss}(x)>0$. A sufficient and necessary condition for the orthogonality is a decomposition of the drift $b(x)=j(x)+ D(x)\nabla\varphi(x)$ where $\nabla\cdot j(x)=0$ and $j(x)$ $\cdot\nabla\varphi(x)=0$. Stationary processes with Maxwell-Boltzmann equilibrium has an underlying conservative dynamics $\dot{x}= j(x)\equiv$ $\big(f^{ss}(x)\big)^{-1}J^{ss}(x)$, and a first integral $\varphi(x)\equiv-\ln f^{ss}(x)=$ const, akin to a Hamiltonian system. At all time, an instantaneous free energy balance equation exists for a given diffusion system; and an extended energy conservation law among a family of diffusion processes with different parameter $α$ can be established via a Helmholtz theorem. For the general diffusion process without the orthogonality, a nonequilibrium cycle emerges, which consists of external driven $\varphi$-ascending steps and spontaneous $\varphi$-descending movements, alternated with iso-$\varphi$ motions. The theory presented here provides a rich mathematical narrative for complex mesoscopic dynamics.
△ Less
Submitted 19 September, 2015; v1 submitted 18 December, 2014;
originally announced December 2014.
-
A Thermodynamic Theory of Ecology: Helmholtz Theorem for Lotka-Volterra Equation, Extended Conservation Law, and Stochastic Predator-Prey Dynamics
Authors:
Yi-An Ma,
Hong Qian
Abstract:
We carry out mathematical analyses, {\em à la} Helmholtz's and Boltzmann's 1884 studies of monocyclic Newtonian dynamics, for the Lotka-Volterra (LV) equation exhibiting predator-prey oscillations. In doing so a novel "thermodynamic theory" of ecology is introduced. An important feature, absent in the classical mechanics, of ecological systems is a natural stochastic population dynamic formulation…
▽ More
We carry out mathematical analyses, {\em à la} Helmholtz's and Boltzmann's 1884 studies of monocyclic Newtonian dynamics, for the Lotka-Volterra (LV) equation exhibiting predator-prey oscillations. In doing so a novel "thermodynamic theory" of ecology is introduced. An important feature, absent in the classical mechanics, of ecological systems is a natural stochastic population dynamic formulation of which the deterministic equation (e.g., the LV equation studied) is the infinite population limit. Invariant density for the stochastic dynamics plays a central role in the deterministic LV dynamics. We show how the conservation law along a single trajectory extends to incorporate both variations in a model parameter $α$ and in initial conditions: Helmholtz's theorem establishes a broadly valid conservation law in a class of ecological dynamics. We analyze the relationships among mean ecological activeness $θ$, quantities characterizing dynamic ranges of populations $\mathcal{A}$ and $α$, and the ecological force $F_α$. The analyses identify an entire orbit as a stationary ecology, and establish the notion of "equation of ecological states". Studies of the stochastic dynamics with finite populations show the LV equation as the robust, fast cyclic underlying behavior. The mathematical narrative provides a novel way of capturing long-term dynamical behaviors with an emergent {\em conservative ecology}.
△ Less
Submitted 3 November, 2015; v1 submitted 16 May, 2014;
originally announced May 2014.
-
The Zeroth Law of Thermodynamics and Volume-Preserving Conservative Dynamics with Equilibrium Stochastic Dam**
Authors:
Hong Qian
Abstract:
We propose a mathematical formulation of the zeroth law of thermodynamics and develop a stochastic dynamical theory, with a consistent irreversible thermodynamics, for systems possessing sustained conservative stationary current in phase space while in equilibrium with a heat bath. The theory generalizes underdamped mechanical equilibrium: $dx=gdt+\{-D\nablaφdt+\sqrt{2D}dB(t)\}$, with…
▽ More
We propose a mathematical formulation of the zeroth law of thermodynamics and develop a stochastic dynamical theory, with a consistent irreversible thermodynamics, for systems possessing sustained conservative stationary current in phase space while in equilibrium with a heat bath. The theory generalizes underdamped mechanical equilibrium: $dx=gdt+\{-D\nablaφdt+\sqrt{2D}dB(t)\}$, with $\nabla\cdot g=0$ and $\{\cdots\}$ respectively representing phase-volume preserving dynamics and stochastic dam**. The zeroth law implies stationary distribution $u^{ss}(x)=e^{-φ(x)}$. We find an orthogonality $\nablaφ\cdot g=0$ as a hallmark of the system. Stochastic thermodynamics based on time reversal $\big(t,φ,g\big)\rightarrow\big(-t,φ,-g\big)$ is formulated: entropy production $e_p^{\#}(t)=-dF(t)/dt$; generalized "heat" $h_d^{\#}(t)=-dU(t)/dt$, $U(t)=\int_{\mathbb{R}^n} φ(x)u(x,t)dx$ being "internal energy", and "free energy" $F(t)=U(t)+\int_{\mathbb{R}^n} u(x,t)\ln u(x,t)dx$ never increases. Entropy follows $\frac{dS}{dt}=e_p^{\#}-h_d^{\#}$. Our formulation is shown to be consistent with an earlier theory of P. Ao. Its contradistinctions to other theories, potential-flux decomposition, stochastic Hamiltonian system with even and odd variables, Klein-Kramers equation, Freidlin-Wentzell's theory, and GENERIC, are discussed.
△ Less
Submitted 20 December, 2013; v1 submitted 29 June, 2012;
originally announced June 2012.
-
A Hamiltonian-Entropy Production Connection in the Skew-symmetric Part of a Stochastic Dynamics
Authors:
Hong Qian
Abstract:
The infinitesimal transition probability operator for a continuous-time discrete-state Markov process, $\mathcal{Q}$, can be decomposed into a symmetric and a skew-symmetric parts. As recently shown for the case of diffusion processes, while the symmetric part corresponding to a gradient system stands for a reversible Markov process, the skew-symmetric part, $\frac{d}{dt}u(t)=\mcA u$, is mathemati…
▽ More
The infinitesimal transition probability operator for a continuous-time discrete-state Markov process, $\mathcal{Q}$, can be decomposed into a symmetric and a skew-symmetric parts. As recently shown for the case of diffusion processes, while the symmetric part corresponding to a gradient system stands for a reversible Markov process, the skew-symmetric part, $\frac{d}{dt}u(t)=\mcA u$, is mathematically equivalent to a linear Hamiltonian dynamics with Hamiltonian $H=1/2u^T\big(\mcA^T\mcA)^{1/2}u$. It can also be transformed into a Schrödinger-like equation $\frac{d}{dt}u=i\mathcal{H}u$ where the "Hamiltonian" operator $\mathcal{H}=-i\mcA$ is Hermitian. In fact, these two representations of a skew-symmetric dynamics emerge natually through singular-value and eigen-value decompositions, respectively. The stationary probability of the Markov process can be expressed as $\|u^s_i\|^2$. The motion can be viewed as "harmonic" since $\frac{d}{dt}\|u(t)-\vec{c}\|^2=0$ where $\vec{c}=(c,c,...,c)$ with $c$ being a constant. More interestingly, we discover that $\textrm{Tr}(\mcA^T\mcA)=\sum_{j,\ell=1}^n \frac{(q_{j\ell}π_\ell-q_{\ell j}π_j)^2}{π_jπ_{\ell}}$, whose right-hand-side is intimately related to the entropy production rate of the Markov process in a nonequilibrium steady state with stationary distribution $\{π_j\}$. The physical implication of this intriguing connection between conservative Hamiltonian dynamics and dissipative entropy production remains to be further explored.
△ Less
Submitted 6 April, 2013; v1 submitted 30 May, 2012;
originally announced May 2012.
-
Analytical Mechanics in Stochastic Dynamics: Most Probable Path, Large-Deviation Rate Function and Hamilton-Jacobi Equation
Authors:
Hao Ge,
Hong Qian
Abstract:
Analytical (rational) mechanics is the mathematical structure of Newtonian deterministic dynamics developed by D'Alembert, Langrange, Hamilton, Jacobi, and many other luminaries of applied mathematics. Diffusion as a stochastic process of an overdamped individual particle immersed in a fluid, initiated by Einstein, Smoluchowski, Langevin and Wiener, has no momentum since its path is nowhere differ…
▽ More
Analytical (rational) mechanics is the mathematical structure of Newtonian deterministic dynamics developed by D'Alembert, Langrange, Hamilton, Jacobi, and many other luminaries of applied mathematics. Diffusion as a stochastic process of an overdamped individual particle immersed in a fluid, initiated by Einstein, Smoluchowski, Langevin and Wiener, has no momentum since its path is nowhere differentiable. In this exposition, we illustrate how analytical mechanics arises in stochastic dynamics from a randomly perturbed ordinary differential equation $dX_t=b(X_t)dt+εdW_t$ where $W_t$ is a Brownian motion. In the limit of vanishingly small $ε$, the solution to the stochastic differential equation other than $\dot{x}=b(x)$ are all rare events. However, conditioned on an occurence of such an event, the most probable trajectory of the stochastic motion is the solution to Lagrangian mechanics with $\mathcal{L}=\|\dot{q}-b(q)\|^2/4$ and Hamiltonian equations with $H(p,q)=\|p\|^2+b(q)\cdot p$. Hamiltonian conservation law implies that the most probable trajectory for a "rare" event has a uniform "excess kinetic energy" along its path. Rare events can also be characterized by the principle of large deviations which expresses the probability density function for $X_t$ as $f(x,t)=e^{-u(x,t)/ε}$, where $u(x,t)$ is called a large-deviation rate function which satisfies the corresponding Hamilton-Jacobi equation. An irreversible diffusion process with $\nabla\times b\neq 0$ corresponds to a Newtonian system with a Lorentz force $\ddot{q}=(\nabla\times b)\times \dot{q}+1/2\nabla\|b\|^2$. The connection between stochastic motion and analytical mechanics can be explored in terms of various techniques of applied mathematics, for example, singular perturbations, viscosity solutions, and integrable systems.
△ Less
Submitted 28 May, 2012;
originally announced May 2012.
-
A Decomposition of Irreversible Diffusion Processes Without Detailed Balance
Authors:
Hong Qian
Abstract:
As a generalization of deterministic, nonlinear conservative dynamical systems, a notion of {\em canonical conservative dynamics} with respect to a positive, differentiable stationary density $ρ(x)$ is introduced: $\dot{x}=j(x)$ in which $\nabla\cdot\big(ρ(x)j(x)\big)=0$. Such systems have a conserved "generalized free energy function" $F[u]$ $=$ $\int u(x,t)\ln\big(u(x,t)/ρ(x)\big)dx$ in phase sp…
▽ More
As a generalization of deterministic, nonlinear conservative dynamical systems, a notion of {\em canonical conservative dynamics} with respect to a positive, differentiable stationary density $ρ(x)$ is introduced: $\dot{x}=j(x)$ in which $\nabla\cdot\big(ρ(x)j(x)\big)=0$. Such systems have a conserved "generalized free energy function" $F[u]$ $=$ $\int u(x,t)\ln\big(u(x,t)/ρ(x)\big)dx$ in phase space with a density flow $u(x,t)$ satisfying $\partial u_t =-\nabla\cdot(ju)$. Any general stochastic diffusion process without detailed balance, in terms of its Fokker-Planck equation, can be decomposed into a reversible diffusion process with detailed balance and a canonical conservative dynamics. This decomposition can be rigorously established in a function space with inner product defined as $\langleφ,ψ\rangle=\intρ^{-1}(x)φ(x)ψ(x)dx$. Furthermore, a law for balancing $F[u]$ can be obtained: The non-positive $dF[u(x,t)]/dt$ $=$ $E_{in}(t)-e_p(t)$ where the "source" $E_{in}(t)\ge 0$ and the "sink" $e_p(t)\ge 0$ are known as house-kee** heat and entropy production, respectively. A reversible diffusion has $E_{in}(t)=0$. For a linear (Ornstein-Uhlenbeck) diffusion process, our decomposition is equivalent to the previous approaches developed by R. Graham and P. Ao, as well as the theory of large deviations. In terms of two different formulations of time reversal for a same stochastic process, the meanings of {\em dissipative} and {\em conservative} stationary dynamics are discussed.
△ Less
Submitted 8 May, 2013; v1 submitted 29 April, 2012;
originally announced April 2012.
-
Stochastic Free Energies, Conditional Probability and Legendre Transform for Ensemble Change
Authors:
Moisés Santillán,
Hong Qian
Abstract:
This work extends a recently developed mathematical theory of thermodynamics for Markov processes with, and more importantly, without detailed balance. We show that the Legendre transform in connection to ensemble changes in Gibbs' statistical mechanics can be derived from the stochastic theory. We consider the joint probability $p_{XY}$ of two random variables X and Y and the conditional probabil…
▽ More
This work extends a recently developed mathematical theory of thermodynamics for Markov processes with, and more importantly, without detailed balance. We show that the Legendre transform in connection to ensemble changes in Gibbs' statistical mechanics can be derived from the stochastic theory. We consider the joint probability $p_{XY}$ of two random variables X and Y and the conditional probability $p_{X|Y=y^*}$, with $y^*=<Y>$ according to $p_{XY}$. The stochastic free energies of the XY system (fluctuating Y ensemble) and the $X|Y$ system (fixed Y ensemble) are related by the chain rule for relative entropy. In the thermodynamic limit, defined as $V,Y\to\infty$ (where one assumes Y as an extensive quantity, while V denotes the system size parameter), the marginal probability obeys $p_Y(y)\to \exp(-Vφ(z))$ with $z=y/V$. A conjugate variable $μ=-φ(z)/z$ naturally emerges from this result. The stochastic free energies of the fluctuating and fixed ensembles are then related by $F_{XY}=F_{X|Y=y^*}-μy^*$, with $μ=\partial F_{X|Y=y}/\partial y$. The time evolutions for the two free energies are the same: $d[F_{XY}(t)]/dt=\partial [F_{X|Y=y^*(t)}(t)]/ \partial t$. This mathematical theory is applied to systems with fixed and fluctuating number of identical independent random variables (idea gas), as well as to microcanonical systems with uniform stationary probability.
△ Less
Submitted 27 October, 2015; v1 submitted 13 December, 2011;
originally announced December 2011.
-
Thermodynamics and Geometry of Reversible and Irreversible Markov Processes
Authors:
Hao Ge,
Woo H. Kim,
Hong Qian
Abstract:
Master equation with microscopic reversibility ($q_{ij}\neq 0$ iff $q_{ji}\neq 0$) has a {\em thermodynamic superstructure} in terms of two state functions $S$, entropy, and $F$, free energy: It is discovered recently that entropy production rate $e_p=-dF/dt+Q_{hk}$ with both $-dF/dt=f_d, Q_{hk} \ge 0$. The free energy dissipation $f_d\ge 0$ reflects irreversibility in spontaneous self-organizatio…
▽ More
Master equation with microscopic reversibility ($q_{ij}\neq 0$ iff $q_{ji}\neq 0$) has a {\em thermodynamic superstructure} in terms of two state functions $S$, entropy, and $F$, free energy: It is discovered recently that entropy production rate $e_p=-dF/dt+Q_{hk}$ with both $-dF/dt=f_d, Q_{hk} \ge 0$. The free energy dissipation $f_d\ge 0$ reflects irreversibility in spontaneous self-organization; house-kee** heat $Q_{hk}\ge 0$ reveals broken time-symmetry in open system driven away from equilibrium. In a Riemannian geometric space, the master equation is a geodesic flow when $Q_{hk}=0$; here we show that the $e_p$ decomposition is orthogonal: $e_p$, $f_d$, $Q_{hk}$ forms a pythagorean triples. Gradient flow means {\em maximum dissipation principle} outside Onsager's regime. The presence of $Q_{hk}$ makses gradient flow no longer generally true. Thermodynamics of stochastic physics requires a new geometric perspective.
△ Less
Submitted 31 August, 2011; v1 submitted 19 August, 2011;
originally announced August 2011.
-
Stochastic Thermodynamics Across Scales: Emergent Inter-attractoral Discrete Markov Jump Process and Its Underlying Continuous Diffusion
Authors:
Moises Santillan,
Hong Qian
Abstract:
The consistency across scales of a recently developed mathematical thermodynamic structure, between a continuous stochastic nonlinear dynamical system (diffusion process with Langevin or Fokker-Planck equations) and its emergent discrete, inter-attractoral Markov jump process, is investigated. We analyze how the system's thermodynamic state functions, e.g. free energy $F$, entropy $S$, entropy pro…
▽ More
The consistency across scales of a recently developed mathematical thermodynamic structure, between a continuous stochastic nonlinear dynamical system (diffusion process with Langevin or Fokker-Planck equations) and its emergent discrete, inter-attractoral Markov jump process, is investigated. We analyze how the system's thermodynamic state functions, e.g. free energy $F$, entropy $S$, entropy production $e_p$, and free energy dissipation $\dot{F}$, etc., are related when the continuous system is describe with a coarse-grained discrete variable. We show that the thermodynamics derived from the underlying detailed continuous dynamics is exact in the Helmholtz free-energy representation. That is, the system thermodynamic structure is the same as if one only takes a middle-road and starts with the "natural" discrete description, with the corresponding transition rates empirically determined. By "natural", we mean in the thermodynamic limit of large systems in which there is an inherent separation of time scales between inter- and intra-attractoral dynamics. This result generalizes a fundamental idea from chemistry and the theory of Kramers by including thermodynamics: while a mechanical description of a molecule is in terms of continuous bond lengths and angles, chemical reactions are phenomenologically described by the Law of Mass Action with rate constants, and a stochastic thermodynamics.
△ Less
Submitted 15 May, 2012; v1 submitted 16 March, 2011;
originally announced March 2011.
-
Landscapes of Non-gradient Dynamics Without Detailed Balance: Stable Limit Cycles and Multiple Attractors
Authors:
Hao Ge,
Hong Qian
Abstract:
Landscape is one of the key notions in literature on biological processes and physics of complex systems with both deterministic and stochastic dynamics. The large deviation theory (LDT) provides a possible mathematical basis for the scientists' intuition. In terms of Freidlin-Wentzell's LDT, we discuss explicitly two issues in singularly perturbed stationary diffusion processes arisen from nonlin…
▽ More
Landscape is one of the key notions in literature on biological processes and physics of complex systems with both deterministic and stochastic dynamics. The large deviation theory (LDT) provides a possible mathematical basis for the scientists' intuition. In terms of Freidlin-Wentzell's LDT, we discuss explicitly two issues in singularly perturbed stationary diffusion processes arisen from nonlinear differential equations: (1) For a process whose corresponding ordinary differential equation has a stable limit cycle, the stationary solution exhibits a clear separation of time scales: an exponential terms and an algebraic prefactor. The large deviation rate function attains its minimum zero on the entire stable limit cycle, while the leading term of the prefactor is inversely proportional to the velocity of the non-uniform periodic oscillation on the cycle. (2) For dynamics with multiple stable fixed points and saddles, there is in general a breakdown of detailed balance among the corresponding attractors. Two landscapes, a local and a global, arise in LDT, and a Markov jum** process with cycle flux emerges in the low-noise limit. A local landscape is pertinent to the transition rates between neighboring stable fixed points; and the global landscape defines a nonequilibrium steady state. There would be nondifferentiable points in the latter for a stationary dynamics with cycle flux. LDT serving as the mathematical foundation for emergent landscapes deserves further investigations.
△ Less
Submitted 22 May, 2012; v1 submitted 17 November, 2010;
originally announced November 2010.
-
Thermodynamics of Markov Processes with Non-extensive Entropy and Free Energy
Authors:
Liangrong Peng,
Hong Qian,
Liu Hong
Abstract:
Statistical thermodynamics of small systems shows dramatic differences from normal systems. Parallel to the recently presented steady-state thermodynamic formalism for master equation and Fokker-Planck equation, we show that a ``thermodynamic'' theory can also be developed based on Tsallis' generalized entropy $S^{(q)}=\sum_{i=1}^N(p_i-p_i^q)/[q(q-1)]$ and Shiino's generalized free energy…
▽ More
Statistical thermodynamics of small systems shows dramatic differences from normal systems. Parallel to the recently presented steady-state thermodynamic formalism for master equation and Fokker-Planck equation, we show that a ``thermodynamic'' theory can also be developed based on Tsallis' generalized entropy $S^{(q)}=\sum_{i=1}^N(p_i-p_i^q)/[q(q-1)]$ and Shiino's generalized free energy $F^{(q)}=[\sum_{i=1}^Np_i(p_i/π_i)^{q-1}-1]/[q(q-1)]$, where $π_i$ is the stationary distribution. $dF^{(q)}/dt=-f_d^{(q)}\le 0$ and it is zero iff the system is in its stationary state. $dS^{(q)}/dt-Q_{ex}^{(q)} = f_d^{(q)}$ where $Q_{ex}^{(q)}$ characterizes the heat exchange. For systems approaching equilibrium with detailed balance, $f_d^{(q)}$ is the product of Onsager's thermodynamic flux and force. However, it is discovered that the Onsager's force is non-local. This is a consequence of the particular transformation invariance for zero energy of Tsallis' statistics.
△ Less
Submitted 31 March, 2020; v1 submitted 7 May, 2010;
originally announced May 2010.
-
Irreversible Thermodynamics in Multiscale Stochastic Dynamical Systems
Authors:
Moises Santillan,
Hong Qian
Abstract:
This work extends the results of the recently developed theory of a rather complete thermodynamic formalism for discrete-state, continuous-time Markov processes with and without detailed balance. We aim at investigating the question that whether and how the thermodynamic structure is invariant in a multiscale stochastic system. That is, whether the relations between thermodynamic functions of stat…
▽ More
This work extends the results of the recently developed theory of a rather complete thermodynamic formalism for discrete-state, continuous-time Markov processes with and without detailed balance. We aim at investigating the question that whether and how the thermodynamic structure is invariant in a multiscale stochastic system. That is, whether the relations between thermodynamic functions of state and process variables remain unchanged when the system is viewed at different time scales and resolutions. Our results show that the dynamics on a fast time scale contribute an entropic term to the "internal energy function", $u_S(x)$, for the slow dynamics. Based on the conditional free energy $u_S(x)$, one can then treat the slow dynamics as if the fast dynamics is nonexistent. Furthermore, we show that the free energy, which characterizes the spontaneous organization in a system without detailed balance, is invariant with or without the fast dynamics: The fast dynamics is assumed to reach stationarity instantaneously on the slow time scale; they have no effect on the system's free energy. The same can not be said for the entropy and the internal energy, both of which contain the same contribution from the fast dynamics. We also investigate the consequences of time-scale separation in connection to the concepts of quasi-stationaryty and steady-adiabaticity introduced in the phenomenological steady-state thermodynamics.
△ Less
Submitted 27 May, 2011; v1 submitted 18 March, 2010;
originally announced March 2010.
-
Statistical Thermodynamics of General Minimal Diffusion Processes: Constuction, Invariant Density, Reversibility and Entropy Production
Authors:
Hong Qian,
Min Qian,
Xiang Tang
Abstract:
The solution to nonlinear Fokker-Planck equation is constructed in terms of the minimal Markov semigroup generated by the equation. The semigroup is obtained by a purely functional analytical method via Hille-Yosida theorem. The existence of the positive invariant measure with density is established and a weak form of Foguel alternative proven. We show the equivalence among self-adjoint of the e…
▽ More
The solution to nonlinear Fokker-Planck equation is constructed in terms of the minimal Markov semigroup generated by the equation. The semigroup is obtained by a purely functional analytical method via Hille-Yosida theorem. The existence of the positive invariant measure with density is established and a weak form of Foguel alternative proven. We show the equivalence among self-adjoint of the elliptic operator, time-reversibility, and zero entropy production rate of the stationary diffusion process. A thermodynamic theory for diffusion processes emerges.
△ Less
Submitted 31 December, 2001;
originally announced January 2002.
-
Relative Entropy: Free Energy Associated with Equilibrium Fluctuations and Nonequilibrium Deviations
Authors:
Hong Qian
Abstract:
Using a one-dimensional macromolecule in aqueous solution as an illustration, we demonstrate that the relative entropy from information theory, $\sum_k p_k\ln(p_k/p_k^*)$, has a natural role in the energetics of equilibrium and nonequilibrium conformational fluctuations of the single molecule. It is identified as the free energy difference associated with a fluctuating density in equilibrium, an…
▽ More
Using a one-dimensional macromolecule in aqueous solution as an illustration, we demonstrate that the relative entropy from information theory, $\sum_k p_k\ln(p_k/p_k^*)$, has a natural role in the energetics of equilibrium and nonequilibrium conformational fluctuations of the single molecule. It is identified as the free energy difference associated with a fluctuating density in equilibrium, and is associated with the distribution deviate from the equilibrium in nonequilibrium relaxation. This result can be generalized to any other isothermal macromolecular systems using the mathematical theories of large deviations and Markov processes, and at the same time provides the well-known mathematical results with an interesting physical interpretations.
△ Less
Submitted 7 February, 2001; v1 submitted 8 July, 2000;
originally announced July 2000.
-
Mathematical Formalism for Isothermal Linear Irreversibility
Authors:
Hong Qian
Abstract:
We prove the equivalence among symmetricity, time reversibility, and zero entropy production of the stationary solutions of linear stochastic differential equations. A sufficient and necessary reversibility condition expressed in terms of the coefficients of the equations is given. The existence of a linear stationary irreversible process is established. Concerning reversibility, we show that th…
▽ More
We prove the equivalence among symmetricity, time reversibility, and zero entropy production of the stationary solutions of linear stochastic differential equations. A sufficient and necessary reversibility condition expressed in terms of the coefficients of the equations is given. The existence of a linear stationary irreversible process is established. Concerning reversibility, we show that there is a contradistinction between any 1-dimensional stationary Gaussian process and stationary Gaussian process of dimension $n>1$. A concrete criterion for differentiating stationarity and swee** behavior is also obtained. The mathematical result is a natural generalization of Einstein's fluctuation-dissipation relation, and provides a rigorous basis for the isothermal irreversibility in a linear regime which is the basis for applying Onsager's theory to macromolecules in aqueous solution.
△ Less
Submitted 26 June, 2001; v1 submitted 8 July, 2000;
originally announced July 2000.
