Showing 1–36 of 36 results for author: Crooks, G E

Thermodynamic Linear Algebra

Authors: Maxwell Aifer, Kaelan Donatella, Max Hunter Gordon, Samuel Duffield, Thomas Ahle, Daniel Simpson, Gavin E. Crooks, Patrick J. Coles

Abstract: Linear algebraic primitives are at the core of many modern algorithms in engineering, science, and machine learning. Hence, accelerating these primitives with novel computing hardware would have tremendous economic impact. Quantum computing has been proposed for this purpose, although the resource requirements are far beyond current technological capabilities, so this approach remains long-term in… ▽ More Linear algebraic primitives are at the core of many modern algorithms in engineering, science, and machine learning. Hence, accelerating these primitives with novel computing hardware would have tremendous economic impact. Quantum computing has been proposed for this purpose, although the resource requirements are far beyond current technological capabilities, so this approach remains long-term in timescale. Here we consider an alternative physics-based computing paradigm based on classical thermodynamics, to provide a near-term approach to accelerating linear algebra. At first sight, thermodynamics and linear algebra seem to be unrelated fields. In this work, we connect solving linear algebra problems to sampling from the thermodynamic equilibrium distribution of a system of coupled harmonic oscillators. We present simple thermodynamic algorithms for (1) solving linear systems of equations, (2) computing matrix inverses, (3) computing matrix determinants, and (4) solving Lyapunov equations. Under reasonable assumptions, we rigorously establish asymptotic speedups for our algorithms, relative to digital methods, that scale linearly in matrix dimension. Our algorithms exploit thermodynamic principles like ergodicity, entropy, and equilibration, highlighting the deep connection between these two seemingly distinct fields, and opening up algebraic applications for thermodynamic computing hardware. △ Less

Submitted 10 June, 2024; v1 submitted 10 August, 2023; originally announced August 2023.

Comments: 15+22 pages, 6 figures

Measuring Analytic Gradients of General Quantum Evolution with the Stochastic Parameter Shift Rule

Authors: Leonardo Banchi, Gavin E. Crooks

Abstract: Hybrid quantum-classical optimization algorithms represent one of the most promising application for near-term quantum computers. In these algorithms the goal is to optimize an observable quantity with respect to some classical parameters, using feedback from measurements performed on the quantum device. Here we study the problem of estimating the gradient of the function to be optimized directly… ▽ More Hybrid quantum-classical optimization algorithms represent one of the most promising application for near-term quantum computers. In these algorithms the goal is to optimize an observable quantity with respect to some classical parameters, using feedback from measurements performed on the quantum device. Here we study the problem of estimating the gradient of the function to be optimized directly from quantum measurements, generalizing and simplifying some approaches present in the literature, such as the so-called parameter-shift rule. We derive a mathematically exact formula that provides a stochastic algorithm for estimating the gradient of any multi-qubit parametric quantum evolution, without the introduction of ancillary qubits or the use of Hamiltonian simulation techniques. The gradient measurement is possible when the underlying device can realize all Pauli rotations in the expansion of the Hamiltonian whose coefficients depend on the parameter. Our algorithm continues to work, although with some approximations, even when all the available quantum gates are noisy, for instance due to the coupling between the quantum device and an unknown environment. △ Less

Submitted 19 January, 2021; v1 submitted 20 May, 2020; originally announced May 2020.

Comments: 14 pages, 8 figures

Journal ref: Quantum 5, 386 (2021)

Gradients of parameterized quantum gates using the parameter-shift rule and gate decomposition

Authors: Gavin E. Crooks

Abstract: The parameter-shift rule is an approach to measuring gradients of quantum circuits with respect to their parameters, which does not require ancilla qubits or controlled operations. Here, I discuss applying this approach to a wider range of parameterize quantum gates by decomposing gates into a product of standard gates, each of which is parameter-shift rule differentiable. The parameter-shift rule is an approach to measuring gradients of quantum circuits with respect to their parameters, which does not require ancilla qubits or controlled operations. Here, I discuss applying this approach to a wider range of parameterize quantum gates by decomposing gates into a product of standard gates, each of which is parameter-shift rule differentiable. △ Less

Submitted 30 May, 2019; originally announced May 2019.

Fixed-Depth Two-Qubit Circuits and the Monodromy Polytope

Authors: Eric C. Peterson, Gavin E. Crooks, Robert S. Smith

Abstract: For a native gate set which includes all single-qubit gates, we apply results from symplectic geometry to analyze the spaces of two-qubit programs accessible within a fixed number of gates. These techniques yield an explicit description of this subspace as a convex polytope, presented by a family of linear inequalities themselves accessible via a finite calculation. We completely describe this fam… ▽ More For a native gate set which includes all single-qubit gates, we apply results from symplectic geometry to analyze the spaces of two-qubit programs accessible within a fixed number of gates. These techniques yield an explicit description of this subspace as a convex polytope, presented by a family of linear inequalities themselves accessible via a finite calculation. We completely describe this family of inequalities in a variety of familiar example cases, and as a consequence we highlight a certain member of the "XY-family" for which this subspace is particularly large, i.e., for which many two-qubit programs admit expression as low-depth circuits. △ Less

Submitted 8 November, 2021; v1 submitted 23 April, 2019; originally announced April 2019.

Comments: Updated after initial publication to fix increasing/decreasing conventions and an incorrect Figure 6

MSC Class: 81P68; 53D20

Journal ref: Quantum 4, 247 (2020)

Performance of the Quantum Approximate Optimization Algorithm on the Maximum Cut Problem

Authors: Gavin E. Crooks

Abstract: The Quantum Approximate Optimization Algorithm (QAOA) is a promising approach for programming a near-term gate-based hybrid quantum computer to find good approximate solutions of hard combinatorial problems. However, little is currently know about the capabilities of QAOA, or of the difficulty of the requisite parameters optimization. Here, we study the performance of QAOA on the MaxCut combinator… ▽ More The Quantum Approximate Optimization Algorithm (QAOA) is a promising approach for programming a near-term gate-based hybrid quantum computer to find good approximate solutions of hard combinatorial problems. However, little is currently know about the capabilities of QAOA, or of the difficulty of the requisite parameters optimization. Here, we study the performance of QAOA on the MaxCut combinatorial optimization problem, optimizing the quantum circuits on a classical computer using automatic differentiation and stochastic gradient descent, using QuantumFlow, a quantum circuit simulator implemented with TensorFlow. We find that we can amortize the training cost by optimizing on batches of problems instances; that QAOA can exceed the performance of the classical polynomial time Goemans-Williamson algorithm with modest circuit depth, and that performance with fixed circuit depth is insensitive to problem size. Moreover, MaxCut QAOA can be efficiently implemented on a gate-based quantum computer with limited qubit connectivity, using a qubit swap network. These observations support the prospects that QAOA will be an effective method for solving interesting problems on near-term quantum computers. △ Less

Submitted 20 November, 2018; originally announced November 2018.

Comparison of the roughness scaling of the surface topography of Earth and Venus

Authors: G. E. Crooks, Y. Bar-Yam, S. V. Buldyrev, H. E. Stanley

Abstract: We report the scaling behavior of the Earth and Venus over a wider range of length scales than reported by previous researchers. All landscapes (not only mountains) together follow a consistent scaling behavior, demonstrating a crossover between highly correlated (smooth) behavior at short length scales (with a scaling exponent $α$=1) and self-affine behavior at long length scales ($α$=0.4). The s… ▽ More We report the scaling behavior of the Earth and Venus over a wider range of length scales than reported by previous researchers. All landscapes (not only mountains) together follow a consistent scaling behavior, demonstrating a crossover between highly correlated (smooth) behavior at short length scales (with a scaling exponent $α$=1) and self-affine behavior at long length scales ($α$=0.4). The self-affine behavior at long scales is achieved on Earth above 10 km and on Venus above 50 km. △ Less

Submitted 7 September, 2018; originally announced September 2018.

Comments: 8 pages, 3 figures

Quantum Kitchen Sinks: An algorithm for machine learning on near-term quantum computers

Authors: C. M. Wilson, J. S. Otterbach, N. Tezak, R. S. Smith, A. M. Polloreno, Peter J. Karalekas, S. Heidel, M. Sohaib Alam, G. E. Crooks, M. P. da Silva

Abstract: Noisy intermediate-scale quantum computing devices are an exciting platform for the exploration of the power of near-term quantum applications. Performing nontrivial tasks in such devices requires a fundamentally different approach than what would be used on an error-corrected quantum computer. One such approach is to use hybrid algorithms, where problems are reduced to a parameterized quantum cir… ▽ More Noisy intermediate-scale quantum computing devices are an exciting platform for the exploration of the power of near-term quantum applications. Performing nontrivial tasks in such devices requires a fundamentally different approach than what would be used on an error-corrected quantum computer. One such approach is to use hybrid algorithms, where problems are reduced to a parameterized quantum circuit that is often optimized in a classical feedback loop. Here we describe one such hybrid algorithm for machine learning tasks by building upon the classical algorithm known as random kitchen sinks. Our technique, called quantum kitchen sinks, uses quantum circuits to nonlinearly transform classical inputs into features that can then be used in a number of machine learning algorithms. We demonstrate the power and flexibility of this proposal by using it to solve binary classification problems for synthetic datasets as well as handwritten digits from the MNIST database. Using the Rigetti quantum virtual machine, we show that small quantum circuits provide significant performance lift over standard linear classical algorithms, reducing classification error rates from 50% to $<0.1\%$, and from $4.1\%$ to $1.4\%$ in these two examples, respectively. Further, we are able to run the MNIST classification problem, using full-sized MNIST images, on a Rigetti quantum processing unit, finding a modest performance lift over the linear baseline. △ Less

Submitted 20 November, 2019; v1 submitted 21 June, 2018; originally announced June 2018.

Comments: 8 pages, 5 figures; v2: Added experimental results and new authors related to experimental effort

Marginal and Conditional Second Laws of Thermodynamics

Authors: Gavin E. Crooks, Susanne E. Still

Abstract: We consider the entropy production of a strongly coupled bipartite system. The total entropy production can be partitioned into various components, which we use to define local versions of the Second Law that are valid without the usual idealization of weak coupling. The key insight is that causal intervention offers a way to identify those parts of the entropy production that result from feedback… ▽ More We consider the entropy production of a strongly coupled bipartite system. The total entropy production can be partitioned into various components, which we use to define local versions of the Second Law that are valid without the usual idealization of weak coupling. The key insight is that causal intervention offers a way to identify those parts of the entropy production that result from feedback between the sub-systems. From this the central relations describing the thermodynamics of strongly coupled systems follow in a few lines. △ Less

Submitted 2 June, 2018; v1 submitted 14 November, 2016; originally announced November 2016.

Journal ref: EPL 125 40005 (2019)

Thermodynamic geometry of minimum-dissipation driven barrier crossing

Authors: David A. Sivak, Gavin E. Crooks

Abstract: We explore the thermodynamic geometry of a simple system that models the bistable dynamics of nucleic acid hairpins in single molecule force-extension experiments. Near equilibrium, optimal (minimum-dissipation) driving protocols are governed by a generalized linear response friction coefficient. Our analysis and simulations demonstrate that the friction coefficient of the driving protocols is sha… ▽ More We explore the thermodynamic geometry of a simple system that models the bistable dynamics of nucleic acid hairpins in single molecule force-extension experiments. Near equilibrium, optimal (minimum-dissipation) driving protocols are governed by a generalized linear response friction coefficient. Our analysis and simulations demonstrate that the friction coefficient of the driving protocols is sharply peaked at the interface between metastable regions, which leads to minimum-dissipation protocols that drive rapidly within a metastable basin, but then linger longest at the interface, giving thermal fluctuations maximal time to kick the system over the barrier. Intuitively, the same principle applies generically in free energy estimation (both in steered molecular dynamics simulations and in single-molecule experiments), provides a design principle for the construction of thermodynamically efficient coupling between stochastic objects, and makes a prediction regarding the construction of evolved biomolecular motors. △ Less

Submitted 3 November, 2016; v1 submitted 15 August, 2016; originally announced August 2016.

Comments: 8 pages, 8 figures

Journal ref: Physical Review E 94, 052106 (2016)

A geometric approach to optimal nonequilibrium control: Minimizing dissipation in nanomagnetic spin systems

Authors: Grant M. Rotskoff, Gavin E. Crooks, Eric Vanden-Eijnden

Abstract: Optimal control of nanomagnets has become an urgent problem for the field of spintronics as technological tools approach thermodynamically determined limits of efficiency. In complex, fluctuating systems, like nanomagnetic bits, finding optimal protocols is challenging, requiring detailed information about the dynamical fluctuations of the controlled system. We provide a new, physically transparen… ▽ More Optimal control of nanomagnets has become an urgent problem for the field of spintronics as technological tools approach thermodynamically determined limits of efficiency. In complex, fluctuating systems, like nanomagnetic bits, finding optimal protocols is challenging, requiring detailed information about the dynamical fluctuations of the controlled system. We provide a new, physically transparent derivation of a metric tensor for which the length of a protocol is proportional to its dissipation. This perspective simplifies nonequilibrium optimization problems by recasting them in a geometric language. We then describe a numerical method, an instance of geometric minimum action methods, that enables computation of geodesics even when the number of control parameters is large. We apply these methods to two models of nanomagnetic bits: a simple Landau-Lifshitz-Gilbert description of a single magnetic spin controlled by two orthogonal magnetic fields and a two dimensional Ising model in which the field is spatially controlled. These calculations reveal nontrivial protocols for bit erasure and reversal, providing important, experimentally testable predictions for ultra-low power computing. △ Less

Submitted 25 July, 2016; originally announced July 2016.

Comments: 9 pages, 2 figures

Journal ref: Phys. Rev. E 95, 012148 (2017)

Near-optimal protocols in complex nonequilibrium transformations

Authors: Todd R. Gingrich, Grant M. Rotskoff, Gavin E. Crooks, Phillip L. Geissler

Abstract: The development of sophisticated experimental means to control nanoscale systems has motivated efforts to design driving protocols which minimize the energy dissipated to the environment. Computational models are a crucial tool in this practical challenge. We describe a general method for sampling an ensemble of finite-time, nonequilibrium protocols biased towards a low average dissipation. We sho… ▽ More The development of sophisticated experimental means to control nanoscale systems has motivated efforts to design driving protocols which minimize the energy dissipated to the environment. Computational models are a crucial tool in this practical challenge. We describe a general method for sampling an ensemble of finite-time, nonequilibrium protocols biased towards a low average dissipation. We show that this scheme can be carried out very efficiently in several limiting cases. As an application, we sample the ensemble of low-dissipation protocols that invert the magnetization of a 2D Ising model and explore how the diversity of the protocols varies in response to constraints on the average dissipation. In this example, we find that there is a large set of protocols with average dissipation close to the optimal value, which we argue is a general phenomenon. △ Less

Submitted 2 September, 2016; v1 submitted 3 February, 2016; originally announced February 2016.

Comments: 6 pages and 3 figures plus 4 pages and 5 figures of supplemental material

Journal ref: Proc. Natl. Acad. Sci. USA 113(37), 10263 (2016)

Dynamic Riemannian Geometry of the Ising Model

Authors: Grant M. Rotskoff, Gavin E. Crooks

Abstract: A general understanding of optimal control in non-equilibrium systems would illuminate the operational principles of biological and artificial nanoscale machines. Recent work has shown that a system driven out of equilibrium by a linear response protocol is endowed with a Riemannian metric related to generalized susceptibilities, and that geodesics on this manifold are the non-equilibrium control… ▽ More A general understanding of optimal control in non-equilibrium systems would illuminate the operational principles of biological and artificial nanoscale machines. Recent work has shown that a system driven out of equilibrium by a linear response protocol is endowed with a Riemannian metric related to generalized susceptibilities, and that geodesics on this manifold are the non-equilibrium control protocols with the lowest achievable dissipation. While this elegant mathematical framework has inspired numerous studies of exactly solvable systems, no description of the thermodynamic geometry yet exists when the metric cannot be derived analytically. Herein, we numerically construct the dynamic metric of the 2D Ising model in order to study optimal protocols for reversing the net magnetization. △ Less

Submitted 22 October, 2015; originally announced October 2015.

Comments: 5 pages, 3 figures

Journal ref: Phys. Rev. E 92, 060102 (2015)

Scaling laws governing stochastic growth and division of single bacterial cells

Authors: Srividya Iyer-Biswas, Charles S. Wright, Jonathan T. Henry, Klevin Lo, Stanislav Burov, Yihan Lin, Gavin E. Crooks, Sean Crosson, Aaron R. Dinner, Norbert F. Scherer

Abstract: Uncovering the quantitative laws that govern the growth and division of single cells remains a major challenge. Using a unique combination of technologies that yields unprecedented statistical precision, we find that the sizes of individual Caulobacter crescentus cells increase exponentially in time. We also establish that they divide upon reaching a critical multiple ($\approx$1.8) of their initi… ▽ More Uncovering the quantitative laws that govern the growth and division of single cells remains a major challenge. Using a unique combination of technologies that yields unprecedented statistical precision, we find that the sizes of individual Caulobacter crescentus cells increase exponentially in time. We also establish that they divide upon reaching a critical multiple ($\approx$1.8) of their initial sizes, rather than an absolute size. We show that when the temperature is varied, the growth and division timescales scale proportionally with each other over the physiological temperature range. Strikingly, the cell-size and division-time distributions can both be rescaled by their mean values such that the condition-specific distributions collapse to universal curves. We account for these observations with a minimal stochastic model that is based on an autocatalytic cycle. It predicts the scalings, as well as specific functional forms for the universal curves. Our experimental and theoretical analysis reveals a simple physical principle governing these complex biological processes: a single temperature-dependent scale of cellular time governs the stochastic dynamics of growth and division in balanced growth conditions. △ Less

Submitted 29 September, 2014; v1 submitted 24 September, 2014; originally announced September 2014.

Comments: Text+Supplementary

Universality in stochastic exponential growth

Authors: Srividya Iyer-Biswas, Gavin E. Crooks, Norbert F. Scherer, Aaron R. Dinner

Abstract: Recent imaging data for single bacterial cells reveal that their mean sizes grow exponentially in time and that their size distributions collapse to a single curve when rescaled by their means. An analogous result holds for the division-time distributions. A model is needed to delineate the minimal requirements for these scaling behaviors. We formulate a microscopic theory of stochastic exponentia… ▽ More Recent imaging data for single bacterial cells reveal that their mean sizes grow exponentially in time and that their size distributions collapse to a single curve when rescaled by their means. An analogous result holds for the division-time distributions. A model is needed to delineate the minimal requirements for these scaling behaviors. We formulate a microscopic theory of stochastic exponential growth as a Master Equation that accounts for these observations, in contrast to existing quantitative models of stochastic exponential growth (e.g., the Black-Scholes equation or geometric Brownian motion). Our model, the stochastic Hinshelwood cycle (SHC), is an autocatalytic reaction cycle in which each molecular species catalyzes the production of the next. By finding exact analytical solutions to the SHC and the corresponding first passage time problem, we uncover universal signatures of fluctuations in exponential growth and division. The model makes minimal assumptions, and we describe how more complex reaction networks can reduce to such a cycle. We thus expect similar scalings to be discovered in stochastic processes resulting in exponential growth that appear in diverse contexts such as cosmology, finance, technology, and population growth. △ Less

Submitted 10 July, 2014; originally announced July 2014.

Comments: Text+Supplementary

Journal ref: Phys. Rev. Lett., 2014, 113, 028101

Time step rescaling recovers continuous-time dynamical properties for discrete-time Langevin integration of nonequilibrium systems

Authors: David A. Sivak, John D. Chodera, Gavin E. Crooks

Abstract: When simulating molecular systems using deterministic equations of motion (e.g., Newtonian dynamics), such equations are generally numerically integrated according to a well-developed set of algorithms that share commonly agreed-upon desirable properties. However, for stochastic equations of motion (e.g., Langevin dynamics), there is still broad disagreement over which integration algorithms are m… ▽ More When simulating molecular systems using deterministic equations of motion (e.g., Newtonian dynamics), such equations are generally numerically integrated according to a well-developed set of algorithms that share commonly agreed-upon desirable properties. However, for stochastic equations of motion (e.g., Langevin dynamics), there is still broad disagreement over which integration algorithms are most appropriate. While multiple desiderata have been proposed throughout the literature, consensus on which criteria are important is absent, and no published integration scheme satisfies all desiderata simultaneously. Additional nontrivial complications stem from simulating systems driven out of equilibrium using existing stochastic integration schemes in conjunction with recently-developed nonequilibrium fluctuation theorems. Here, we examine a family of discrete time integration schemes for Langevin dynamics, assessing how each member satisfies a variety of desiderata that have been enumerated in prior efforts to construct suitable Langevin integrators. We show that the incorporation of a novel time step rescaling in the deterministic updates of position and velocity can correct a number of dynamical defects in these integrators. Finally, we identify a particular splitting that has essentially universally appropriate properties for the simulation of Langevin dynamics for molecular systems in equilibrium, nonequilibrium, and path sampling contexts. △ Less

Submitted 9 April, 2014; v1 submitted 16 January, 2013; originally announced January 2013.

Comments: 15 pages, 2 figures, and 2 tables

Journal ref: J. Phys. Chem. B, 118, 6466-6474, 2014

The geometry of thermodynamic control

Authors: Patrick R. Zulkowski, David A. Sivak, Gavin E. Crooks, Michael R. DeWeese

Abstract: A deeper understanding of nonequilibrium phenomena is needed to reveal the principles governing natural and synthetic molecular machines. Recent work has shown that when a thermodynamic system is driven from equilibrium then, in the linear response regime, the space of controllable parameters has a Riemannian geometry induced by a generalized friction tensor. We exploit this geometric insight to c… ▽ More A deeper understanding of nonequilibrium phenomena is needed to reveal the principles governing natural and synthetic molecular machines. Recent work has shown that when a thermodynamic system is driven from equilibrium then, in the linear response regime, the space of controllable parameters has a Riemannian geometry induced by a generalized friction tensor. We exploit this geometric insight to construct closed-form expressions for minimal-dissipation protocols for a particle diffusing in a one dimensional harmonic potential, where the spring constant, inverse temperature, and trap location are adjusted simultaneously. These optimal protocols are geodesics on the Riemannian manifold, and reveal that this simple model has a surprisingly rich geometry. We test these optimal protocols via a numerical implementation of the Fokker-Planck equation and demonstrate that the friction tensor arises naturally from a first order expansion in temporal derivatives of the control parameters, without appealing directly to linear response theory. △ Less

Submitted 9 October, 2012; v1 submitted 22 August, 2012; originally announced August 2012.

Journal ref: Phys. Rev. E. 86, 0141148, 2012

The thermodynamics of prediction

Authors: Susanne Still, David A. Sivak, Anthony J. Bell, Gavin E. Crooks

Abstract: A system responding to a stochastic driving signal can be interpreted as computing, by means of its dynamics, an implicit model of the environmental variables. The system's state retains information about past environmental fluctuations, and a fraction of this information is predictive of future ones. The remaining nonpredictive information reflects model complexity that does not improve predictiv… ▽ More A system responding to a stochastic driving signal can be interpreted as computing, by means of its dynamics, an implicit model of the environmental variables. The system's state retains information about past environmental fluctuations, and a fraction of this information is predictive of future ones. The remaining nonpredictive information reflects model complexity that does not improve predictive power, and thus represents the ineffectiveness of the model. We expose the fundamental equivalence between this model inefficiency and thermodynamic inefficiency, measured by dissipation. Our results hold arbitrarily far from thermodynamic equilibrium and are applicable to a wide range of systems, including biomolecular machines. They highlight a profound connection between the effective use of information and efficient thermodynamic operation: any system constructed to keep memory about its environment and to operate with maximal energetic efficiency has to be predictive. △ Less

Submitted 5 October, 2012; v1 submitted 15 March, 2012; originally announced March 2012.

Comments: 5 pages, 1 figure

Journal ref: Phys. Rev. Lett. 109, 120604 (2012)

Thermodynamic metrics and optimal paths

Authors: David A. Sivak, Gavin E. Crooks

Abstract: A fundamental problem in modern thermodynamics is how a molecular-scale machine performs useful work, while operating away from thermal equilibrium without excessive dissipation. To this end, we derive a friction tensor that induces a Riemannian manifold on the space of thermodynamic states. Within the linear-response regime, this metric structure controls the dissipation of finite-time transforma… ▽ More A fundamental problem in modern thermodynamics is how a molecular-scale machine performs useful work, while operating away from thermal equilibrium without excessive dissipation. To this end, we derive a friction tensor that induces a Riemannian manifold on the space of thermodynamic states. Within the linear-response regime, this metric structure controls the dissipation of finite-time transformations, and bestows optimal protocols with many useful properties. We discuss the connection to the existing thermodynamic length formalism, and demonstrate the utility of this metric by solving for optimal control parameter protocols in a simple nonequilibrium model. △ Less

Submitted 8 May, 2012; v1 submitted 19 January, 2012; originally announced January 2012.

Comments: 5 pages

Journal ref: Phys. Rev. Lett., 108, 190602, 2012

Using nonequilibrium fluctuation theorems to understand and correct errors in equilibrium and nonequilibrium discrete Langevin dynamics simulations

Authors: David A. Sivak, John D. Chodera, Gavin E. Crooks

Abstract: Common algorithms for computationally simulating Langevin dynamics must discretize the stochastic differential equations of motion. These resulting finite time step integrators necessarily have several practical issues in common: Microscopic reversibility is violated, the sampled stationary distribution differs from the desired equilibrium distribution, and the work accumulated in nonequilibrium s… ▽ More Common algorithms for computationally simulating Langevin dynamics must discretize the stochastic differential equations of motion. These resulting finite time step integrators necessarily have several practical issues in common: Microscopic reversibility is violated, the sampled stationary distribution differs from the desired equilibrium distribution, and the work accumulated in nonequilibrium simulations is not directly usable in estimators based on nonequilibrium work theorems. Here, we show that even with a time-independent Hamiltonian, finite time step Langevin integrators can be thought of as a driven, nonequilibrium physical process. Once an appropriate work-like quantity is defined -- here called the shadow work -- recently developed nonequilibrium fluctuation theorems can be used to measure or correct for the errors introduced by the use of finite time steps. In particular, we demonstrate that amending estimators based on nonequilibrium work theorems to include this shadow work removes the time step dependent error from estimates of free energies. We also quantify, for the first time, the magnitude of deviations between the sampled stationary distribution and the desired equilibrium distribution for equilibrium Langevin simulations of solvated systems of varying size. While these deviations can be large, they can be eliminated altogether by Metropolization or greatly diminished by small reductions in the time step. Through this connection with driven processes, further developments in nonequilibrium fluctuation theorems can provide additional analytical tools for dealing with errors in finite time step integrators. △ Less

Submitted 29 January, 2013; v1 submitted 14 July, 2011; originally announced July 2011.

Comments: 11 pages, 4 figures

Journal ref: Phys. Rev. X, 3, 011007, 2013

Nonequilibrium candidate Monte Carlo: A new tool for efficient equilibrium simulation

Authors: Jerome P. Nilmeier, Gavin E. Crooks, David D. L. Minh, John D. Chodera

Abstract: Metropolis Monte Carlo simulation is a powerful tool for studying the equilibrium properties of matter. In complex condensed-phase systems, however, it is difficult to design Monte Carlo moves with high acceptance probabilities that also rapidly sample uncorrelated configurations. Here, we introduce a new class of moves based on nonequilibrium dynamics: candidate configurations are generated throu… ▽ More Metropolis Monte Carlo simulation is a powerful tool for studying the equilibrium properties of matter. In complex condensed-phase systems, however, it is difficult to design Monte Carlo moves with high acceptance probabilities that also rapidly sample uncorrelated configurations. Here, we introduce a new class of moves based on nonequilibrium dynamics: candidate configurations are generated through a finite-time process in which a system is actively driven out of equilibrium, and accepted with criteria that preserve the equilibrium distribution. The acceptance rule is similar to the Metropolis acceptance probability, but related to the nonequilibrium work rather than the instantaneous energy difference. Our method is applicable to sampling from both a single thermodynamic state or a mixture of thermodynamic states, and allows both coordinates and thermodynamic parameters to be driven in nonequilibrium proposals. While generating finite-time switching trajectories incurs an additional cost, driving some degrees of freedom while allowing others to evolve naturally can lead to large enhancements in acceptance probabilities, greatly reducing structural correlation times. Using nonequilibrium driven processes vastly expands the repertoire of useful Monte Carlo proposals in simulations of dense solvated systems. △ Less

Submitted 20 October, 2011; v1 submitted 11 May, 2011; originally announced May 2011.

Journal ref: PNAS 108 E1009-E1018 (2011)

The Amoroso Distribution

Authors: Gavin E. Crooks

Abstract: Herein, we review the properties of the Amoroso distribution, the natural unification of the gamma and extreme value distribution families. Over 50 distinct, named distributions (and twice as many synonyms) occur as special cases or limiting forms. Consequently, this single simple functional form encapsulates and systematizes an extensive menagerie of interesting and common probability distributio… ▽ More Herein, we review the properties of the Amoroso distribution, the natural unification of the gamma and extreme value distribution families. Over 50 distinct, named distributions (and twice as many synonyms) occur as special cases or limiting forms. Consequently, this single simple functional form encapsulates and systematizes an extensive menagerie of interesting and common probability distributions. △ Less

Submitted 13 July, 2015; v1 submitted 18 May, 2010; originally announced May 2010.

Comments: v2 minor corrections

MSC Class: 60E05

Near-equilibrium measurements of nonequilibrium free energy

Authors: David A. Sivak, Gavin E. Crooks

Abstract: A central endeavor of thermodynamics is the measurement of free energy changes. Regrettably, although we can measure the free energy of a system in thermodynamic equilibrium, typically all we can say about the free energy of a non-equilibrium ensemble is that it is larger than that of the same system at equilibrium. Herein, we derive a formally exact expression for the probability distribution of… ▽ More A central endeavor of thermodynamics is the measurement of free energy changes. Regrettably, although we can measure the free energy of a system in thermodynamic equilibrium, typically all we can say about the free energy of a non-equilibrium ensemble is that it is larger than that of the same system at equilibrium. Herein, we derive a formally exact expression for the probability distribution of a driven system, which involves path ensemble averages of the work over trajectories of the time-reversed system. From this we find a simple near-equilibrium approximation for the free energy in terms of an excess mean time-reversed work, which can be experimentally measured on real systems. With analysis and computer simulation, we demonstrate the accuracy of our approximations for several simple models. △ Less

Submitted 9 April, 2012; v1 submitted 14 December, 2009; originally announced December 2009.

Comments: 5 pages, 3 figures

Journal ref: Physical Review Letters, 108, 150601, 2012

The length of time's arrow

Authors: Edward H. Feng, Gavin E. Crooks

Abstract: An unresolved problem in physics is how the thermodynamic arrow of time arises from an underlying time reversible dynamics. We contribute to this issue by develo** a measure of time-symmetry breaking, and by using the work fluctuation relations, we determine the time asymmetry of recent single molecule RNA unfolding experiments. We define time asymmetry as the Jensen-Shannon divergence between… ▽ More An unresolved problem in physics is how the thermodynamic arrow of time arises from an underlying time reversible dynamics. We contribute to this issue by develo** a measure of time-symmetry breaking, and by using the work fluctuation relations, we determine the time asymmetry of recent single molecule RNA unfolding experiments. We define time asymmetry as the Jensen-Shannon divergence between trajectory probability distributions of an experiment and its time-reversed conjugate. Among other interesting properties, the length of time's arrow bounds the average dissipation and determines the difficulty of accurately estimating free energy differences in nonequilibrium experiments. △ Less

Submitted 29 August, 2008; originally announced September 2008.

Journal ref: Phys.Rev.Lett.101:090602,2008

Far-from-Equilibrium Measurements of Thermodynamic Length

Authors: Edward H. Feng, Gavin E. Crooks

Abstract: Thermodynamic length is a path function that generalizes the notion of length to the surface of thermodynamic states. Here, we show how to measure thermodynamic length in far-from-equilibrium single molecule experiments using the work fluctuation relations. For these microscopic systems, it proves necessary to define the thermodynamic length in terms of the Fisher information. Consequently, the… ▽ More Thermodynamic length is a path function that generalizes the notion of length to the surface of thermodynamic states. Here, we show how to measure thermodynamic length in far-from-equilibrium single molecule experiments using the work fluctuation relations. For these microscopic systems, it proves necessary to define the thermodynamic length in terms of the Fisher information. Consequently, the thermodynamic length can be directly related to the magnitude of fluctuations about equilibrium. The work fluctuation relations link the work and the free energy change during an external perturbation on a system. We use this result to determine equilibrium averages at intermediate points of the protocol in which the system is out-of-equilibrium. This allows us to extend Bennett's method to determine the potential of mean force, as well as the thermodynamic length, in single molecule experiments. △ Less

Submitted 3 July, 2008; originally announced July 2008.

Journal ref: Phys. Rev. E 79, 012104 (2009)

Bayesian estimates of free energies from nonequilibrium work data in the presence of instrument noise

Authors: Paul Maragakis, Felix Ritort, Carlos Bustamante, Martin Karplus, Gavin E. Crooks

Abstract: The Jarzynski equality and the fluctuation theorem relate equilibrium free energy differences to non-equilibrium measurements of the work. These relations extend to single-molecule experiments that have probed the finite-time thermodynamics of proteins and nucleic acids. The effects of experimental error and instrument noise have not previously been considered. Here, we present a Bayesian formal… ▽ More The Jarzynski equality and the fluctuation theorem relate equilibrium free energy differences to non-equilibrium measurements of the work. These relations extend to single-molecule experiments that have probed the finite-time thermodynamics of proteins and nucleic acids. The effects of experimental error and instrument noise have not previously been considered. Here, we present a Bayesian formalism for estimating free-energy changes from non-equilibrium work measurements that compensates for instrument noise and combines data from multiple driving protocols. We reanalyze a recent set of experiments in which a single RNA hairpin is unfolded and refolded using optical tweezers at three different rates. Interestingly, the fastest and farthest-from-equilibrium measurements contain the least instrumental noise, and therefore provide a more accurate estimate of the free energies than a few slow, more noisy, near-equilibrium measurements. The methods we propose here will extend the scope of single-molecule experiments; they can be used in the analysis of data from measurements with AFM, optical, and magnetic tweezers. △ Less

Submitted 30 June, 2007; originally announced July 2007.

Comments: 8 pages

Journal ref: J. Chem. Phys. 129, 024102 (2008)

Quantum Operation Time Reversal

Authors: Gavin E. Crooks

Abstract: The dynamics of an open quantum system can be described by a quantum operation, a linear, complete positive map of operators. Here, I exhibit a compact expression for the time reversal of a quantum operation, which is closely analogous to the time reversal of a classical Markov transition matrix. Since open quantum dynamics are stochastic, and not, in general, deterministic, the time reversal is… ▽ More The dynamics of an open quantum system can be described by a quantum operation, a linear, complete positive map of operators. Here, I exhibit a compact expression for the time reversal of a quantum operation, which is closely analogous to the time reversal of a classical Markov transition matrix. Since open quantum dynamics are stochastic, and not, in general, deterministic, the time reversal is not, in general, an inversion of the dynamics. Rather, the system relaxes towards equilibrium in both the forward and reverse time directions. The probability of a quantum trajectory and the conjugate, time reversed trajectory are related by the heat exchanged with the environment. △ Less

Submitted 25 June, 2007; originally announced June 2007.

Comments: 4 pages

Journal ref: Phys. Rev. A 77 034101(4) (2008)

On the Quantum Jarzynski Identity

Authors: Gavin E. Crooks

Abstract: In this note, we will discuss how to compactly express and prove the Jarzynski identity for an open quantum system with dissipative dynamics. We will avoid explicitly measuring the work directly, which is tantamount to continuously monitoring the system, and instead measure the heat flow from the environment. We represent the measurement of heat flow with Hermitian map superoperators that act on… ▽ More In this note, we will discuss how to compactly express and prove the Jarzynski identity for an open quantum system with dissipative dynamics. We will avoid explicitly measuring the work directly, which is tantamount to continuously monitoring the system, and instead measure the heat flow from the environment. We represent the measurement of heat flow with Hermitian map superoperators that act on the system density matrix. Hermitian maps provide a convenient and compact representation of sequential measurement and correlation functions. △ Less

Submitted 13 June, 2007; originally announced June 2007.

Comments: 4 pages

Journal ref: J. Stat. Mech.: Theor. Exp. P10023 (9pp) (2008)

Measuring thermodynamic length

Authors: Gavin E. Crooks

Abstract: Thermodynamic length is a metric distance between equilibrium thermodynamic states. Among other interesting properties, this metric asymptotically bounds the dissipation induced by a finite time transformation of a thermodynamic system. It is also connected to the Jensen-Shannon divergence, Fisher information and Rao's entropy differential metric. Therefore, thermodynamic length is of central in… ▽ More Thermodynamic length is a metric distance between equilibrium thermodynamic states. Among other interesting properties, this metric asymptotically bounds the dissipation induced by a finite time transformation of a thermodynamic system. It is also connected to the Jensen-Shannon divergence, Fisher information and Rao's entropy differential metric. Therefore, thermodynamic length is of central interest in understanding matter out-of-equilibrium. In this paper, we will consider how to define thermodynamic length for a small system described by equilibrium statistical mechanics and how to measure thermodynamic length within a computer simulation. Surprisingly, Bennett's classic acceptance ratio method for measuring free energy differences also measures thermodynamic length. △ Less

Submitted 7 September, 2007; v1 submitted 4 June, 2007; originally announced June 2007.

Comments: 4 pages; Typos corrected

Report number: LBNL-62740

Journal ref: Phys. Rev. Lett. 99 100602 (2007)

Beyond Boltzmann-Gibbs statistics: Maximum entropy hyperensembles out-of-equilibrium

Authors: Gavin E. Crooks

Abstract: What is the best description that we can construct of a thermodynamic system that is not in equilibrium, given only one, or a few, extra parameters over and above those needed for a description of the same system at equilibrium? Here, we argue the most appropriate additional parameter is the non-equilibrium entropy of the system, and that we should not attempt to estimate the probability distrib… ▽ More What is the best description that we can construct of a thermodynamic system that is not in equilibrium, given only one, or a few, extra parameters over and above those needed for a description of the same system at equilibrium? Here, we argue the most appropriate additional parameter is the non-equilibrium entropy of the system, and that we should not attempt to estimate the probability distribution of the system, but rather the metaprobability (or hyperensemble) that the system is described by a particular probability distribution. The result is an entropic distribution with two parameters, one a non-equilibrium temperature, and the other a measure of distance from equilibrium. This dispersion parameter smoothly interpolates between certainty of a canonical distribution at equilibrium and great uncertainty as to the probability distribution as we move away from equilibrium. We deduce that, in general, large, rare fluctuations become far more common as we move away from equilibrium. △ Less

Submitted 6 March, 2006; originally announced March 2006.

Comments: 4 pages

Journal ref: Phys. Rev. E, 75, 041119 (2007

On the work distribution for the adiabatic compression of a dilute classical gas

Authors: Gavin E. Crooks, Christopher Jarzynski

Abstract: We consider the adiabatic and quasi-static compression of a dilute classical gas, confined in a piston and initially equilibrated with a heat bath. We find that the work performed during this process is described statistically by a gamma distribution. We use this result to show that the model satisfies the non-equilibrium work and fluctuation theorems, but not the flucutation-dissipation relatio… ▽ More We consider the adiabatic and quasi-static compression of a dilute classical gas, confined in a piston and initially equilibrated with a heat bath. We find that the work performed during this process is described statistically by a gamma distribution. We use this result to show that the model satisfies the non-equilibrium work and fluctuation theorems, but not the flucutation-dissipation relation. We discuss the rare but dominant realizations that contribute most to the exponential average of the work, and relate our results to potentially universal work distributions. △ Less

Submitted 5 March, 2006; originally announced March 2006.

Comments: 4 pages

Journal ref: Phys. Rev. E 75, 021116 (2007)

Pairwise alignment incorporating dipeptide covariation

Authors: Gavin E. Crooks, Richard E. Green, Steven E. Brenner

Abstract: Motivation: Standard algorithms for pairwise protein sequence alignment make the simplifying assumption that amino acid substitutions at neighboring sites are uncorrelated. This assumption allows implementation of fast algorithms for pairwise sequence alignment, but it ignores information that could conceivably increase the power of remote homolog detection. We examine the validity of this assum… ▽ More Motivation: Standard algorithms for pairwise protein sequence alignment make the simplifying assumption that amino acid substitutions at neighboring sites are uncorrelated. This assumption allows implementation of fast algorithms for pairwise sequence alignment, but it ignores information that could conceivably increase the power of remote homolog detection. We examine the validity of this assumption by constructing extended substitution matrixes that encapsulate the observed correlations between neighboring sites, by develo** an efficient and rigorous algorithm for pairwise protein sequence alignment that incorporates these local substitution correlations, and by assessing the ability of this algorithm to detect remote homologies. Results: Our analysis indicates that local correlations between substitutions are not strong on the average. Furthermore, incorporating local substitution correlations into pairwise alignment did not lead to a statistically significant improvement in remote homology detection. Therefore, the standard assumption that individual residues within protein sequences evolve independently of neighboring positions appears to be an efficient and appropriate approximation. △ Less

Submitted 28 July, 2005; v1 submitted 19 February, 2005; originally announced February 2005.

Journal ref: Bioinformatics 21 3704-3710 (2005)

An Alternative Model of Amino Acid Replacement

Authors: Gavin E. Crooks, Steven E. Brenner

Abstract: The observed correlations between pairs of homologous protein sequences are typically explained in terms of a Markovian dynamic of amino acid substitution. This model assumes that every location on the protein sequence has the same background distribution of amino acids, an assumption that is incompatible with the observed heterogeneity of protein amino acid profiles and with the success of prof… ▽ More The observed correlations between pairs of homologous protein sequences are typically explained in terms of a Markovian dynamic of amino acid substitution. This model assumes that every location on the protein sequence has the same background distribution of amino acids, an assumption that is incompatible with the observed heterogeneity of protein amino acid profiles and with the success of profile multiple sequence alignment. We propose an alternative model of amino acid replacement during protein evolution based upon the assumption that the variation of the amino acid background distribution from one residue to the next is sufficient to explain the observed sequence correlations of homologs. The resulting dynamical model of independent replacements drawn from heterogeneous backgrounds is simple and consistent, and provides a unified homology match score for sequence-sequence, sequence-profile and profile-profile alignment. △ Less

Submitted 25 October, 2004; v1 submitted 23 July, 2004; originally announced July 2004.

Comments: Minor improvements. Added figure and references

Journal ref: Bioinformatics 2005 21(7):975-980

Protein secondary structure: Entropy, correlations and prediction

Authors: Gavin E. Crooks, Steven E. Brenner

Abstract: Is protein secondary structure primarily determined by local interactions between residues closely spaced along the amino acid backbone, or by non-local tertiary interactions? To answer this question we have measured the entropy densities of primary structure and secondary structure sequences, and the local inter-sequence mutual information density. We find that the important inter-sequence inte… ▽ More Is protein secondary structure primarily determined by local interactions between residues closely spaced along the amino acid backbone, or by non-local tertiary interactions? To answer this question we have measured the entropy densities of primary structure and secondary structure sequences, and the local inter-sequence mutual information density. We find that the important inter-sequence interactions are short ranged, that correlations between neighboring amino acids are essentially uninformative, and that only 1/4 of the total information needed to determine the secondary structure is available from local inter-sequence correlations. Since the remaining information must come from non-local interactions, this observation supports the view that the majority of most proteins fold via a cooperative process where secondary and tertiary structure form concurrently. To provide a more direct comparison to existing secondary structure prediction methods, we construct a simple hidden Markov model (HMM) of the sequences. This HMM achieves a prediction accuracy comparable to other single sequence secondary structure prediction algorithms, and can extract almost all of the inter-sequence mutual information. This suggests that these algorithms are almost optimal, and that we should not expect a dramatic improvement in prediction accuracy. However, local correlations between secondary and primary structure are probably of under-appreciated importance in many tertiary structure prediction methods, such as threading. △ Less

Submitted 29 October, 2003; originally announced October 2003.

Comments: 8 pages, 5 figures

Journal ref: Bioinformatics 20:1603-1611 (2004)

Path ensembles averages in systems driven far-from-equilibrium

Authors: Gavin E. Crooks

Abstract: The Kawasaki nonlinear response relation, the transient fluctuation theorem, and the Jarzynski nonequilibrium work relation are all expressions that describe the behavior of a system that has been driven from equilibrium by an external perturbation. In contrast to linear response theory, these expressions are exact no matter the strength of the perturbation, or how far the system has been driven… ▽ More The Kawasaki nonlinear response relation, the transient fluctuation theorem, and the Jarzynski nonequilibrium work relation are all expressions that describe the behavior of a system that has been driven from equilibrium by an external perturbation. In contrast to linear response theory, these expressions are exact no matter the strength of the perturbation, or how far the system has been driven away from equilibrium. In this paper I show that these three relations (and several other closely related results) can all be considered special cases of a single theorem. This expression is explicitly derived for discrete time and space Markovian dynamics, with the additional assumptions that the single time step dynamics preserve the appropriate equilibrium ensemble, and that the energy of the system remains finite. △ Less

Submitted 27 August, 1999; originally announced August 1999.

Comments: 6 pages

Journal ref: Phys. Rev. E 61, 2361 (2000)

The Mesostructure of Polymer Collapse and Fractal Smoothing

Authors: G. E. Crooks, B. Ostrovsky, Y. Bar-Yam

Abstract: We investigate the internal structure of a polymer during collapse from an expanded coil to a compact globule. Collapse is more probable in local regions of high curvature, so a smoothing of the fractal polymer structure occurs that proceeds systematically from the shortest to the longest length scales. A proposed universal scaling relationship is tested by comparison with Monte Carlo simulation… ▽ More We investigate the internal structure of a polymer during collapse from an expanded coil to a compact globule. Collapse is more probable in local regions of high curvature, so a smoothing of the fractal polymer structure occurs that proceeds systematically from the shortest to the longest length scales. A proposed universal scaling relationship is tested by comparison with Monte Carlo simulations. We speculate that the universal form applies to various fractal systems with local processes that promote smoothness over time. The results complement earlier work showing that on the macroscale polymer collapse proceeds by driven diffusion of the polymer ends. △ Less

Submitted 26 May, 1999; originally announced May 1999.

Comments: 5 pages, 4 figures. Accepted to Phys. Rev. E

Journal ref: Phys. Rev. E 60, 4559 (1999)

The Entropy Production Fluctuation Theorem and the Nonequilibrium Work Relation for Free Energy Differences

Authors: Gavin E. Crooks

Abstract: There are only a very few known relations in statistical dynamics that are valid for systems driven arbitrarily far-from-equilibrium. One of these is the fluctuation theorem, which places conditions on the entropy production probability distribution of nonequilibrium systems. Another recently discovered far-from-equilibrium expression relates nonequilibrium measurements of the work done on a sys… ▽ More There are only a very few known relations in statistical dynamics that are valid for systems driven arbitrarily far-from-equilibrium. One of these is the fluctuation theorem, which places conditions on the entropy production probability distribution of nonequilibrium systems. Another recently discovered far-from-equilibrium expression relates nonequilibrium measurements of the work done on a system to equilibrium free energy differences. In this paper, we derive a generalized version of the fluctuation theorem for stochastic, microscopically reversible dynamics. Invoking this generalized theorem provides a succinct proof of the nonequilibrium work relation. △ Less

Submitted 29 July, 1999; v1 submitted 29 January, 1999; originally announced January 1999.

Comments: 6 pages, 5 figures. Typos removed, references added. Includes an expanded introduction

Journal ref: Phys. Rev. E 60, 2721 (1999)