Showing 1–18 of 18 results for author: Boyd, A B

Thermodynamic Overfitting and Generalization: Energetic Limits on Predictive Complexity

Authors: Alexander B. Boyd, James P. Crutchfield, Mile Gu, Felix C. Binder

Abstract: Efficiently harvesting thermodynamic resources requires a precise understanding of their structure. This becomes explicit through the lens of information engines -- thermodynamic engines that use information as fuel. Maximizing the work harvested using available information is a form of physically-instantiated machine learning that drives information engines to develop complex predictive memory to… ▽ More Efficiently harvesting thermodynamic resources requires a precise understanding of their structure. This becomes explicit through the lens of information engines -- thermodynamic engines that use information as fuel. Maximizing the work harvested using available information is a form of physically-instantiated machine learning that drives information engines to develop complex predictive memory to store an environment's temporal correlations. We show that an information engine's complex predictive memory poses both energetic benefits and risks. While increasing memory facilitates detection of hidden patterns in an environment, it also opens the possibility of thermodynamic overfitting, where the engine dissipates additional energy in testing. To address overfitting, we introduce thermodynamic regularizers that incur a cost to engine complexity in training due to the physical constraints on the information engine. We demonstrate that regularized thermodynamic machine learning generalizes effectively. In particular, the physical constraints from which regularizers are derived improve the performance of learned predictive models. This suggests that the laws of physics jointly create the conditions for emergent complexity and predictive intelligence. △ Less

Submitted 26 February, 2024; originally announced February 2024.

Efficient Quantum Work Reservoirs at the Nanoscale

Authors: **ghao Lyu, Alexander B. Boyd, James P. Crutchfield

Abstract: When reformulated as a resource theory, thermodynamics can analyze system behaviors in the single-shot regime. In this, the work required to implement state transitions is bounded by α-Renyi divergences and so differs in identifying efficient operations compared to stochastic thermodynamics. Thus, a detailed understanding of the difference between stochastic and resource-theoretic thermodynamics i… ▽ More When reformulated as a resource theory, thermodynamics can analyze system behaviors in the single-shot regime. In this, the work required to implement state transitions is bounded by α-Renyi divergences and so differs in identifying efficient operations compared to stochastic thermodynamics. Thus, a detailed understanding of the difference between stochastic and resource-theoretic thermodynamics is needed. To this end, we explore reversibility in the single-shot regime, generalizing the two-level work reservoirs used there to multi-level work reservoirs. This achieves reversibility in any transition in the single-shot regime. Building on this, we systematically develop multi-level work reservoirs in the nondissipation regime with and without catalysts. The resource-theoretic results show that two-level work reservoirs undershoot Landauer's bound, misleadingly implying energy dissipation during computation. In contrast, we demonstrate that multilevel work reservoirs achieve Landauer's bound while producing arbitrarily low entropy. △ Less

Submitted 22 June, 2024; v1 submitted 28 May, 2023; originally announced May 2023.

Comments: 23 pages, 8 figures, 7 tables; https://csc.ucdavis.edu/~cmg/compmech/pubs/eqwratn.htm

The Thermodynamic Uncertainty Theorem

Authors: Kyle J. Ray, Alexander B. Boyd, Giacomo Guarnieri, James P. Crutchfield

Abstract: Thermodynamic uncertainty relations (TURs) express a fundamental tradeoff between the precision (inverse scaled variance) of any thermodynamic current by functionals of the average entropy production. Relying on purely variational arguments, we significantly extend these inequalities by incorporating and analyzing the impact of higher statistical cumulants of entropy production within a general fr… ▽ More Thermodynamic uncertainty relations (TURs) express a fundamental tradeoff between the precision (inverse scaled variance) of any thermodynamic current by functionals of the average entropy production. Relying on purely variational arguments, we significantly extend these inequalities by incorporating and analyzing the impact of higher statistical cumulants of entropy production within a general framework of time-symmetrically controlled computation. This allows us to derive an exact expression for the current that achieves the minimum scaled variance, for which the TUR bound tightens to an equality that we name Thermodynamic Uncertainty Theorem (TUT). Importantly, both the minimum scaled variance current and the TUT are functionals of the stochastic entropy production, thus retaining the impact of its higher moments. In particular, our results show that, beyond the average, the entropy production distribution's higher moments have a significant effect on any current's precision. This is made explicit via a thorough numerical analysis of swap and reset computations that quantitatively compares the TUT against previous generalized TURs. Our results demonstrate how to interpolate between previously-established bounds and how to identify the most relevant TUR bounds in different nonequilibrium regimes. △ Less

Submitted 25 November, 2022; v1 submitted 3 October, 2022; originally announced October 2022.

Trajectory Class Fluctuation Theorem

Authors: Gregory Wimsatt, Alexander B. Boyd, James P. Crutchfield

Abstract: The Trajectory Class Fluctuation Theorem (TCFT) substantially strengthens the Second Law of Thermodynamics -- that, in point of fact, can be a rather weak bound on resource fluxes. Practically, it improves empirical estimates of free energies, a task known to be statistically challenging, and has diagnosed successful and failed information processing in experimentally-implemented Josephson-junctio… ▽ More The Trajectory Class Fluctuation Theorem (TCFT) substantially strengthens the Second Law of Thermodynamics -- that, in point of fact, can be a rather weak bound on resource fluxes. Practically, it improves empirical estimates of free energies, a task known to be statistically challenging, and has diagnosed successful and failed information processing in experimentally-implemented Josephson-junction information engines. The development here justifies that empirical analysis, explicating its mathematical foundations. The TCFT reveals the thermodynamics induced by macroscopic system transformations for each measurable subset of system trajectories. In this, it directly combats the statistical challenge of extremely rare events that dominate thermodynamic calculations. And, it reveals new forms of free energy -- forms that can be solved for analytically and practically estimated. Conceptually, the TCFT unifies a host of previously-established fluctuation theorems, interpolating from Crooks' Detailed Fluctuation Theorem (single trajectories) to Jarzynski's Equality (trajectory ensembles). △ Less

Submitted 27 April, 2024; v1 submitted 7 July, 2022; originally announced July 2022.

Comments: 23 pages, 2 figures, 3 appendices; http://csc.ucdavis.edu/~cmg/compmech/pubs/tcft.htm

Time Symmetries of Memory Determine Thermodynamic Efficiency

Authors: Alexander B. Boyd, Paul M. Riechers, Gregory W. Wimsatt, James P. Crutchfield, Mile Gu

Abstract: While Landauer's Principle sets a lower bound for the work required for a computation, that work is recoverable for efficient computations. However, practical physical computers, such as modern digital computers or biochemical systems, are subject to constraints that make them inefficient -- irreversibly dissipating significant energy. Recent results show that the dissipation in such systems is bo… ▽ More While Landauer's Principle sets a lower bound for the work required for a computation, that work is recoverable for efficient computations. However, practical physical computers, such as modern digital computers or biochemical systems, are subject to constraints that make them inefficient -- irreversibly dissipating significant energy. Recent results show that the dissipation in such systems is bounded by the nonreciprocity of the embedded computation. We investigate the consequences of this bound for different types of memory, showing that different memory devices are better suited for different computations. This correspondence comes from the time-reversal symmetries of the memory, which depend on whether information is stored positionally or magnetically. This establishes that the time symmetries of the memory device play an essential roll in determining energetics. The energetic consequences of time symmetries are particularly pronounced in nearly deterministic computations, where the cost of computing diverges as minus log of the error rate. We identify the coefficient of that divergence as the dissipation divergence. We find that the dissipation divergence may be zero for a computation when implemented in one type of memory while it's maximal when implemented with another. Given flexibility in the type of memory, the dissipation divergence is bounded below by the average state compression of the computation. Moreover, we show how to explicitly construct the memory to achieve this minimal dissipation. As a result, we find that logically reversible computations are indeed thermodynamically efficient, but logical irreversibility comes at a much higher cost than previously anticipated. △ Less

Submitted 25 April, 2021; originally announced April 2021.

Refining Landauer's Stack: Balancing Error and Dissipation When Erasing Information

Authors: Gregory W. Wimsatt, Alexander B. Boyd, Paul M. Riechers, James P. Crutchfield

Abstract: Nonequilibrium information thermodynamics determines the minimum energy dissipation to reliably erase memory under time-symmetric control protocols. We demonstrate that its bounds are tight and so show that the costs overwhelm those implied by Landauer's energy bound on information erasure. Moreover, in the limit of perfect computation, the costs diverge. The conclusion is that time-asymmetric pro… ▽ More Nonequilibrium information thermodynamics determines the minimum energy dissipation to reliably erase memory under time-symmetric control protocols. We demonstrate that its bounds are tight and so show that the costs overwhelm those implied by Landauer's energy bound on information erasure. Moreover, in the limit of perfect computation, the costs diverge. The conclusion is that time-asymmetric protocols should be developed for efficient, accurate thermodynamic computing. And, that Landauer's Stack -- the full suite of theoretically-predicted thermodynamic costs -- is ready for experimental test and calibration. △ Less

Submitted 28 November, 2020; originally announced November 2020.

Comments: 12 pages, 6 figures, 1 table; http://csc.ucdavis.edu/~cmg/compmech/pubs/tsperase.htm. arXiv admin note: substantial text overlap with arXiv:1909.06650

Non-Markovian Momentum Computing: Universal and Efficient

Authors: Kyle J. Ray, Gregory W. Wimsatt, Alexander B. Boyd, James P. Crutchfield

Abstract: All computation is physically embedded. Reflecting this, a growing body of results embraces rate equations as the underlying mechanics of thermodynamic computation and biological information processing. Strictly applying the implied continuous-time Markov chains, however, excludes a universe of natural computing. We show that expanding the toolset to continuous-time hidden Markov chains substantia… ▽ More All computation is physically embedded. Reflecting this, a growing body of results embraces rate equations as the underlying mechanics of thermodynamic computation and biological information processing. Strictly applying the implied continuous-time Markov chains, however, excludes a universe of natural computing. We show that expanding the toolset to continuous-time hidden Markov chains substantially removes the constraints. The general point is made concrete by our analyzing two eminently-useful computations that are impossible to describe with a set of rate equations over the memory states. We design and analyze a thermodynamically-costless bit flip, providing a first counterexample to rate-equation modeling. We generalize this to a costless Fredkin gate---a key operation in reversible computing that is computation universal. Going beyond rate-equation dynamics is not only possible, but necessary if stochastic thermodynamics is to become part of the paradigm for physical information processing. △ Less

Submitted 2 October, 2020; originally announced October 2020.

Comments: 6 pages, 3 figures; Supplementary Material, 1 page; http://csc.ucdavis.edu/~cmg/compmech/pubs/cbdb.htm

Journal ref: Phys. Rev. Research 3, 023164 (2021)

Thermodynamic Machine Learning through Maximum Work Production

Authors: A. B. Boyd, J. P. Crutchfield, M. Gu

Abstract: Adaptive systems -- such as a biological organism gaining survival advantage, an autonomous robot executing a functional task, or a motor protein transporting intracellular nutrients -- must model the regularities and stochasticity in their environments to take full advantage of thermodynamic resources. Analogously, but in a purely computational realm, machine learning algorithms estimate models t… ▽ More Adaptive systems -- such as a biological organism gaining survival advantage, an autonomous robot executing a functional task, or a motor protein transporting intracellular nutrients -- must model the regularities and stochasticity in their environments to take full advantage of thermodynamic resources. Analogously, but in a purely computational realm, machine learning algorithms estimate models to capture predictable structure and identify irrelevant noise in training data. This happens through optimization of performance metrics, such as model likelihood. If physically implemented, is there a sense in which computational models estimated through machine learning are physically preferred? We introduce the thermodynamic principle that work production is the most relevant performance metric for an adaptive physical agent and compare the results to the maximum-likelihood principle that guides machine learning. Within the class of physical agents that most efficiently harvest energy from their environment, we demonstrate that an efficient agent's model explicitly determines its architecture and how much useful work it harvests from the environment. We then show that selecting the maximum-work agent for given environmental data corresponds to finding the maximum-likelihood model. This establishes an equivalence between nonequilibrium thermodynamics and dynamic learning. In this way, work maximization emerges as an organizing principle that underlies learning in adaptive thermodynamic systems. △ Less

Submitted 12 April, 2021; v1 submitted 27 June, 2020; originally announced June 2020.

Comments: 29 pages, 10 figures, 6 appendices; http://csc.ucdavis.edu/~cmg/compmech/pubs/tml.htm

Balancing Error and Dissipation in Computing

Authors: P. M. Riechers, A. B. Boyd, G. W. Wimsatt, J. P. Crutchfield

Abstract: Modern digital electronics support remarkably reliable computing, especially given the challenge of controlling nanoscale logical components that interact in fluctuating environments. However, we demonstrate that the high-reliability limit is subject to a fundamental error-energy-efficiency tradeoff that arises from time-symmetric control: Requiring a low probability of error causes energy consump… ▽ More Modern digital electronics support remarkably reliable computing, especially given the challenge of controlling nanoscale logical components that interact in fluctuating environments. However, we demonstrate that the high-reliability limit is subject to a fundamental error-energy-efficiency tradeoff that arises from time-symmetric control: Requiring a low probability of error causes energy consumption to diverge as logarithm of the inverse error rate for nonreciprocal logical transitions. The reciprocity (self-invertibility) of a computation is a stricter condition for thermodynamic efficiency than logical reversibility (invertibility), the latter being the root of Landauer's work bound on erasing information. Beyond engineered computation, the results identify a generic error-dissipation tradeoff in steady-state transformations of genetic information carried out by biological organisms. The lesson is that computation under time-symmetric control cannot reach, and is often far above, the Landauer limit. In this way, time-asymmetry becomes a design principle for thermodynamically efficient computing. △ Less

Submitted 2 June, 2020; v1 submitted 14 September, 2019; originally announced September 2019.

Comments: 19 pages, 8 figures; Supplementary material 7 pages, 1 figure; http://csc.ucdavis.edu/~cmg/compmech/pubs/tsp.htm

Journal ref: Phys. Rev. Research 2, 033524 (2020)

Harnessing Fluctuations in Thermodynamic Computing via Time-Reversal Symmetries

Authors: Gregory Wimsatt, Olli-Pentti Saira, Alexander B. Boyd, Matthew H. Matheny, Siyuan Han, Michael L. Roukes, James P. Crutchfield

Abstract: We experimentally demonstrate that highly structured distributions of work emerge during even the simple task of erasing a single bit. These are signatures of a refined suite of time-reversal symmetries in distinct functional classes of microscopic trajectories. As a consequence, we introduce a broad family of conditional fluctuation theorems that the component work distributions must satisfy. Sin… ▽ More We experimentally demonstrate that highly structured distributions of work emerge during even the simple task of erasing a single bit. These are signatures of a refined suite of time-reversal symmetries in distinct functional classes of microscopic trajectories. As a consequence, we introduce a broad family of conditional fluctuation theorems that the component work distributions must satisfy. Since they identify entropy production, the component work distributions encode both the frequency of various mechanisms of success and failure during computing, as well giving improved estimates of the total irreversibly-dissipated heat. This new diagnostic tool provides strong evidence that thermodynamic computing at the nanoscale can be constructively harnessed. We experimentally verify this functional decomposition and the new class of fluctuation theorems by measuring transitions between flux states in a superconducting circuit. △ Less

Submitted 27 June, 2019; originally announced June 2019.

Comments: 13 pages, 3 figures, supplementary material; http://csc.ucdavis.edu/~cmg/compmech/pubs/tcft.htm

Journal ref: Phys. Rev. Research 3, 033115 (2021)

Shortcuts to Thermodynamic Computing: The Cost of Fast and Faithful Erasure

Authors: A. B. Boyd, A. Patra, C. Jarzynski, J. P. Crutchfield

Abstract: Landauer's Principle states that the energy cost of information processing must exceed the product of the temperature and the change in Shannon entropy of the information-bearing degrees of freedom. However, this lower bound is achievable only for quasistatic, near-equilibrium computations -- that is, only over infinite time. In practice, information processing takes place in finite time, resultin… ▽ More Landauer's Principle states that the energy cost of information processing must exceed the product of the temperature and the change in Shannon entropy of the information-bearing degrees of freedom. However, this lower bound is achievable only for quasistatic, near-equilibrium computations -- that is, only over infinite time. In practice, information processing takes place in finite time, resulting in dissipation and potentially unreliable logical outcomes. For overdamped Langevin dynamics, we show that counterdiabatic potentials can be crafted to guide systems rapidly and accurately along desired computational paths, providing shortcuts that allows for the precise design of finite-time computations. Such shortcuts require additional work, beyond Landauer's bound, that is irretrievably dissipated into the environment. We show that this dissipated work is proportional to the computation rate as well as the square of the information-storing system's length scale. As a paradigmatic example, we design shortcuts to erase a bit of information metastably stored in a double-well potential. Though dissipated work generally increases with erasure fidelity, we show that it is possible perform perfect erasure in finite time with finite work. We also show that the robustness of information storage affects the energetic cost of erasure---specifically, the dissipated work scales as the information lifetime of the bistable system. Our analysis exposes a rich and nuanced relationship between work, speed, size of the information-bearing degrees of freedom, storage robustness, and the difference between initial and final informational statistics. △ Less

Submitted 28 December, 2018; originally announced December 2018.

Comments: 19 pages, 7 figures; http://csc.ucdavis.edu/~cmg/compmech/pubs/scte.htm

Above and Beyond the Landauer Bound: Thermodynamics of Modularity

Authors: Alexander B. Boyd, Dibyendu Mandal, James P. Crutchfield

Abstract: Information processing typically occurs via the composition of modular units, such as universal logic gates. The benefit of modular information processing, in contrast to globally integrated information processing, is that complex global computations are more easily and flexibly implemented via a series of simpler, localized information processing operations which only control and change local deg… ▽ More Information processing typically occurs via the composition of modular units, such as universal logic gates. The benefit of modular information processing, in contrast to globally integrated information processing, is that complex global computations are more easily and flexibly implemented via a series of simpler, localized information processing operations which only control and change local degrees of freedom. We show that, despite these benefits, there are unavoidable thermodynamic costs to modularity---costs that arise directly from the operation of localized processing and that go beyond Landauer's dissipation bound for erasing information. Integrated computations can achieve Landauer's bound, however, when they globally coordinate the control of all of an information reservoir's degrees of freedom. Unfortunately, global correlations among the information-bearing degrees of freedom are easily lost by modular implementations. This is costly since such correlations are a thermodynamic fuel. We quantify the minimum irretrievable dissipation of modular computations in terms of the difference between the change in global nonequilibrium free energy, which captures these global correlations, and the local (marginal) change in nonequilibrium free energy, which bounds modular work production. This modularity dissipation is proportional to the amount of additional work required to perform the computational task modularly. It has immediate consequences for physically embedded transducers, known as information ratchets. We show how to circumvent modularity dissipation by designing internal ratchet states that capture the global correlations and patterns in the ratchet's information reservoir. Designed in this way, information ratchets match the optimum thermodynamic efficiency of globally integrated computations. △ Less

Submitted 9 August, 2017; originally announced August 2017.

Comments: 17 pages, 9 figures; http://csc.ucdavis.edu/~cmg/compmech/pubs/idolip.htm

Journal ref: Phys. Rev. X 8, 031036 (2018)

Transient Dissipation and Structural Costs of Physical Information Transduction

Authors: Alexander B. Boyd, Dibyendu Mandal, Paul M. Riechers, James P. Crutchfield

Abstract: A central result that arose in applying information theory to the stochastic thermodynamics of nonlinear dynamical systems is the Information-Processing Second Law (IPSL): the physical entropy of the universe can decrease if compensated by the Shannon-Kolmogorov-Sinai entropy change of appropriate information-carrying degrees of freedom. In particular, the asymptotic-rate IPSL precisely delineates… ▽ More A central result that arose in applying information theory to the stochastic thermodynamics of nonlinear dynamical systems is the Information-Processing Second Law (IPSL): the physical entropy of the universe can decrease if compensated by the Shannon-Kolmogorov-Sinai entropy change of appropriate information-carrying degrees of freedom. In particular, the asymptotic-rate IPSL precisely delineates the thermodynamic functioning of autonomous Maxwellian demons and information engines. How do these systems begin to function as engines, Landauer erasers, and error correctors? Here, we identify a minimal, inescapable transient dissipation engendered by physical information processing not captured by asymptotic rates, but critical to adaptive thermodynamic processes such as found in biological systems. A component of transient dissipation, we also identify an implementation-dependent cost that varies from one physical substrate to another for the same information processing task. Applying these results to producing structured patterns from a structureless information reservoir, we show that "retrodictive" generators achieve the minimal costs. The results establish the thermodynamic toll imposed by a physical system's structure as it comes to optimally transduce information. △ Less

Submitted 23 December, 2016; originally announced December 2016.

Comments: 8 pages, 2 figures, supplementary material; http://csc.ucdavis.edu/~cmg/compmech/pubs/mticit.htm

Journal ref: Phys. Rev. Lett. 118, 220602 (2017)

Leveraging Environmental Correlations: The Thermodynamics of Requisite Variety

Authors: Alexander B. Boyd, Dibyendu Mandal, James P. Crutchfield

Abstract: Key to biological success, the requisite variety that confronts an adaptive organism is the set of detectable, accessible, and controllable states in its environment. We analyze its role in the thermodynamic functioning of information ratchets---a form of autonomous Maxwellian Demon capable of exploiting fluctuations in an external information reservoir to harvest useful work from a thermal bath.… ▽ More Key to biological success, the requisite variety that confronts an adaptive organism is the set of detectable, accessible, and controllable states in its environment. We analyze its role in the thermodynamic functioning of information ratchets---a form of autonomous Maxwellian Demon capable of exploiting fluctuations in an external information reservoir to harvest useful work from a thermal bath. This establishes a quantitative paradigm for understanding how adaptive agents leverage structured thermal environments for their own thermodynamic benefit. General ratchets behave as memoryful communication channels, interacting with their environment sequentially and storing results to an output. The bulk of thermal ratchets analyzed to date, however, assume memoryless environments that generate input signals without temporal correlations. Employing computational mechanics and a new information-processing Second Law of Thermodynamics (IPSL) we remove these restrictions, analyzing general finite-state ratchets interacting with structured environments that generate correlated input signals. On the one hand, we demonstrate that a ratchet need not have memory to exploit an uncorrelated environment. On the other, and more appropriate to biological adaptation, we show that a ratchet must have memory to most effectively leverage structure and correlation in its environment. The lesson is that to optimally harvest work a ratchet's memory must reflect the input generator's memory. Finally, we investigate achieving the IPSL bounds on the amount of work a ratchet can extract from its environment, discovering that finite-state, optimal ratchets are unable to reach these bounds. In contrast, we show that infinite-state ratchets can go well beyond these bounds by utilizing their own infinite "negentropy". We conclude with an outline of the collective thermodynamics of information-ratchet swarms. △ Less

Submitted 17 September, 2016; originally announced September 2016.

Comments: 19 pages, 9 figures, http://csc.ucdavis.edu/~cmg/compmech/pubs/tom.htm

Correlation-powered Information Engines and the Thermodynamics of Self-Correction

Authors: Alexander B. Boyd, Dibyendu Mandal, James P. Crutchfield

Abstract: Information engines can use structured environments as a resource to generate work by randomizing ordered inputs and leveraging the increased Shannon entropy to transfer energy from a thermal reservoir to a work reservoir. We give a broadly applicable expression for the work production of an information engine, generally modeled as a memoryful channel that communicates inputs to outputs as it inte… ▽ More Information engines can use structured environments as a resource to generate work by randomizing ordered inputs and leveraging the increased Shannon entropy to transfer energy from a thermal reservoir to a work reservoir. We give a broadly applicable expression for the work production of an information engine, generally modeled as a memoryful channel that communicates inputs to outputs as it interacts with an evolving environment. The expression establishes that an information engine must have more than one memory state in order to leverage input environment correlations. To emphasize this functioning, we designed an information engine powered solely by temporal correlations and not by statistical biases, as employed by previous engines. Key to this is the engine's ability to synchronize---the engine automatically returns to a desired dynamical phase when thrown into an unwanted, dissipative phase by corruptions in the input---that is, by unanticipated environmental fluctuations. This self-correcting mechanism is robust up to a critical level of corruption, beyond which the system fails to act as an engine. We give explicit analytical expressions for both work and critical corruption level and summarize engine performance via a thermodynamic-function phase diagram over engine control parameters. The results reveal a new thermodynamic mechanism based on nonergodicity that underlies error correction as it operates to support resilient engineered and biological systems. △ Less

Submitted 13 August, 2016; v1 submitted 27 June, 2016; originally announced June 2016.

Comments: 22 pages, 13 figures; http://csc.ucdavis.edu/~cmg/compmech/pubs/tos.htm

Journal ref: Phys. Rev. E 95, 012152 (2017)

Memoryless Thermodynamics? A Reply

Authors: Dibyendu Mandal, Alexander B. Boyd, James P. Crutchfield

Abstract: We reply to arXiv:1508.00203 `Comment on "Identifying Functional Thermodynamics in Autonomous Maxwellian Ratchets" (arXiv:1507.01537v2)'. We reply to arXiv:1508.00203 `Comment on "Identifying Functional Thermodynamics in Autonomous Maxwellian Ratchets" (arXiv:1507.01537v2)'. △ Less

Submitted 13 August, 2015; originally announced August 2015.

Comments: 4 pages; http://csc.ucdavis.edu/~cmg/compmech/pubs/MerhavReply.htm

Identifying Functional Thermodynamics in Autonomous Maxwellian Ratchets

Authors: A. B. Boyd, D. Mandal, J. P. Crutchfield

Abstract: We introduce a family of Maxwellian Demons for which correlations among information bearing degrees of freedom can be calculated exactly and in compact analytical form. This allows one to precisely determine Demon functional thermodynamic operating regimes, when previous methods either misclassify or simply fail due to approximations they invoke. This reveals that these Demons are more functional… ▽ More We introduce a family of Maxwellian Demons for which correlations among information bearing degrees of freedom can be calculated exactly and in compact analytical form. This allows one to precisely determine Demon functional thermodynamic operating regimes, when previous methods either misclassify or simply fail due to approximations they invoke. This reveals that these Demons are more functional than previous candidates. They too behave either as engines, lifting a mass against gravity by extracting energy from a single heat reservoir, or as Landauer erasers, consuming external work to remove information from a sequence of binary symbols by decreasing their individual uncertainty. Going beyond these, our Demon exhibits a new functionality that erases bits not by simply decreasing individual-symbol uncertainty, but by increasing inter-bit correlations (that is, by adding temporal order) while increasing single-symbol uncertainty. In all cases, but especially in the new erasure regime, exactly accounting for informational correlations leads to tight bounds on Demon performance, expressed as a refined Second Law of Thermodynamics that relies on the Kolmogorov-Sinai entropy for dynamical processes and not on changes purely in system configurational entropy, as previously employed. We rigorously derive the refined Second Law under minimal assumptions and so it applies quite broadly---for Demons with and without memory and input sequences that are correlated or not. We note that general Maxwellian Demons readily violate previously proposed, alternative such bounds, while the current bound still holds. △ Less

Submitted 21 December, 2015; v1 submitted 6 July, 2015; originally announced July 2015.

Comments: 13 pages, 9 figures, http://csc.ucdavis.edu/~cmg/compmech/pubs/mrd.htm

Demon Dynamics: Deterministic Chaos, the Szilard Map, and the Intelligence of Thermodynamic Systems

Authors: Alexander B. Boyd, James P. Crutchfield

Abstract: We introduce a deterministic chaotic system---the Szilard Map---that encapsulates the measurement, control, and erasure protocol by which Maxwellian Demons extract work from a heat reservoir. Implementing the Demon's control function in a dynamical embodiment, our construction symmetrizes Demon and thermodynamic system, allowing one to explore their functionality and recover the fundamental trade-… ▽ More We introduce a deterministic chaotic system---the Szilard Map---that encapsulates the measurement, control, and erasure protocol by which Maxwellian Demons extract work from a heat reservoir. Implementing the Demon's control function in a dynamical embodiment, our construction symmetrizes Demon and thermodynamic system, allowing one to explore their functionality and recover the fundamental trade-off between the thermodynamic costs of dissipation due to measurement and due to erasure. The map's degree of chaos---captured by the Kolmogorov-Sinai entropy---is the rate of energy extraction from the heat bath. Moreover, an engine's statistical complexity quantifies the minimum necessary system memory for it to function. In this way, dynamical instability in the control protocol plays an essential and constructive role in intelligent thermodynamic systems. △ Less

Submitted 13 June, 2015; originally announced June 2015.

Comments: 5 pages, 3 figures, supplementary materials; http://csc.ucdavis.edu/~cmg/compmech/pubs/dds.htm

Journal ref: Phys. Rev. Lett. 116, 190601 (2016)