-
Pseudo-perplexity in One Fell Swoop for Protein Fitness Estimation
Authors:
Pranav Kantroo,
Günter P. Wagner,
Benjamin B. Machta
Abstract:
Protein language models trained on the masked language modeling objective learn to predict the identity of hidden amino acid residues within a sequence using the remaining observable sequence as context. They do so by embedding the residues into a high dimensional space that encapsulates the relevant contextual cues. These embedding vectors serve as an informative context-sensitive representation…
▽ More
Protein language models trained on the masked language modeling objective learn to predict the identity of hidden amino acid residues within a sequence using the remaining observable sequence as context. They do so by embedding the residues into a high dimensional space that encapsulates the relevant contextual cues. These embedding vectors serve as an informative context-sensitive representation that not only aids with the defined training objective, but can also be used for other tasks by downstream models. We propose a scheme to use the embeddings of an unmasked sequence to estimate the corresponding masked probability vectors for all the positions in a single forward pass through the language model. This One Fell Swoop (OFS) approach allows us to efficiently estimate the pseudo-perplexity of the sequence, a measure of the model's uncertainty in its predictions, that can also serve as a fitness estimate. We find that ESM2 OFS pseudo-perplexity performs nearly as well as the true pseudo-perplexity at fitness estimation, and more notably it defines a new state of the art on the ProteinGym Indels benchmark. The strong performance of the fitness measure prompted us to investigate if it could be used to detect the elevated stability reported in reconstructed ancestral sequences. We find that this measure ranks ancestral reconstructions as more fit than extant sequences. Finally, we show that the computational efficiency of the technique allows for the use of Monte Carlo methods that can rapidly explore functional sequence space.
△ Less
Submitted 9 July, 2024;
originally announced July 2024.
-
E. coli do not count single molecules
Authors:
Henry H. Mattingly,
Keita Kamino,
Jude Ong,
Rafaela Kottou,
Thierry Emonet,
Benjamin B. Machta
Abstract:
Organisms must perform sensory-motor behaviors to survive. What bounds or constraints limit behavioral performance? Previously, we found that the gradient-climbing speed of a chemotaxing Escherichia coli is near a bound set by the limited information they acquire from their chemical environments. Here we ask what limits their sensory accuracy. Past theoretical analyses have shown that the stochast…
▽ More
Organisms must perform sensory-motor behaviors to survive. What bounds or constraints limit behavioral performance? Previously, we found that the gradient-climbing speed of a chemotaxing Escherichia coli is near a bound set by the limited information they acquire from their chemical environments. Here we ask what limits their sensory accuracy. Past theoretical analyses have shown that the stochasticity of single molecule arrivals sets a fundamental limit on the precision of chemical sensing. Although it has been argued that bacteria approach this limit, direct evidence is lacking. Here, using information theory and quantitative experiments, we find that E. coli's chemosensing is not limited by the physics of particle counting. First, we derive the physical limit on the behaviorally-relevant information that any sensor can get about a changing chemical concentration, assuming that every molecule arriving at the sensor is recorded. Then, we derive and measure how much information E. coli's signaling pathway encodes during chemotaxis. We find that E. coli encode two orders of magnitude less information than an ideal sensor limited only by shot noise in particle arrivals. These results strongly suggest that constraints other than particle arrival noise limit E. coli's sensory fidelity.
△ Less
Submitted 9 July, 2024;
originally announced July 2024.
-
Lattice ultrasensitivity produces large gain in E. coli chemosensing
Authors:
Derek M. Sherry,
Isabella R. Graf,
Samuel J. Bryant,
Thierry Emonet,
Benjamin B. Machta
Abstract:
E. coli use a regular lattice of receptors and attached kinases to detect and amplify faint chemical signals. Kinase output is characterized by precise adaptation to a wide range of background ligand levels and large gain in response to small relative changes in ligand concentration. These characteristics are well described by models which achieve their gain through equilibrium cooperativity. But…
▽ More
E. coli use a regular lattice of receptors and attached kinases to detect and amplify faint chemical signals. Kinase output is characterized by precise adaptation to a wide range of background ligand levels and large gain in response to small relative changes in ligand concentration. These characteristics are well described by models which achieve their gain through equilibrium cooperativity. But these models are challenged by two experimental results. First, neither adaptation nor large gain are present in receptor binding assays. Second, in cells lacking adaptation machinery, fluctuations can sometimes be enormous, with essentially all kinases transitioning together. Here we introduce a far-from equilibrium model in which receptors gate the spread of activity between neighboring kinases. This model achieves large gain through a mechanism we term lattice ultrasensitivity (LU). In our LU model, kinase and receptor states are separate degrees of freedom, and kinase kinetics are dominated by chemical rates far-from-equilibrium rather than by equilibrium allostery. The model recapitulates the successes of past models, but also matches the challenging experimental findings. Importantly, unlike past lattice critical models, our LU model does not require parameters to be fine tuned for function.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
Polymer Collapse and Liquid-Liquid Phase-Separation are Coupled in a Generalized Prewetting Transition
Authors:
Mason N. Rouches,
Benjamin B. Machta
Abstract:
The three-dimensional organization of chromatin is thought to play an important role in controlling gene expression. Specificity in expression is achieved through the interaction of transcription factors and other nuclear proteins with particular sequences of DNA. At unphysiological concentrations many of these nuclear proteins can phase-separate in the absence of DNA, and it has been hypothesized…
▽ More
The three-dimensional organization of chromatin is thought to play an important role in controlling gene expression. Specificity in expression is achieved through the interaction of transcription factors and other nuclear proteins with particular sequences of DNA. At unphysiological concentrations many of these nuclear proteins can phase-separate in the absence of DNA, and it has been hypothesized that, in vivo, the thermodynamic forces driving these phases help determine chromosomal organization. However it is unclear how DNA, itself a long polymer subject to configurational transitions, interacts with three-dimensional protein phases. Here we show that a long compressible polymer can be coupled to interacting protein mixtures, leading to a generalized prewetting transition where polymer collapse is coincident with a locally stabilized liquid droplet. We use lattice Monte-Carlo simulations and a mean-field theory to show that these phases can be stable even in regimes where both polymer collapse and coexisting liquid phases are unstable in isolation, and that these new transitions can be either abrupt or continuous. For polymers with internal linear structure we further show that changes in the concentration of bulk components can lead to changes in three-dimensional polymer structure. In the nucleus there are many distinct proteins that interact with many different regions of chromatin, potentially giving rise to many different Prewet phases. The simple systems we consider here highlight chromatin's role as a lower-dimensional surface whose interactions with proteins are required for these novel phases.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
A bifurcation integrates information from many noisy ion channels
Authors:
Isabella R. Graf,
Benjamin B. Machta
Abstract:
In various biological systems information from many noisy molecular receptors must be integrated into a collective response. A striking example is the thermal imaging organ of pit vipers. Single nerve fibers in the organ reliably respond to mK temperature increases, a thousand times more sensitive than their molecular sensors, thermo-TRP ion channels. Here, we propose a mechanism for the integrati…
▽ More
In various biological systems information from many noisy molecular receptors must be integrated into a collective response. A striking example is the thermal imaging organ of pit vipers. Single nerve fibers in the organ reliably respond to mK temperature increases, a thousand times more sensitive than their molecular sensors, thermo-TRP ion channels. Here, we propose a mechanism for the integration of this molecular information. In our model, amplification arises due to proximity to a dynamical bifurcation, separating a regime with frequent and regular action potentials (APs), from a regime where APs are irregular and infrequent. Near the transition, AP frequency can have an extremely sharp dependence on temperature, naturally accounting for the thousand-fold amplification. Furthermore, close to the bifurcation, most of the information about temperature available in the TRP channels' kinetics can be read out from the timing of APs even in the presence of readout noise. While proximity to such bifurcation points typically requires fine-tuning of parameters, we propose that having feedback act from the order parameter (AP frequency) onto the control parameter robustly maintains the system in the vicinity of the bifurcation. This robustness suggests that similar feedback mechanisms might be found in other sensory systems which also need to detect tiny signals in a varying environment.
△ Less
Submitted 9 May, 2023;
originally announced May 2023.
-
Physical constraints in intracellular signaling: the cost of sending a bit
Authors:
Samuel Bryant,
Benjamin Machta
Abstract:
One of the primary computational requirements of a cellular system is the ability to transfer information between spatially separated components. To accomplish this, biology uses diverse physical channels including production or release of second-messengers molecules and electrical depolarization of the plasma membrane. To send reliable information, these processes must dissipate energy to compete…
▽ More
One of the primary computational requirements of a cellular system is the ability to transfer information between spatially separated components. To accomplish this, biology uses diverse physical channels including production or release of second-messengers molecules and electrical depolarization of the plasma membrane. To send reliable information, these processes must dissipate energy to compete with thermal noise, in some cases consuming a substantial fraction of the cellular energy budget. Here we bound the energetic efficiency of several physical strategies for communication, using tools from information theory and the fluctuation dissipation relations to quantify communication through a channel corrupted by thermal noise. We find a minimum energetic cost, in $k_B$T/bit for sending information as a function of the size of the sender and receiver, their spatial separation, and the communication latency. From these calculations construct a phase diagram indicating where each strategy is most efficient. In addition, these calculations provide an estimate for the energy costs associated with information processing arising from the physical constraints of the cellular environment.
△ Less
Submitted 30 May, 2022;
originally announced May 2022.
-
Far from Asymptopia
Authors:
Michael C. Abbott,
Benjamin B. Machta
Abstract:
Inference from limited data requires a notion of measure on parameter space, most explicit in the Bayesian framework as a prior. Here we demonstrate that Jeffreys prior, the best-known uninformative choice, introduces enormous bias when applied to typical scientific models. Such models have a relevant effective dimensionality much smaller than the number of microscopic parameters. Because Jeffreys…
▽ More
Inference from limited data requires a notion of measure on parameter space, most explicit in the Bayesian framework as a prior. Here we demonstrate that Jeffreys prior, the best-known uninformative choice, introduces enormous bias when applied to typical scientific models. Such models have a relevant effective dimensionality much smaller than the number of microscopic parameters. Because Jeffreys prior treats all microscopic parameters equally, it is from uniform when projected onto the sub-space of relevant parameters, due to variations in the local co-volume of irrelevant directions. We present results on a principled choice of measure which avoids this issue, leading to unbiased inference in complex models. This optimal prior depends on the quantity of data to be gathered, and approaches Jeffreys prior in the asymptotic limit. However, this limit cannot be justified without an impossibly large amount of data, exponential in the number of microscopic parameters.
△ Less
Submitted 30 March, 2023; v1 submitted 6 May, 2022;
originally announced May 2022.
-
Information geometry for multiparameter models: New perspectives on the origin of simplicity
Authors:
Katherine N. Quinn,
Michael C. Abbott,
Mark K. Transtrum,
Benjamin B. Machta,
James P. Sethna
Abstract:
Complex models in physics, biology, economics, and engineering are often sloppy, meaning that the model parameters are not well determined by the model predictions for collective behavior. Many parameter combinations can vary over decades without significant changes in the predictions. This review uses information geometry to explore sloppiness and its deep relation to emergent theories. We introd…
▽ More
Complex models in physics, biology, economics, and engineering are often sloppy, meaning that the model parameters are not well determined by the model predictions for collective behavior. Many parameter combinations can vary over decades without significant changes in the predictions. This review uses information geometry to explore sloppiness and its deep relation to emergent theories. We introduce the model manifold of predictions, whose coordinates are the model parameters. Its hyperribbon structure explains why only a few parameter combinations matter for the behavior. We review recent rigorous results that connect the hierarchy of hyperribbon widths to approximation theory, and to the smoothness of model predictions under changes of the control variables. We discuss recent geodesic methods to find simpler models on nearby boundaries of the model manifold -- emergent theories with fewer parameters that explain the behavior equally well. We discuss a Bayesian prior which optimizes the mutual information between model parameters and experimental data, naturally favoring points on the emergent boundary theories and thus simpler models. We introduce a `projected maximum likelihood' prior that efficiently approximates this optimal prior, and contrast both to the poor behavior of the traditional Jeffreys prior. We discuss the way the renormalization group coarse-graining in statistical mechanics introduces a flow of the model manifold, and connect stiff and sloppy directions along the model manifold with relevant and irrelevant eigendirections of the renormalization group. Finally, we discuss recently developed `intensive' embedding methods, allowing one to visualize the predictions of arbitrary probabilistic models as low-dimensional projections of an isometric embedding, and illustrate our method by generating the model manifold of the Ising model.
△ Less
Submitted 22 September, 2022; v1 submitted 13 November, 2021;
originally announced November 2021.
-
Thermodynamic stability and critical points in multicomponent mixtures with structured interactions
Authors:
Isabella R. Graf,
Benjamin B. Machta
Abstract:
Theoretical work has shed light on the phase behavior of idealized mixtures of many components with random interactions. But typical mixtures interact through particular physical features, leading to a structured, non-random interaction matrix of lower rank. Here we develop a theoretical framework for such mixtures and derive mean-field conditions for thermodynamic stability and critical behavior.…
▽ More
Theoretical work has shed light on the phase behavior of idealized mixtures of many components with random interactions. But typical mixtures interact through particular physical features, leading to a structured, non-random interaction matrix of lower rank. Here we develop a theoretical framework for such mixtures and derive mean-field conditions for thermodynamic stability and critical behavior. Irrespective of the number of components and features, this framework allows for a generally lower-dimensional representation in the space of features and proposes a principled way to coarse-grain multicomponent mixtures as binary mixtures. Moreover, it suggests a way to systematically characterize different series of critical points and their codimensions in mean-field. Since every pairwise interaction matrix can be expressed in terms of features, our work is applicable to a broad class of mean-field models.
△ Less
Submitted 1 September, 2022; v1 submitted 21 October, 2021;
originally announced October 2021.
-
E. coli chemotaxis is information-limited
Authors:
Henry H. Mattingly,
Keita Kamino,
Benjamin B. Machta,
Thierry Emonet
Abstract:
Organisms must acquire and use environmental information to guide their behaviors. However, it is unclear whether and how information quantitatively limits behavioral performance. Here, we relate information to behavioral performance in Escherichia coli chemotaxis. First, we derive a theoretical limit for the maximum achievable gradient-climbing speed given a cell's information acquisition rate. N…
▽ More
Organisms must acquire and use environmental information to guide their behaviors. However, it is unclear whether and how information quantitatively limits behavioral performance. Here, we relate information to behavioral performance in Escherichia coli chemotaxis. First, we derive a theoretical limit for the maximum achievable gradient-climbing speed given a cell's information acquisition rate. Next, we measure cells' gradient-climbing speeds and the rate of information acquisition by the chemotaxis pathway. We find that E. coli make behavioral decisions with much less than the 1 bit required to determine whether they are swimming up-gradient. However, they use this information efficiently, performing near the theoretical limit. Thus, information can limit organisms' performance, and sensory-motor pathways may have evolved to efficiently use information from the environment.
△ Less
Submitted 23 February, 2021;
originally announced February 2021.
-
Surface Densities Prewet a Near-Critical Membrane
Authors:
Mason Rouches,
Sarah Veatch,
Benjamin Machta
Abstract:
Recent work has highlighted roles for thermodynamic phase behavior in diverse cellular processes. Proteins and nucleic acids can phase separate into three-dimensional liquid droplets in the cytoplasm and nucleus and the plasma membrane of animal cells appears tuned close to a two-dimensional liquid-liquid critical point. In some examples, cytoplasmic proteins aggregate at plasma membrane domains,…
▽ More
Recent work has highlighted roles for thermodynamic phase behavior in diverse cellular processes. Proteins and nucleic acids can phase separate into three-dimensional liquid droplets in the cytoplasm and nucleus and the plasma membrane of animal cells appears tuned close to a two-dimensional liquid-liquid critical point. In some examples, cytoplasmic proteins aggregate at plasma membrane domains, forming structures such as the post-synaptic density and diverse signaling clusters. Here we examine the physics of these surface densities, employing minimal simulations of co-acervating polymers coupled to an Ising membrane surface in conjunction with a complementary Landau theory. We argue that these surface densities are a novel phase reminiscent of pre-wetting, in which a molecularly thin three-dimensional liquid forms on a usually solid surface. However, in surface densities the solid surface is replaced by a membrane with an independent propensity to phase separate. We show that proximity to criticality in the membrane dramatically increases the parameter regime in which a pre-wetting-like transition occurs, leading to a broad region where coexisting surface phases can form even when a bulk phase is unstable. Our simulations naturally exhibit three surface phase coexistence even though both the membrane and the polymer bulk can only display two phase coexistence on their own. We argue that the physics of these surface densities enables diverse functions seen in Eukaryotic cells.
△ Less
Submitted 17 February, 2021;
originally announced February 2021.
-
Irreversibility in dynamical phases and transitions
Authors:
Daniel S. Seara,
Benjamin B. Machta,
Michael P. Murrell
Abstract:
Living and non-living active matter consumes energy at the microscopic scale to drive emergent, macroscopic behavior including traveling waves and coherent oscillations. Recent work has characterized non-equilibrium systems by their total energy dissipation, but little has been said about how dissipation manifests in distinct spatiotemporal patterns. We introduce a novel measure of irreversibility…
▽ More
Living and non-living active matter consumes energy at the microscopic scale to drive emergent, macroscopic behavior including traveling waves and coherent oscillations. Recent work has characterized non-equilibrium systems by their total energy dissipation, but little has been said about how dissipation manifests in distinct spatiotemporal patterns. We introduce a novel measure of irreversibility we term the entropy production factor (EPF) to quantify how time reversal symmetry is broken in field theories across scales. We use the EPF to characterize a dynamical phase transition in simulations of the Brusselator, a prototypical biochemically motivated non-linear oscillator. The EPF quantifies the distribution of irreversibility across spatiotemporal frequencies as the Brusselator transitions from local to global coherent oscillations, bounding the energetic cost to establish spatially synchronized biochemical oscillations.
△ Less
Submitted 19 August, 2020; v1 submitted 24 November, 2019;
originally announced November 2019.
-
Energy Dissipation Bounds for Autonomous Thermodynamic Cycles
Authors:
Samuel J. Bryant,
Benjamin B. Machta
Abstract:
How much free energy is irreversibly lost during a thermodynamic process? For deterministic protocols, lower bounds on energy dissipation arise from the thermodynamic friction associated with pushing a system out of equilibrium in finite time. Recent work has also bounded the cost of precisely moving a single degree of freedom. Using stochastic thermodynamics, we compute the total energy cost of a…
▽ More
How much free energy is irreversibly lost during a thermodynamic process? For deterministic protocols, lower bounds on energy dissipation arise from the thermodynamic friction associated with pushing a system out of equilibrium in finite time. Recent work has also bounded the cost of precisely moving a single degree of freedom. Using stochastic thermodynamics, we compute the total energy cost of an autonomously controlled system by considering both thermodynamic friction and the entropic cost of precisely directing a single control parameter. Our result suggests a challenge to the usual understanding of the adiabatic limit: here, even infinitely slow protocols are energetically irreversible.
△ Less
Submitted 25 March, 2021; v1 submitted 15 March, 2019;
originally announced March 2019.
-
A scaling law from discrete to continuous solutions of channel capacity problems in the low-noise limit
Authors:
Michael C. Abbott,
Benjamin B. Machta
Abstract:
An analog communication channel typically achieves its full capacity when the distribution of inputs is discrete, composed of just K symbols, such as voltage levels or wavelengths. As the effective noise level goes to zero, for example by sending the same message multiple times, it is known that optimal codes become continuous. Here we derive a scaling law for the optimal number of symbols in this…
▽ More
An analog communication channel typically achieves its full capacity when the distribution of inputs is discrete, composed of just K symbols, such as voltage levels or wavelengths. As the effective noise level goes to zero, for example by sending the same message multiple times, it is known that optimal codes become continuous. Here we derive a scaling law for the optimal number of symbols in this limit, finding a novel rational scaling exponent. The number of symbols in the optimal code grows as $\log K \sim I^{4/3}$, where the channel capacity I increases with decreasing noise. The same scaling applies to other problems equivalent to maximizing channel capacity over a continuous distribution.
△ Less
Submitted 6 May, 2019; v1 submitted 25 October, 2017;
originally announced October 2017.
-
Information loss under coarse-graining: a geometric approach
Authors:
Archishman Raju,
Benjamin B. Machta,
James P. Sethna
Abstract:
We use information geometry, in which the local distance between models measures their distinguishability from data, to quantify the flow of information under the renormalization group. We show that information about relevant parameters is preserved, with distances along relevant directions maintained under flow. By contrast, irrelevant parameters become less distinguishable under the flow, with d…
▽ More
We use information geometry, in which the local distance between models measures their distinguishability from data, to quantify the flow of information under the renormalization group. We show that information about relevant parameters is preserved, with distances along relevant directions maintained under flow. By contrast, irrelevant parameters become less distinguishable under the flow, with distances along irrelevant directions contracting according to renormalization group exponents. We develop a covariant formalism to understand the contraction of the model manifold. We then apply our tools to understand the emergence of the diffusion equation and more general statistical systems described by a free energy. Our results give an information-theoretic justification of universality in terms of the flow of the model manifold under coarse-graining.
△ Less
Submitted 17 October, 2018; v1 submitted 16 October, 2017;
originally announced October 2017.
-
Maximizing the information learned from finite data selects a simple model
Authors:
Henry H. Mattingly,
Mark K. Transtrum,
Michael C. Abbott,
Benjamin B. Machta
Abstract:
We use the language of uninformative Bayesian prior choice to study the selection of appropriately simple effective models. We advocate for the prior which maximizes the mutual information between parameters and predictions, learning as much as possible from limited data. When many parameters are poorly constrained by the available data, we find that this prior puts weight only on boundaries of th…
▽ More
We use the language of uninformative Bayesian prior choice to study the selection of appropriately simple effective models. We advocate for the prior which maximizes the mutual information between parameters and predictions, learning as much as possible from limited data. When many parameters are poorly constrained by the available data, we find that this prior puts weight only on boundaries of the parameter manifold. Thus it selects a lower-dimensional effective theory in a principled way, ignoring irrelevant parameter directions. In the limit where there is sufficient data to tightly constrain any number of parameters, this reduces to Jeffreys prior. But we argue that this limit is pathological when applied to the hyper-ribbon parameter manifolds generic in science, because it leads to dramatic dependence on effects invisible to experiment.
△ Less
Submitted 14 February, 2018; v1 submitted 2 May, 2017;
originally announced May 2017.
-
Allosteric Regulation by a Critical Membrane
Authors:
Ofer Kimchi,
Sarah L. Veatch,
Benjamin B. Machta
Abstract:
Many of the processes that underly neural computation are carried out by ion channels embedded in the plasma membrane, a two-dimensional liquid that surrounds all cells. Recent experiments have demonstrated that this membrane is poised close to a liquid-liquid critical point in the Ising universality class. Here we use both exact and stochastic techniques on the lattice Ising model to explore the…
▽ More
Many of the processes that underly neural computation are carried out by ion channels embedded in the plasma membrane, a two-dimensional liquid that surrounds all cells. Recent experiments have demonstrated that this membrane is poised close to a liquid-liquid critical point in the Ising universality class. Here we use both exact and stochastic techniques on the lattice Ising model to explore the ramifications of proximity to criticality for proteins that are allosterically coupled to Ising composition modes. Owing to diverging generalized susceptibilities, such a protein's activity becomes strongly influenced by perturbations that influence the two relevant parameters of the critical point, especially the critical temperature. In addition, the protein's kinetics acquire a range of time scales from its surrounding membrane, naturally leading to non-Markovian dynamics.
△ Less
Submitted 22 July, 2016;
originally announced July 2016.
-
Stabilizing membrane domains antagonizes n-alcohol anesthesia
Authors:
Benjamin B. Machta,
Ellyn Gray,
Mariam Nouri,
Nicola L. C. McCarthy,
Erin M. Gray,
Ann L. Miller,
Nicholas J. Brooks,
Sarah L. Veatch
Abstract:
Diverse molecules induce general anesthesia with potency strongly correlated both with their hydrophobicity and their effects on certain ion channels. We recently observed that several n-alcohol anesthetics inhibit heterogeneity in plasma membrane derived vesicles by lowering the critical temperature ($T_c$) for phase separation. Here we exploit conditions that stabilize membrane heterogeneity to…
▽ More
Diverse molecules induce general anesthesia with potency strongly correlated both with their hydrophobicity and their effects on certain ion channels. We recently observed that several n-alcohol anesthetics inhibit heterogeneity in plasma membrane derived vesicles by lowering the critical temperature ($T_c$) for phase separation. Here we exploit conditions that stabilize membrane heterogeneity to further test the correlation between the anesthetic potency of n-alcohols and effects on $T_c$. First we show that hexadecanol acts oppositely to n-alcohol anesthetics on membrane mixing and antagonizes ethanol induced anesthesia in a tadpole behavioral assay. Second, we show that two previously described `intoxication reversers' raise $T_c$ and counter ethanol's effects in vesicles, mimicking the findings of previous electrophysiological and behavioral measurements. Third, we find that hydrostatic pressure, long known to reverse anesthesia, also raises $T_c$ in vesicles with a magnitude that counters the effect of butanol at relevant concentrations and pressures. Taken together, these results demonstrate that $ΔT_c$ predicts anesthetic potency for n-alcohols better than hydrophobicity in a range of contexts, supporting a mechanistic role for membrane heterogeneity in general anesthesia.
△ Less
Submitted 5 June, 2016; v1 submitted 1 April, 2016;
originally announced April 2016.
-
A dissipation bound for thermodynamic control
Authors:
Benjamin B. Machta
Abstract:
Biological and engineered systems operate by coupling function to the transfer of heat and/or particles down a thermal or chemical gradient. In idealized \textit{deterministically} driven systems, thermodynamic control can be exerted reversibly, with no entropy production, as long as the rate of the protocol is made slow compared to the equilibration time of the system. Here we consider \textit{fu…
▽ More
Biological and engineered systems operate by coupling function to the transfer of heat and/or particles down a thermal or chemical gradient. In idealized \textit{deterministically} driven systems, thermodynamic control can be exerted reversibly, with no entropy production, as long as the rate of the protocol is made slow compared to the equilibration time of the system. Here we consider \textit{fully realizable, entropically driven} systems where the control parameters themselves obey rules that are reversible and that acquire directionality in time solely through dissipation. We show that when such a system moves in a directed way through thermodynamic space, it must produce entropy that is on average larger than its generalized displacement as measured by the Fisher information metric. This distance measure is sub-extensive but cannot be made small by slowing the rate of the protocol.
△ Less
Submitted 28 August, 2015; v1 submitted 17 August, 2015;
originally announced August 2015.
-
Sloppiness and Emergent Theories in Physics, Biology, and Beyond
Authors:
Mark K. Transtrum,
Benjamin Machta,
Kevin Brown,
Bryan C. Daniels,
Christopher R. Myers,
James P. Sethna
Abstract:
Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are `sloppy', i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher Information Matrix, which we inter…
▽ More
Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are `sloppy', i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher Information Matrix, which we interpret as a Riemannian metric on a parameterized space of models. Distance in this space is a measure of how distinguishable two models are based on their predictions. Sloppy model manifolds are bounded with a hierarchy of widths and extrinsic curvatures. We show how the manifold boundary approximation can extract the simple, hidden theory from complicated sloppy models. We attribute the success of simple effective models in physics as likewise emerging from complicated processes exhibiting a low effective dimensionality. We discuss the ramifications and consequences of sloppy models for biochemistry and science more generally. We suggest that the reason our complex world is understandable is due to the same fundamental reason: simple theories of macroscopic behavior are hidden inside complicated microscopic processes.
△ Less
Submitted 30 January, 2015;
originally announced January 2015.
-
Mechanical Surface Waves Accompany Action Potential Propagation
Authors:
Ahmed El Hady,
Benjamin B. Machta
Abstract:
Many studies have shown that a mechanical displacement of the axonal membrane accompanies the electrical pulse defining the Action Potential (AP). Despite a large and diverse body of experimental evidence, there is no theoretical consensus either for the physical basis of this mechanical wave nor its interdependence with the electrical signal. In this manuscript we present a model for these mechan…
▽ More
Many studies have shown that a mechanical displacement of the axonal membrane accompanies the electrical pulse defining the Action Potential (AP). Despite a large and diverse body of experimental evidence, there is no theoretical consensus either for the physical basis of this mechanical wave nor its interdependence with the electrical signal. In this manuscript we present a model for these mechanical displacements as arising from the driving of surface wave modes in which potential energy is stored in elastic properties of the neuronal membrane and cytoskeleton while kinetic energy is carried by the axoplasmic fluid. In our model these surface waves are driven by the traveling wave of electrical depolarization that characterizes the AP, altering the compressive electrostatic forces across the membrane as it passes. This driving leads to co-propagating mechanical displacements, which we term Action Waves (AWs). Our model for these AWs allows us to predict, in terms of elastic constants, axon radius and axoplasmic density and viscosity, the shape of the AW that should accompany any traveling wave of voltage, including the AP predicted by the Hodgkin and Huxley (HH) equations. We show that our model makes predictions that are in agreement with results in experimental systems including the garfish olfactory nerve and the squid giant axon. We expect our model to serve as a framework for understanding the physical origins and possible functional roles of these AWs in neurobiology.
△ Less
Submitted 5 October, 2014; v1 submitted 28 July, 2014;
originally announced July 2014.
-
Liquid general anesthetics lower critical temperatures in plasma membrane vesicles
Authors:
Ellyn Gray,
Joshua Karslake,
Benjamin B. Machta,
Sarah L. Veatch
Abstract:
A large and diverse array of small hydrophobic molecules induce general anesthesia. Their efficacy as anesthetics has been shown to correlate both with their affinity for a hydrophobic environment and with their potency in inhibiting certain ligand gated ion channels. Here we explore the effects that n-alcohols and other liquid anesthetics have on the two-dimensional miscibility critical point obs…
▽ More
A large and diverse array of small hydrophobic molecules induce general anesthesia. Their efficacy as anesthetics has been shown to correlate both with their affinity for a hydrophobic environment and with their potency in inhibiting certain ligand gated ion channels. Here we explore the effects that n-alcohols and other liquid anesthetics have on the two-dimensional miscibility critical point observed in cell derived giant plasma membrane vesicles (GPMVs). We show that anesthetics depress the critical temperature (Tc) of these GPMVs without strongly altering the ratio of the two liquid phases found below Tc. The magnitude of this affect is consistent across n-alcohols when their concentration is rescaled by the median anesthetic concentration (AC50) for tadpole anesthesia, but not when plotted against the overall concentration in solution. At AC50 we see a 4°C downward shift in Tc, much larger than is typically seen in the main chain transition at these anesthetic concentrations. GPMV miscibility critical temperatures are also lowered to a similar extent by propofol, phenylethanol, and isopropanol when added at anesthetic concentrations, but not by tetradecanol or 2,6 diterbutylphenol, two structural analogs of general anesthetics that are hydrophobic but have no anesthetic potency. We propose that liquid general anesthetics provide an experimental tool for lowering critical temperatures in plasma membranes of intact cells, which we predict will reduce lipid-mediated heterogeneity in a way that is complimentary to increasing or decreasing cholesterol. Also, several possible implications of our results are discussed in the context of current models of anesthetic action on ligand gated ion channels.
△ Less
Submitted 10 September, 2013;
originally announced September 2013.
-
Universal scaling function for the two-dimensional Ising model in an external field: A pragmatic approach
Authors:
Yan-Jiun Chen,
Natalie M. Paquette,
Benjamin B. Machta,
James P. Sethna
Abstract:
We report an effective functional form for the spin-spin correlation function of the 2D Ising model as a function of temperature and field. Although the Ising model has been well studied, no analytical result for the spin-spin correlation function exists for arbitrary magnetic fields and temperatures. We show the validity of our form by comparison with simulations using the Wolff algorithm, and ob…
▽ More
We report an effective functional form for the spin-spin correlation function of the 2D Ising model as a function of temperature and field. Although the Ising model has been well studied, no analytical result for the spin-spin correlation function exists for arbitrary magnetic fields and temperatures. We show the validity of our form by comparison with simulations using the Wolff algorithm, and obtain remarkable precision by including analytic corrections to scaling. Given recent interest in comparing biomembrane heterogeneity to Ising criticality, our spin-spin correlation function may be used as a predictive quantitative measure for FRET or NMR membrane experiments.
△ Less
Submitted 25 July, 2013;
originally announced July 2013.
-
Parameter Space Compression Underlies Emergent Theories and Predictive Models
Authors:
Benjamin B. Machta,
Ricky Chachra,
Mark K. Transtrum,
James P. Sethna
Abstract:
We report a similarity between the microscopic parameter dependance of emergent theories in physics and that of multiparameter models common in other areas of science. In both cases, predictions are possible despite large uncertainties in the microscopic parameters because these details are compressed into just a few governing parameters that are sufficient to describe relevant observables. We mak…
▽ More
We report a similarity between the microscopic parameter dependance of emergent theories in physics and that of multiparameter models common in other areas of science. In both cases, predictions are possible despite large uncertainties in the microscopic parameters because these details are compressed into just a few governing parameters that are sufficient to describe relevant observables. We make this commonality explicit by examining parameter sensitivity in a hop** model of diffusion and a generalized Ising model of ferromagnetism. We trace the emergence of a smaller effective model to the development of a hierarchy of parameter importance quantified by the eigenvalues of the Fisher Information Matrix. Strikingly, the same hierarchy appears ubiquitously in models taken from diverse areas of science. We conclude that the emergence of effective continuum and universal theories in physics is due to the same parameter space hierarchy that underlies predictive modeling in other areas of science.
△ Less
Submitted 27 March, 2013;
originally announced March 2013.
-
Critical Casimir forces in cellular membranes
Authors:
Benjamin B. Machta,
Sarah L. Veatch,
James P. Sethna
Abstract:
Recent experiments suggest that membranes of living cells are tuned close to a miscibility critical point in the 2D Ising universality class. We propose that one role for this proximity to criticality in live cells is to provide a conduit for relatively long-ranged critical Casimir forces. Using techniques from conformal field theory we calculate potentials of mean force between membrane bound inc…
▽ More
Recent experiments suggest that membranes of living cells are tuned close to a miscibility critical point in the 2D Ising universality class. We propose that one role for this proximity to criticality in live cells is to provide a conduit for relatively long-ranged critical Casimir forces. Using techniques from conformal field theory we calculate potentials of mean force between membrane bound inclusions mediated by their local interactions with the composition order parameter. We verify these calculations using Monte-Carlo where we also compare critical and off-critical results. Our findings suggest that membrane bound proteins experience weak yet long range forces mediated by critical composition fluctuations in the plasma membranes of living cells.
△ Less
Submitted 3 August, 2012; v1 submitted 9 March, 2012;
originally announced March 2012.
-
Correlation functions quantify super-resolution images and estimate apparent clustering due to over-counting
Authors:
Sarah Veatch,
Benjamin Machta,
Sarah Shelby,
Ethan Chiang,
David Holowka,
Barbara Baird
Abstract:
We present an analytical method to quantify clustering in super-resolution localization images of static surfaces in two dimensions. The method also describes how over-counting of labeled molecules contributes to apparent self-clustering and how the effective lateral resolution of an image can be determined. This treatment applies to clustering of proteins and lipids in membranes, where there is s…
▽ More
We present an analytical method to quantify clustering in super-resolution localization images of static surfaces in two dimensions. The method also describes how over-counting of labeled molecules contributes to apparent self-clustering and how the effective lateral resolution of an image can be determined. This treatment applies to clustering of proteins and lipids in membranes, where there is significant interest in using super-resolution localization techniques to probe membrane heterogeneity. When images are quantified using pair correlation functions, the magnitude of apparent clustering due to over-counting will vary inversely with the surface density of labeled molecules and does not depend on the number of times an average molecule is counted. Over-counting does not yield apparent co-clustering in double label experiments when pair cross-correlation functions are measured. We apply our analytical method to quantify the distribution of the IgE receptor (FcεRI) on the plasma membranes of chemically fixed RBL-2H3 mast cells from images acquired using stochastic optical reconstruction microscopy (STORM) and scanning electron microscopy (SEM). We find that apparent clustering of labeled IgE bound to FcεRI detected with both methods arises from over-counting of individual complexes. Thus our results indicate that these receptors are randomly distributed within the resolution and sensitivity limits of these experiments.
△ Less
Submitted 29 June, 2011;
originally announced June 2011.
-
Experimental observations of dynamic critical phenomena in a lipid membrane
Authors:
Aurelia R. Honerkamp-Smith,
Benjamin B. Machta,
Sarah L. Keller
Abstract:
Near a critical point, the time scale of thermally-induced fluctuations diverges in a manner determined by the dynamic universality class. Experiments have verified predicted 3D dynamic critical exponents in many systems, but similar experiments in 2D have been lacking for the case of conserved order parameter. Here we analyze time-dependent correlation functions of a quasi-2D lipid bilayer in wat…
▽ More
Near a critical point, the time scale of thermally-induced fluctuations diverges in a manner determined by the dynamic universality class. Experiments have verified predicted 3D dynamic critical exponents in many systems, but similar experiments in 2D have been lacking for the case of conserved order parameter. Here we analyze time-dependent correlation functions of a quasi-2D lipid bilayer in water to show that its critical dynamics agree with a recently predicted universality class. In particular, the effective dynamic exponent $z_{\text{eff}}$ crosses over from $\sim 2$ to $\sim 3$ as the correlation length of fluctuations exceeds a hydrodynamic length set by the membrane and bulk viscosities.
△ Less
Submitted 9 May, 2012; v1 submitted 13 April, 2011;
originally announced April 2011.
-
The geometry of nonlinear least squares with applications to sloppy models and optimization
Authors:
Mark K. Transtrum,
Benjamin B. Machta,
James P. Sethna
Abstract:
Parameter estimation by nonlinear least squares minimization is a common problem with an elegant geometric interpretation: the possible parameter values of a model induce a manifold in the space of data predictions. The minimization problem is then to find the point on the manifold closest to the data. We show that the model manifolds of a large class of models, known as sloppy models, have many u…
▽ More
Parameter estimation by nonlinear least squares minimization is a common problem with an elegant geometric interpretation: the possible parameter values of a model induce a manifold in the space of data predictions. The minimization problem is then to find the point on the manifold closest to the data. We show that the model manifolds of a large class of models, known as sloppy models, have many universal features; they are characterized by a geometric series of widths, extrinsic curvatures, and parameter-effects curvatures. A number of common difficulties in optimizing least squares problems are due to this common structure. First, algorithms tend to run into the boundaries of the model manifold, causing parameters to diverge or become unphysical. We introduce the model graph as an extension of the model manifold to remedy this problem. We argue that appropriate priors can remove the boundaries and improve convergence rates. We show that typical fits will have many evaporated parameters. Second, bare model parameters are usually ill-suited to describing model behavior; cost contours in parameter space tend to form hierarchies of plateaus and canyons. Geometrically, we understand this inconvenient parametrization as an extremely skewed coordinate basis and show that it induces a large parameter-effects curvature on the manifold. Using coordinates based on geodesic motion, these narrow canyons are transformed in many cases into a single quadratic, isotropic basin. We interpret the modified Gauss-Newton and Levenberg-Marquardt fitting algorithms as an Euler approximation to geodesic motion in these natural coordinates on the model manifold and the model graph respectively. By adding a geodesic acceleration adjustment to these algorithms, we alleviate the difficulties from parameter-effects curvature, improving both efficiency and success rates at finding good fits.
△ Less
Submitted 7 October, 2010;
originally announced October 2010.
-
A minimal model of plasma membrane heterogeneity requires coupling cortical actin to criticality
Authors:
Benjamin B. Machta,
Stefanos Papanikolaou,
James P. Sethna,
Sarah L. Veatch
Abstract:
We present a minimal model of plasma membrane heterogeneity that combines criticality with connectivity to cortical cytoskeleton. Our model is motivated by recent observations of micron-sized critical fluctuations in plasma membrane vesicles that are detached from their cortical cytoskeleton. We incorporate criticality using a conserved order parameter Ising model coupled to a simple actin cytoske…
▽ More
We present a minimal model of plasma membrane heterogeneity that combines criticality with connectivity to cortical cytoskeleton. Our model is motivated by recent observations of micron-sized critical fluctuations in plasma membrane vesicles that are detached from their cortical cytoskeleton. We incorporate criticality using a conserved order parameter Ising model coupled to a simple actin cytoskeleton interacting through point-like pinning sites. Using this minimal model, we recapitulate several experimental observations of plasma membrane raft heterogeneity. Small (r~20nm) and dynamic fluctuations at physiological temperatures arise from criticality. Including connectivity to cortical cytoskeleton disrupts large fluctuations, prevents macroscopic phase separation at low temperatures (T<=22°C), and provides a template for long lived fluctuations at physiological temperature (T=37°C). Cytoskeleton-stabilized fluctuations produce significant barriers to the diffusion of some membrane components in a manner that is weakly dependent on the number of pinning sites and strongly dependent on criticality. More generally, we demonstrate that critical fluctuations provide a physical mechanism to organize and spatially segregate membrane components by providing channels for interaction over large distances.
△ Less
Submitted 10 September, 2010;
originally announced September 2010.
-
Why are nonlinear fits so challenging?
Authors:
M. K. Transtrum,
B. B. Machta,
J. P. Sethna
Abstract:
Fitting model parameters to experimental data is a common yet often challenging task, especially if the model contains many parameters. Typically, algorithms get lost in regions of parameter space in which the model is unresponsive to changes in parameters, and one is left to make adjustments by hand. We explain this difficulty by interpreting the fitting process as a generalized interpretation…
▽ More
Fitting model parameters to experimental data is a common yet often challenging task, especially if the model contains many parameters. Typically, algorithms get lost in regions of parameter space in which the model is unresponsive to changes in parameters, and one is left to make adjustments by hand. We explain this difficulty by interpreting the fitting process as a generalized interpretation procedure. By considering the manifold of all model predictions in data space, we find that cross sections have a hierarchy of widths and are typically very narrow. Algorithms become stuck as they move near the boundaries. We observe that the model manifold, in addition to being tightly bounded, has low extrinsic curvature, leading to the use of geodesics in the fitting process. We improve the convergence of the Levenberg-Marquardt algorithm by adding the geodesic acceleration to the usual Levenberg-Marquardt step.
△ Less
Submitted 16 December, 2009; v1 submitted 21 September, 2009;
originally announced September 2009.
-
Power-law velocity distributions in granular gases
Authors:
E. Ben-Naim,
B. Machta,
J. Machta
Abstract:
We report a general class of steady and transient states of granular gases. We find that the kinetic theory of inelastic gases admits stationary solutions with a power-law velocity distribution, f(v) ~ v^(-sigma). The exponent sigma is found analytically and depends on the spatial dimension, the degree of inelasticity, and the homogeneity degree of the collision rate. Driven steady-states, with…
▽ More
We report a general class of steady and transient states of granular gases. We find that the kinetic theory of inelastic gases admits stationary solutions with a power-law velocity distribution, f(v) ~ v^(-sigma). The exponent sigma is found analytically and depends on the spatial dimension, the degree of inelasticity, and the homogeneity degree of the collision rate. Driven steady-states, with the same power-law tail and a cut-off can be maintained by injecting energy at a large velocity scale, which then cascades to smaller velocities where it is dissipated. Associated with these steady-states are freely cooling time-dependent states for which the cut-off decreases and the velocity distribution is self-similar.
△ Less
Submitted 7 April, 2005;
originally announced April 2005.
-
Parallel Dynamics and Computational Complexity of Network Growth Models
Authors:
Benjamin Machta,
Jonthan Machta
Abstract:
The parallel computational complexity or depth of growing network models is investigated. The networks considered are generated by preferential attachment rules where the probability of attaching a new node to an existing node is given by a power, $α$ of the connectivity of the existing node. Algorithms for generating growing networks very quickly in parallel are described and studied. The subli…
▽ More
The parallel computational complexity or depth of growing network models is investigated. The networks considered are generated by preferential attachment rules where the probability of attaching a new node to an existing node is given by a power, $α$ of the connectivity of the existing node. Algorithms for generating growing networks very quickly in parallel are described and studied. The sublinear and superlinear cases require distinct algorithms. As a result, there is a discontinuous transition in the parallel complexity of sampling these networks corresponding to the discontinuous structural transition at $α=1$, where the networks become scale free. For $α>1$ networks can be generated in constant time while for $0 \leq α< 1$ logarithmic parallel time is required. The results show that these networks have little depth and embody very little history dependence despite being defined by sequential growth rules.
△ Less
Submitted 22 August, 2004; v1 submitted 16 August, 2004;
originally announced August 2004.