-
Frequency-dependent returns in nonlinear public goods games
Authors:
Christoph Hauert,
Alex McAvoy
Abstract:
When individuals interact in groups, the evolution of cooperation is traditionally modeled using the framework of public goods games. Overwhelmingly, these models assume that the return of the public good depends linearly on the fraction of contributors. In contrast, it seems natural that in real life public goods interactions the return most likely depends on the size of the investor pool as well…
▽ More
When individuals interact in groups, the evolution of cooperation is traditionally modeled using the framework of public goods games. Overwhelmingly, these models assume that the return of the public good depends linearly on the fraction of contributors. In contrast, it seems natural that in real life public goods interactions the return most likely depends on the size of the investor pool as well. Here, we consider a model to account for such nonlinearities in which the multiplication factor (marginal per capita return) for the public good depends on how many contribute. We find that nonlinear public goods interactions can break the curse of dominant defection in linear public goods interactions and give rise to richer dynamical outcomes in evolutionary settings. We provide an in-depth analysis of the more varied decisions by the classical rational player in nonlinear public goods interactions as well as a mechanistic, microscopic derivation of the evolutionary outcomes for the stochastic dynamics in finite populations and in the deterministic limit of infinite populations. This kind of nonlinearity provides a natural way to model public goods with diminishing returns as well as economies of scale.
△ Less
Submitted 21 April, 2024;
originally announced April 2024.
-
Promoting collective cooperation through temporal interactions
Authors:
Yao Meng,
Alex McAvoy,
Aming Li
Abstract:
Collective cooperation drives the dynamics of many natural, social, and economic phenomena, making understanding the evolution of cooperation with evolutionary game theory a central question of modern science. Although human interactions are best described as complex networks, current explorations are limited to static networks where interactions represented by network links are permanent and do n…
▽ More
Collective cooperation drives the dynamics of many natural, social, and economic phenomena, making understanding the evolution of cooperation with evolutionary game theory a central question of modern science. Although human interactions are best described as complex networks, current explorations are limited to static networks where interactions represented by network links are permanent and do not change over time. In reality, human activities often involve temporal interactions, where links are impermanent, and understanding the evolution of cooperation on such ubiquitous temporal networks is an open question. Here, we present a general framework for systematically analyzing how collective cooperation evolves on any temporal network, which unifies the study of evolutionary game dynamics with dynamic and static interactions. We show that the emergence of cooperation is facilitated by a simple rule of thumb: hubs (individuals with many social ties) should be temporally deprioritized in interactions. We further provide a quantitative metric capturing the priority of hubs, which we utilize to orchestrate the ordering of interactions to best promote cooperation on empirical temporal networks. Our findings unveil the fundamental advantages conferred by temporal interactions for promoting collective cooperation, which transcends the specific insights gleaned from studying traditional static snapshots.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
Evolution of reciprocity with limited payoff memory
Authors:
Nikoleta E. Glynatsi,
Alex McAvoy,
Christian Hilbe
Abstract:
Direct reciprocity is a mechanism for the evolution of cooperation in repeated social interactions. According to this literature, individuals naturally learn to adopt conditionally cooperative strategies if they have multiple encounters with their partner. Corresponding models have greatly facilitated our understanding of cooperation, yet they often make strong assumptions on how individuals remem…
▽ More
Direct reciprocity is a mechanism for the evolution of cooperation in repeated social interactions. According to this literature, individuals naturally learn to adopt conditionally cooperative strategies if they have multiple encounters with their partner. Corresponding models have greatly facilitated our understanding of cooperation, yet they often make strong assumptions on how individuals remember and process payoff information. For example, when strategies are updated through social learning, it is commonly assumed that individuals compare their average payoffs. This would require them to compute (or remember) their payoffs against everyone else in the population. To understand how more realistic constraints influence direct reciprocity, we consider the evolution of conditional behaviors when individuals learn based on more recent experiences. Even in the most extreme case that they only take into account their very last interaction, we find that cooperation can still evolve. However, such individuals adopt less generous strategies, and they tend to cooperate less often than in the classical setup with average payoffs. Interestingly, once individuals remember the payoffs of two or three recent interactions, cooperation rates quickly approach the classical limit. These findings contribute to a literature that explores which kind of cognitive capabilities are required for reciprocal cooperation. While our results suggest that some rudimentary form of payoff memory is necessary, it already suffices to remember a few interactions.
△ Less
Submitted 4 November, 2023;
originally announced November 2023.
-
Imitation dynamics on networks with incomplete information
Authors:
Xiaochen Wang,
Lei Zhou,
Alex McAvoy,
Aming Li
Abstract:
Imitation is an important learning heuristic in animal and human societies. Previous explorations report that the fate of individuals with cooperative strategies is sensitive to the protocol of imitation, leading to a conundrum about how different styles of imitation quantitatively impact the evolution of cooperation. Here, we take a different perspective on the personal and external social inform…
▽ More
Imitation is an important learning heuristic in animal and human societies. Previous explorations report that the fate of individuals with cooperative strategies is sensitive to the protocol of imitation, leading to a conundrum about how different styles of imitation quantitatively impact the evolution of cooperation. Here, we take a different perspective on the personal and external social information required by imitation. We develop a general model of imitation dynamics with incomplete information in networked systems, which unifies classical update rules including the death-birth and pairwise-comparison rule on complex networks. Under pairwise interactions, we find that collective cooperation is most promoted if individuals neglect personal information. If personal information is considered, cooperators evolve more readily with more external information. Intriguingly, when interactions take place in groups on networks with low degrees of clustering, using more personal and less external information better facilitates cooperation. Our unifying perspective uncovers intuition by examining the rate and range of competition induced by different information situations.
△ Less
Submitted 21 November, 2023; v1 submitted 27 May, 2023;
originally announced June 2023.
-
Strategy evolution on dynamic networks
Authors:
Qi Su,
Alex McAvoy,
Joshua B. Plotkin
Abstract:
Models of strategy evolution on static networks help us understand how population structure can promote the spread of traits like cooperation. One key mechanism is the formation of altruistic spatial clusters, where neighbors of a cooperative individual are likely to reciprocate, which protects prosocial traits from exploitation. But most real-world interactions are ephemeral and subject to exogen…
▽ More
Models of strategy evolution on static networks help us understand how population structure can promote the spread of traits like cooperation. One key mechanism is the formation of altruistic spatial clusters, where neighbors of a cooperative individual are likely to reciprocate, which protects prosocial traits from exploitation. But most real-world interactions are ephemeral and subject to exogenous restructuring, so that social networks change over time. Strategic behavior on dynamic networks is difficult to study, and much less is known about the resulting evolutionary dynamics. Here, we provide an analytical treatment of cooperation on dynamic networks, allowing for arbitrary spatial and temporal heterogeneity. We show that transitions among a large class of network structures can favor the spread of cooperation, even if each individual social network would inhibit cooperation when static. Furthermore, we show that spatial heterogeneity tends to inhibit cooperation, whereas temporal heterogeneity tends to promote it. Dynamic networks can have profound effects on the evolution of prosocial traits, even when individuals have no agency over network structures.
△ Less
Submitted 5 September, 2023; v1 submitted 27 January, 2023;
originally announced January 2023.
-
The coalescent in finite populations with arbitrary, fixed structure
Authors:
Benjamin Allen,
Alex McAvoy
Abstract:
The coalescent is a stochastic process representing ancestral lineages in a population undergoing neutral genetic drift. Originally defined for a well-mixed population, the coalescent has been adapted in various ways to accommodate spatial, age, and class structure, along with other features of real-world populations. To further extend the range of population structures to which coalescent theory…
▽ More
The coalescent is a stochastic process representing ancestral lineages in a population undergoing neutral genetic drift. Originally defined for a well-mixed population, the coalescent has been adapted in various ways to accommodate spatial, age, and class structure, along with other features of real-world populations. To further extend the range of population structures to which coalescent theory applies, we formulate a coalescent process for a broad class of neutral drift models with arbitrary -- but fixed -- spatial, age, sex, and class structure, haploid or diploid genetics, and any fixed mating pattern. Here, the coalescent is represented as a random sequence of map**s $\mathcal{C} = \left(C_t\right)_{t=0}^\infty$ from a finite set $G$ to itself. The set $G$ represents the ``sites'' (in individuals, in particular locations and/or classes) at which these alleles can live. The state of the coalescent, $C_t:G \to G$, maps each site $g \in G$ to the site containing $g$'s ancestor, $t$ time-steps into the past. Using this representation, we define and analyze coalescence time, coalescence branch length, mutations prior to coalescence, and stationary probabilities of identity-by-descent and identity-by-state. For low mutation, we provide a recipe for computing identity-by-descent and identity-by-state probabilities via the coalescent. Applying our results to a diploid population with arbitrary sex ratio $r$, we find that measures of genetic dissimilarity, among any set of sites, are scaled by $4r(1-r)$ relative to the even sex ratio case.
△ Less
Submitted 28 June, 2024; v1 submitted 6 July, 2022;
originally announced July 2022.
-
Payoff landscapes and the robustness of selfish optimization in iterated games
Authors:
Arjun Mirani,
Alex McAvoy
Abstract:
In iterated games, a player can unilaterally exert influence over the outcome through a careful choice of strategy. A powerful class of such "payoff control" strategies was discovered by Press and Dyson (2012). Their so-called "zero-determinant" (ZD) strategies allow a player to unilaterally enforce a linear relationship between both players' payoffs. It was subsequently shown by Chen and Zinger (…
▽ More
In iterated games, a player can unilaterally exert influence over the outcome through a careful choice of strategy. A powerful class of such "payoff control" strategies was discovered by Press and Dyson (2012). Their so-called "zero-determinant" (ZD) strategies allow a player to unilaterally enforce a linear relationship between both players' payoffs. It was subsequently shown by Chen and Zinger (2014) that when the slope of this linear relationship is positive, ZD strategies are robustly effective against a selfishly optimizing co-player, in that all adapting paths of the selfish player lead to the maximal payoffs for both players (at least when there are certain restrictions on the game parameters). In this paper, we investigate the efficacy of selfish learning against a fixed player in more general settings, for both ZD and non-ZD strategies. We first prove that in any symmetric $2\times 2$ game, the selfish player's final strategy must be of a certain form and cannot be fully stochastic. We then show that there are prisoner's dilemma interactions for which selfish optimization does not always lead to maximal payoffs against fixed ZD strategies with positive slope. We give examples of selfish adapting paths that lead to locally but not globally optimal payoffs, undermining the robustness of payoff control strategies. For non-ZD strategies, these pathologies arise regardless of the original restrictions on the game parameters. Our results illuminate the difficulty of implementing robust payoff control and selfish optimization, even in the simplest context of playing against a fixed strategy.
△ Less
Submitted 9 May, 2022; v1 submitted 28 November, 2021;
originally announced November 2021.
-
Selfish optimization and collective learning in populations
Authors:
Alex McAvoy,
Yoichiro Mori,
Joshua B. Plotkin
Abstract:
A selfish learner seeks to maximize their own success, disregarding others. When success is measured as payoff in a game played against another learner, mutual selfishness typically fails to produce the optimal outcome for a pair of individuals. However, learners often operate in populations, and each learner may have a limited duration of interaction with any other individual. Here, we compare se…
▽ More
A selfish learner seeks to maximize their own success, disregarding others. When success is measured as payoff in a game played against another learner, mutual selfishness typically fails to produce the optimal outcome for a pair of individuals. However, learners often operate in populations, and each learner may have a limited duration of interaction with any other individual. Here, we compare selfish learning in stable pairs to selfish learning with stochastic encounters in a population. We study gradient-based optimization in repeated games like the prisoner's dilemma, which feature multiple Nash equilibria, many of which are suboptimal. We find that myopic, selfish learning, when distributed in a population via ephemeral encounters, can reverse the dynamics that occur in stable pairs. In particular, when there is flexibility in partner choice, selfish learning in large populations can produce optimal payoffs in repeated social dilemmas. This result holds for the entire population, not just for a small subset of individuals. Furthermore, as the population size grows, the timescale to reach the optimal population payoff remains finite in the number of learning steps per individual. While it is not universally true that interacting with many partners in a population improves outcomes, this form of collective learning achieves optimality for several important classes of social dilemmas. We conclude that naïve learning can be surprisingly effective in populations of individuals navigating conflicts of interest.
△ Less
Submitted 6 July, 2022; v1 submitted 15 November, 2021;
originally announced November 2021.
-
Evolutionary instability of selfish learning in repeated games
Authors:
Alex McAvoy,
Julian Kates-Harbeck,
Krishnendu Chatterjee,
Christian Hilbe
Abstract:
Across many domains of interaction, both natural and artificial, individuals use past experience to shape future behaviors. The results of such learning processes depend on what individuals wish to maximize. A natural objective is one's own success. However, when two such "selfish" learners interact with each other, the outcome can be detrimental to both, especially when there are conflicts of int…
▽ More
Across many domains of interaction, both natural and artificial, individuals use past experience to shape future behaviors. The results of such learning processes depend on what individuals wish to maximize. A natural objective is one's own success. However, when two such "selfish" learners interact with each other, the outcome can be detrimental to both, especially when there are conflicts of interest. Here, we explore how a learner can align incentives with a selfish opponent. Moreover, we consider the dynamics that arise when learning rules themselves are subject to evolutionary pressure. By combining extensive simulations and analytical techniques, we demonstrate that selfish learning is unstable in most classical two-player repeated games. If evolution operates on the level of long-run payoffs, selection instead favors learning rules that incorporate social (other-regarding) preferences. To further corroborate these results, we analyze data from a repeated prisoner's dilemma experiment. We find that selfish learning is insufficient to explain human behavior when there is a trade-off between payoff maximization and fairness.
△ Less
Submitted 31 August, 2022; v1 submitted 13 May, 2021;
originally announced May 2021.
-
Evaluating the structure-coefficient theorem of evolutionary game theory
Authors:
Alex McAvoy,
John Wakeley
Abstract:
In order to accommodate the empirical fact that population structures are rarely simple, modern studies of evolutionary dynamics allow for complicated and highly-heterogeneous spatial structures. As a result, one of the most difficult obstacles lies in making analytical deductions, either qualitative or quantitative, about the long-term outcomes of evolution. The "structure-coefficient" theorem is…
▽ More
In order to accommodate the empirical fact that population structures are rarely simple, modern studies of evolutionary dynamics allow for complicated and highly-heterogeneous spatial structures. As a result, one of the most difficult obstacles lies in making analytical deductions, either qualitative or quantitative, about the long-term outcomes of evolution. The "structure-coefficient" theorem is a well-known approach to this problem for mutation-selection processes under weak selection, but a general method of evaluating the terms it comprises is lacking. Here, we provide such a method for populations of fixed (but arbitrary) size and structure, using easily interpretable demographic measures. This method encompasses a large family of evolutionary update mechanisms and extends the theorem to allow for asymmetric contests to provide a better understanding of the mutation-selection balance under more realistic circumstances. We apply the method to study social goods produced and distributed among individuals in spatially-heterogeneous populations, where asymmetric interactions emerge naturally and the outcome of selection varies dramatically depending on the nature of the social good, the spatial topology, and frequency with which mutations arise.
△ Less
Submitted 16 June, 2022; v1 submitted 27 October, 2020;
originally announced October 2020.
-
Evolution of prosocial behavior in multilayer populations
Authors:
Qi Su,
Alex McAvoy,
Yoichiro Mori,
Joshua B. Plotkin
Abstract:
Human societies include diverse social relationships. Friends, family, business colleagues, and online contacts can all contribute to one's social life. Individuals may behave differently in different domains, but success in one domain may engender success in another. Here, we study this problem using multilayer networks to model multiple domains of social interactions, in which individuals experi…
▽ More
Human societies include diverse social relationships. Friends, family, business colleagues, and online contacts can all contribute to one's social life. Individuals may behave differently in different domains, but success in one domain may engender success in another. Here, we study this problem using multilayer networks to model multiple domains of social interactions, in which individuals experience different environments and may express different behaviors. We provide a mathematical analysis and find that coupling between layers tends to promote prosocial behavior. Even if prosociality is disfavored in each layer alone, multilayer coupling can promote its proliferation in all layers simultaneously. We apply this analysis to six real-world multilayer networks, ranging from the socio-emotional and professional relationships in a Zambian community, to the online and offline relationships within an academic University. We discuss the implications of our results, which suggest that small modifications to interactions in one domain may catalyze prosociality in a different domain.
△ Less
Submitted 25 October, 2021; v1 submitted 3 October, 2020;
originally announced October 2020.
-
The Moran process on 2-chromatic graphs
Authors:
Kamran Kaveh,
Alex McAvoy,
Krishnendu Chatterjee,
Martin A. Nowak
Abstract:
Resources are rarely distributed uniformly within a population. Heterogeneity in the concentration of a drug, the quality of breeding sites, or wealth can all affect evolutionary dynamics. In this study, we represent a collection of properties affecting the fitness at a given location using a color. A green node is rich in resources while a red node is poorer. More colors can represent a broader s…
▽ More
Resources are rarely distributed uniformly within a population. Heterogeneity in the concentration of a drug, the quality of breeding sites, or wealth can all affect evolutionary dynamics. In this study, we represent a collection of properties affecting the fitness at a given location using a color. A green node is rich in resources while a red node is poorer. More colors can represent a broader spectrum of resource qualities. For a population evolving according to the birth-death Moran model, the first question we address is which structures, identified by graph connectivity and graph coloring, are evolutionarily equivalent. We prove that all properly two-colored, undirected, regular graphs are evolutionarily equivalent (where "properly colored" means that no two neighbors have the same color). We then compare the effects of background heterogeneity on properly two-colored graphs to those with alternative schemes in which the colors are permuted. Finally, we discuss dynamic coloring as a model for spatiotemporal resource fluctuations, and we illustrate that random dynamic colorings often diminish the effects of background heterogeneity relative to a proper two-coloring.
△ Less
Submitted 22 September, 2020;
originally announced September 2020.
-
Social goods dilemmas in heterogeneous societies
Authors:
Alex McAvoy,
Benjamin Allen,
Martin A. Nowak
Abstract:
Prosocial behaviors are encountered in the donation game, the prisoner's dilemma, relaxed social dilemmas, and public goods games. Many studies assume that the population structure is homogeneous, meaning all individuals have the same number of interaction partners, or that the social good is of one particular type. Here, we explore general evolutionary dynamics for arbitrary spatial structures an…
▽ More
Prosocial behaviors are encountered in the donation game, the prisoner's dilemma, relaxed social dilemmas, and public goods games. Many studies assume that the population structure is homogeneous, meaning all individuals have the same number of interaction partners, or that the social good is of one particular type. Here, we explore general evolutionary dynamics for arbitrary spatial structures and social goods. We find that heterogeneous networks, wherein some individuals have many more interaction partners than others, can enhance the evolution of prosocial behaviors. However, they often accumulate most of the benefits in the hands of a few highly-connected individuals, while many others receive low or negative payoff. Surprisingly, selection can favor producers of social goods even if the total costs exceed the total benefits. In summary, heterogeneous structures have the ability to strongly promote the emergence of prosocial behaviors, but they also create the possibility of generating large inequality.
△ Less
Submitted 30 April, 2020; v1 submitted 22 September, 2019;
originally announced September 2019.
-
Fixation probabilities in evolutionary dynamics under weak selection
Authors:
Alex McAvoy,
Benjamin Allen
Abstract:
In evolutionary dynamics, a key measure of a mutant trait's success is the probability that it takes over the population given some initial mutant-appearance distribution. This "fixation probability" is difficult to compute in general, as it depends on the mutation's effect on the organism as well as the population's spatial structure, mating patterns, and other factors. In this study, we consider…
▽ More
In evolutionary dynamics, a key measure of a mutant trait's success is the probability that it takes over the population given some initial mutant-appearance distribution. This "fixation probability" is difficult to compute in general, as it depends on the mutation's effect on the organism as well as the population's spatial structure, mating patterns, and other factors. In this study, we consider weak selection, which means that the mutation's effect on the organism is small. We obtain a weak-selection perturbation expansion of a mutant's fixation probability, from an arbitrary initial configuration of mutant and resident types. Our results apply to a broad class of stochastic evolutionary models, in which the size and spatial structure are arbitrary (but fixed). The problem of whether selection favors a given trait is thereby reduced from exponential to polynomial complexity in the population size, when selection is weak. We conclude by applying these methods to obtain new results for evolutionary dynamics on graphs.
△ Less
Submitted 1 February, 2021; v1 submitted 10 August, 2019;
originally announced August 2019.
-
Evolutionary dynamics with game transitions
Authors:
Qi Su,
Alex McAvoy,
Long Wang,
Martin A. Nowak
Abstract:
The environment has a strong influence on a population's evolutionary dynamics. Driven by both intrinsic and external factors, the environment is subject to continual change in nature. To capture an ever-changing environment, we consider a model of evolutionary dynamics with game transitions, where individuals' behaviors together with the games they play in one time step influence the games to be…
▽ More
The environment has a strong influence on a population's evolutionary dynamics. Driven by both intrinsic and external factors, the environment is subject to continual change in nature. To capture an ever-changing environment, we consider a model of evolutionary dynamics with game transitions, where individuals' behaviors together with the games they play in one time step influence the games to be played next time step. Within this model, we study the evolution of cooperation in structured populations and find a simple rule: weak selection favors cooperation over defection if the ratio of the benefit provided by an altruistic behavior, $b$, to the corresponding cost, $c$, exceeds $k-k'$, where $k$ is the average number of neighbors of an individual and $k'$ captures the effects of the game transitions. Even if cooperation cannot be favored in each individual game, allowing for a transition to a relatively valuable game after mutual cooperation and to a less valuable game after defection can result in a favorable outcome for cooperation. In particular, small variations in different games being played can promote cooperation markedly. Our results suggest that simple game transitions can serve as a mechanism for supporting prosocial behaviors in highly-connected populations.
△ Less
Submitted 27 November, 2019; v1 submitted 24 May, 2019;
originally announced May 2019.
-
Reactive learning strategies for iterated games
Authors:
Alex McAvoy,
Martin A. Nowak
Abstract:
In an iterated game between two players, there is much interest in characterizing the set of feasible payoffs for both players when one player uses a fixed strategy and the other player is free to switch. Such characterizations have led to extortionists, equalizers, partners, and rivals. Most of those studies use memory-one strategies, which specify the probabilities to take actions depending on t…
▽ More
In an iterated game between two players, there is much interest in characterizing the set of feasible payoffs for both players when one player uses a fixed strategy and the other player is free to switch. Such characterizations have led to extortionists, equalizers, partners, and rivals. Most of those studies use memory-one strategies, which specify the probabilities to take actions depending on the outcome of the previous round. Here, we consider "reactive learning strategies," which gradually modify their propensity to take certain actions based on past actions of the opponent. Every linear reactive learning strategy, $\mathbf{p}^{\ast}$, corresponds to a memory one-strategy, $\mathbf{p}$, and vice versa. We prove that for evaluating the region of feasible payoffs against a memory-one strategy, $\mathcal{C}\left(\mathbf{p}\right)$, we need to check its performance against at most $11$ other strategies. Thus, $\mathcal{C}\left(\mathbf{p}\right)$ is the convex hull in $\mathbb{R}^{2}$ of at most $11$ points. Furthermore, if $\mathbf{p}$ is a memory-one strategy, with feasible payoff region $\mathcal{C}\left(\mathbf{p}\right)$, and $\mathbf{p}^{\ast}$ is the corresponding reactive learning strategy, with feasible payoff region $\mathcal{C}\left(\mathbf{p}^{\ast}\right)$, then $\mathcal{C}\left(\mathbf{p}^{\ast}\right)$ is a subset of $\mathcal{C}\left(\mathbf{p}\right)$. Reactive learning strategies are therefore powerful tools in restricting the outcomes of iterated games.
△ Less
Submitted 11 March, 2019;
originally announced March 2019.
-
Stationary frequencies and mixing times for neutral drift processes with spatial structure
Authors:
Alex McAvoy,
Ben Adlam,
Benjamin Allen,
Martin A. Nowak
Abstract:
We study a general setting of neutral evolution in which the population is of finite, constant size and can have spatial structure. Mutation leads to different genetic types ("traits"), which can be discrete or continuous. Under minimal assumptions, we show that the marginal trait distributions of the evolutionary process, which specify the probability that any given individual has a certain trait…
▽ More
We study a general setting of neutral evolution in which the population is of finite, constant size and can have spatial structure. Mutation leads to different genetic types ("traits"), which can be discrete or continuous. Under minimal assumptions, we show that the marginal trait distributions of the evolutionary process, which specify the probability that any given individual has a certain trait, all converge to the stationary distribution of the mutation process. In particular, the stationary frequencies of traits in the population are independent of its size, spatial structure, and evolutionary update rule, and these frequencies can be calculated by evaluating a simple stochastic process describing a population of size one (i.e. the mutation process itself). We conclude by analyzing mixing times, which characterize rates of convergence of the mutation process along the lineages, in terms of demographic variables of the evolutionary process.
△ Less
Submitted 20 September, 2018;
originally announced September 2018.
-
Asymmetric evolutionary games with environmental feedback
Authors:
Christoph Hauert,
Camille Saade,
Alex McAvoy
Abstract:
Models in evolutionary game theory traditionally assume symmetric interactions in homogeneous environments. Here, we consider populations evolving in a heterogeneous environment, which consists of patches of different qualities that are occupied by one individual each. The fitness of individuals is not only determined by interactions with others but also by environmental quality. This heterogeneit…
▽ More
Models in evolutionary game theory traditionally assume symmetric interactions in homogeneous environments. Here, we consider populations evolving in a heterogeneous environment, which consists of patches of different qualities that are occupied by one individual each. The fitness of individuals is not only determined by interactions with others but also by environmental quality. This heterogeneity results in asymmetric interactions where the characteristics of the interaction may depend on an individual's location. Interestingly, in non-varying heterogeneous environments, the long-term dynamics are the same as for symmetric interactions in an average, homogeneous environment. However, introducing environmental feedback between an individual's strategy and the quality of its patch results in rich eco-evolutionary dynamics. Thus, individuals act as ecosystem engineers. The nature of the feedback and the rate of ecological changes can relax or aggravate social dilemmas and promote persistent periodic oscillations of strategy abundance and environmental quality.
△ Less
Submitted 10 December, 2018; v1 submitted 4 July, 2018;
originally announced July 2018.
-
A mathematical formalism for natural selection with arbitrary spatial and genetic structure
Authors:
Benjamin Allen,
Alex McAvoy
Abstract:
We define a general class of models representing natural selection between two alleles. The population size and spatial structure are arbitrary, but fixed. Genetics can be haploid, diploid, or otherwise; reproduction can be asexual or sexual. Biological events (e.g.~births, deaths, mating, dispersal) depend in arbitrary fashion on the current population state. Our formalism is based on the idea of…
▽ More
We define a general class of models representing natural selection between two alleles. The population size and spatial structure are arbitrary, but fixed. Genetics can be haploid, diploid, or otherwise; reproduction can be asexual or sexual. Biological events (e.g.~births, deaths, mating, dispersal) depend in arbitrary fashion on the current population state. Our formalism is based on the idea of genetic sites. Each genetic site resides at a particular locus and houses a single allele. Each individual contains a number of sites equal to its ploidy (one for haploids, two for diploids, etc.). Selection occurs via replacement events, in which alleles in some sites are replaced by copies of others. Replacement events depend stochastically on the population state, leading to a Markov chain representation of natural selection. Within this formalism, we define reproductive value, fitness, neutral drift, and fixation probability, and prove relationships among them. We identify four criteria for evaluating which allele is selected and show that these become equivalent in the limit of low mutation. We then formalize the method of weak selection. The power of our formalism is illustrated with applications to evolutionary games on graphs and to selection in a haplodiploid population.
△ Less
Submitted 14 November, 2018; v1 submitted 12 June, 2018;
originally announced June 2018.
-
Public goods games in populations with fluctuating size
Authors:
Alex McAvoy,
Nicolas Fraiman,
Christoph Hauert,
John Wakeley,
Martin A. Nowak
Abstract:
Many mathematical frameworks of evolutionary game dynamics assume that the total population size is constant and that selection affects only the relative frequency of strategies. Here, we consider evolutionary game dynamics in an extended Wright-Fisher process with variable population size. In such a scenario, it is possible that the entire population becomes extinct. Survival of the population ma…
▽ More
Many mathematical frameworks of evolutionary game dynamics assume that the total population size is constant and that selection affects only the relative frequency of strategies. Here, we consider evolutionary game dynamics in an extended Wright-Fisher process with variable population size. In such a scenario, it is possible that the entire population becomes extinct. Survival of the population may depend on which strategy prevails in the game dynamics. Studying cooperative dilemmas, it is a natural feature of such a model that cooperators enable survival, while defectors drive extinction. Although defectors are favored for any mixed population, random drift could lead to their elimination and the resulting pure-cooperator population could survive. On the other hand, if the defectors remain, then the population will quickly go extinct because the frequency of cooperators steadily declines and defectors alone cannot survive. In a mutation-selection model, we find that (i) a steady supply of cooperators can enable long-term population survival, provided selection is sufficiently strong, and (ii) selection can increase the abundance of cooperators but reduce their relative frequency. Thus, evolutionary game dynamics in populations with variable size generate a multifaceted notion of what constitutes a trait's long-term success.
△ Less
Submitted 14 February, 2018; v1 submitted 11 September, 2017;
originally announced September 2017.
-
Environmental fitness heterogeneity in the Moran process
Authors:
Kamran Kaveh,
Alex McAvoy,
Martin A. Nowak
Abstract:
Many mathematical models of evolution assume that all individuals experience the same environment. Here, we study the Moran process in heterogeneous environments. The population is of finite size with two competing types, which are exposed to a fixed number of environmental conditions. Reproductive rate is determined by both the type and the environment. We first calculate the condition for select…
▽ More
Many mathematical models of evolution assume that all individuals experience the same environment. Here, we study the Moran process in heterogeneous environments. The population is of finite size with two competing types, which are exposed to a fixed number of environmental conditions. Reproductive rate is determined by both the type and the environment. We first calculate the condition for selection to favor the mutant relative to the resident wild type. In large populations, the mutant is favored if and only if the mutant's spatial average reproductive rate exceeds that of the resident. But environmental heterogeneity elucidates an interesting asymmetry between the mutant and the resident. Specifically, mutant heterogeneity suppresses its fixation probability; if this heterogeneity is strong enough, it can even completely offset the effects of selection (including in large populations). In contrast, resident heterogeneity has no effect on a mutant's fixation probability in large populations and can amplify it in small populations.
△ Less
Submitted 18 December, 2018; v1 submitted 9 September, 2017;
originally announced September 2017.
-
Effects of motion in structured populations
Authors:
Madison S. Krieger,
Alex McAvoy,
Martin A. Nowak
Abstract:
In evolutionary processes, population structure has a substantial effect on natural selection. Here, we analyze how motion of individuals affects constant selection in structured populations. Motion is relevant because it leads to changes in the distribution of types as mutations march toward fixation or extinction. We describe motion as the swap** of individuals on graphs, and more generally as…
▽ More
In evolutionary processes, population structure has a substantial effect on natural selection. Here, we analyze how motion of individuals affects constant selection in structured populations. Motion is relevant because it leads to changes in the distribution of types as mutations march toward fixation or extinction. We describe motion as the swap** of individuals on graphs, and more generally as the shuffling of individuals between reproductive updates. Beginning with a one-dimensional graph, the cycle, we prove that motion suppresses natural selection for death-birth updating or for any process that combines birth-death and death-birth updating. If the rule is purely birth-death updating, no change in fixation probability appears in the presence of motion. We further investigate how motion affects evolution on the square lattice and weighted graphs. In the case of weighted graphs we find that motion can be either an amplifier or a suppressor of natural selection. In some cases, whether it is one or the other can be a function of the relative reproductive rate, indicating that motion is a subtle and complex attribute of evolving populations. As a first step towards understanding less restricted types of motion in evolutionary graph theory, we consider a similar rule on dynamic graphs induced by a spatial flow and find qualitatively similar results indicating that continuous motion also suppresses natural selection.
△ Less
Submitted 1 September, 2017; v1 submitted 12 August, 2017;
originally announced August 2017.
-
Fixation probabilities for any configuration of two strategies on regular graphs
Authors:
Yu-Ting Chen,
Alex McAvoy,
Martin A. Nowak
Abstract:
Population structure and spatial heterogeneity are integral components of evolutionary dynamics, in general, and of evolution of cooperation, in particular. Structure can promote the emergence of cooperation in some populations and suppress it in others. Here, we provide results for weak selection to favor cooperation on regular graphs for any configuration, meaning any arrangement of cooperators…
▽ More
Population structure and spatial heterogeneity are integral components of evolutionary dynamics, in general, and of evolution of cooperation, in particular. Structure can promote the emergence of cooperation in some populations and suppress it in others. Here, we provide results for weak selection to favor cooperation on regular graphs for any configuration, meaning any arrangement of cooperators and defectors. Our results extend previous work on fixation probabilities of single, randomly placed mutants. We find that for any configuration cooperation is never favored for birth-death (BD) updating. In contrast, for death-birth (DB) updating, we derive a simple, computationally tractable formula for weak selection to favor cooperation when starting from any configuration containing any number of cooperators and defectors. This formula elucidates two important features: (i) the takeover of cooperation can be enhanced by the strategic placement of cooperators and (ii) adding more cooperators to a configuration can sometimes suppress the evolution of cooperation. These findings give a formal account for how selection acts on all transient states that appear in evolutionary trajectories. They also inform the strategic design of initial states in social networks to maximally promote cooperation. We also derive general results that characterize the interaction of any two strategies, not only cooperation and defection.
△ Less
Submitted 5 December, 2016; v1 submitted 4 May, 2016;
originally announced May 2016.
-
Autocratic strategies for alternating games
Authors:
Alex McAvoy,
Christoph Hauert
Abstract:
Repeated games have a long tradition in the behavioral sciences and evolutionary biology. Recently, strategies were discovered that permit an unprecedented level of control over repeated interactions by enabling a player to unilaterally enforce linear constraints on payoffs. Here, we extend this theory of "zero-determinant" (or, more generally, "autocratic") strategies to alternating games, which…
▽ More
Repeated games have a long tradition in the behavioral sciences and evolutionary biology. Recently, strategies were discovered that permit an unprecedented level of control over repeated interactions by enabling a player to unilaterally enforce linear constraints on payoffs. Here, we extend this theory of "zero-determinant" (or, more generally, "autocratic") strategies to alternating games, which are often biologically more relevant than traditional synchronous games. Alternating games naturally result in asymmetries between players because the first move matters or because players might not move with equal probabilities. In a strictly-alternating game with two players, $X$ and $Y$, we give conditions for the existence of autocratic strategies for player $X$ when (i) $X$ moves first and (ii) $Y$ moves first. Furthermore, we show that autocratic strategies exist even for (iii) games with randomly-alternating moves. Particularly important categories of autocratic strategies are extortionate and generous strategies, which enforce unfavorable and favorable outcomes for the opponent, respectively. We illustrate these strategies using the continuous Donation Game, in which a player pays a cost to provide a benefit to the opponent according to a continuous cooperative investment level. Asymmetries due to alternating moves could easily arise from dominance hierarchies, and we show that they can endow subordinate players with more autocratic strategies than dominant players.
△ Less
Submitted 24 October, 2016; v1 submitted 8 February, 2016;
originally announced February 2016.
-
Stochastic selection processes
Authors:
Alex McAvoy
Abstract:
We propose a mathematical framework for natural selection in finite populations. Traditionally, many of the selection-based processes used to describe cultural and genetic evolution (such as imitation and birth-death models) have been studied on a case-by-case basis. Over time, these models have grown in sophistication to include population structure, differing phenotypes, and various forms of int…
▽ More
We propose a mathematical framework for natural selection in finite populations. Traditionally, many of the selection-based processes used to describe cultural and genetic evolution (such as imitation and birth-death models) have been studied on a case-by-case basis. Over time, these models have grown in sophistication to include population structure, differing phenotypes, and various forms of interaction asymmetry, among other features. Furthermore, many processes inspired by natural selection, such as evolutionary algorithms in computer science, possess characteristics that should fall within the realm of a "selection process," but so far there is no overarching theory encompassing these evolutionary processes. The framework of $\textit{stochastic selection processes}$ we present here provides such a theory and consists of three main components: a $\textit{population state space}$, an $\textit{aggregate payoff function}$, and an $\textit{update rule}$. A population state space is a generalization of the notion of population structure, and it can include non-spatial information such as strategy-mutation rates and phenotypes. An aggregate payoff function allows one to generically talk about the fitness of traits without explicitly specifying a method of payoff accounting or even the nature of the interactions that determine payoff/fitness. An update rule is a fitness-based function that updates a population based on its current state, and it includes as special cases the classical update mechanisms (Moran, Wright-Fisher, etc.) as well as more complicated mechanisms involving chromosomal crossover, mutation, and even complex cultural syntheses of strategies of neighboring individuals. Our framework covers models with variable population size as well as with arbitrary, measurable trait spaces.
△ Less
Submitted 17 November, 2015;
originally announced November 2015.
-
Autocratic strategies for iterated games with arbitrary action spaces
Authors:
Alex McAvoy,
Christoph Hauert
Abstract:
The recent discovery of zero-determinant strategies for the iterated Prisoner's Dilemma sparked a surge of interest in the surprising fact that a player can exert unilateral control over iterated interactions. These remarkable strategies, however, are known to exist only in games in which players choose between two alternative actions such as "cooperate" and "defect." Here we introduce a broader c…
▽ More
The recent discovery of zero-determinant strategies for the iterated Prisoner's Dilemma sparked a surge of interest in the surprising fact that a player can exert unilateral control over iterated interactions. These remarkable strategies, however, are known to exist only in games in which players choose between two alternative actions such as "cooperate" and "defect." Here we introduce a broader class of autocratic strategies by extending zero-determinant strategies to iterated games with more general action spaces. We use the continuous Donation Game as an example, which represents an instance of the Prisoner's Dilemma that intuitively extends to a continuous range of cooperation levels. Surprisingly, despite the fact that the opponent has infinitely many donation levels from which to choose, a player can devise an autocratic strategy to enforce a linear relationship between his or her payoff and that of the opponent even when restricting his or her actions to merely two discrete levels of cooperation. In particular, a player can use such a strategy to extort an unfair share of the payoffs from the opponent. Therefore, although the action space of the continuous Donation Game dwarfs that of the classical Prisoner's Dilemma, players can still devise relatively simple autocratic and, in particular, extortionate strategies.
△ Less
Submitted 11 April, 2016; v1 submitted 28 October, 2015;
originally announced October 2015.
-
Structural symmetry in evolutionary games
Authors:
Alex McAvoy,
Christoph Hauert
Abstract:
In evolutionary game theory, an important measure of a mutant trait (strategy) is its ability to invade and take over an otherwise-monomorphic population. Typically, one quantifies the success of a mutant strategy via the probability that a randomly occurring mutant will fixate in the population. However, in a structured population, this fixation probability may depend on where the mutant arises.…
▽ More
In evolutionary game theory, an important measure of a mutant trait (strategy) is its ability to invade and take over an otherwise-monomorphic population. Typically, one quantifies the success of a mutant strategy via the probability that a randomly occurring mutant will fixate in the population. However, in a structured population, this fixation probability may depend on where the mutant arises. Moreover, the fixation probability is just one quantity by which one can measure the success of a mutant; fixation time, for instance, is another. We define a notion of homogeneity for evolutionary games that captures what it means for two single-mutant states, i.e. two configurations of a single mutant in an otherwise-monomorphic population, to be "evolutionarily equivalent" in the sense that all measures of evolutionary success are the same for both configurations. Using asymmetric games, we argue that the term "homogeneous" should apply to the evolutionary process as a whole rather than to just the population structure. For evolutionary matrix games in graph-structured populations, we give precise conditions under which the resulting process is homogeneous. Finally, we show that asymmetric matrix games can be reduced to symmetric games if the population structure possesses a sufficient degree of symmetry.
△ Less
Submitted 12 September, 2015;
originally announced September 2015.
-
Asymmetric evolutionary games
Authors:
Alex McAvoy,
Christoph Hauert
Abstract:
Evolutionary game theory is a powerful framework for studying evolution in populations of interacting individuals. A common assumption in evolutionary game theory is that interactions are symmetric, which means that the players are distinguished by only their strategies. In nature, however, the microscopic interactions between players are nearly always asymmetric due to environmental effects, diff…
▽ More
Evolutionary game theory is a powerful framework for studying evolution in populations of interacting individuals. A common assumption in evolutionary game theory is that interactions are symmetric, which means that the players are distinguished by only their strategies. In nature, however, the microscopic interactions between players are nearly always asymmetric due to environmental effects, differing baseline characteristics, and other possible sources of heterogeneity. To model these phenomena, we introduce into evolutionary game theory two broad classes of asymmetric interactions: ecological and genotypic. Ecological asymmetry results from variation in the environments of the players, while genotypic asymmetry is a consequence of the players having differing baseline genotypes. We develop a theory of these forms of asymmetry for games in structured populations and use the classical social dilemmas, the Prisoner's Dilemma and the Snowdrift Game, for illustrations. Interestingly, asymmetric games reveal essential differences between models of genetic evolution based on reproduction and models of cultural evolution based on imitation that are not apparent in symmetric games.
△ Less
Submitted 24 June, 2015;
originally announced June 2015.
-
On pointless diagonal Fermat curves
Authors:
Alexander P. McAvoy
Abstract:
We give an improved asymptotic upper bound on the number of diagonal Fermat curves $Ax^{\ell}+By^{\ell}=z^{\ell}$ over $\mathbb{F}_{q}$ with no $\mathbb{F}_{q}$-rational points, where $\ell$ is a prime number dividing $q-1$.
We give an improved asymptotic upper bound on the number of diagonal Fermat curves $Ax^{\ell}+By^{\ell}=z^{\ell}$ over $\mathbb{F}_{q}$ with no $\mathbb{F}_{q}$-rational points, where $\ell$ is a prime number dividing $q-1$.
△ Less
Submitted 20 May, 2011;
originally announced May 2011.
