Showing 1–50 of 104 results for author: Gershenson, C

The Origin and Evolution of Information Handling

Authors: Amahury Jafet López-Díaz, Hiroki Sayama, Carlos Gershenson

Abstract: A major challenge when describing the origin of life is to explain "how instructional information control systems emerge naturally and spontaneously from mere molecular dynamics". So far, no one has clarified how information control emerged ab initio and how primitive control mechanisms in life might have evolved, becoming increasingly refined. Based on recent experimental results showing that che… ▽ More A major challenge when describing the origin of life is to explain "how instructional information control systems emerge naturally and spontaneously from mere molecular dynamics". So far, no one has clarified how information control emerged ab initio and how primitive control mechanisms in life might have evolved, becoming increasingly refined. Based on recent experimental results showing that chemical computation does not require the presence of life-related chemistry, we elucidate the origin and early evolution of information handling by chemical automata, from information processing (computation) to information storage (memory) and information transmission (communication) and later digital messengers, covering at the same time its syntactic, semantic and pragmatic flavors. In contrast to other theories that assume the existence of initial complex structures, our representation starts from trivial self-replicators whose interaction leads to the arising of more powerful molecular machines. By describing precisely the primordial transitions in chemistry-based computation, our framework is capable of explaining the above-mentioned gaps and can be translated to other models of computation, which allow us to explore biological phenomena at multiple spatial and temporal scales. Being compatible with the free energy principle, we have developed a computational enactivist theoretical framework that could be able to describe from the origin of life to high-level cognition, as if it were a purely constructivist narrative. At the end of our manuscript, we propose some ways to extend our ideas, including experimental validation of our theory (both in vitro and in silico). △ Less

Submitted 11 July, 2024; v1 submitted 5 April, 2024; originally announced April 2024.

Comments: 9 pages, 3 figures, 1 table

Quaternion Convolutional Neural Networks: Current Advances and Future Directions

Authors: Gerardo Altamirano-Gomez, Carlos Gershenson

Abstract: Since their first applications, Convolutional Neural Networks (CNNs) have solved problems that have advanced the state-of-the-art in several domains. CNNs represent information using real numbers. Despite encouraging results, theoretical analysis shows that representations such as hyper-complex numbers can achieve richer representational capacities than real numbers, and that Hamilton products can… ▽ More Since their first applications, Convolutional Neural Networks (CNNs) have solved problems that have advanced the state-of-the-art in several domains. CNNs represent information using real numbers. Despite encouraging results, theoretical analysis shows that representations such as hyper-complex numbers can achieve richer representational capacities than real numbers, and that Hamilton products can capture intrinsic interchannel relationships. Moreover, in the last few years, experimental research has shown that Quaternion-Valued CNNs (QCNNs) can achieve similar performance with fewer parameters than their real-valued counterparts. This paper condenses research in the development of QCNNs from its very beginnings. We propose a conceptual organization of current trends and analyze the main building blocks used in the design of QCNN models. Based on this conceptual organization, we propose future directions of research. △ Less

Submitted 17 July, 2023; originally announced July 2023.

ACM Class: I.2.0; I.4.0; I.2.7

Statistical analysis of word flow among five Indo-European languages

Authors: Josué Ely Molina, Jorge Flores, Carlos Gershenson, Carlos Pineda

Abstract: A recent increase in data availability has allowed the possibility to perform different statistical linguistic studies. Here we use the Google Books Ngram dataset to analyze word flow among English, French, German, Italian, and Spanish. We study what we define as ``migrant words'', a type of loanwords that do not change their spelling. We quantify migrant words from one language to another for dif… ▽ More A recent increase in data availability has allowed the possibility to perform different statistical linguistic studies. Here we use the Google Books Ngram dataset to analyze word flow among English, French, German, Italian, and Spanish. We study what we define as ``migrant words'', a type of loanwords that do not change their spelling. We quantify migrant words from one language to another for different decades, and notice that most migrant words can be aggregated in semantic fields and associated to historic events. We also study the statistical properties of accumulated migrant words and their rank dynamics. We propose a measure of use of migrant words that could be used as a proxy of cultural influence. Our methodology is not exempt of caveats, but our results are encouraging to promote further studies in this direction. △ Less

Submitted 17 January, 2023; originally announced January 2023.

Comments: 13 pages

Temporal, structural, and functional heterogeneities extend criticality and antifragility in random Boolean networks

Authors: Amahury Jafet López-Díaz, Fernanda Sánchez-Puig, Carlos Gershenson

Abstract: Most models of complex systems have been homogeneous, i.e., all elements have the same properties (spatial, temporal, structural, functional). However, most natural systems are heterogeneous: few elements are more relevant, larger, stronger, or faster than others. In homogeneous systems, criticality -- a balance between change and stability, order and chaos -- is usually found for a very narrow re… ▽ More Most models of complex systems have been homogeneous, i.e., all elements have the same properties (spatial, temporal, structural, functional). However, most natural systems are heterogeneous: few elements are more relevant, larger, stronger, or faster than others. In homogeneous systems, criticality -- a balance between change and stability, order and chaos -- is usually found for a very narrow region in the parameter space, close to a phase transition. Using random Boolean networks -- a general model of discrete dynamical systems -- we show that heterogeneity -- in time, structure, and function -- can broaden additively the parameter region where criticality is found. Moreover, parameter regions where antifragility is found are also increased with heterogeneity. However, maximum antifragility is found for particular parameters in homogeneous networks. Our work suggests that the "optimal" balance between homogeneity and heterogeneity is non-trivial, context-dependent, and in some cases, dynamic. △ Less

Submitted 15 September, 2022; originally announced September 2022.

Heterogeneity extends criticality

Authors: Fernanda Sánchez-Puig, Octavio Zapata, Omar K. Pineda, Gerardo Iñiguez, Carlos Gershenson

Abstract: Criticality has been proposed as a mechanism for the emergence of complexity, life, and computation, as it exhibits a balance between robustness and adaptability. In classic models of complex systems where structure and dynamics are considered homogeneous, criticality is restricted to phase transitions, leading either to robust (ordered) or adaptive (chaotic) phases in most of the parameter space.… ▽ More Criticality has been proposed as a mechanism for the emergence of complexity, life, and computation, as it exhibits a balance between robustness and adaptability. In classic models of complex systems where structure and dynamics are considered homogeneous, criticality is restricted to phase transitions, leading either to robust (ordered) or adaptive (chaotic) phases in most of the parameter space. Many real-world complex systems, however, are not homogeneous. Some elements change in time faster than others, with slower elements (usually the most relevant) providing robustness, and faster ones being adaptive. Structural patterns of connectivity are also typically heterogeneous, characterized by few elements with many interactions and most elements with only a few. Here we take a few traditionally homogeneous dynamical models and explore their heterogeneous versions, finding evidence that heterogeneity extends criticality. Thus, parameter fine-tuning is not necessary to reach a phase transition and obtain the benefits of (homogeneous) criticality. Simply adding heterogeneity can extend criticality, making the search/evolution of complex systems faster and more reliable. Our results add theoretical support for the ubiquitous presence of heterogeneity in physical, social, and technological systems, as natural selection can exploit heterogeneity to evolve complexity "for free". In artificial systems and biological design, heterogeneity may also be used to extend the parameter range that allows for criticality. △ Less

Submitted 30 June, 2022; originally announced August 2022.

Comments: 17 pages, 3 figures

Journal ref: Frontiers in Complex Systems 1, 1111486 (2023)

Language statistics at different spatial, temporal, and grammatical scales

Authors: Fernanda Sánchez-Puig, Rogelio Lozano-Aranda, Dante Pérez-Méndez, Ewan Colman, Alfredo J. Morales-Guzmán, Carlos Pineda, Pedro Juan Rivera Torres, Carlos Gershenson

Abstract: Statistical linguistics has advanced considerably in recent decades as data has become available. This has allowed researchers to study how statistical properties of languages change over time. In this work, we use data from Twitter to explore English and Spanish considering the rank diversity at different scales: temporal (from 3 to 96 hour intervals), spatial (from 3km to 3000+km radii), and gra… ▽ More Statistical linguistics has advanced considerably in recent decades as data has become available. This has allowed researchers to study how statistical properties of languages change over time. In this work, we use data from Twitter to explore English and Spanish considering the rank diversity at different scales: temporal (from 3 to 96 hour intervals), spatial (from 3km to 3000+km radii), and grammatical (from monograms to pentagrams). We find that all three scales are relevant. However, the greatest changes come from variations in the grammatical scale. At the lowest grammatical scale (monograms), the rank diversity curves are most similar, independently on the values of other scales, languages, and countries. As the grammatical scale grows, the rank diversity curves vary more depending on the temporal and spatial scales, as well as on the language and country. We also study the statistics of Twitter-specific tokens: emojis, hashtags, and user mentions. These particular type of tokens show a sigmoid kind of behaviour as a rank diversity function. Our results are helpful to quantify aspects of language statistics that seem universal and what may lead to variations. △ Less

Submitted 26 July, 2022; v1 submitted 1 July, 2022; originally announced July 2022.

Temporal Heterogeneity Improves Speed and Convergence in Genetic Algorithms

Authors: Yoshio Martinez, Katya Rodriguez, Carlos Gershenson

Abstract: Genetic algorithms have been used in recent decades to solve a broad variety of search problems. These algorithms simulate natural selection to explore a parameter space in search of solutions for a broad variety of problems. In this paper, we explore the effects of introducing temporal heterogeneity in genetic algorithms. In particular, we set the crossover probability to be inversely proportiona… ▽ More Genetic algorithms have been used in recent decades to solve a broad variety of search problems. These algorithms simulate natural selection to explore a parameter space in search of solutions for a broad variety of problems. In this paper, we explore the effects of introducing temporal heterogeneity in genetic algorithms. In particular, we set the crossover probability to be inversely proportional to the individual's fitness, i.e., better solutions change slower than those with a lower fitness. As case studies, we apply heterogeneity to solve the $N$-Queens and Traveling Salesperson problems. We find that temporal heterogeneity consistently improves search without having prior knowledge of the parameter space. △ Less

Submitted 2 February, 2022; originally announced March 2022.

Comments: Draft from November 2020

Statistical Properties of Rankings in Sports and Games

Authors: José Antonio Morales, Jorge Flores, Carlos Gershenson, Carlos Pineda

Abstract: Any collection can be ranked. Sports and games are common examples of ranked systems: players and teams are constantly ranked using different methods. The statistical properties of rankings have been studied for almost a century in a variety of fields. More recently, data availability has allowed us to study rank dynamics: how elements of a ranking change in time. Here, we study the rank distribut… ▽ More Any collection can be ranked. Sports and games are common examples of ranked systems: players and teams are constantly ranked using different methods. The statistical properties of rankings have been studied for almost a century in a variety of fields. More recently, data availability has allowed us to study rank dynamics: how elements of a ranking change in time. Here, we study the rank distributions and rank dynamics of twelve datasets from different sports and games. To study rank dynamics, we consider measures we have defined previously: rank diversity, change probability, rank entropy, and rank complexity. We also introduce a new measure that we call ``system closure'' that reflects how many elements enter or leave the rankings in time. We use a random walk model to reproduce the observed rank dynamics, showing that a simple mechanism can generate similar statistical properties as the ones observed in the datasets. Our results show that, while rank distributions vary considerably for different rankings, rank dynamics have similar behaviors, independently of the nature and competitiveness of the sport or game and its ranking method. Our results also suggest that our measures of rank dynamics are general and applicable for complex systems of different natures. △ Less

Submitted 5 November, 2021; originally announced November 2021.

Comments: 15 pages

Journal ref: Advances in Complex Systems, 0:2150007, 2021

Intelligence as information processing: brains, swarms, and computers

Authors: Carlos Gershenson

Abstract: There is no agreed definition of intelligence, so it is problematic to simply ask whether brains, swarms, computers, or other systems are intelligent or not. To compare the potential intelligence exhibited by different cognitive systems, I use the common approach used by artificial intelligence and artificial life: Instead of studying the substrate of systems, let us focus on their organization. T… ▽ More There is no agreed definition of intelligence, so it is problematic to simply ask whether brains, swarms, computers, or other systems are intelligent or not. To compare the potential intelligence exhibited by different cognitive systems, I use the common approach used by artificial intelligence and artificial life: Instead of studying the substrate of systems, let us focus on their organization. This organization can be measured with information. Thus, I apply an informationist epistemology to describe cognitive systems, including brains and computers. This allows me to frame the usefulness and limitations of the brain-computer analogy in different contexts. I also use this perspective to discuss the evolution and ecology of intelligence. △ Less

Submitted 9 August, 2021; originally announced August 2021.

Comments: 11 pages

Extracting real social interactions from social media: a debate of COVID-19 policies in Mexico

Authors: Alberto García-Rodríguez, Tzipe Govezensky, Carlos Gershenson, Gerardo G. Naumis, Rafael A. Barrio

Abstract: A study of the dynamical formation of networks of friends and enemies in social media, in this case Twitter, is presented. We characterise the single node properties of such networks, as the clustering coefficient and the degree, to investigate the structure of links. The results indicate that the network is made from three kinds of nodes: one with high clustering coefficient but very small degree… ▽ More A study of the dynamical formation of networks of friends and enemies in social media, in this case Twitter, is presented. We characterise the single node properties of such networks, as the clustering coefficient and the degree, to investigate the structure of links. The results indicate that the network is made from three kinds of nodes: one with high clustering coefficient but very small degree, a second group has zero clustering coefficient with variable degree, and finally, a third group in which the clustering coefficient as a function of the degree decays as a power law. This third group represents $\sim2\%$ of the nodes and is characteristic of dynamical networks with feedback. This part of the lattice seemingly represents strongly interacting friends in a real social network. △ Less

Submitted 16 June, 2021; originally announced June 2021.

Artificial life: sustainable self-replicating systems

Authors: Carlos Gershenson, Jitka Cejkova

Abstract: Nature has found one method of organizing living matter, but maybe other options exist -- not yet discovered -- on how to create life. To study the life "as it could be" is the objective of an interdisciplinary field called Artificial Life (commonly abbreviated as ALife). The word "artificial" refers to the fact that humans are involved in the creation process. The artificial life forms might be c… ▽ More Nature has found one method of organizing living matter, but maybe other options exist -- not yet discovered -- on how to create life. To study the life "as it could be" is the objective of an interdisciplinary field called Artificial Life (commonly abbreviated as ALife). The word "artificial" refers to the fact that humans are involved in the creation process. The artificial life forms might be completely unlike natural forms of life, with different chemical compositions, and even computer programs exhibiting life-like behaviours. △ Less

Submitted 4 October, 2021; v1 submitted 27 May, 2021; originally announced May 2021.

Comments: Short review chapter, to be included in EPS Grand Challenges 2050 book

Emergence in artificial life

Authors: Carlos Gershenson

Abstract: Even when concepts similar to emergence have been used since antiquity, we lack an agreed definition. However, emergence has been identified as one of the main features of complex systems. Most would agree on the statement ``life is complex''. Thus, understanding emergence and complexity should benefit the study of living systems. It can be said that life emerges from the interactions of complex… ▽ More Even when concepts similar to emergence have been used since antiquity, we lack an agreed definition. However, emergence has been identified as one of the main features of complex systems. Most would agree on the statement ``life is complex''. Thus, understanding emergence and complexity should benefit the study of living systems. It can be said that life emerges from the interactions of complex molecules. But how useful is this to understand living systems? Artificial life (ALife) has been developed in recent decades to study life using a synthetic approach: build it to understand it. ALife systems are not so complex, be them soft (simulations), hard (robots), or wet (protocells). Then, we can aim at first understanding emergence in ALife, for then using this knowledge in biology. I argue that to understand emergence and life, it becomes useful to use information as a framework. In a general sense, I define emergence as information that is not present at one scale but is present at another scale. This perspective avoids problems of studying emergence from a materialist framework, and can be also useful in the study of self-organization and complexity. △ Less

Submitted 23 September, 2022; v1 submitted 30 April, 2021; originally announced May 2021.

Comments: 28 pages, 1 figure

Dynamics of ranking

Authors: Gerardo Iñiguez, Carlos Pineda, Carlos Gershenson, Albert-László Barabási

Abstract: Virtually anything can be and is ranked; people, institutions, countries, words, genes. Rankings reduce complex systems to ordered lists, reflecting the ability of their elements to perform relevant functions, and are being used from socioeconomic policy to knowledge extraction. A century of research has found regularities when temporal rank data is aggregated. Far less is known, however, about ho… ▽ More Virtually anything can be and is ranked; people, institutions, countries, words, genes. Rankings reduce complex systems to ordered lists, reflecting the ability of their elements to perform relevant functions, and are being used from socioeconomic policy to knowledge extraction. A century of research has found regularities when temporal rank data is aggregated. Far less is known, however, about how rankings change in time. Here we explore the dynamics of 30 rankings in natural, social, economic, and infrastructural systems, comprising millions of elements and timescales from minutes to centuries. We find that the flux of new elements determines the stability of a ranking: for high flux only the top of the list is stable, otherwise top and bottom are equally stable. We show that two basic mechanisms - displacement and replacement of elements - capture empirical ranking dynamics. The model uncovers two regimes of behavior; fast and large rank changes, or slow diffusion. Our results indicate that the balance between robustness and adaptability in ranked systems might be governed by simple random processes irrespective of system details. △ Less

Submitted 11 April, 2022; v1 submitted 27 April, 2021; originally announced April 2021.

Comments: 12 pages, 3 figures. SI: 40 pages, 22 figures

Journal ref: Iñiguez, G., Pineda, C., Gershenson, C., Barabási, A-.L. Dynamics of ranking. Nature Communications 13, 1646 (2022)

Identifying tax evasion in Mexico with tools from network science and machine learning

Authors: Martin Zumaya, Rita Guerrero, Eduardo Islas, Omar Pineda, Carlos Gershenson, Gerardo Iñiguez, Carlos Pineda

Abstract: Mexico has kept electronic records of all taxable transactions since 2014. Anonymized data collected by the Mexican federal government comprises more than 80 million contributors (individuals and companies) and almost 7 billion monthly-aggregations of invoices among contributors between January 2015 and December 2018. This data includes a list of almost ten thousand contributors already identified… ▽ More Mexico has kept electronic records of all taxable transactions since 2014. Anonymized data collected by the Mexican federal government comprises more than 80 million contributors (individuals and companies) and almost 7 billion monthly-aggregations of invoices among contributors between January 2015 and December 2018. This data includes a list of almost ten thousand contributors already identified as tax evaders, due to their activities fabricating invoices for non-existing products or services so that recipients can evade taxes. Harnessing this extensive dataset, we build monthly and yearly temporal networks where nodes are contributors and directed links are invoices produced in a given time slice. Exploring the properties of the network neighborhoods around tax evaders, we show that their interaction patterns differ from those of the majority of contributors. In particular, invoicing loops between tax evaders and their clients are over-represented. With this insight, we use two machine-learning methods to classify other contributors as suspects of tax evasion: deep neural networks and random forests. We train each method with a portion of the tax evader list and test it with the rest, obtaining more than 0.9 accuracy with both methods. By using the complete dataset of contributors, each method classifies more than 100 thousand suspects of tax evasion, with more than 40 thousand suspects classified by both methods. We further reduce the number of suspects by focusing on those with a short network distance from known tax evaders. We thus obtain a list of highly suspicious contributors sorted by the amount of evaded tax, valuable information for the authorities to further investigate illegal tax activity in Mexico. With our methods, we estimate previously undetected tax evasion in the order of \$10 billion USD per year by about 10 thousand contributors. △ Less

Submitted 24 April, 2021; originally announced April 2021.

Comments: 26 pages, 12 figures

Journal ref: Granados, O.M., Nicolás-Carlock, J.R. (eds) Corruption Networks. Understanding Complex Systems (2021, Springer, Cham)

Stocks and Cryptocurrencies: Anti-fragile or Robust?

Authors: Darío Alatorre, Carlos Gershenson, José L. Mateos

Abstract: In contrast with robust systems that resist noise or fragile systems that break with noise, antifragility is defined as a property of complex systems that benefit from noise or disorder. Here we define and test a simple measure of antifragility for complex dynamical systems. In this work we use our antifragility measure to analyze real data from return prices in the stock and cryptocurrency market… ▽ More In contrast with robust systems that resist noise or fragile systems that break with noise, antifragility is defined as a property of complex systems that benefit from noise or disorder. Here we define and test a simple measure of antifragility for complex dynamical systems. In this work we use our antifragility measure to analyze real data from return prices in the stock and cryptocurrency markets. Our definition of antifragility is the product of the return price and a perturbation. We explore different types of perturbations that typically arise from within the system. Our results suggest that for both the stock market and the cryptocurrency market, the tendency among the 'top performers' is to be robust rather than antifragile. It would be important to explore other possible definitions of antifragility to understand its role in financial markets and in complex dynamical systems in general. △ Less

Submitted 31 July, 2022; v1 submitted 26 May, 2020; originally announced May 2020.

Comments: 22 pages, 16 figures

Antifragility Predicts the Robustness and Evolvability of Biological Networks through Multi-class Classification with a Convolutional Neural Network

Authors: Hyobin Kim, Stalin Muñoz, Pamela Osuna, Carlos Gershenson

Abstract: Robustness and evolvability are essential properties to the evolution of biological networks. To determine if a biological network is robust and/or evolvable, it is required to compare its functions before and after mutations. However, this sometimes takes a high computational cost as the network size grows. Here we develop a predictive method to estimate the robustness and evolvability of biologi… ▽ More Robustness and evolvability are essential properties to the evolution of biological networks. To determine if a biological network is robust and/or evolvable, it is required to compare its functions before and after mutations. However, this sometimes takes a high computational cost as the network size grows. Here we develop a predictive method to estimate the robustness and evolvability of biological networks without an explicit comparison of functions. We measure antifragility in Boolean network models of biological systems and use this as the predictor. Antifragility occurs when a system benefits from external perturbations. By means of the differences of antifragility between the original and mutated biological networks, we train a convolutional neural network (CNN) and test it to classify the properties of robustness and evolvability. We found that our CNN model successfully classified the properties. Thus, we conclude that our antifragility measure can be used as a predictor of the robustness and evolvability of biological networks. △ Less

Submitted 2 September, 2020; v1 submitted 4 February, 2020; originally announced February 2020.

Comments: 22 pages, 10 figures

Guiding the Self-organization of Cyber-Physical Systems

Authors: Carlos Gershenson

Abstract: Self-organization offers a promising approach for designing adaptive systems. Given the inherent complexity of most cyber-physical systems, adaptivity is desired, as predictability is limited. Here I summarize different concepts and approaches that can facilitate self-organization in cyber-physical systems, and thus be exploited for design. Then I mention real-world examples of systems where self-… ▽ More Self-organization offers a promising approach for designing adaptive systems. Given the inherent complexity of most cyber-physical systems, adaptivity is desired, as predictability is limited. Here I summarize different concepts and approaches that can facilitate self-organization in cyber-physical systems, and thus be exploited for design. Then I mention real-world examples of systems where self-organization has managed to provide solutions that outperform classical approaches, in particular related to urban mobility. Finally, I identify when a centralized, distributed, or self-organizing control is more appropriate. △ Less

Submitted 16 November, 2019; originally announced December 2019.

Comments: 16 pages, 2 figures

Journal ref: Frontiers in Robotics and AI, 7:41, 2020

Self-Organization and Artificial Life

Authors: Carlos Gershenson, Vito Trianni, Justin Werfel, Hiroki Sayama

Abstract: Self-organization can be broadly defined as the ability of a system to display ordered spatio-temporal patterns solely as the result of the interactions among the system components. Processes of this kind characterize both living and artificial systems, making self-organization a concept that is at the basis of several disciplines, from physics to biology and engineering. Placed at the frontiers b… ▽ More Self-organization can be broadly defined as the ability of a system to display ordered spatio-temporal patterns solely as the result of the interactions among the system components. Processes of this kind characterize both living and artificial systems, making self-organization a concept that is at the basis of several disciplines, from physics to biology and engineering. Placed at the frontiers between disciplines, Artificial Life (ALife) has heavily borrowed concepts and tools from the study of self-organization, providing mechanistic interpretations of life-like phenomena as well as useful constructivist approaches to artificial system design. Despite its broad usage within ALife, the concept of self-organization has been often excessively stretched or misinterpreted, calling for a clarification that could help with tracing the borders between what can and cannot be considered self-organization. In this review, we discuss the fundamental aspects of self-organization and list the main usages within three primary ALife domains, namely "soft" (mathematical/computational modeling), "hard" (physical robots), and "wet" (chemical/biological systems) ALife. We also provide a classification to locate this research. Finally, we discuss the usefulness of self-organization and related concepts within ALife studies, point to perspectives and challenges for future research, and list open questions. We hope that this work will motivate discussions related to self-organization in ALife and related fields. △ Less

Submitted 3 June, 2020; v1 submitted 14 March, 2019; originally announced March 2019.

Comments: 24 pages, 1 figure, 1 table arXiv admin note: substantial text overlap with arXiv:1804.01144

A Multilayer Structure Facilitates the Production of Antifragile Systems in Boolean Network Models

Authors: Hyobin Kim, Omar K. Pineda, Carlos Gershenson

Abstract: Antifragility is a property from which systems are able to resist stress and furthermore benefit from it. Even though antifragile dynamics is found in various real-world complex systems where multiple subsystems interact with each other, the attribute has not been quantitatively explored yet in those complex systems which can be regarded as multilayer networks. Here we study how the multilayer str… ▽ More Antifragility is a property from which systems are able to resist stress and furthermore benefit from it. Even though antifragile dynamics is found in various real-world complex systems where multiple subsystems interact with each other, the attribute has not been quantitatively explored yet in those complex systems which can be regarded as multilayer networks. Here we study how the multilayer structure affects the antifragility of the whole system. By comparing single-layer and multilayer Boolean networks based on our recently proposed antifragility measure, we found that the multilayer structure facilitated the production of antifragile systems. Our measure and findings will be useful for various applications such as exploring properties of biological systems with multilayer structures and creating more antifragile engineered systems. △ Less

Submitted 10 December, 2019; v1 submitted 28 February, 2019; originally announced February 2019.

Comments: 15 pages, 8 figures

Journal ref: Complexity, 2019:11

A Novel Antifragility Measure Based on Satisfaction and Its Application to Random and Biological Boolean Networks

Authors: Omar K. Pineda, Hyobin Kim, Carlos Gershenson

Abstract: Antifragility is a property that enhances the capability of a system in response to external perturbations. Although the concept has been applied in many areas, a practical measure of antifragility has not been developed yet. Here we propose a simply calculable measure of antifragility, based on the change of "satisfaction" before and after adding perturbations, and apply it to random Boolean netw… ▽ More Antifragility is a property that enhances the capability of a system in response to external perturbations. Although the concept has been applied in many areas, a practical measure of antifragility has not been developed yet. Here we propose a simply calculable measure of antifragility, based on the change of "satisfaction" before and after adding perturbations, and apply it to random Boolean networks (RBNs). Using the measure, we found that ordered RBNs are the most antifragile. Also, we demonstrated that seven biological systems are antifragile. Our measure and results can be used in various applications of Boolean networks (BNs) including creating antifragile engineering systems, identifying the genetic mechanism of antifragile biological systems, and develo** new treatment strategies for various diseases. △ Less

Submitted 24 April, 2019; v1 submitted 17 December, 2018; originally announced December 2018.

Comments: 15 pages, 7 figures

Journal ref: Complexity, 2019:10

Rank-frequency distribution of natural languages: a difference of probabilities approach

Authors: Germinal Cocho, R. F. Rodríguez, Sergio Sánchez, Jorge Flores, Carlos Pineda, Carlos Gershenson

Abstract: The time variation of the rank $k$ of words for six Indo-European languages is obtained using data from Google Books. For low ranks the distinct languages behave differently, maybe due to syntaxis rules, whereas for $k>50$ the law of large numbers predominates. The dynamics of $k$ is described stochastically through a master equation governing the time evolution of its probability density, which i… ▽ More The time variation of the rank $k$ of words for six Indo-European languages is obtained using data from Google Books. For low ranks the distinct languages behave differently, maybe due to syntaxis rules, whereas for $k>50$ the law of large numbers predominates. The dynamics of $k$ is described stochastically through a master equation governing the time evolution of its probability density, which is approximated by a Fokker-Planck equation that is solved analytically. The difference between the data and the asymptotic solution is identified with the transient solution, and good agreement is obtained. △ Less

Submitted 23 November, 2018; originally announced November 2018.

Comments: 11 pages

Journal ref: Physica A 532, 121795 (2019)

Self-Organization and Artificial Life: A Review

Authors: Carlos Gershenson, Vito Trianni, Justin Werfel, Hiroki Sayama

Abstract: Self-organization has been an important concept within a number of disciplines, which Artificial Life (ALife) also has heavily utilized since its inception. The term and its implications, however, are often confusing or misinterpreted. In this work, we provide a mini-review of self-organization and its relationship with ALife, aiming at initiating discussions on this important topic with the inter… ▽ More Self-organization has been an important concept within a number of disciplines, which Artificial Life (ALife) also has heavily utilized since its inception. The term and its implications, however, are often confusing or misinterpreted. In this work, we provide a mini-review of self-organization and its relationship with ALife, aiming at initiating discussions on this important topic with the interested audience. We first articulate some fundamental aspects of self-organization, outline its usage, and review its applications to ALife within its soft, hard, and wet domains. We also provide perspectives for further research. △ Less

Submitted 3 April, 2018; originally announced April 2018.

Comments: 8 pages, submitted to ALife 2018

Rank dynamics of word usage at multiple scales

Authors: José A. Morales, Ewan Colman, Sergio Sánchez, Fernanda Sánchez-Puig, Carlos Pineda, Gerardo Iñiguez, Germinal Cocho, Jorge Flores, Carlos Gershenson

Abstract: The recent dramatic increase in online data availability has allowed researchers to explore human culture with unprecedented detail, such as the growth and diversification of language. In particular, it provides statistical tools to explore whether word use is similar across languages, and if so, whether these generic features appear at different scales of language structure. Here we use the Googl… ▽ More The recent dramatic increase in online data availability has allowed researchers to explore human culture with unprecedented detail, such as the growth and diversification of language. In particular, it provides statistical tools to explore whether word use is similar across languages, and if so, whether these generic features appear at different scales of language structure. Here we use the Google Books $N$-grams dataset to analyze the temporal evolution of word usage in several languages. We apply measures proposed recently to study rank dynamics, such as the diversity of $N$-grams in a given rank, the probability that an $N$-gram changes rank between successive time intervals, the rank entropy, and the rank complexity. Using different methods, results show that there are generic properties for different languages at different scales, such as a core of words necessary to minimally understand a language. We also propose a null model to explore the relevance of linguistic structure across multiple scales, concluding that $N$-gram statistics cannot be reduced to word statistics. We expect our results to be useful in improving text prediction algorithms, as well as in shedding light on the large-scale features of language use, beyond linguistic and cultural differences across human populations. △ Less

Submitted 20 February, 2018; originally announced February 2018.

Comments: 19 pages (main text) + 24 pages (supplementary information)

Journal ref: Front. Phys. 6:45 (2018)

Self-Organization in Traffic Lights: Evolution of Signal Control with Advances in Sensors and Communications

Authors: Sanjay Goel, Stephen F. Bush, Carlos Gershenson

Abstract: Traffic signals are ubiquitous devices that first appeared in 1868. Recent advances in information and communications technology (ICT) have led to unprecedented improvements in such areas as mobile handheld devices (i.e., smartphones), the electric power industry (i.e., smart grids), transportation infrastructure, and vehicle area networks. Given the trend towards interconnectivity, it is only a m… ▽ More Traffic signals are ubiquitous devices that first appeared in 1868. Recent advances in information and communications technology (ICT) have led to unprecedented improvements in such areas as mobile handheld devices (i.e., smartphones), the electric power industry (i.e., smart grids), transportation infrastructure, and vehicle area networks. Given the trend towards interconnectivity, it is only a matter of time before vehicles communicate with one another and with infrastructure. In fact, several pilots of such vehicle-to-vehicle and vehicle-to-infrastructure (e.g. traffic lights and parking spaces) communication systems are already operational. This survey of autonomous and self-organized traffic signaling control has been undertaken with these potential developments in mind. Our research results indicate that, while many sophisticated techniques have attempted to improve the scheduling of traffic signal control, either real-time sensing of traffic patterns or a priori knowledge of traffic flow is required to optimize traffic. Once this is achieved, communication between traffic signals will serve to vastly improve overall traffic efficiency. △ Less

Submitted 18 June, 2017; originally announced August 2017.

Trajectory stability in the traveling salesman problem

Authors: Sergio Sánchez, Germinal Cocho, Jorge Flores, Carlos Gershenson, Gerardo Iñiguez, Carlos Pineda

Abstract: Two generalizations of the traveling salesman problem in which sites change their position in time are presented. The way the rank of different trajectory lengths changes in time is studied using the rank diversity. We analyze the statistical properties of rank distributions and rank dynamics and give evidence that the shortest and longest trajectories are more predictable and robust to change, th… ▽ More Two generalizations of the traveling salesman problem in which sites change their position in time are presented. The way the rank of different trajectory lengths changes in time is studied using the rank diversity. We analyze the statistical properties of rank distributions and rank dynamics and give evidence that the shortest and longest trajectories are more predictable and robust to change, that is, more stable. △ Less

Submitted 23 August, 2017; originally announced August 2017.

Comments: 8 pages

Journal ref: Complexity 2826082, 2018

Self-organized UAV Traffic in Realistic Environments

Authors: Csaba Virágh, Máté Nagy, Carlos Gershenson, Gábor Vásárhelyi

Abstract: We investigated different dense multirotor UAV traffic simulation scenarios in open 2D and 3D space, under realistic environments with the presence of sensor noise, communication delay, limited communication range, limited sensor update rate and finite inertia. We implemented two fundamental self-organized algorithms: one with constant direction and one with constant velocity preference to reach a… ▽ More We investigated different dense multirotor UAV traffic simulation scenarios in open 2D and 3D space, under realistic environments with the presence of sensor noise, communication delay, limited communication range, limited sensor update rate and finite inertia. We implemented two fundamental self-organized algorithms: one with constant direction and one with constant velocity preference to reach a desired target. We performed evolutionary optimization on both algorithms in five basic traffic scenarios and tested the optimized algorithms under different vehicle densities. We provide optimal algorithm and parameter selection criteria and compare the maximal flux and collision risk of each solution and situation. We found that i) different scenarios and densities require different algorithmic approaches, i.e., UAVs have to behave differently in sparse and dense environments or when they have common or different targets; ii) a slower-is-faster effect is implicitly present in our models, i.e., the maximal flux is achieved at densities where the average speed is far from maximal; iii) communication delay is the most severe destabilizing environmental condition that has a fundamental effect on performance and needs to be taken into account when designing algorithms to be used in real life. △ Less

Submitted 24 November, 2016; v1 submitted 29 October, 2016; originally announced October 2016.

Cybernetic Cities: Designing and controlling adaptive and robust urban systems

Authors: Carlos Gershenson, Paolo Santi, Carlo Ratti

Abstract: Cities are changing constantly. All urban systems face different conditions from day to day. Even when averaged regularities can be found, urban systems will be more efficient if they can adapt to changes at the same temporal scales at which these occur. Still, the functionality of urban systems must be robust to changes, either caused by adaptation or by other factors. Technology can assist human… ▽ More Cities are changing constantly. All urban systems face different conditions from day to day. Even when averaged regularities can be found, urban systems will be more efficient if they can adapt to changes at the same temporal scales at which these occur. Still, the functionality of urban systems must be robust to changes, either caused by adaptation or by other factors. Technology can assist humans in designing and regulating this adaptation and robustness. To achieve this, we propose a description of cities as cybernetic systems. We identify three main components: information, algorithms, and agents, which we illustrate with current and future examples. The implications of cybernetic cities are manifold, with direct impacts on mobility, sustainability, resilience, governance, and society. Still, the potential of a cybernetic perspective on cities will not depend so much on technology as on how we use it. △ Less

Submitted 15 February, 2022; v1 submitted 7 September, 2016; originally announced September 2016.

Journal ref: In Portugali, J. (ed.) Handbook on Cities and Complexity, ch. 10, pp. 195-208. Edward Elgar Publishing. 2021

Universal temporal features of rankings in competitive sports and games

Authors: José A. Morales, Sergio Sánchez, Jorge Flores, Carlos Pineda, Carlos Gershenson, Germinal Cocho, Jerónimo Zizumbo, Gerardo Iñiguez

Abstract: Many complex phenomena, from the selection of traits in biological systems to hierarchy formation in social and economic entities, show signs of competition and heterogeneous performance in the temporal evolution of their components, which may eventually lead to stratified structures such as the wealth distribution worldwide. However, it is still unclear whether the road to hierarchical complexity… ▽ More Many complex phenomena, from the selection of traits in biological systems to hierarchy formation in social and economic entities, show signs of competition and heterogeneous performance in the temporal evolution of their components, which may eventually lead to stratified structures such as the wealth distribution worldwide. However, it is still unclear whether the road to hierarchical complexity is determined by the particularities of each phenomena, or if there are universal mechanisms of stratification common to many systems. Human sports and games, with their (varied but simplified) rules of competition and measures of performance, serve as an ideal test bed to look for universal features of hierarchy formation. With this goal in mind, we analyse here the behaviour of players and team rankings over time for several sports and games. Even though, for a given time, the distribution of performance ranks varies across activities, we find statistical regularities in the dynamics of ranks. Specifically the rank diversity, a measure of the number of elements occupying a given rank over a length of time, has the same functional form in sports and games as in languages, another system where competition is determined by the use or disuse of grammatical structures. Our results support the notion that hierarchical phenomena may be driven by the same underlying mechanisms of rank formation, regardless of the nature of their components. Moreover, such regularities can in principle be used to predict lifetimes of rank occupancy, thus increasing our ability to forecast stratification in the presence of competition. △ Less

Submitted 13 June, 2016; originally announced June 2016.

Journal ref: EPJ Data Science 5:33 (2016)

Improving Urban Mobility by Understanding its Complexity

Authors: Carlos Gershenson

Abstract: Urban mobility systems are composed multiple elements with strong interactions, i.e. their future is co-determined by the state of other elements. Thus, studying components in isolation, i.e. using a reductionist approach, is inappropriate. I propose five recommendations to improve urban mobility based on insights from the scientific study of complex systems: use adaptation over prediction, regula… ▽ More Urban mobility systems are composed multiple elements with strong interactions, i.e. their future is co-determined by the state of other elements. Thus, studying components in isolation, i.e. using a reductionist approach, is inappropriate. I propose five recommendations to improve urban mobility based on insights from the scientific study of complex systems: use adaptation over prediction, regulate interactions to avoid friction, use sensors to recover real time information, develop adaptive algorithms to exploit that information, and deploy agents to act on the urban environment. △ Less

Submitted 14 March, 2016; originally announced March 2016.

Comments: 4 pages, book contribution

Exploring Dynamic Environments Using Stochastic Search Strategies

Authors: C. A. Piña-García, Dongbing Gu, J. Mario Siqueiros-García, Gustavo Carreón, Carlos Gershenson

Abstract: In this paper, we conduct a literature review of laws of motion based on stochastic search strategies which are mainly focused on exploring highly dynamic environments. In this regard, stochastic search strategies represent an interesting alternative to cope with uncertainty and reduced perceptual capabilities. This study aims to present an introductory overview of research in terms of directional… ▽ More In this paper, we conduct a literature review of laws of motion based on stochastic search strategies which are mainly focused on exploring highly dynamic environments. In this regard, stochastic search strategies represent an interesting alternative to cope with uncertainty and reduced perceptual capabilities. This study aims to present an introductory overview of research in terms of directional rules and searching methods mainly based on bio-inspired approaches. This study critically examines the role of animal searching behavior applied to random walk models using stochastic rules and kinesis or taxis. The aim of this study is to examine existing techniques and to select relevant work on random walks and analyze their actual contributions. In this regard, we cover a wide range of displacement events with an orientation mechanism given by a reactive behavior or a source-seeking behavior. Finally, we conclude with a discussion concerning the usefulness of using optimal foraging strategies as a reliable methodology. △ Less

Submitted 9 February, 2016; originally announced February 2016.

Comments: 8 pages, 11 figures

Measuring the Complexity of Continuous Distributions

Authors: Guillermo Santamaría-Bonfil, Nelson Fernández, Carlos Gershenson

Abstract: We extend previously proposed measures of complexity, emergence, and self-organization to continuous distributions using differential entropy. This allows us to calculate the complexity of phenomena for which distributions are known. We find that a broad range of common parameters found in Gaussian and scale-free distributions present high complexity values. We also explore the relationship betwee… ▽ More We extend previously proposed measures of complexity, emergence, and self-organization to continuous distributions using differential entropy. This allows us to calculate the complexity of phenomena for which distributions are known. We find that a broad range of common parameters found in Gaussian and scale-free distributions present high complexity values. We also explore the relationship between our measure of complexity and information adaptation. △ Less

Submitted 2 November, 2015; originally announced November 2015.

Comments: 21 pages, 5 Tables, 4 Figures

Journal ref: Entropy, 18(3):72. 2016

When slower is faster

Authors: Carlos Gershenson, Dirk Helbing

Abstract: The slower is faster (SIF) effect occurs when a system performs worse as its components try to do better. Thus, a moderate individual efficiency actually leads to a better systemic performance. The SIF effect takes place in a variety of phenomena. We review studies and examples of the SIF effect in pedestrian dynamics, vehicle traffic, traffic light control, logistics, public transport, social dyn… ▽ More The slower is faster (SIF) effect occurs when a system performs worse as its components try to do better. Thus, a moderate individual efficiency actually leads to a better systemic performance. The SIF effect takes place in a variety of phenomena. We review studies and examples of the SIF effect in pedestrian dynamics, vehicle traffic, traffic light control, logistics, public transport, social dynamics, ecological systems, and adaptation. Drawing on these examples, we generalize common features of the SIF effect and suggest possible future lines of research. △ Less

Submitted 19 October, 2015; v1 submitted 22 June, 2015; originally announced June 2015.

Journal ref: Complexity, 21(2):9-15. 2015

Rank diversity of languages: Generic behavior in computational linguistics

Authors: Germinal Cocho, Jorge Flores, Carlos Gershenson, Carlos Pineda, Sergio Sánchez

Abstract: Statistical studies of languages have focused on the rank-frequency distribution of words. Instead, we introduce here a measure of how word ranks change in time and call this distribution \emph{rank diversity}. We calculate this diversity for books published in six European languages since 1800, and find that it follows a universal lognormal distribution. Based on the mean and standard deviation a… ▽ More Statistical studies of languages have focused on the rank-frequency distribution of words. Instead, we introduce here a measure of how word ranks change in time and call this distribution \emph{rank diversity}. We calculate this diversity for books published in six European languages since 1800, and find that it follows a universal lognormal distribution. Based on the mean and standard deviation associated with the lognormal distribution, we define three different word regimes of languages: "heads" consist of words which almost do not change their rank in time, "bodies" are words of general use, while "tails" are comprised by context-specific words and vary their rank considerably in time. The heads and bodies reflect the size of language cores identified by linguists for basic communication. We propose a Gaussian random walk model which reproduces the rank variation of words in time and thus the diversity. Rank diversity of words can be understood as the result of random variations in rank, where the size of the variation depends on the rank itself. We find that the core size is similar for all languages studied. △ Less

Submitted 14 May, 2015; originally announced May 2015.

Journal ref: PLoS ONE 10(4): e0121898 (2015)

Urban transfer entropy across scales

Authors: Roberto Murcio, Robin Morphet, Carlos Gershenson, Michael Batty

Abstract: The morphology of urban agglomeration is studied here in the context of information exchange between different spatio-temporal scales. Cities are multidimensional non-linear phenomena, so understanding the relationships and connectivity between scales is important in determining how the interplay of local/regional urban policies may affect the distribution of urban settlements. In order to quantif… ▽ More The morphology of urban agglomeration is studied here in the context of information exchange between different spatio-temporal scales. Cities are multidimensional non-linear phenomena, so understanding the relationships and connectivity between scales is important in determining how the interplay of local/regional urban policies may affect the distribution of urban settlements. In order to quantify these relationships, we follow an information theoretic approach using the concept of Transfer Entropy. Our analysis is based on a stochastic urban fractal model, which mimics urban growing settlements and migration waves. The results indicate how different policies could affect urban morphology in terms of the information generated across geographical scales. △ Less

Submitted 8 May, 2015; originally announced May 2015.

Comments: 19 pages, 4 figures

Requisite Variety, Autopoiesis, and Self-organization

Authors: Carlos Gershenson

Abstract: Ashby's law of requisite variety states that a controller must have at least as much variety (complexity) as the controlled. Maturana and Varela proposed autopoiesis (self-production) to define living systems. Living systems also require to fulfill the law of requisite variety. A measure of autopoiesis has been proposed as the ratio between the complexity of a system and the complexity of its envi… ▽ More Ashby's law of requisite variety states that a controller must have at least as much variety (complexity) as the controlled. Maturana and Varela proposed autopoiesis (self-production) to define living systems. Living systems also require to fulfill the law of requisite variety. A measure of autopoiesis has been proposed as the ratio between the complexity of a system and the complexity of its environment. Self-organization can be used as a concept to guide the design of systems towards higher values of autopoiesis, with the potential of making technology more "living", i.e. adaptive and robust. △ Less

Submitted 5 November, 2014; v1 submitted 26 September, 2014; originally announced September 2014.

Comments: Invited keynote at WOSC 2014

Journal ref: Kybernetes, 44(6-7):866-873. 2015

Harnessing the Complexity of Education with Information Technology

Authors: Carlos Gershenson

Abstract: Education at all levels is facing several challenges in most countries, such as low quality, high costs, lack of educators, and unsatisfied student demand. Traditional approaches are becoming unable to deliver the required education. Several causes for this inefficiency can be identified. I argue that beyond specific causes, the lack of effective education is related to complexity. However, inform… ▽ More Education at all levels is facing several challenges in most countries, such as low quality, high costs, lack of educators, and unsatisfied student demand. Traditional approaches are becoming unable to deliver the required education. Several causes for this inefficiency can be identified. I argue that beyond specific causes, the lack of effective education is related to complexity. However, information technology is hel** us overcome this complexity. △ Less

Submitted 10 February, 2014; originally announced February 2014.

Comments: 5 pages, 2 figures. Commentary

ACM Class: K.3; F.1.3

Journal ref: Complexity, 20(5):13-16. 2015

Measuring the Complexity of Self-organizing Traffic Lights

Authors: Dario Zubillaga, Geovany Cruz, Luis Daniel Aguilar, Jorge Zapotecatl, Nelson Fernandez, Jose Aguilar, David A. Rosenblueth, Carlos Gershenson

Abstract: We apply measures of complexity, emergence and self-organization to an abstract city traffic model for comparing a traditional traffic coordination method with a self-organizing method in two scenarios: cyclic boundaries and non-orientable boundaries. We show that the measures are useful to identify and characterize different dynamical phases. It becomes clear that different operation regimes are… ▽ More We apply measures of complexity, emergence and self-organization to an abstract city traffic model for comparing a traditional traffic coordination method with a self-organizing method in two scenarios: cyclic boundaries and non-orientable boundaries. We show that the measures are useful to identify and characterize different dynamical phases. It becomes clear that different operation regimes are required for different traffic demands. Thus, not only traffic is a non-stationary problem, which requires controllers to adapt constantly. Controllers must also change drastically the complexity of their behavior depending on the demand. Based on our measures, we can say that the self-organizing method achieves an adaptability level comparable to a living system. △ Less

Submitted 2 February, 2014; originally announced February 2014.

Comments: 18 pages, 11 figures

ACM Class: F.1.1; D.2.8; F.1.3; J.2; H.1.1

Journal ref: Entropy, 16(5):2384-2407. 2014

Complexity measurement of natural and artificial languages

Authors: Gerardo Febres, Klaus Jaffe, Carlos Gershenson

Abstract: We compared entropy for texts written in natural languages (English, Spanish) and artificial languages (computer software) based on a simple expression for the entropy as a function of message length and specific word diversity. Code text written in artificial languages showed higher entropy than text of similar length expressed in natural languages. Spanish texts exhibit more symbolic diversity t… ▽ More We compared entropy for texts written in natural languages (English, Spanish) and artificial languages (computer software) based on a simple expression for the entropy as a function of message length and specific word diversity. Code text written in artificial languages showed higher entropy than text of similar length expressed in natural languages. Spanish texts exhibit more symbolic diversity than English ones. Results showed that algorithms based on complexity measures differentiate artificial from natural languages, and that text analysis based on complexity measures allows the unveiling of important aspects of their nature. We propose specific expressions to examine entropy related aspects of tests and estimate the values of entropy, emergence, self-organization and complexity based on specific diversity and message length. △ Less

Submitted 22 November, 2013; v1 submitted 19 November, 2013; originally announced November 2013.

Comments: 29 pages, 11 figures, 3 tables, 2 appendixes

Journal ref: Complexity 20 6 429- (2015)

Modelling Complexity for Policy: Opportunities and Challenges

Authors: Bruce Edmonds, Carlos Gershenson

Abstract: This chapter reviews the purpose and use of models from the field of complex systems and, in particular, the implications of trying to use models to understand or make decisions within complex situations, such as policy makers usually face. A discussion of the different dimensions one can formalise situations, the different purposes for models and the different kinds of relationship they can have… ▽ More This chapter reviews the purpose and use of models from the field of complex systems and, in particular, the implications of trying to use models to understand or make decisions within complex situations, such as policy makers usually face. A discussion of the different dimensions one can formalise situations, the different purposes for models and the different kinds of relationship they can have with the policy making process, is followed by an examination of the compromises forced by the complexity of the target issues. Several modelling approaches from complexity science are briefly described, with notes as to their abilities and limitations. These approaches include system dynamics, network theory, information theory, cellular automata, and agent-based modelling. Some examples of policy models are presented and discussed in the context of the previous analysis. Finally we conclude by outlining some of the major pitfalls facing those wishing to use such models for policy evaluation. △ Less

Submitted 8 October, 2013; originally announced October 2013.

Comments: Draft for the Handbook on Complexity and Public Policy, edited by Robert Geyer and Paul Cairney

The Past, Present and Future of Cybernetics and Systems Research

Authors: Carlos Gershenson, Peter Csermely, Peter Erdi, Helena Knyazeva, Alexander Laszlo

Abstract: Cybernetics and Systems Research (CSR) were developed in the mid-twentieth century, offering the possibility of describing and comparing different phenomena using the same language. The concepts which originated in CSR have spread to practically all disciplines, many now used within the scientific study of complex systems. CSR has the potential to contribute to the solution of relevant problems, b… ▽ More Cybernetics and Systems Research (CSR) were developed in the mid-twentieth century, offering the possibility of describing and comparing different phenomena using the same language. The concepts which originated in CSR have spread to practically all disciplines, many now used within the scientific study of complex systems. CSR has the potential to contribute to the solution of relevant problems, but the path towards this goal is not straightforward. This paper summarizes the ideas presented by the authors during a round table in 2012 on the past, present and future of CSR. △ Less

Submitted 23 September, 2013; v1 submitted 28 August, 2013; originally announced August 2013.

Comments: 10 pages

Journal ref: systema: connecting matter, life, culture and technology, 1(3):4-13. 2014

Measuring Complexity in an Aquatic Ecosystem

Authors: Nelson Fernandez, Carlos Gershenson

Abstract: We apply formal measures of emergence, self-organization, homeostasis, autopoiesis and complexity to an aquatic ecosystem; in particular to the physiochemical component of an Arctic lake. These measures are based on information theory. Variables with an homogeneous distribution have higher values of emergence, while variables with a more heterogeneous distribution have a higher self-organization.… ▽ More We apply formal measures of emergence, self-organization, homeostasis, autopoiesis and complexity to an aquatic ecosystem; in particular to the physiochemical component of an Arctic lake. These measures are based on information theory. Variables with an homogeneous distribution have higher values of emergence, while variables with a more heterogeneous distribution have a higher self-organization. Variables with a high complexity reflect a balance between change (emergence) and regularity/order (self-organization). In addition, homeostasis values coincide with the variation of the winter and summer seasons. Autopoiesis values show a higher degree of independence of biological components over their environment. Our approach shows how the ecological dynamics can be described in terms of information. △ Less

Submitted 21 May, 2013; originally announced May 2013.

Comments: 6 pages, to be published in Proceedings of the CCBCOL 2013, 2nd Colombian Computational Biology Congress, Springer

The Dynamically Extended Mind -- A Minimal Modeling Case Study

Authors: Tom Froese, Carlos Gershenson, David A. Rosenblueth

Abstract: The extended mind hypothesis has stimulated much interest in cognitive science. However, its core claim, i.e. that the process of cognition can extend beyond the brain via the body and into the environment, has been heavily criticized. A prominent critique of this claim holds that when some part of the world is coupled to a cognitive system this does not necessarily entail that the part is also co… ▽ More The extended mind hypothesis has stimulated much interest in cognitive science. However, its core claim, i.e. that the process of cognition can extend beyond the brain via the body and into the environment, has been heavily criticized. A prominent critique of this claim holds that when some part of the world is coupled to a cognitive system this does not necessarily entail that the part is also constitutive of that cognitive system. This critique is known as the "coupling-constitution fallacy". In this paper we respond to this reductionist challenge by using an evolutionary robotics approach to create a minimal model of two acoustically coupled agents. We demonstrate how the interaction process as a whole has properties that cannot be reduced to the contributions of the isolated agents. We also show that the neural dynamics of the coupled agents has formal properties that are inherently impossible for those neural networks in isolation. By kee** the complexity of the model to an absolute minimum, we are able to illustrate how the coupling-constitution fallacy is in fact based on an inadequate understanding of the constitutive role of nonlinear interactions in dynamical systems theory. △ Less

Submitted 8 May, 2013; originally announced May 2013.

Comments: 8 pages, accepted in Congress on Evolutionary Computation IEEE CEC 2013, Evolutionary Robotics track

ACM Class: I.2.0

Information Measures of Complexity, Emergence, Self-organization, Homeostasis, and Autopoiesis

Authors: Nelson Fernandez, Carlos Maldonado, Carlos Gershenson

Abstract: This chapter reviews measures of emergence, self-organization, complexity, homeostasis, and autopoiesis based on information theory. These measures are derived from proposed axioms and tested in two case studies: random Boolean networks and an Arctic lake ecosystem. Emergence is defined as the information a system or process produces. Self-organization is defined as the opposite of emergence, wh… ▽ More This chapter reviews measures of emergence, self-organization, complexity, homeostasis, and autopoiesis based on information theory. These measures are derived from proposed axioms and tested in two case studies: random Boolean networks and an Arctic lake ecosystem. Emergence is defined as the information a system or process produces. Self-organization is defined as the opposite of emergence, while complexity is defined as the balance between emergence and self-organization. Homeostasis reflects the stability of a system. Autopoiesis is defined as the ratio between the complexity of a system and the complexity of its environment. The proposed measures can be applied at different scales, which can be studied with multi-scale profiles. △ Less

Submitted 31 July, 2013; v1 submitted 5 April, 2013; originally announced April 2013.

Comments: 35 pages, 12 figures, to be published in Prokopenko, M., editor, Guided Self-Organization: Inception. Springer. In Press

Report number: C3 Report 2013.02 ACM Class: H.1.1; F.1.3; J.3

Information and Computation

Authors: Carlos Gershenson

Abstract: In this chapter, concepts related to information and computation are reviewed in the context of human computation. A brief introduction to information theory and different types of computation is given. Two examples of human computation systems, online social networks and Wikipedia, are used to illustrate how these can be described and compared in terms of information and computation. In this chapter, concepts related to information and computation are reviewed in the context of human computation. A brief introduction to information theory and different types of computation is given. Two examples of human computation systems, online social networks and Wikipedia, are used to illustrate how these can be described and compared in terms of information and computation. △ Less

Submitted 24 May, 2013; v1 submitted 4 April, 2013; originally announced April 2013.

Comments: 9 pages, 3 figures. Draft of a chapter to be published in Michelucci, P. (Ed.) Handbook of Human Computation, Springer

ACM Class: H.1.2; H.1.1; F.1.1

Self-Organization Promotes the Evolution of Cooperation with Cultural Propagation

Authors: Luis Enrique Cortés-Berrueco, Carlos Gershenson, Christopher R. Stephens

Abstract: In this paper three computational models for the study of the evolution of cooperation under cultural propagation are studied: Kin Selection, Direct Reciprocity and Indirect Reciprocity. Two analyzes are reported, one comparing their behavior between them and a second one identifying the impact that different parameters have in the model dynamics. The results of these analyzes illustrate how game… ▽ More In this paper three computational models for the study of the evolution of cooperation under cultural propagation are studied: Kin Selection, Direct Reciprocity and Indirect Reciprocity. Two analyzes are reported, one comparing their behavior between them and a second one identifying the impact that different parameters have in the model dynamics. The results of these analyzes illustrate how game transitions may occur depending of some parameters within the models and also explain how agents adapt to these transitions by individually choosing their attachment to a cooperative attitude. These parameters regulate how cooperation can self-organize under different circumstances. The emergence of the evolution of cooperation as a result of the agent's adapting processes is also discussed. △ Less

Submitted 1 March, 2013; v1 submitted 26 February, 2013; originally announced February 2013.

Living is information processing: from molecules to global systems

Authors: Keith D. Farnsworth, John Nelson, Carlos Gershenson

Abstract: We extend the concept that life is an informational phenomenon, at every level of organisation, from molecules to the global ecological system. According to this thesis: (a) living is information processing, in which memory is maintained by both molecular states and ecological states as well as the more obvious nucleic acid coding; (b) this information processing has one overall function - to perp… ▽ More We extend the concept that life is an informational phenomenon, at every level of organisation, from molecules to the global ecological system. According to this thesis: (a) living is information processing, in which memory is maintained by both molecular states and ecological states as well as the more obvious nucleic acid coding; (b) this information processing has one overall function - to perpetuate itself; and (c) the processing method is filtration (cognition) of, and synthesis of, information at lower levels to appear at higher levels in complex systems (emergence). We show how information patterns, are united by the creation of mutual context, generating persistent consequences, to result in `functional information'. This constructive process forms arbitrarily large complexes of information, the combined effects of which include the functions of life. Molecules and simple organisms have already been measured in terms of functional information content; we show how quantification may be extended to each level of organisation up to the ecological. In terms of a computer analogy, life is both the data and the program and its biochemical structure is the way the information is embodied. This idea supports the seamless integration of life at all scales with the physical universe. The innovation reported here is essentially to integrate these ideas, basing information on the `general definition' of information, rather than simply the statistics of information, thereby explaining how functional information operates throughout life. △ Less

Submitted 1 March, 2013; v1 submitted 22 October, 2012; originally announced October 2012.

Comments: 28 pages, 2 figures

ACM Class: H.1.1; J.3

Journal ref: Acta Biotheoretica, 61(2):203-222. 2013

Measuring the Complexity of Ultra-Large-Scale Adaptive Systems

Authors: Michele Amoretti, Carlos Gershenson

Abstract: Ultra-large scale (ULS) systems are becoming pervasive. They are inherently complex, which makes their design and control a challenge for traditional methods. Here we propose the design and analysis of ULS systems using measures of complexity, emergence, self-organization, and homeostasis based on information theory. These measures allow the evaluation of ULS systems and thus can be used to guide… ▽ More Ultra-large scale (ULS) systems are becoming pervasive. They are inherently complex, which makes their design and control a challenge for traditional methods. Here we propose the design and analysis of ULS systems using measures of complexity, emergence, self-organization, and homeostasis based on information theory. These measures allow the evaluation of ULS systems and thus can be used to guide their design. We evaluate the proposal with a ULS computing system provided with adaptation mechanisms. We show the evolution of the system with stable and also changing workload, using different fitness functions. When the adaptive plan forces the system to converge to a predefined performance level, the nodes may result in highly unstable configurations, that correspond to a high variance in time of the measured complexity. Conversely, if the adaptive plan is less "aggressive", the system may be more stable, but the optimal performance may not be achieved. △ Less

Submitted 22 March, 2013; v1 submitted 27 July, 2012; originally announced July 2012.

Comments: highly extended version, 28 pages, 11 figures

Complexity and Information: Measuring Emergence, Self-organization, and Homeostasis at Multiple Scales

Authors: Carlos Gershenson, Nelson Fernandez

Abstract: Concepts used in the scientific study of complex systems have become so widespread that their use and abuse has led to ambiguity and confusion in their meaning. In this paper we use information theory to provide abstract and concise measures of complexity, emergence, self-organization, and homeostasis. The purpose is to clarify the meaning of these concepts with the aid of the proposed formal meas… ▽ More Concepts used in the scientific study of complex systems have become so widespread that their use and abuse has led to ambiguity and confusion in their meaning. In this paper we use information theory to provide abstract and concise measures of complexity, emergence, self-organization, and homeostasis. The purpose is to clarify the meaning of these concepts with the aid of the proposed formal measures. In a simplified version of the measures (focusing on the information produced by a system), emergence becomes the opposite of self-organization, while complexity represents their balance. Homeostasis can be seen as a measure of the stability of the system. We use computational experiments on random Boolean networks and elementary cellular automata to illustrate our measures at multiple scales. △ Less

Submitted 10 August, 2012; v1 submitted 9 May, 2012; originally announced May 2012.

Comments: 42 pages, 11 figures, 2 tables

Report number: C3 2012.03 MSC Class: 94A15 (Primary) 94A17; 68Q15; 68Q80 (Secondary) ACM Class: H.1.1; F.1.3; F.1.1

Journal ref: Complexity 18(2):29-44. 2012

Learning, Social Intelligence and the Turing Test - why an "out-of-the-box" Turing Machine will not pass the Turing Test

Authors: Bruce Edmonds, Carlos Gershenson

Abstract: The Turing Test (TT) checks for human intelligence, rather than any putative general intelligence. It involves repeated interaction requiring learning in the form of adaption to the human conversation partner. It is a macro-level post-hoc test in contrast to the definition of a Turing Machine (TM), which is a prior micro-level definition. This raises the question of whether learning is just anothe… ▽ More The Turing Test (TT) checks for human intelligence, rather than any putative general intelligence. It involves repeated interaction requiring learning in the form of adaption to the human conversation partner. It is a macro-level post-hoc test in contrast to the definition of a Turing Machine (TM), which is a prior micro-level definition. This raises the question of whether learning is just another computational process, i.e. can be implemented as a TM. Here we argue that learning or adaption is fundamentally different from computation, though it does involve processes that can be seen as computations. To illustrate this difference we compare (a) designing a TM and (b) learning a TM, defining them for the purpose of the argument. We show that there is a well-defined sequence of problems which are not effectively designable but are learnable, in the form of the bounded halting problem. Some characteristics of human intelligence are reviewed including it's: interactive nature, learning abilities, imitative tendencies, linguistic ability and context-dependency. A story that explains some of these is the Social Intelligence Hypothesis. If this is broadly correct, this points to the necessity of a considerable period of acculturation (social learning in context) if an artificial intelligence is to pass the TT. Whilst it is always possible to 'compile' the results of learning into a TM, this would not be a designed TM and would not be able to continually adapt (pass future TTs). We conclude three things, namely that: a purely "designed" TM will never pass the TT; that there is no such thing as a general intelligence since it necessary involves learning; and that learning/adaption and computation should be clearly distinguished. △ Less

Submitted 15 March, 2012; originally announced March 2012.

Comments: 10 pages, invited talk at Turing Centenary Conference CiE 2012, special session on "The Turing Test and Thinking Machines"

Report number: CPM Report No.: 12-215 ACM Class: F.1.1; I.2.0

Journal ref: Lecture Notes in Computer Science 7318 (2012) pp. 182-192

Facing Complexity: Prediction vs. Adaptation

Authors: Carlos Gershenson

Abstract: One of the presuppositions of science since the times of Galileo, Newton, Laplace, and Descartes has been the predictability of the world. This idea has strongly influenced scientific and technological models. However, in recent decades, chaos and complexity have shown that not every phenomenon is predictable, even if it is deterministic. If a problem space is predictable, in theory we can find a… ▽ More One of the presuppositions of science since the times of Galileo, Newton, Laplace, and Descartes has been the predictability of the world. This idea has strongly influenced scientific and technological models. However, in recent decades, chaos and complexity have shown that not every phenomenon is predictable, even if it is deterministic. If a problem space is predictable, in theory we can find a solution via optimization. Nevertheless, if a problem space is not predictable, or it changes too fast, very probably optimization will offer obsolete solutions. This occurs often when the immediate solution affects the problem itself. An alternative is found in adaptation. An adaptive system will be able to find by itself new solutions for unforeseen situations. △ Less

Submitted 16 December, 2011; originally announced December 2011.

Comments: Introduction to the implications of complex systems for a general audience. English and updated version of http://arxiv.longhoe.net/abs/0905.4908, to be published in Martorell, X. & Massip, A. (Eds.) Complexity and Language. 13 pages, 3 figures

Report number: C3 Report 2011.10