Showing 1–50 of 56 results for author: Browne, C

Spontaneous assembly of condensate networks during the demixing of structured fluids

Authors: Yuma Morimitsu, Christopher A. Browne, Zhe Liu, Paul G. Severino, Manesh Gopinadhan, Eric B. Sirota, Ozcan Altintas, Kazem V. Edmond, Chinedum O. Osuji

Abstract: Liquid-liquid phase separation, whereby two liquids spontaneously demix, is ubiquitous in industrial, environmental, and biological processes. While isotropic fluids are known to condense into spherical droplets in the binodal region, these dynamics are poorly understood for structured fluids. Here, we report the novel observation of condensate networks, which spontaneously assemble during the dem… ▽ More Liquid-liquid phase separation, whereby two liquids spontaneously demix, is ubiquitous in industrial, environmental, and biological processes. While isotropic fluids are known to condense into spherical droplets in the binodal region, these dynamics are poorly understood for structured fluids. Here, we report the novel observation of condensate networks, which spontaneously assemble during the demixing of a mesogen from a solvent. Condensing mesogens form rapidly-elongating filaments, rather than spheres, to relieve distortion of a simultaneously-forming internal smectic mesophase. As filaments densify, they collapse into bulged discs, lowering the elastic free energy. Additional distortion is relieved by retraction of filaments into the bulged discs, which are straightened under tension to form a ramified network. Understanding and controlling these dynamics may provide new avenues to direct pattern formation or template materials. △ Less

Submitted 8 April, 2024; v1 submitted 2 March, 2024; originally announced March 2024.

Harnessing elastic instabilities for enhanced mixing and reaction kinetics in porous media

Authors: Christopher A. Browne, Sujit S. Datta

Abstract: Turbulent flows have been used for millennia to mix solutes; a familiar example is stirring cream into coffee. However, many energy, environmental, and industrial processes rely on the mixing of solutes in porous media where confinement suppresses inertial turbulence. As a result, mixing is drastically hindered, requiring fluid to permeate long distances for appreciable mixing and introducing addi… ▽ More Turbulent flows have been used for millennia to mix solutes; a familiar example is stirring cream into coffee. However, many energy, environmental, and industrial processes rely on the mixing of solutes in porous media where confinement suppresses inertial turbulence. As a result, mixing is drastically hindered, requiring fluid to permeate long distances for appreciable mixing and introducing additional steps to drive mixing that can be expensive and environmentally harmful. Here, we demonstrate that this limitation can be overcome just by adding dilute amounts of flexible polymers to the fluid. Flow-driven stretching of the polymers generates an elastic instability (EI), driving turbulent-like chaotic flow fluctuations, despite the pore-scale confinement that prohibits typical inertial turbulence. Using in situ imaging, we show that these fluctuations stretch and fold the fluid within the pores along thin layers (``lamellae'') characterized by sharp solute concentration gradients, driving mixing by diffusion in the pores. This process results in a $3\times$ reduction in the required mixing length, a $6\times$ increase in solute transverse dispersivity, and can be harnessed to increase the rate at which chemical compounds react by $3\times$ -- enhancements that we rationalize using turbulence-inspired modeling of the underlying transport processes. Our work thereby establishes a simple, robust, versatile, and predictive new way to mix solutes in porous media, with potential applications ranging from large-scale chemical production to environmental remediation. △ Less

Submitted 13 November, 2023; originally announced November 2023.

Develo** a Machine Learning-Based Clinical Decision Support Tool for Uterine Tumor Imaging

Authors: Darryl E. Wright, Adriana V. Gregory, Deema Anaam, Sepideh Yadollahi, Sumana Ramanathan, Kafayat A. Oyemade, Reem Alsibai, Heather Holmes, Harrison Gottlich, Cherie-Akilah G. Browne, Sarah L. Cohen Rassier, Isabel Green, Elizabeth A. Stewart, Hiroaki Takahashi, Bohyun Kim, Shannon Laughlin-Tommaso, Timothy L. Kline

Abstract: Uterine leiomyosarcoma (LMS) is a rare but aggressive malignancy. On imaging, it is difficult to differentiate LMS from, for example, degenerated leiomyoma (LM), a prevalent but benign condition. We curated a data set of 115 axial T2-weighted MRI images from 110 patients (mean [range] age=45 [17-81] years) with UTs that included five different tumor types. These data were randomly split stratifyin… ▽ More Uterine leiomyosarcoma (LMS) is a rare but aggressive malignancy. On imaging, it is difficult to differentiate LMS from, for example, degenerated leiomyoma (LM), a prevalent but benign condition. We curated a data set of 115 axial T2-weighted MRI images from 110 patients (mean [range] age=45 [17-81] years) with UTs that included five different tumor types. These data were randomly split stratifying on tumor volume into training (n=85) and test sets (n=30). An independent second reader (reader 2) provided manual segmentations for all test set images. To automate segmentation, we applied nnU-Net and explored the effect of training set size on performance by randomly generating subsets with 25, 45, 65 and 85 training set images. We evaluated the ability of radiomic features to distinguish between types of UT individually and when combined through feature selection and machine learning. Using the entire training set the mean [95% CI] fibroid DSC was measured as 0.87 [0.59-1.00] and the agreement between the two readers was 0.89 [0.77-1.0] on the test set. When classifying degenerated LM from LMS we achieve a test set F1-score of 0.80. Classifying UTs based on radiomic features we identify classifiers achieving F1-scores of 0.53 [0.45, 0.61] and 0.80 [0.80, 0.80] on the test set for the benign versus malignant, and degenerated LM versus LMS tasks. We show that it is possible to develop an automated method for 3D segmentation of the uterus and UT that is close to human-level performance with fewer than 150 annotated images. For distinguishing UT types, while we train models that merit further investigation with additional data, reliable automatic differentiation of UTs remains a challenge. △ Less

Submitted 20 August, 2023; originally announced August 2023.

Fluid drainage in erodible porous media

Authors: Joanna Schneider, Christopher A. Browne, Malcolm Slutzky, Cecilia A. Quirk, Daniel B. Amchin, Sujit S. Datta

Abstract: Drainage, in which a nonwetting fluid displaces a wetting fluid from a porous medium, is well-studied for media with unchanging solid surfaces. However, many media can be eroded by drainage, with eroded material redeposited in pores downstream, altering further flow. Here, we use theory and simulation to examine how these coupled processes both alter the overall fluid displacement pathway and help… ▽ More Drainage, in which a nonwetting fluid displaces a wetting fluid from a porous medium, is well-studied for media with unchanging solid surfaces. However, many media can be eroded by drainage, with eroded material redeposited in pores downstream, altering further flow. Here, we use theory and simulation to examine how these coupled processes both alter the overall fluid displacement pathway and help reshape the solid medium. We find two new drainage behaviors with markedly different characteristics, and quantitatively delineate the conditions under which they arise. Our results thereby help expand current understanding of these rich physics, with implications for applications of drainage in industry and the environment. △ Less

Submitted 2 March, 2023; originally announced March 2023.

Measuring Board Game Distance

Authors: Matthew Stephenson, Dennis J. N. J. Soemers, Éric Piette, Cameron Browne

Abstract: This paper presents a general approach for measuring distances between board games within the Ludii general game system. These distances are calculated using a previously published set of general board game concepts, each of which represents a common game idea or shared property. Our results compare and contrast two different measures of distance, highlighting the subjective nature of such metrics… ▽ More This paper presents a general approach for measuring distances between board games within the Ludii general game system. These distances are calculated using a previously published set of general board game concepts, each of which represents a common game idea or shared property. Our results compare and contrast two different measures of distance, highlighting the subjective nature of such metrics and discussing the different ways that they can be interpreted. △ Less

Submitted 10 January, 2023; originally announced January 2023.

Comments: Accepted at the Computers and Games 2022 conference

Elastic turbulence homogenizes fluid transport in stratified porous media

Authors: Christopher A. Browne, Richard B. Huang, Callie W. Zheng, Sujit S. Datta

Abstract: Many key environmental, industrial, and energy processes rely on controlling fluid transport within subsurface porous media. These media are typically structurally heterogeneous, often with vertically-layered strata of distinct permeabilities -- leading to uneven partitioning of flow across strata, which can be undesirable. Here, using direct in situ visualization, we demonstrate that polymer addi… ▽ More Many key environmental, industrial, and energy processes rely on controlling fluid transport within subsurface porous media. These media are typically structurally heterogeneous, often with vertically-layered strata of distinct permeabilities -- leading to uneven partitioning of flow across strata, which can be undesirable. Here, using direct in situ visualization, we demonstrate that polymer additives can homogenize this flow by inducing a purely-elastic flow instability that generates random spatiotemporal fluctuations and excess flow resistance in individual strata. In particular, we find that this instability arises at smaller imposed flow rates in higher-permeability strata, diverting flow towards lower-permeability strata and hel** to homogenize the flow. Guided by the experiments, we develop a parallel-resistor model that quantitatively predicts the flow rate at which this homogenization is optimized for a given stratified medium. Thus, our work provides a new approach to homogenizing fluid and passive scalar transport in heterogeneous porous media. △ Less

Submitted 12 July, 2022; originally announced July 2022.

Combining Monte-Carlo Tree Search with Proof-Number Search

Authors: Elliot Doe, Mark H. M. Winands, Dennis J. N. J. Soemers, Cameron Browne

Abstract: Proof-Number Search (PNS) and Monte-Carlo Tree Search (MCTS) have been successfully applied for decision making in a range of games. This paper proposes a new approach called PN-MCTS that combines these two tree-search methods by incorporating the concept of proof and disproof numbers into the UCT formula of MCTS. Experimental results demonstrate that PN-MCTS outperforms basic MCTS in several game… ▽ More Proof-Number Search (PNS) and Monte-Carlo Tree Search (MCTS) have been successfully applied for decision making in a range of games. This paper proposes a new approach called PN-MCTS that combines these two tree-search methods by incorporating the concept of proof and disproof numbers into the UCT formula of MCTS. Experimental results demonstrate that PN-MCTS outperforms basic MCTS in several games including Lines of Action, MiniShogi, Knightthrough, and Awari, achieving win rates up to 94.0%. △ Less

Submitted 8 June, 2022; originally announced June 2022.

Comments: Accepted at IEEE CoG 2022. Copyright of final version held by IEEE

Five Ps: Leverage Zones Towards Responsible AI

Authors: Ehsan Nabavi, Chris Browne

Abstract: There is a growing debate amongst academics and practitioners on whether interventions made, thus far, towards Responsible AI would have been enough to engage with root causes of AI problems. Failure to effect meaningful changes in this system could see these initiatives to not reach their potential and lead to the concept becoming another buzzword for companies to use in their marketing campaigns… ▽ More There is a growing debate amongst academics and practitioners on whether interventions made, thus far, towards Responsible AI would have been enough to engage with root causes of AI problems. Failure to effect meaningful changes in this system could see these initiatives to not reach their potential and lead to the concept becoming another buzzword for companies to use in their marketing campaigns. We propose that there is an opportunity to improve the extent to which interventions are understood to be effective in their contribution to the change required for Responsible AI. Using the notions of leverage zones adapted from the 'Systems Thinking' literature, we suggest a novel approach to evaluate the effectiveness of interventions, to focus on those that may bring about the real change that is needed. In this paper we argue that insights from using this perspective demonstrate that the majority of current initiatives taken by various actors in the field, focus on low-order interventions, such as short-term fixes, tweaking algorithms and updating parameters, absent from higher-order interventions, such as redefining the system's foundational structures that govern those parameters, or challenging the underlying purpose upon which those structures are built and developed in the first place(high-leverage). This paper presents a conceptual framework called the Five Ps to identify interventions towards Responsible AI and provides a scaffold for transdisciplinary question asking to improve outcomes towards Responsible AI. △ Less

Submitted 20 April, 2022; originally announced May 2022.

A Change Dynamic Model for the Online Detection of Gradual Change

Authors: Chris Browne

Abstract: Changes in the statistical properties of a stochastic process are typically assumed to occur via change-points, which demark instantaneous moments of complete and total change in process behavior. In cases where these transitions occur gradually, this assumption can result in a reduced ability to properly identify and respond to process change. With this observation in mind, we introduce a novel c… ▽ More Changes in the statistical properties of a stochastic process are typically assumed to occur via change-points, which demark instantaneous moments of complete and total change in process behavior. In cases where these transitions occur gradually, this assumption can result in a reduced ability to properly identify and respond to process change. With this observation in mind, we introduce a novel change-dynamic model for the online detection of gradual change in a Bayesian framework, in which change-points are used within a hierarchical model to indicate moments of gradual change onset or termination. We apply this model to synthetic data and EEG readings drawn during epileptic seizure, where we find our change-dynamic model can enable faster and more accurate identification of gradual change than traditional change-point models allow. △ Less

Submitted 3 May, 2022; v1 submitted 2 May, 2022; originally announced May 2022.

The Ludii Game Description Language is Universal

Authors: Dennis J. N. J. Soemers, Éric Piette, Matthew Stephenson, Cameron Browne

Abstract: There are several different game description languages (GDLs), each intended to allow wide ranges of arbitrary games (i.e., general games) to be described in a single higher-level language than general-purpose programming languages. Games described in such formats can subsequently be presented as challenges for automated general game playing agents, which are expected to be capable of playing any… ▽ More There are several different game description languages (GDLs), each intended to allow wide ranges of arbitrary games (i.e., general games) to be described in a single higher-level language than general-purpose programming languages. Games described in such formats can subsequently be presented as challenges for automated general game playing agents, which are expected to be capable of playing any arbitrary game described in such a language without prior knowledge about the games to be played. The language used by the Ludii general game system was previously shown to be capable of representing equivalent games for any arbitrary, finite, deterministic, fully observable extensive-form game. In this paper, we prove its universality by extending this to include finite non-deterministic and imperfect-information games. △ Less

Submitted 12 June, 2024; v1 submitted 1 May, 2022; originally announced May 2022.

Comments: Accepted for publication in the Proceedings of the 2024 IEEE Conference on Games

Spatial State-Action Features for General Games

Authors: Dennis J. N. J. Soemers, Éric Piette, Matthew Stephenson, Cameron Browne

Abstract: In many board games and other abstract games, patterns have been used as features that can guide automated game-playing agents. Such patterns or features often represent particular configurations of pieces, empty positions, etc., which may be relevant for a game's strategies. Their use has been particularly prevalent in the game of Go, but also many other games used as benchmarks for AI research.… ▽ More In many board games and other abstract games, patterns have been used as features that can guide automated game-playing agents. Such patterns or features often represent particular configurations of pieces, empty positions, etc., which may be relevant for a game's strategies. Their use has been particularly prevalent in the game of Go, but also many other games used as benchmarks for AI research. In this paper, we formulate a design and efficient implementation of spatial state-action features for general games. These are patterns that can be trained to incentivise or disincentivise actions based on whether or not they match variables of the state in a local area around action variables. We provide extensive details on several design and implementation choices, with a primary focus on achieving a high degree of generality to support a wide variety of different games using different board geometries or other graphs. Secondly, we propose an efficient approach for evaluating active features for any given set of features. In this approach, we take inspiration from heuristics used in problems such as SAT to optimise the order in which parts of patterns are matched and prune unnecessary evaluations. This approach is defined for a highly general and abstract description of the problem -- phrased as optimising the order in which propositions of formulas in disjunctive normal form are evaluated -- and may therefore also be of interest to other types of problems than board games. An empirical evaluation on 33 distinct games in the Ludii general game system demonstrates the efficiency of this approach in comparison to a naive baseline, as well as a baseline based on prefix trees, and demonstrates that the additional efficiency significantly improves the playing strength of agents using the features to guide search. △ Less

Submitted 4 May, 2023; v1 submitted 17 January, 2022; originally announced January 2022.

Comments: Accepted for publication in the journal of Artificial Intelligence (AIJ)

General Board Geometry

Authors: Cameron Browne, Éric Piette, Matthew Stephenson, Dennis J. N. J. Soemers

Abstract: Game boards are described in the Ludii general game system by their underlying graphs, based on tiling, shape and graph operators, with the automatic detection of important properties such as topological relationships between graph elements, directions and radial step sequences. This approach allows most conceivable game boards to be described simply and succinctly. Game boards are described in the Ludii general game system by their underlying graphs, based on tiling, shape and graph operators, with the automatic detection of important properties such as topological relationships between graph elements, directions and radial step sequences. This approach allows most conceivable game boards to be described simply and succinctly. △ Less

Submitted 22 November, 2021; originally announced November 2021.

Comments: Accepted at Advances in Computer Games (ACG) 2021

Optimised Playout Implementations for the Ludii General Game System

Authors: Dennis J. N. J. Soemers, Éric Piette, Matthew Stephenson, Cameron Browne

Abstract: This paper describes three different optimised implementations of playouts, as commonly used by game-playing algorithms such as Monte-Carlo Tree Search. Each of the optimised implementations is applicable only to specific sets of games, based on their rules. The Ludii general game system can automatically infer, based on a game's description in its general game description language, whether any op… ▽ More This paper describes three different optimised implementations of playouts, as commonly used by game-playing algorithms such as Monte-Carlo Tree Search. Each of the optimised implementations is applicable only to specific sets of games, based on their rules. The Ludii general game system can automatically infer, based on a game's description in its general game description language, whether any optimised implementations are applicable. An empirical evaluation demonstrates major speedups over a standard implementation, with a median result of running playouts 5.08 times as fast, over 145 different games in Ludii for which one of the optimised implementations is applicable. △ Less

Submitted 4 November, 2021; originally announced November 2021.

Comments: Advances in Computer Games (ACG) 2021

Automatic Generation of Board Game Manuals

Authors: Matthew Stephenson, Eric Piette, Dennis J. N. J. Soemers, Cameron Browne

Abstract: In this paper we present a process for automatically generating manuals for board games within the Ludii general game system. This process requires many different sub-tasks to be addressed, such as English translation of Ludii game descriptions, move visualisation, highlighting winning moves, strategy explanation, among others. These aspects are then combined to create a full manual for any given… ▽ More In this paper we present a process for automatically generating manuals for board games within the Ludii general game system. This process requires many different sub-tasks to be addressed, such as English translation of Ludii game descriptions, move visualisation, highlighting winning moves, strategy explanation, among others. These aspects are then combined to create a full manual for any given game. This manual is intended to provide a more intuitive explanation of a game's rules and mechanics, particularly for players who are less familiar with the Ludii game description language and grammar. △ Less

Submitted 20 September, 2021; originally announced September 2021.

Comments: 12 Pages, 6 Figures

General Board Game Concepts

Authors: Éric Piette, Matthew Stephenson, Dennis J. N. J. Soemers, Cameron Browne

Abstract: Many games often share common ideas or aspects between them, such as their rules, controls, or playing area. However, in the context of General Game Playing (GGP) for board games, this area remains under-explored. We propose to formalise the notion of "game concept", inspired by terms generally used by game players and designers. Through the Ludii General Game System, we describe concepts for seve… ▽ More Many games often share common ideas or aspects between them, such as their rules, controls, or playing area. However, in the context of General Game Playing (GGP) for board games, this area remains under-explored. We propose to formalise the notion of "game concept", inspired by terms generally used by game players and designers. Through the Ludii General Game System, we describe concepts for several levels of abstraction, such as the game itself, the moves played, or the states reached. This new GGP feature associated with the ludeme representation of games opens many new lines of research. The creation of a hyper-agent selector, the transfer of AI learning between games, or explaining AI techniques using game terms, can all be facilitated by the use of game concepts. Other applications which can benefit from game concepts are also discussed, such as the generation of plausible reconstructed rules for incomplete ancient games, or the implementation of a board game recommender system. △ Less

Submitted 2 July, 2021; originally announced July 2021.

Virus-immune dynamics determined by prey-predator interaction network and epistasis in viral fitness landscape

Authors: Cameron J. Browne, Fadoua Yahia

Abstract: Population dynamics and evolutionary genetics underly the structure of ecosystems, changing on the same timescale for interacting species with rapid turnover, such as virus (e.g. HIV) and immune response. Thus, an important problem in mathematical modeling is to connect ecology, evolution and genetics, which often have been treated separately. Here, extending analysis of multiple virus and immune… ▽ More Population dynamics and evolutionary genetics underly the structure of ecosystems, changing on the same timescale for interacting species with rapid turnover, such as virus (e.g. HIV) and immune response. Thus, an important problem in mathematical modeling is to connect ecology, evolution and genetics, which often have been treated separately. Here, extending analysis of multiple virus and immune response populations in a resource - prey (consumer) - predator model from Browne and Smith \cite{browne2018dynamics}, we show that long term dynamics of viral mutants evolving resistance at distinct epitopes (viral proteins targeted by immune responses) are governed by epistasis in the virus fitness landscape. In particular, the stability of persistent equilibrium virus-immune (prey-predator) network structures, such as nested and one-to-one, and bifurcations are determined by a collection of circuits defined by combinations of viral fitnesses that are minimally additive within a hypercube of binary sequences representing all possible viral epitope sequences ordered according to immunodominance hierarchy. Numerical solutions of our ordinary differential equation system, along with an extended stochastic version including random mutation, demonstrate how pairwise or multiplicative epistatic interactions shape viral evolution against concurrent immune responses and convergence to the multi-variant steady state predicted by theoretical results. Furthermore, simulations illustrate how periodic infusions of subdominant immune responses can induce a bifurcation in the persistent viral strains, offering superior host outcome over an alternative strategy of immunotherapy with strongest immune response. △ Less

Submitted 16 June, 2021; originally announced June 2021.

General Game Heuristic Prediction Based on Ludeme Descriptions

Authors: Matthew Stephenson, Dennis J. N. J. Soemers, Eric Piette, Cameron Browne

Abstract: This paper investigates the performance of different general-game-playing heuristics for games in the Ludii general game system. Based on these results, we train several regression learning models to predict the performance of these heuristics based on each game's description file. We also provide a condensed analysis of the games available in Ludii, and the different ludemes that define them. This paper investigates the performance of different general-game-playing heuristics for games in the Ludii general game system. Based on these results, we train several regression learning models to predict the performance of these heuristics based on each game's description file. We also provide a condensed analysis of the games available in Ludii, and the different ludemes that define them. △ Less

Submitted 5 July, 2021; v1 submitted 26 May, 2021; originally announced May 2021.

Comments: 4 pages, 1 figure, 2 tables

Infection percolation: A dynamic network model of disease spreading

Authors: Christopher A. Browne, Daniel B. Amchin, Joanna Schneider, Sujit S. Datta

Abstract: Models of disease spreading are critical for predicting infection growth in a population and evaluating public health policies. However, standard models typically represent the dynamics of disease transmission between individuals using macroscopic parameters that do not accurately represent person-to-person variability. To address this issue, we present a dynamic network model that provides a stra… ▽ More Models of disease spreading are critical for predicting infection growth in a population and evaluating public health policies. However, standard models typically represent the dynamics of disease transmission between individuals using macroscopic parameters that do not accurately represent person-to-person variability. To address this issue, we present a dynamic network model that provides a straightforward way to incorporate both disease transmission dynamics at the individual scale as well as the full spatiotemporal history of infection at the population scale. We find that disease spreads through a social network as a traveling wave of infection, followed by a traveling wave of recovery, with the onset and dynamics of spreading determined by the interplay between disease transmission and recovery. We use these insights to develop a scaling theory that predicts the dynamics of infection for diverse diseases and populations. Furthermore, we show how spatial heterogeneities in susceptibility to infection can either exacerbate or quell the spread of disease, depending on its infectivity. Ultimately, our dynamic network approach provides a simple way to model disease spreading that unifies previous findings and can be generalized to diverse diseases, containment strategies, seasonal conditions, and community structures. △ Less

Submitted 17 March, 2021; originally announced March 2021.

Comments: In press, Frontiers in Physics (2021)

Journal ref: Frontiers in Physics, 9, 645954 (2021)

Transfer of Fully Convolutional Policy-Value Networks Between Games and Game Variants

Authors: Dennis J. N. J. Soemers, Vegard Mella, Eric Piette, Matthew Stephenson, Cameron Browne, Olivier Teytaud

Abstract: In this paper, we use fully convolutional architectures in AlphaZero-like self-play training setups to facilitate transfer between variants of board games as well as distinct games. We explore how to transfer trained parameters of these architectures based on shared semantics of channels in the state and action representations of the Ludii general game system. We use Ludii's large library of games… ▽ More In this paper, we use fully convolutional architectures in AlphaZero-like self-play training setups to facilitate transfer between variants of board games as well as distinct games. We explore how to transfer trained parameters of these architectures based on shared semantics of channels in the state and action representations of the Ludii general game system. We use Ludii's large library of games and game variants for extensive transfer learning evaluations, in zero-shot transfer experiments as well as experiments with additional fine-tuning time. △ Less

Submitted 24 February, 2021; originally announced February 2021.

Journal ref: This preprint is superceded by the 2023 TMLR publication: https://openreview.net/forum?id=vJcTm2v9Ku

Modern Techniques for Ancient Games

Authors: Cameron Browne

Abstract: Games potentially provide a wealth of knowledge about our shared cultural past and the development of human civilisation, but our understanding of early games is incomplete and often based on unreliable reconstructions. This paper describes the Digital Ludeme Project, a five-year research project currently underway that aims to address such issues using modern computational techniques. Games potentially provide a wealth of knowledge about our shared cultural past and the development of human civilisation, but our understanding of early games is incomplete and often based on unreliable reconstructions. This paper describes the Digital Ludeme Project, a five-year research project currently underway that aims to address such issues using modern computational techniques. △ Less

Submitted 30 December, 2020; originally announced January 2021.

Journal ref: Proceedings of IEEE Computational Intelligence and Games (CIG 2018), Maastricht, 14 August 2018, pp. 490-497

Deep Learning for General Game Playing with Ludii and Polygames

Authors: Dennis J. N. J. Soemers, Vegard Mella, Cameron Browne, Olivier Teytaud

Abstract: Combinations of Monte-Carlo tree search and Deep Neural Networks, trained through self-play, have produced state-of-the-art results for automated game-playing in many board games. The training and search algorithms are not game-specific, but every individual game that these approaches are applied to still requires domain knowledge for the implementation of the game's rules, and constructing the ne… ▽ More Combinations of Monte-Carlo tree search and Deep Neural Networks, trained through self-play, have produced state-of-the-art results for automated game-playing in many board games. The training and search algorithms are not game-specific, but every individual game that these approaches are applied to still requires domain knowledge for the implementation of the game's rules, and constructing the neural network's architecture -- in particular the shapes of its input and output tensors. Ludii is a general game system that already contains over 500 different games, which can rapidly grow thanks to its powerful and user-friendly game description language. Polygames is a framework with training and search algorithms, which has already produced superhuman players for several board games. This paper describes the implementation of a bridge between Ludii and Polygames, which enables Polygames to train and evaluate models for games that are implemented and run through Ludii. We do not require any game-specific domain knowledge anymore, and instead leverage our domain knowledge of the Ludii system and its abstract state and move representations to write functions that can automatically determine the appropriate shapes for input and output tensors for any game implemented in Ludii. We describe experimental results for short training runs in a wide variety of different board games, and discuss several open problems and avenues for future research. △ Less

Submitted 23 January, 2021; originally announced January 2021.

Ludii Game Logic Guide

Authors: Éric Piette, Cameron Browne, Dennis J. N. J. Soemers

Abstract: This technical report outlines the fundamental workings of the game logic behind Ludii, a general game system, that can be used to play a wide variety of games. Ludii is a program developed for the ERC-funded Digital Ludeme Project, in which mathematical and computational approaches are used to study how games were played, and spread, throughout history. This report explains how general game state… ▽ More This technical report outlines the fundamental workings of the game logic behind Ludii, a general game system, that can be used to play a wide variety of games. Ludii is a program developed for the ERC-funded Digital Ludeme Project, in which mathematical and computational approaches are used to study how games were played, and spread, throughout history. This report explains how general game states and equipment are represented in Ludii, and how the rule ludemes dictating play are implemented behind the scenes, giving some insight into the core game logic behind the Ludii general game player. This guide is intended to help game designers using the Ludii game description language to understand it more completely and make fuller use of its features when describing their games. △ Less

Submitted 2 June, 2022; v1 submitted 6 January, 2021; originally announced January 2021.

Strategic Features for General Games

Authors: Cameron Browne, Dennis J. N. J. Soemers, Eric Piette

Abstract: This short paper describes an ongoing research project that requires the automated self-play learning and evaluation of a large number of board games in digital form. We describe the approach we are taking to determine relevant features, for biasing MCTS playouts for arbitrary games played on arbitrary geometries. Benefits of our approach include efficient implementation, the potential to transfer… ▽ More This short paper describes an ongoing research project that requires the automated self-play learning and evaluation of a large number of board games in digital form. We describe the approach we are taking to determine relevant features, for biasing MCTS playouts for arbitrary games played on arbitrary geometries. Benefits of our approach include efficient implementation, the potential to transfer learnt knowledge to new contexts, and the potential to explain strategic knowledge embedded in features in human-comprehensible terms. △ Less

Submitted 4 January, 2021; originally announced January 2021.

Comments: Paper exactly as it appeared at KEG Workshop held at AAAI 2019

Journal ref: Proceedings of the 2nd Workshop on Knowledge Extraction from Games co-located with 33rd AAAI Conference on Artificial Intelligence (AAAI 2019)

Elastic turbulence generates anomalous flow resistance in porous media

Authors: Christopher A. Browne, Sujit S. Datta

Abstract: Diverse processes rely on the viscous flow of polymer solutions through porous media. In many cases, the macroscopic flow resistance abruptly increases above a threshold flow rate in a porous medium---but not in bulk solution. The reason why has been a puzzle for over half a century. Here, by directly visualizing the flow in a transparent 3D porous medium, we demonstrate that this anomalous increa… ▽ More Diverse processes rely on the viscous flow of polymer solutions through porous media. In many cases, the macroscopic flow resistance abruptly increases above a threshold flow rate in a porous medium---but not in bulk solution. The reason why has been a puzzle for over half a century. Here, by directly visualizing the flow in a transparent 3D porous medium, we demonstrate that this anomalous increase is due to the onset of an elastic instability. We establish that the energy dissipated by the unstable flow fluctuations, which vary across pores, generates the anomalous increase in flow resistance through the entire medium. Thus, by linking the pore-scale onset of unstable flow to macroscopic transport, our work provides generally-applicable guidelines for predicting and controlling polymer solution flows. △ Less

Submitted 11 November, 2020; originally announced November 2020.

Journal ref: Science Advances, 7, eabj2619 (2021)

Forced Imbibition in Stratified Porous Media

Authors: Nancy B. Lu, Amir A. Pahlavan, Christopher A. Browne, Daniel B. Amchin, Howard A. Stone, Sujit S. Datta

Abstract: Imbibition plays a central role in diverse energy, environmental, and industrial processes. In many cases, the medium has multiple parallel strata of different permeabilities; however, how this stratification impacts imbibition is poorly understood. We address this gap in knowledge by directly visualizing forced imbibition in three-dimensional (3D) porous media with two parallel strata. We find th… ▽ More Imbibition plays a central role in diverse energy, environmental, and industrial processes. In many cases, the medium has multiple parallel strata of different permeabilities; however, how this stratification impacts imbibition is poorly understood. We address this gap in knowledge by directly visualizing forced imbibition in three-dimensional (3D) porous media with two parallel strata. We find that imbibition is spatially heterogeneous: for small capillary number Ca, the wetting fluid preferentially invades the fine stratum, while for Ca above a threshold value, the fluid instead preferentially invades the coarse stratum. This threshold value depends on the medium geometry, the fluid properties, and the presence of residual wetting films in the pore space. These findings are well described by a linear stability analysis that incorporates crossflow between the strata. Thus, our work provides quantitative guidelines for predicting and controlling flow in stratified porous media. △ Less

Submitted 5 October, 2020; originally announced October 2020.

Comments: In press

Journal ref: Phys. Rev. Applied 14, 054009 (2020)

Manipulating the Distributions of Experience used for Self-Play Learning in Expert Iteration

Authors: Dennis J. N. J. Soemers, Éric Piette, Matthew Stephenson, Cameron Browne

Abstract: Expert Iteration (ExIt) is an effective framework for learning game-playing policies from self-play. ExIt involves training a policy to mimic the search behaviour of a tree search algorithm - such as Monte-Carlo tree search - and using the trained policy to guide it. The policy and the tree search can then iteratively improve each other, through experience gathered in self-play between instances o… ▽ More Expert Iteration (ExIt) is an effective framework for learning game-playing policies from self-play. ExIt involves training a policy to mimic the search behaviour of a tree search algorithm - such as Monte-Carlo tree search - and using the trained policy to guide it. The policy and the tree search can then iteratively improve each other, through experience gathered in self-play between instances of the guided tree search algorithm. This paper outlines three different approaches for manipulating the distribution of data collected from self-play, and the procedure that samples batches for learning updates from the collected data. Firstly, samples in batches are weighted based on the durations of the episodes in which they were originally experienced. Secondly, Prioritized Experience Replay is applied within the ExIt framework, to prioritise sampling experience from which we expect to obtain valuable training signals. Thirdly, a trained exploratory policy is used to diversify the trajectories experienced in self-play. This paper summarises the effects of these manipulations on training performance evaluated in fourteen different board games. We find major improvements in early training performance in some games, and minor improvements averaged over fourteen games. △ Less

Submitted 30 May, 2020; originally announced June 2020.

Comments: Accepted at the IEEE Conference on Games (CoG) 2020

Bistability in the Unstable Flow of Polymer Solutions Through Porous Media

Authors: Christopher A. Browne, Audrey Shih, Sujit S. Datta

Abstract: Polymer solutions are often injected in porous media for applications such as oil recovery and groundwater remediation. As the fluid navigates the tortuous pore space, elastic stresses build up, causing the flow to become unstable at sufficiently large injection rates. However, it is poorly understood how the spatial and temporal characteristics of this unstable flow depend on pore space geometry.… ▽ More Polymer solutions are often injected in porous media for applications such as oil recovery and groundwater remediation. As the fluid navigates the tortuous pore space, elastic stresses build up, causing the flow to become unstable at sufficiently large injection rates. However, it is poorly understood how the spatial and temporal characteristics of this unstable flow depend on pore space geometry. We elucidate this dependence by systematically varying the spacing between pore constrictions in a model porous medium. We find that when the pore spacing is large, unstable eddies form upstream of each pore, similar to observations of an isolated pore. By contrast, when the pore spacing is sufficiently small, the flow exhibits a surprising bistability, stochastically switching between two distinct unstable flow states. We hypothesize that this unusual behavior arises from the interplay between flow-induced polymer elongation and relaxation of polymers as they are advected through the porous medium. Consistent with this idea, we find that the flow state in a given pore persists for long times. Moreover, we find that the flow state is correlated between neighboring pores; however, these correlations do not persist long-range. Our results thus help to elucidate the rich array of flow behaviors that can arise in polymer solution flow through porous media. △ Less

Submitted 5 February, 2020; originally announced February 2020.

Comments: In press; this version is pre-review. Updated version will be posted in six months

Journal ref: Journal of Fluid Mechanics, 2020

Infection severity across scales in multi-strain immuno-epidemiological Dengue model structured by host antibody level

Authors: Hayriye Gulbudak, Cameron J. Browne

Abstract: Infection by distinct Dengue virus serotypes and host immunity are intricately linked. In particular, certain levels of cross-reactive antibodies in the host may actually enhance infection severity leading to Dengue hemorrhagic fever (DHF). The coupled immunological and epidemiological dynamics of Dengue calls for a multi-scale modeling approach. In this work, we formulate a within-host model whic… ▽ More Infection by distinct Dengue virus serotypes and host immunity are intricately linked. In particular, certain levels of cross-reactive antibodies in the host may actually enhance infection severity leading to Dengue hemorrhagic fever (DHF). The coupled immunological and epidemiological dynamics of Dengue calls for a multi-scale modeling approach. In this work, we formulate a within-host model which mechanistically recapitulates characteristics of antibody dependent enhancement (ADE) in Dengue infection. The within-host scale is then linked to epidemiological spread by a vector-host partial differential equation model structured by host antibody level. The coupling allows for dynamic population-wide antibody levels to be tracked through primary and secondary infections by distinct Dengue strains, along with waning of cross-protective immunity after primary infection. Analysis of both the within-host and between-host systems are conducted. Stability results in the epidemic model are formulated via basic and invasion reproduction numbers as a function of immunological variables. Additionally, we develop numerical methods in order to simulate the multi-scale model and assess the influence of parameters on disease spread and DHF prevalence in the population. △ Less

Submitted 17 December, 2019; originally announced December 2019.

Pore-Scale Flow Characterization of Polymer Solutions in Microfluidic Porous Media

Authors: Christopher A. Browne, Audrey Shih, Sujit S. Datta

Abstract: Polymer solutions are frequently used in enhanced oil recovery and groundwater remediation to improve the recovery of trapped non-aqueous fluids. However, applications are limited by an incomplete understanding of the flow in porous media. The tortuous pore structure imposes both shear and extension, which elongates polymers; moreover, the flow is often at large Weissenberg numbers Wi at which pol… ▽ More Polymer solutions are frequently used in enhanced oil recovery and groundwater remediation to improve the recovery of trapped non-aqueous fluids. However, applications are limited by an incomplete understanding of the flow in porous media. The tortuous pore structure imposes both shear and extension, which elongates polymers; moreover, the flow is often at large Weissenberg numbers Wi at which polymer elasticity in turn strongly alters the flow. This dynamic elongation can even produce flow instabilities with strong spatial and temporal fluctuations despite the low Reynolds number Re. Unfortunately, macroscopic approaches are limited in their ability to characterize the pore-scale flow. Thus, understanding how polymer conformations, flow dynamics, and pore geometry together determine these non-trivial flow patterns and impact macroscopic transport remains an outstanding challenge. Here, we describe how microfluidic tools can shed light on the physics underlying the flow of polymer solutions in porous media at high Wi and low Re. Specifically, microfluidic studies elucidate how steady and unsteady flow behavior depends on pore geometry and solution properties, and how polymer-induced effects impact non-aqueous fluid recovery. This work provides new insights for polymer dynamics, non-Newtonian fluid mechanics, and applications such as enhanced oil recovery and groundwater remediation. △ Less

Submitted 11 September, 2019; originally announced September 2019.

Comments: 45 pages, 12 figures

Controlling capillary fingering using pore size gradients in disordered media

Authors: Nancy B. Lu, Christopher A. Browne, Daniel B. Amchin, Janine K. Nunes, Sujit S. Datta

Abstract: Capillary fingering is a displacement process that can occur when a non-wetting fluid displaces a wetting fluid from a homogeneous disordered porous medium. Here, we investigate how this process is influenced by a pore size gradient. Using microfluidic experiments and computational pore-network models, we show that the non-wetting fluid displacement behavior depends sensitively on the direction an… ▽ More Capillary fingering is a displacement process that can occur when a non-wetting fluid displaces a wetting fluid from a homogeneous disordered porous medium. Here, we investigate how this process is influenced by a pore size gradient. Using microfluidic experiments and computational pore-network models, we show that the non-wetting fluid displacement behavior depends sensitively on the direction and the magnitude of the gradient. The fluid displacement depends on the competition between a pore size gradient and pore-scale disorder; indeed, a sufficiently large gradient can completely suppress capillary fingering. By analyzing capillary forces at the pore scale, we identify a non-dimensional parameter that describes the physics underlying these diverse flow behaviors. Our results thus expand the understanding of flow in complex porous media, and suggest a new way to control flow behavior via the introduction of pore size gradients. △ Less

Submitted 21 July, 2019; originally announced July 2019.

Comments: In press, Physical Review Fluids (2019)

Journal ref: Physical Review Fluids 4, 084303 (2019)

Ludii as a Competition Platform

Authors: Matthew Stephenson, Éric Piette, Dennis J. N. J. Soemers, Cameron Browne

Abstract: Ludii is a general game system being developed as part of the ERC-funded Digital Ludeme Project (DLP). While its primary aim is to model, play, and analyse the full range of traditional strategy games, Ludii also has the potential to support a wide range of AI research topics and competitions. This paper describes some of the future competitions and challenges that we intend to run using the Ludii… ▽ More Ludii is a general game system being developed as part of the ERC-funded Digital Ludeme Project (DLP). While its primary aim is to model, play, and analyse the full range of traditional strategy games, Ludii also has the potential to support a wide range of AI research topics and competitions. This paper describes some of the future competitions and challenges that we intend to run using the Ludii system, highlighting some of its most important aspects that can potentially lead to many algorithm improvements and new avenues of research. We compare and contrast our proposed competition motivations, goals and frameworks against those of existing general game playing competitions, addressing the strengths and weaknesses of each platform. △ Less

Submitted 29 June, 2019; originally announced July 2019.

Comments: Accepted at the IEEE Conference on Games (CoG) 2019

Ludii and XCSP: Playing and Solving Logic Puzzles

Authors: Cédric Piette, Éric Piette, Matthew Stephenson, Dennis J. N. J. Soemers, Cameron Browne

Abstract: Many of the famous single-player games, commonly called puzzles, can be shown to be NP-Complete. Indeed, this class of complexity contains hundreds of puzzles, since people particularly appreciate completing an intractable puzzle, such as Sudoku, but also enjoy the ability to check their solution easily once it's done. For this reason, using constraint programming is naturally suited to solve them… ▽ More Many of the famous single-player games, commonly called puzzles, can be shown to be NP-Complete. Indeed, this class of complexity contains hundreds of puzzles, since people particularly appreciate completing an intractable puzzle, such as Sudoku, but also enjoy the ability to check their solution easily once it's done. For this reason, using constraint programming is naturally suited to solve them. In this paper, we focus on logic puzzles described in the Ludii general game system and we propose using the XCSP formalism in order to solve them with any CSP solver. △ Less

Submitted 29 June, 2019; originally announced July 2019.

Comments: Accepted at the IEEE Conference on Games (CoG) 2019 (Short paper)

An Empirical Evaluation of Two General Game Systems: Ludii and RBG

Authors: Éric Piette, Matthew Stephenson, Dennis J. N. J. Soemers, Cameron Browne

Abstract: Although General Game Playing (GGP) systems can facilitate useful research in Artificial Intelligence (AI) for game-playing, they are often computationally inefficient and somewhat specialised to a specific class of games. However, since the start of this year, two General Game Systems have emerged that provide efficient alternatives to the academic state of the art -- the Game Description Languag… ▽ More Although General Game Playing (GGP) systems can facilitate useful research in Artificial Intelligence (AI) for game-playing, they are often computationally inefficient and somewhat specialised to a specific class of games. However, since the start of this year, two General Game Systems have emerged that provide efficient alternatives to the academic state of the art -- the Game Description Language (GDL). In order of publication, these are the Regular Boardgames language (RBG), and the Ludii system. This paper offers an experimental evaluation of Ludii. Here, we focus mainly on a comparison between the two new systems in terms of two key properties for any GGP system: simplicity/clarity (e.g. human-readability), and efficiency. △ Less

Submitted 29 June, 2019; originally announced July 2019.

Comments: Accepted at the IEEE Conference on Games (CoG) 2019 (Short paper)

An Overview of the Ludii General Game System

Authors: Matthew Stephenson, Éric Piette, Dennis J. N. J. Soemers, Cameron Browne

Abstract: The Digital Ludeme Project (DLP) aims to reconstruct and analyse over 1000 traditional strategy games using modern techniques. One of the key aspects of this project is the development of Ludii, a general game system that will be able to model and play the complete range of games required by this project. Such an undertaking will create a wide range of possibilities for new AI challenges. In this… ▽ More The Digital Ludeme Project (DLP) aims to reconstruct and analyse over 1000 traditional strategy games using modern techniques. One of the key aspects of this project is the development of Ludii, a general game system that will be able to model and play the complete range of games required by this project. Such an undertaking will create a wide range of possibilities for new AI challenges. In this paper we describe many of the features of Ludii that can be used. This includes designing and modifying games using the Ludii game description language, creating agents capable of playing these games, and several advantages the system has over prior general game software. △ Less

Submitted 29 June, 2019; originally announced July 2019.

Comments: Accepted at the IEEE Conference on Games (CoG) 2019 (Demo paper)

Foundations of Digital Archæoludology

Authors: Cameron Browne, Dennis J. N. J. Soemers, Éric Piette, Matthew Stephenson, Michael Conrad, Walter Crist, Thierry Depaulis, Eddie Duggan, Fred Horn, Steven Kelk, Simon M. Lucas, João Pedro Neto, David Parlett, Abdallah Saffidine, Ulrich Schädler, Jorge Nuno Silva, Alex de Voogt, Mark H. M. Winands

Abstract: Digital Archaeoludology (DAL) is a new field of study involving the analysis and reconstruction of ancient games from incomplete descriptions and archaeological evidence using modern computational techniques. The aim is to provide digital tools and methods to help game historians and other researchers better understand traditional games, their development throughout recorded human history, and the… ▽ More Digital Archaeoludology (DAL) is a new field of study involving the analysis and reconstruction of ancient games from incomplete descriptions and archaeological evidence using modern computational techniques. The aim is to provide digital tools and methods to help game historians and other researchers better understand traditional games, their development throughout recorded human history, and their relationship to the development of human culture and mathematical knowledge. This work is being explored in the ERC-funded Digital Ludeme Project. The aim of this inaugural international research meeting on DAL is to gather together leading experts in relevant disciplines - computer science, artificial intelligence, machine learning, computational phylogenetics, mathematics, history, archaeology, anthropology, etc. - to discuss the key themes and establish the foundations for this new field of research, so that it may continue beyond the lifetime of its initiating project. △ Less

Submitted 31 May, 2019; originally announced May 2019.

Comments: Report on Dagstuhl Research Meeting. Authored/edited by all participants. Appendices by Thierry Depaulis

Learning Policies from Self-Play with Policy Gradients and MCTS Value Estimates

Authors: Dennis J. N. J. Soemers, Éric Piette, Matthew Stephenson, Cameron Browne

Abstract: In recent years, state-of-the-art game-playing agents often involve policies that are trained in self-playing processes where Monte Carlo tree search (MCTS) algorithms and trained policies iteratively improve each other. The strongest results have been obtained when policies are trained to mimic the search behaviour of MCTS by minimising a cross-entropy loss. Because MCTS, by design, includes an e… ▽ More In recent years, state-of-the-art game-playing agents often involve policies that are trained in self-playing processes where Monte Carlo tree search (MCTS) algorithms and trained policies iteratively improve each other. The strongest results have been obtained when policies are trained to mimic the search behaviour of MCTS by minimising a cross-entropy loss. Because MCTS, by design, includes an element of exploration, policies trained in this manner are also likely to exhibit a similar extent of exploration. In this paper, we are interested in learning policies for a project with future goals including the extraction of interpretable strategies, rather than state-of-the-art game-playing performance. For these goals, we argue that such an extent of exploration is undesirable, and we propose a novel objective function for training policies that are not exploratory. We derive a policy gradient expression for maximising this objective function, which can be estimated using MCTS value estimates, rather than MCTS visit counts. We empirically evaluate various properties of resulting policies, in a variety of board games. △ Less

Submitted 14 May, 2019; originally announced May 2019.

Comments: Accepted at the IEEE Conference on Games (CoG) 2019

Ludii -- The Ludemic General Game System

Authors: Éric Piette, Dennis J. N. J. Soemers, Matthew Stephenson, Chiara F. Sironi, Mark H. M. Winands, Cameron Browne

Abstract: While current General Game Playing (GGP) systems facilitate useful research in Artificial Intelligence (AI) for game-playing, they are often somewhat specialised and computationally inefficient. In this paper, we describe the "ludemic" general game system Ludii, which has the potential to provide an efficient tool for AI researchers as well as game designers, historians, educators and practitioner… ▽ More While current General Game Playing (GGP) systems facilitate useful research in Artificial Intelligence (AI) for game-playing, they are often somewhat specialised and computationally inefficient. In this paper, we describe the "ludemic" general game system Ludii, which has the potential to provide an efficient tool for AI researchers as well as game designers, historians, educators and practitioners in related fields. Ludii defines games as structures of ludemes -- high-level, easily understandable game concepts -- which allows for concise and human-understandable game descriptions. We formally describe Ludii and outline its main benefits: generality, extensibility, understandability and efficiency. Experimentally, Ludii outperforms one of the most efficient Game Description Language (GDL) reasoners, based on a propositional network, in all games available in the Tiltyard GGP repository. Moreover, Ludii is also competitive in terms of performance with the more recently proposed Regular Boardgames (RBG) system, and has various advantages in qualitative aspects such as generality. △ Less

Submitted 21 February, 2020; v1 submitted 13 May, 2019; originally announced May 2019.

Comments: Accepted at ECAI 2020

Improved Reinforcement Learning with Curriculum

Authors: Joseph West, Frederic Maire, Cameron Browne, Simon Denman

Abstract: Humans tend to learn complex abstract concepts faster if examples are presented in a structured manner. For instance, when learning how to play a board game, usually one of the first concepts learned is how the game ends, i.e. the actions that lead to a terminal state (win, lose or draw). The advantage of learning end-games first is that once the actions which lead to a terminal state are understo… ▽ More Humans tend to learn complex abstract concepts faster if examples are presented in a structured manner. For instance, when learning how to play a board game, usually one of the first concepts learned is how the game ends, i.e. the actions that lead to a terminal state (win, lose or draw). The advantage of learning end-games first is that once the actions which lead to a terminal state are understood, it becomes possible to incrementally learn the consequences of actions that are further away from a terminal state - we call this an end-game-first curriculum. Currently the state-of-the-art machine learning player for general board games, AlphaZero by Google DeepMind, does not employ a structured training curriculum; instead learning from the entire game at all times. By employing an end-game-first training curriculum to train an AlphaZero inspired player, we empirically show that the rate of learning of an artificial player can be improved during the early stages of training when compared to a player not using a training curriculum. △ Less

Submitted 10 June, 2019; v1 submitted 28 March, 2019; originally announced March 2019.

Comments: Draft prior to submission to IEEE Trans on Games. Changed paper slightly

Biasing MCTS with Features for General Games

Authors: Dennis J. N. J. Soemers, Éric Piette, Cameron Browne

Abstract: This paper proposes using a linear function approximator, rather than a deep neural network (DNN), to bias a Monte Carlo tree search (MCTS) player for general games. This is unlikely to match the potential raw playing strength of DNNs, but has advantages in terms of generality, interpretability and resources (time and hardware) required for training. Features describing local patterns are used as… ▽ More This paper proposes using a linear function approximator, rather than a deep neural network (DNN), to bias a Monte Carlo tree search (MCTS) player for general games. This is unlikely to match the potential raw playing strength of DNNs, but has advantages in terms of generality, interpretability and resources (time and hardware) required for training. Features describing local patterns are used as inputs. The features are formulated in such a way that they are easily interpretable and applicable to a wide range of general games, and might encode simple local strategies. We gradually create new features during the same self-play training process used to learn feature weights. We evaluate the playing strength of an MCTS player biased by learnt features against a standard upper confidence bounds for trees (UCT) player in multiple different board games, and demonstrate significantly improved playing strength in the majority of them after a small number of self-play training games. △ Less

Submitted 21 March, 2019; originally announced March 2019.

Comments: Accepted at IEEE CEC 2019, Special Session on Games. Copyright of final version held by IEEE

Dynamics of Virus and Immune Response in Multi-Epitope Network

Authors: Cameron J. Browne, Hal L. Smith

Abstract: The host immune response can often efficiently suppress a virus infection, which may lead to selection for immune-resistant viral variants within the host. For example, during HIV infection, an array of CTL immune response populations recognize specific epitopes (viral proteins) presented on the surface of infected cells to effectively mediate their killing. However HIV can rapidly evolve resistan… ▽ More The host immune response can often efficiently suppress a virus infection, which may lead to selection for immune-resistant viral variants within the host. For example, during HIV infection, an array of CTL immune response populations recognize specific epitopes (viral proteins) presented on the surface of infected cells to effectively mediate their killing. However HIV can rapidly evolve resistance to CTL attack at different epitopes, inducing a dynamic network of interacting viral and immune response variants. We consider models for the network of virus and immune response populations, consisting of Lotka-Volterra-like systems of ordinary differential equations. Stability of feasible equilibria and corresponding uniform persistence of distinct variants are characterized via a Lyapunov function. We specialize the model to a "binary sequence" setting, where for $n$ epitopes there can be $2^n$ distinct viral variants mapped on a hypercube graph. The dynamics in several cases are analyzed and sharp polychotomies are derived characterizing persistent variants. In particular, we prove that if the viral fitness costs for gaining resistance to each epitope are equal, then the system of $2^n$ virus strains converges to a "perfectly nested network" with less than or equal to $n+1$ persistent virus strains. Overall, our results suggest that immunodominance, i.e. relative strength of immune response to an epitope, is the most important factor determining the persistent network structure. △ Less

Submitted 22 February, 2018; v1 submitted 2 May, 2017; originally announced May 2017.

Comments: Revised preprint, to appear in Journal of Mathematical Biology

Global Properties of Nested Network Model with Application to Multi-Epitope HIV/CTL Dynamics

Authors: Cameron J. Browne

Abstract: Mathematical modeling and analysis can provide insight on the dynamics of ecosystems which maintain biodiversity in the face of competitive and prey-predator interactions. Of primary interests are the underlying structure and features which stabilize diverse ecological networks. Recently Korytowski and Smith [17] proved that a perfectly nested infection network, along with appropriate life history… ▽ More Mathematical modeling and analysis can provide insight on the dynamics of ecosystems which maintain biodiversity in the face of competitive and prey-predator interactions. Of primary interests are the underlying structure and features which stabilize diverse ecological networks. Recently Korytowski and Smith [17] proved that a perfectly nested infection network, along with appropriate life history trade-offs, leads to coexistence and persistence of bacteria-phage communities in a chemostat model. In this article, we generalize their model in order to apply it to the within-host dynamics virus and immune response, in particular HIV and CTL (Cytotoxic T Lymphocyte) cells. Our model can produce a diverse hierarchy of viral and immune populations, built through sequential viral escape from dominant immune responses and rise in subdominant immune responses, consistent with observed patterns of HIV/CTL evolution. We find a Lyapunov function for the system which leads to rigorous characterization of persistent viral and immune variants, and informs upon equilibria stability and global dynamics. Results are interpreted in the context of within-host HIV/CTL evolution and numerical simulations are provided. △ Less

Submitted 1 January, 2017; v1 submitted 24 June, 2016; originally announced June 2016.

Organic molecule fluorescence as an experimental test-bed for quantum jumps in thermodynamics

Authors: Cormac Browne, Tristan Farrow, Oscar C. O. Dahlsten, Vlatko Vedral

Abstract: We demonstrate with an experiment how molecules are a natural test-bed for probing fundamental quantum thermodynamics. Single-molecule spectroscopy has undergone transformative change in the past decade with the advent of techniques permitting individual molecules to be distinguished and probed. By considering the time-resolved emission spectrum of organic molecules as arising from quantum jumps b… ▽ More We demonstrate with an experiment how molecules are a natural test-bed for probing fundamental quantum thermodynamics. Single-molecule spectroscopy has undergone transformative change in the past decade with the advent of techniques permitting individual molecules to be distinguished and probed. By considering the time-resolved emission spectrum of organic molecules as arising from quantum jumps between states, we demonstrate that the quantum Jarzynski equality is satisfied in this set-up. This relates the heat dissipated into the environment to the free energy difference between the initial and final state. We demonstrate also how utilizing the quantum Jarzynski equality allows for the detection of energy shifts within a molecule, beyond the relative shift. △ Less

Submitted 10 June, 2016; originally announced June 2016.

Comments: 6 pages, 5 figures

Modeling Contact Tracing in Outbreaks with Application to Ebola

Authors: Cameron Browne, Hayriye Gulbudak, Glenn Webb

Abstract: Contact tracing is an important control strategy for containing Ebola epidemics. From a theoretical perspective, explicitly incorporating contact tracing with disease dynamics presents challenges, and population level effects of contact tracing are difficult to determine. In this work, we formulate and analyze a mechanistic SEIR type outbreak model which considers the key features of contact traci… ▽ More Contact tracing is an important control strategy for containing Ebola epidemics. From a theoretical perspective, explicitly incorporating contact tracing with disease dynamics presents challenges, and population level effects of contact tracing are difficult to determine. In this work, we formulate and analyze a mechanistic SEIR type outbreak model which considers the key features of contact tracing, and we characterize the impact of contact tracing on the effective reproduction number, $\mathcal R_e$, of Ebola. In particular, we determine how relevant epidemiological properties such as incubation period, infectious period and case reporting, along with varying monitoring protocols, affect the efficacy of contact tracing. In the special cases of either perfect monitoring of traced cases or perfect reporting of all cases, we derive simple formulae for the critical proportion of contacts that need to be traced in order to bring the effective reproduction number $\mathcal R_e$ below one. Also, in either case, we show that $\mathcal R_e$ can be expressed completely in terms of observable reported case/tracing quantities, namely $\mathcal R_e=k\dfrac{(1-q)}{q}+k_m$ where $k$ is the number of secondary traced infected contacts per primary untraced reported case, $k_m$ is the number of secondary traced infected contacts per primary traced reported case and $(1-q)/q$ is the odds that a reported case is not a traced contact. These formulae quantify contact tracing as both an intervention strategy that impacts disease spread and a probe into the current epidemic status at the population level. Data from the West Africa Ebola outbreak is utilized to form real-time estimates of $\mathcal R_e$, and inform our projections of the impact of contact tracing, and other control measures, on the epidemic trajectory. △ Less

Submitted 7 November, 2015; v1 submitted 14 May, 2015; originally announced May 2015.

Journal ref: Journal of Theoretical Biology, Volume 384 pg. 33-49, 2015

A Model of the Ebola Epidemics in West Africa Incorporating Age of Infection

Authors: G. F. Webb, C. J. Browne

Abstract: A model of an Ebola epidemic is developed with infected individuals structured according to disease age. The transmission of the infection is tracked by disease age through an initial incubation (exposed) phase, followed by an infectious phase with variable transmission infectiousness. The removal of infected individuals is dependent on disease age, with three types of removal rates: (1) removal d… ▽ More A model of an Ebola epidemic is developed with infected individuals structured according to disease age. The transmission of the infection is tracked by disease age through an initial incubation (exposed) phase, followed by an infectious phase with variable transmission infectiousness. The removal of infected individuals is dependent on disease age, with three types of removal rates: (1) removal due to hospitalization (isolation), (2) removal due to mortality separate from hospitalization, and (3) removal due to recovery separate from hospitalization. The model is applied to the Ebola epidemics in Sierra Leone and Guinea. Model simulations indicate that successive stages of increased and earlier hospitalization of cases have resulted in mitigation of the epidemics. △ Less

Submitted 1 April, 2015; originally announced April 2015.

A Model of the 2014 Ebola Epidemic in West Africa with Contact Tracing

Authors: Cameron Browne, Xi Huo, Pierre Magal, Moussa Seydi, Ousmanne Seydi, Glenn Webb

Abstract: A differential equations model is developed for the 2014 Ebola epidemics in Sierra Leone, Liberia, and Guinea. The model describes the dynamic interactions of the susceptible and infected populations of these countries. The model incorporates the principle features of contact tracing, namely, the number of contacts per identified infectious case, the likelihood that a traced contact is either incu… ▽ More A differential equations model is developed for the 2014 Ebola epidemics in Sierra Leone, Liberia, and Guinea. The model describes the dynamic interactions of the susceptible and infected populations of these countries. The model incorporates the principle features of contact tracing, namely, the number of contacts per identified infectious case, the likelihood that a traced contact is either incubating or infectious, and the efficiency of the contact tracing process.The model is first fitted to current cumulative reported case data in each country. The data fitted simulations are then projected forward in time, with varying parameter regimes corresponding to contact tracing efficiencies. These projections quantify the importance of the identification, isolation, and contact tracing processes for containment of the epidemics. △ Less

Submitted 21 October, 2014; v1 submitted 14 October, 2014; originally announced October 2014.

Guaranteed energy-efficient bit reset in finite time

Authors: Cormac Browne, Andrew J. P. Garner, Oscar C. O. Dahlsten, Vlatko Vedral

Abstract: Landauer's principle states that it costs at least kTln2 of work to reset one bit in the presence of a heat bath at temperature T. The bound of kTln2 is achieved in the unphysical infinite-time limit. Here we ask what is possible if one is restricted to finite-time protocols. We prove analytically that it is possible to reset a bit with a work cost close to kTln2 in a finite time. We construct an… ▽ More Landauer's principle states that it costs at least kTln2 of work to reset one bit in the presence of a heat bath at temperature T. The bound of kTln2 is achieved in the unphysical infinite-time limit. Here we ask what is possible if one is restricted to finite-time protocols. We prove analytically that it is possible to reset a bit with a work cost close to kTln2 in a finite time. We construct an explicit protocol that achieves this, which involves changing the system's Hamiltonian avoiding quantum coherences, and thermalising. Using concepts and techniques pertaining to single-shot statistical mechanics, we further develop the limit on the work cost, proving that the heat dissipated is close to the minimal possible not just on average, but guaranteed with high confidence in every run. Moreover we exploit the protocol to design a quantum heat engine that works near the Carnot efficiency in finite time. △ Less

Submitted 12 September, 2014; v1 submitted 29 November, 2013; originally announced November 2013.

Comments: 5 pages + 5 page technical appendix. 5 figures. Author accepted version

Journal ref: Phys. Rev. Lett. 113, 100603 (2014)

Background identification and suppression for the measurement of (n,g) reactions with the DANCE array at LANSCE

Authors: R. Reifarth, T. A. Bredeweg, A. Alpizar-Vicente, J. C. Browne, E. -I. Esch, U. Greife, R. C. Haight, R. Hatarik, A. Kronenberg, J. M. O'Donnell, R. S. Rundberg, J. L. Ullmann, D. J. Vieira, J. B. Wilhelmy, J. M. Wouters

Abstract: In the commissioning phase of the DANCE project (Detector for Advanced Neutron Capture Experiments) measurements have been performed with special emphasis on the identification and suppression of possible backgrounds for the planned (n,g) experiments. This report describes several background sources, observed in the experiment or anticipated from simulations, which will need to be suppressed in th… ▽ More In the commissioning phase of the DANCE project (Detector for Advanced Neutron Capture Experiments) measurements have been performed with special emphasis on the identification and suppression of possible backgrounds for the planned (n,g) experiments. This report describes several background sources, observed in the experiment or anticipated from simulations, which will need to be suppressed in this and in similar detectors that are planned at other facilities. First successes are documented in the suppression of background from scattered neutrons captured in the detector as well as from the internal radiation. Experimental results and simulations using the GEANT code are compared. △ Less

Submitted 7 October, 2013; originally announced October 2013.

Journal ref: Nuclear Instruments and Methods in Physics Research A 531 (2004) 530-543

From regional pulse vaccination to global disease eradication: insights from a mathematical model of Poliomyelitis

Authors: Cameron Browne, Lydia Bourouiba, Robert Smith

Abstract: Mass-vaccination campaigns are an important strategy in the global fight against poliomyelitis and measles. The large-scale logistics required for these mass immunisation campaigns magnifies the need for research into the effectiveness and optimal deployment of pulse vaccination. In order to better understand this control strategy, we propose a mathematical model accounting for the disease dynamic… ▽ More Mass-vaccination campaigns are an important strategy in the global fight against poliomyelitis and measles. The large-scale logistics required for these mass immunisation campaigns magnifies the need for research into the effectiveness and optimal deployment of pulse vaccination. In order to better understand this control strategy, we propose a mathematical model accounting for the disease dynamics in connected regions, incorporating seasonality, environmental reservoirs and independent periodic pulse vaccination schedules in each region. The effective reproduction number, $R_e$, is defined and proved to be a global threshold for persistence of the disease. Analytical and numerical calculations show the importance of synchronising the pulse vaccinations in connected regions and the timing of the pulses with respect to the pathogen circulation seasonality. Our results indicate that it may be crucial for mass-vaccination programs, such as national immunisation days, to be synchronised across different regions. In addition, simulations show that a migration imbalance can increase $R_e$ and alter how pulse vaccination should be optimally distributed among the patches, similar to results found with constant-rate vaccination. Furthermore, contrary to the case of constant-rate vaccination, the fraction of environmental transmission affects the value of $R_e$ when pulse vaccination is present. △ Less

Submitted 27 May, 2014; v1 submitted 1 September, 2013; originally announced September 2013.

Comments: Added section 6.1, made other revisions, changed title

MSC Class: 92B05; 34A37

A Multi-Strain Virus Model with Infected Cell Age Structure: Application to HIV

Authors: Cameron J. Browne

Abstract: We consider a general mathematical model of a within-host viral infection with $n$ virus strains and explicit age-since-infection structure for infected cells. In the model, multiple virus strains compete for a population of target cells. Cells infected with virus strain $i\in\left\{1,...,n\right\}$ die at per-capita rate $δ_i(a)$ and produce virions at per-capita rate $p_i(a)$, where $δ_i(a)$ and… ▽ More We consider a general mathematical model of a within-host viral infection with $n$ virus strains and explicit age-since-infection structure for infected cells. In the model, multiple virus strains compete for a population of target cells. Cells infected with virus strain $i\in\left\{1,...,n\right\}$ die at per-capita rate $δ_i(a)$ and produce virions at per-capita rate $p_i(a)$, where $δ_i(a)$ and $p_i(a)$ are functions of the age-since-infection of the cell. Viral strain $i$ has a basic reproduction number, $\mathcal{R}_i$, and a corresponding positive single strain equilibrium, $E_i$, when $\mathcal{R}_i>1$. If $\mathcal{R}_i<1$, then the total concentration of virus strain $i$ will converge to 0 asymptotically. The main result is that when $\max_i \mathcal{R}_i>1$ and all of the reproduction numbers are distinct, i.e. $\mathcal{R}_i\neq \mathcal{R}_j \ \forall i\neq j$, the viral strain with the maximal basic reproduction number competitively excludes the other strains. As an application of the model, HIV evolution is considered and simulations are provided. △ Less

Submitted 27 May, 2014; v1 submitted 1 September, 2013; originally announced September 2013.

Comments: Minor revisions performed; reworked Figure 2

MSC Class: 92; 35; 37

Measurement of the $ν_e$ and Total $^{8}$B Solar Neutrino Fluxes with the Sudbury Neutrino Observatory Phase-III Data Set

Authors: B. Aharmim, S. N. Ahmed, J. F. Amsbaugh, J. M. Anaya, A. E. Anthony, J. Banar, N. Barros, E. W. Beier, A. Bellerive, B. Beltran, M. Bergevin, S. D. Biller, K. Boudjemline, M. G. Boulay, T. J. Bowles, M. C. Browne, T. V. Bullard, T. H. Burritt, B. Cai, Y. D. Chan, D. Chauhan, M. Chen, B. T. Cleveland, G. A. Cox, C. A. Currat , et al. (125 additional authors not shown)

Abstract: This paper details the solar neutrino analysis of the 385.17-day Phase-III data set acquired by the Sudbury Neutrino Observatory (SNO). An array of $^3$He proportional counters was installed in the heavy-water target to measure precisely the rate of neutrino-deuteron neutral-current interactions. This technique to determine the total active $^8$B solar neutrino flux was largely independent of the… ▽ More This paper details the solar neutrino analysis of the 385.17-day Phase-III data set acquired by the Sudbury Neutrino Observatory (SNO). An array of $^3$He proportional counters was installed in the heavy-water target to measure precisely the rate of neutrino-deuteron neutral-current interactions. This technique to determine the total active $^8$B solar neutrino flux was largely independent of the methods employed in previous phases. The total flux of active neutrinos was measured to be $5.54^{+0.33}_{-0.31}(stat.)^{+0.36}_{-0.34}(syst.)\times 10^{6}$ cm$^{-2}$ s$^{-1}$, consistent with previous measurements and standard solar models. A global analysis of solar and reactor neutrino mixing parameters yielded the best-fit values of $Δm^2 = 7.59^{+0.19}_{-0.21}\times 10^{-5}{eV}^2$ and $θ= 34.4^{+1.3}_{-1.2}$ degrees. △ Less

Submitted 14 July, 2011; originally announced July 2011.

Comments: 104 pages, 26 figures, 20 tables, submitted to Phys. Rev. C

Report number: LA-UR 11-03212