Searcharxiv⌕ Search

arXiv subjects

Cameron Browne

Publications and source records attributed to Cameron Browne.

27 records · Page 2Linked to original sources

Ludii and XCSP: Playing and Solving Logic Puzzles

Many of the famous single-player games, commonly called puzzles, can be shown to be NP-Complete. Indeed, this class of complexity contains hundreds of puzzles, since people particularly appreciate completing an intractable puzzle, such as Sudoku, but also enjoy the ability to check their solution easily once it's done. For this reason, using constraint programming is naturally suited to solve them. In this paper, we focus on logic puzzles described in the Ludii general game system and we propose using the XCSP formalism in order to solve them with any CSP solver.

cs.AI↗

Ludii as a Competition Platform

Ludii is a general game system being developed as part of the ERC-funded Digital Ludeme Project (DLP). While its primary aim is to model, play, and analyse the full range of traditional strategy games, Ludii also has the potential to support a wide range of AI research topics and competitions. This paper describes some of the future competitions and challenges that we intend to run using the Ludii system, highlighting some of its most important aspects that can potentially lead to many algorithm improvements and new avenues of research. We compare and contrast our proposed competition motivations, goals and frameworks against those of existing general game playing competitions, addressing the strengths and weaknesses of each platform.

cs.AI↗

Improved Reinforcement Learning with Curriculum

Humans tend to learn complex abstract concepts faster if examples are presented in a structured manner. For instance, when learning how to play a board game, usually one of the first concepts learned is how the game ends, i.e. the actions that lead to a terminal state (win, lose or draw). The advantage of learning end-games first is that once the actions which lead to a terminal state are understood, it becomes possible to incrementally learn the consequences of actions that are further away from a terminal state - we call this an end-game-first curriculum. Currently the state-of-the-art machine learning player for general board games, AlphaZero by Google DeepMind, does not employ a structured training curriculum; instead learning from the entire game at all times. By employing an end-game-first training curriculum to train an AlphaZero inspired player, we empirically show that the rate of learning of an artificial player can be improved during the early stages of training when compared to a player not using a training curriculum.

cs.LG↗

Foundations of Digital Archæoludology

Digital Archaeoludology (DAL) is a new field of study involving the analysis and reconstruction of ancient games from incomplete descriptions and archaeological evidence using modern computational techniques. The aim is to provide digital tools and methods to help game historians and other researchers better understand traditional games, their development throughout recorded human history, and their relationship to the development of human culture and mathematical knowledge. This work is being explored in the ERC-funded Digital Ludeme Project. The aim of this inaugural international research meeting on DAL is to gather together leading experts in relevant disciplines - computer science, artificial intelligence, machine learning, computational phylogenetics, mathematics, history, archaeology, anthropology, etc. - to discuss the key themes and establish the foundations for this new field of research, so that it may continue beyond the lifetime of its initiating project.

cs.AI↗

Learning Policies from Self-Play with Policy Gradients and MCTS Value Estimates

In recent years, state-of-the-art game-playing agents often involve policies that are trained in self-playing processes where Monte Carlo tree search (MCTS) algorithms and trained policies iteratively improve each other. The strongest results have been obtained when policies are trained to mimic the search behaviour of MCTS by minimising a cross-entropy loss. Because MCTS, by design, includes an element of exploration, policies trained in this manner are also likely to exhibit a similar extent of exploration. In this paper, we are interested in learning policies for a project with future goals including the extraction of interpretable strategies, rather than state-of-the-art game-playing performance. For these goals, we argue that such an extent of exploration is undesirable, and we propose a novel objective function for training policies that are not exploratory. We derive a policy gradient expression for maximising this objective function, which can be estimated using MCTS value estimates, rather than MCTS visit counts. We empirically evaluate various properties of resulting policies, in a variety of board games.

cs.LG↗

Biasing MCTS with Features for General Games

This paper proposes using a linear function approximator, rather than a deep neural network (DNN), to bias a Monte Carlo tree search (MCTS) player for general games. This is unlikely to match the potential raw playing strength of DNNs, but has advantages in terms of generality, interpretability and resources (time and hardware) required for training. Features describing local patterns are used as inputs. The features are formulated in such a way that they are easily interpretable and applicable to a wide range of general games, and might encode simple local strategies. We gradually create new features during the same self-play training process used to learn feature weights. We evaluate the playing strength of an MCTS player biased by learnt features against a standard upper confidence bounds for trees (UCT) player in multiple different board games, and demonstrate significantly improved playing strength in the majority of them after a small number of self-play training games.

cs.AI↗

Modeling Contact Tracing in Outbreaks with Application to Ebola

Contact tracing is an important control strategy for containing Ebola epidemics. From a theoretical perspective, explicitly incorporating contact tracing with disease dynamics presents challenges, and population level effects of contact tracing are difficult to determine. In this work, we formulate and analyze a mechanistic SEIR type outbreak model which considers the key features of contact tracing, and we characterize the impact of contact tracing on the effective reproduction number, $\mathcal R_e$, of Ebola. In particular, we determine how relevant epidemiological properties such as incubation period, infectious period and case reporting, along with varying monitoring protocols, affect the efficacy of contact tracing. In the special cases of either perfect monitoring of traced cases or perfect reporting of all cases, we derive simple formulae for the critical proportion of contacts that need to be traced in order to bring the effective reproduction number $\mathcal R_e$ below one. Also, in either case, we show that $\mathcal R_e$ can be expressed completely in terms of observable reported case/tracing quantities, namely $\mathcal R_e=k\dfrac{(1-q)}{q}+k_m$ where $k$ is the number of secondary traced infected contacts per primary untraced reported case, $k_m$ is the number of secondary traced infected contacts per primary traced reported case and $(1-q)/q$ is the odds that a reported case is not a traced contact. These formulae quantify contact tracing as both an intervention strategy that impacts disease spread and a probe into the current epidemic status at the population level. Data from the West Africa Ebola outbreak is utilized to form real-time estimates of $\mathcal R_e$, and inform our projections of the impact of contact tracing, and other control measures, on the epidemic trajectory.

q-bio.PE↗

A Model of the 2014 Ebola Epidemic in West Africa with Contact Tracing

A differential equations model is developed for the 2014 Ebola epidemics in Sierra Leone, Liberia, and Guinea. The model describes the dynamic interactions of the susceptible and infected populations of these countries. The model incorporates the principle features of contact tracing, namely, the number of contacts per identified infectious case, the likelihood that a traced contact is either incubating or infectious, and the efficiency of the contact tracing process.The model is first fitted to current cumulative reported case data in each country. The data fitted simulations are then projected forward in time, with varying parameter regimes corresponding to contact tracing efficiencies. These projections quantify the importance of the identification, isolation, and contact tracing processes for containment of the epidemics.

q-bio.PE↗

From regional pulse vaccination to global disease eradication: insights from a mathematical model of Poliomyelitis

Mass-vaccination campaigns are an important strategy in the global fight against poliomyelitis and measles. The large-scale logistics required for these mass immunisation campaigns magnifies the need for research into the effectiveness and optimal deployment of pulse vaccination. In order to better understand this control strategy, we propose a mathematical model accounting for the disease dynamics in connected regions, incorporating seasonality, environmental reservoirs and independent periodic pulse vaccination schedules in each region. The effective reproduction number, $R_e$, is defined and proved to be a global threshold for persistence of the disease. Analytical and numerical calculations show the importance of synchronising the pulse vaccinations in connected regions and the timing of the pulses with respect to the pathogen circulation seasonality. Our results indicate that it may be crucial for mass-vaccination programs, such as national immunisation days, to be synchronised across different regions. In addition, simulations show that a migration imbalance can increase $R_e$ and alter how pulse vaccination should be optimally distributed among the patches, similar to results found with constant-rate vaccination. Furthermore, contrary to the case of constant-rate vaccination, the fraction of environmental transmission affects the value of $R_e$ when pulse vaccination is present.

q-bio.PE↗