SearcharxivSearch

arXiv subjects

Mendeli H. Vainstein

Publications and source records attributed to Mendeli H. Vainstein.

18 recordsLinked to original sources

Dilution, Diffusion and Symbiosis in Spatial Prisoner's Dilemma with Reinforcement Learning

Recent studies in the spatial prisoner's dilemma games with reinforcement learning have shown that static agents can learn to cooperate through a diverse sort of mechanisms, including noise injection, different types of learning algorithms and neighbours' payoff knowledge. In this work, using an independent multi-agent Q-learning algorithm, we study the effects of dilution and mobility in the spatial version of the prisoner's dilemma. Within this setting, different possible actions for the algorithm are defined, connecting with previous results on the classical, non-reinforcement learning spatial prisoner's dilemma, showcasing the versatility of the algorithm in modeling different game-theoretical scenarios and the benchmarking potential of this approach. As a result, a range of effects is observed, including evidence that games with fixed update rules can be qualitatively equivalent to those with learned ones, as well as the emergence of a symbiotic mutualistic effect between populations that forms when multiple actions are defined.

cs.AI

Anomalous behavior of Replicator dynamics for the Prisoner's Dilemma on diluted lattices

In diluted lattices, cooperation is often enhanced at specific densities, particularly near the percolation threshold for stochastic updating rules. However, the Replicator rule, despite being probabilistic, does not follow this trend. We find that this anomalous behavior is caused by structures formed by holes and defectors, which prevent some agents from experiencing fluctuations, thereby restricting the free flow of information across the network. As a result, the system becomes trapped in a frozen state, though this can be disrupted by introducing perturbations. Finally, we provide a more quantitative analysis of the relationship between the percolation threshold and cooperation, tracking its development within clusters of varying sizes and demonstrating how the percolation threshold shapes the fundamental structures of the lattice.

physics.soc-ph

Heterogeneous contributions can jeopardize cooperation in the Public Goods Game

When studying social dilemma games, a crucial question arises regarding the impact of general heterogeneity on cooperation, which has been shown to have positive effects in numerous studies. Here, we demonstrate that heterogeneity in the contribution value for the focal Public Goods Game can jeopardize cooperation. We show that there is an optimal contribution value in the homogeneous case that most benefits cooperation depending on the lattice. In a heterogeneous scenario, where strategy and contribution coevolve, cooperators making contributions higher than the optimal value end up harming those who contribute lower. This effect is notably detrimental to cooperation in the square lattice with von Neumann neighborhood, while it can have no impact in others lattices. Furthermore, in parameter regions where a higher-contributing cooperator cannot normally survive alone, the exploitation of lower value contribution cooperators allows their survival, resembling a parasitic behavior. To obtain these results, we employed various distributions for the contribution values in the initial condition and conducted Monte Carlo simulations.

physics.soc-ph

Cooperation in regular lattices

In the context of Evolutionary Game Theory, one of the most noteworthy mechanisms to support cooperation is spatial reciprocity, usually accomplished by distributing players in a spatial structure allowing cooperators to cluster together and avoid exploitation. This raises an important question: how is the survival of cooperation affected by different topologies? Here, to address this question, we explore the Focal Public Goods (FPGG) and classic Public Goods Games (PGG), and the Prisoner's Dilemma (PD) on several regular lattices: honeycomb, square (with von Neumann and Moore neighborhoods), kagome, triangular, cubic, and 4D hypercubic lattices using both analytical methods and agent-based Monte Carlo simulations. We found that for both Public Goods Games, a consistent trend appears on all two-dimensional lattices: as the number of first neighbors increases, cooperation is enhanced. However, this is only visible by analysing the results in terms of the payoff's synergistic factor normalized by the number of connections. Besides this, clustered topologies, i.e., those that allow two connected players to share neighbors, are the most beneficial to cooperation for the FPGG. The same is not always true for the classic PGG, where having shared neighbors between connected players may or may not benefit cooperation. We also provide a reinterpretation of the classic PGG as a focal game by representing the lattice structure of this category of games as a single interaction game with longer-ranged, weighted neighborhoods, an approach valid for any regular lattice topology. Finally, we show that depending on the payoff parametrization of the PD, there can be an equivalency between the PD and the FPGG; when the mapping between the two games is imperfect, the definition of an effective synergy parameter can still be useful to show their similarities.

q-bio.PE

Symbiotic behaviour in the Public Goods game with altruistic punishment

Finding ways to overcome the temptation to exploit one another is still a challenge in behavioural sciences. In the framework of evolutionary game theory, punishing strategies are frequently used to promote cooperation in competitive environments. Here, we introduce altruistic punishers in the spatial public goods game. This strategy acts as a cooperator in the absence of defectors, otherwise it will punish all defectors in their vicinity while bearing a cost to do so. We observe three distinct behaviours in our model: i) in the absence of punishers, cooperators (who don't punish defectors) are driven to extinction by defectors for most parameter values; ii) clusters of punishers thrive by sharing the punishment costs when these are low iii) for higher punishment costs, punishers, when alone, are subject to exploitation but in the presence of cooperators can form a symbiotic spatial structure that benefits both. This last observation is our main finding since neither cooperation nor punishment alone can survive the defector strategy in this parameter region and the specificity of the symbiotic spatial configuration shows that lattice topology plays a central role in sustaining cooperation. Results were obtained by means of Monte Carlo simulations on a square lattice and subsequently confirmed by a pairwise comparison of different strategies' payoffs in diverse group compositions, leading to a phase diagram of the possible states.

q-bio.PE

Anomalous diffusion: A basic mechanism for the evolution of inhomogeneous systems

In this article we review classical and recent results in anomalous diffusion and provide mechanisms useful for the study of the fundamentals of certain processes, mainly in condensed matter physics, chemistry and biology. Emphasis will be given to some methods applied in the analysis and characterization of diffusive regimes through the memory function, the mixing condition (or irreversibility), and ergodicity. Those methods can be used in the study of small-scale systems, ranging in size from single-molecule to particle clusters and including among others polymers, proteins, ion channels and biological cells, whose diffusive properties have received much attention lately.

cond-mat.stat-mech

Spatial social dilemmas: dilution, mobility and grouping effects with imitation dynamics

We present an extensive, systematic study of the Prisoner's Dilemma and Snowdrift games on a square lattice under a synchronous, noiseless imitation dynamics. We show that for both the occupancy of the network and the (random) mobility of the agents there are intermediate values that may increase the amount of cooperators in the system and new phases appear. We analytically determine the transition lines between these phases and compare with the mean field prediction and the observed behavior on a square lattice. We point out which are the more relevant microscopic processes that entitle cooperators to invade a population of defectors in the presence of mobility and discuss the universality of these results.

q-bio.PE

On the Modeling of Droplet Evaporation on Superhydrophobic Surfaces

When a drop of water is placed on a rough surface, there are two possible extreme regimes of wetting: the one called Cassie-Baxter (CB) with air pockets trapped underneath the droplet and the one characterized by the homogeneous wetting of the surface, called the Wenzel (W) state. A way to investigate the transition between these two states is by means of evaporation experiments, in which the droplet starts in a CB state and, as its volume decreases, penetrates the surface's grooves, reaching a W state. Here we present a theoretical model based on the global interfacial energies for CB and W states that allows us to predict the thermodynamic wetting state of the droplet for a given volume and surface texture. We first analyze the influence of the surface geometric parameters on the droplet's final wetting state with constant volume, and show that it depends strongly on the surface texture. We then vary the volume of the droplet keeping fixed the geometric surface parameters to mimic evaporation and show that the drop experiences a transition from the CB to the W state when its volume reduces, as observed in experiments. To investigate the dependency of the wetting state on the initial state of the droplet, we implement a cellular Potts model in three dimensions. Simulations show a very good agreement with theory when the initial state is W, but it disagrees when the droplet is initialized in a CB state, in accordance with previous observations which show that the CB state is metastable in many cases. Both simulations and theoretical model can be modified to study other types of surface.

cond-mat.soft

Percolation and cooperation with mobile agents: Geometric and strategy clusters

We study the conditions for persistent cooperation in an off-lattice model of mobile agents playing the Prisoner's Dilemma game with pure, unconditional strategies. Each agent has an exclusion radius rP, which accounts for the population viscosity, and an interaction radius rint, which defines the instantaneous contact network for the game dynamics. We show that, differently from the rP=0 case, the model with finite-sized agents presents a coexistence phase with both cooperators and defectors, besides the two absorbing phases, in which either cooperators or defectors dominate. We provide, in addition, a geometric interpretation of the transitions between phases. In analogy with lattice models, the geometric percolation of the contact network (i.e., irrespective of the strategy) enhances cooperation. More importantly, we show that the percolation of defectors is an essential condition for their survival. Differently from compact clusters of cooperators, isolated groups of defectors will eventually become extinct if not percolating, independently of their size.

physics.soc-ph

Khinchin theorem and anomalous diffusion

A recent paper [M. H. Lee, Phys. Rev. Lett. 98, 190601 (2007)] has called attention to the fact that irreversibility is a broader concept than ergodicity, and that therefore the Khinchin theorem [A. I. Khinchin, Mathematical Foundations of Statistical Mechanics (Dover, New York) 1949] may fail in some systems. In this Letter we show that for all ranges of normal and anomalous diffusion described by a Generalized Langevin Equation the Khinchin theorem holds.

cond-mat.stat-mech

Random mobility and spatial structure often enhance cooperation

The effects of an unconditional move rule in the spatial Prisoner's Dilemma, Snowdrift and Stag Hunt games are studied. Spatial structure by itself is known to modify the outcome of many games when compared with a randomly mixed population, sometimes promoting, sometimes inhibiting cooperation. Here we show that random dilution and mobility may suppress the inhibiting factors of the spatial structure in the Snowdrift game, while enhancing the already larger cooperation found in the Prisoner's dilemma and Stag Hunt games.

q-bio.PE

Anomalous Diffusion

Recent investigations call attention to the dynamics of anomalous diffusion and its connection with basic principles of statistical mechanics. We present here a short review of those ideas and their implications.

cond-mat.stat-mech

Mixing, ergodicity and slow relaxation phenomena

Investigations on diffusion in systems with memory [I.V.L. Costa, R. Morgado, M.V.B.T. Lima, F.A. Oliveira, Europhys. Lett. 63 (2003) 173] have established a hierarchical connection between mixing, ergodicity, and the fluctuation-dissipation theorem (FDT). This hierarchy means that ergodicity is a necessary condition for the validity of the FDT, and mixing is a necessary condition for ergodicity. In this work, we compare those results with recent investigations using the Lee recurrence relations method [M.H. Lee, Phys. Rev. B 26 (1982) 2547; M.H. Lee, Phys. Rev. Lett. 87 (2001) 250601; M.H. Lee, J. Phys. A: Math. Gen. 39 (2006) 4651]. Lee shows that ergodicity is violated in the dynamics of the electron gas [M.H. Lee, J. Phys. A: Math. Gen. 39 (2006) 4651]. This reinforces both works and implies that the results of [I.V.L. Costa, R. Morgado, M.V.B.T. Lima, F.A. Oliveira, Europhys. Lett. 63 (2003) 173] are more general than the framework in which they were obtained. Some applications to slow relaxation phenomena are discussed.

cond-mat.stat-mech

Does mobility decrease cooperation?

We explore the minimal conditions for sustainable cooperation on a spatially distributed population of memoryless, unconditional strategies (cooperators and defectors) in presence of unbiased, non contingent mobility in the context of the Prisoner's Dilemma game. We find that cooperative behavior is not only possible but may even be enhanced by such an ``always-move'' rule, when compared with the strongly viscous (``never-move'') case. In addition, mobility also increases the capability of cooperation to emerge and invade a population of defectors, what may have a fundamental role in the problem of the onset of cooperation.

q-bio.PE

Non-exponential relaxation for anomalous diffusion

We study the relaxation process in normal and anomalous diffusion regimes for systems described by a generalized Langevin equation (GLE). We demonstrate the existence of a very general correlation function which describes the relaxation phenomena. Such function is even; therefore, it cannot be an exponential or a stretched exponential. However, for a proper choice of the parameters, those functions can be reproduced within certain intervals with good precision. We also show the passage from the non-Markovian to the Markovian behaviour in the normal diffusion regime. For times longer than the relaxation time, the correlation function for anomalous diffusion becomes a power law for broad-band noise.

cond-mat.dis-nn

Spatio-temporal conjecture for diffusion

We present here a conjecture about the equivalence between the noise density of states of a system governed by a generalized Langevin equation and the fluctuation in the energy density of states in a Hamiltonian system. We present evidence of this for a disordered Heisenberg system.

cond-mat.dis-nn

Heterogeneities in systems with quenched disorder

We study the strong role played by structural (quenched) heterogeneities on static and dynamic properties of the Frustrated Ising Lattice Gas in two dimensions, already in the liquid phase. Differently from the dynamical heterogeneities observed in other glass models in this case they may have infinite lifetime and be spatially pinned by the quenched disorder. We consider a measure of local frustration, show how it induces the appearance of spatial heterogeneities and how this reflects in the observed behavior of equilibrium density distributions and dynamic correlation functions.

cond-mat.dis-nn

Disordered Environments in Spatial Games

The Prisoner's dilemma is the main game theoretical framework in which the onset and maintainance of cooperation in biological populations is studied. In the spatial version of the model, we study the robustness of cooperation in heterogeneous ecosystems in spatial evolutionary games by considering site diluted lattices. The main result is that due to disorder, the fraction of cooperators in the population is enhanced. Moreover, the system presents a dynamical transition at $ρ^*$, separating a region with spatial chaos from one with localized, stable groups of cooperators.

cond-mat.dis-nn