SearcharxivSearch

arXiv subjects

Yishen Jiang

Publications and source records attributed to Yishen Jiang.

6 recordsLinked to original sources

Indirect reciprocity beyond pairwise interactions

Cooperation in groups underpins collective responses to challenges from climate governance to public goods provision, yet how moral evaluation sustains it remains poorly understood. Indirect reciprocity -- cooperating to build a good reputation -- is well characterized for pairwise interactions, but real collective action requires individuals to be judged against the reputational profile of an entire group. Here we develop a general framework for multiplayer indirect reciprocity and show that stable group cooperation obeys a simple organizing principle: `all good, help; one bad, halt'. This rule is both necessary and sufficient for cooperation to emerge, and it recovers the classical leading eight norms in the pairwise limit. We further show that group structure fundamentally changes reputation dynamics: unlike pairwise models, which are monostable, multiplayer systems exhibit bistability and hysteresis, with a critical tipping point separating cooperative and defective regimes. Assessment of the latent norms of large language models reveals that they shift toward punitive defection when provided with richer social information, yet fail to follow the full logic of `all good, help; one bad, halt'. Our results establish a unifying principle for reputation-based cooperation in groups and provide a benchmark for evaluating cooperative alignment in artificial intelligence.

physics.soc-ph

Reinforcement learning with reputation-based adaptive exploration promotes cooperation

Reinforcement learning provides a framework for studying how individuals adjust their behavior through repeated interaction and feedback in social dilemmas. In Q-learning, exploration controls how often agents choose actions other than those favored by their current learned Q-values. Yet existing models usually treat the exploration rate as a constant parameter. In systems with social evaluation, however, trial-and-error behavior carries different costs and opportunities for agents with different reputations, making exploration dependent on social standing rather than uniform across agents. Herein, we develop a spatial prisoner's dilemma model in which Q-learning agents adapt their exploration rates according to local reputation differences, while reputation is updated through an asymmetric, state-dependent rule. Results show that adaptive exploration and asymmetric reputation updating each promote cooperation, but their combination produces a stronger reinforcing effect than either mechanism alone. Low-reputation agents explore more and can recover reputation through cooperation, while high-reputation agents explore less and avoid reputation losses caused by defection. This mechanism also reorganizes cooperation in space, producing a stable checkerboard-like coexistence at intermediate reputation concern. In addition, cooperation is most vulnerable at intermediate baseline exploration rates, whereas stronger asymmetric reputation updating mitigates this exploration-induced disruption. These results suggest that reputation can act not only as a record of past behavior, but also as a dynamic signal that regulates exploratory behavior during learning and thereby stabilizes cooperation.

physics.comp-ph

Nonlinear Public Goods Game in Dynamical Environments

The evolutionary mechanisms of cooperative behavior represent a fundamental topic in complex systems and evolutionary dynamics. Real-world collective interactions, particularly in multi-agent systems, are often characterized by behavior-dependent mechanism switching where the environmental state is endogenously shaped by group strategies. However, existing models typically treat such environmental variations as static stochasticity and neglect the closed-loop feedback between environmental states and cooperative behaviors. Here, we introduce a dynamic environmental feedback mechanism into a nonlinear public goods game framework to establish a coevolutionary model that couples environmental states and individual cooperative strategies. Our results demonstrate that the interplay among environmental feedback, nonlinear effects, and environmental randomness can drive the system toward a wide variety of steady-state structures, including full defection, full cooperation, stable coexistence, and periodic limit cycles. Further analysis reveals that asymmetric nonlinear parameters and environmental feedback rates exert significant regulatory effects on cooperation levels and system dynamics. This study not only enriches the theoretical framework of evolutionary game theory but also provides a foundation for modeling environmental feedback loops in scenarios ranging from ecological management to the design of cooperative mechanisms in autonomous systems.

nlin.AO

Indirect Reciprocity with Environmental Feedback

Indirect reciprocity maintains cooperation in stranger societies by mapping individual behaviors onto reputation signals via social norms. Existing theoretical frameworks assume static environments with constant resources and fixed payoff structures. However, in real-world systems, individuals' strategic behaviors not only shape their reputation but also induce collective-level resource changes in ecological, economic, or other external environments, which in turn reshape the incentives governing future individual actions. To overcome this limitation, we establish a co-evolutionary framework that couples moral assessment, strategy updating, and environmental dynamics, allowing the payoff structure to dynamically adjust in response to the ecological consequences of collective actions. We find that this environmental feedback mechanism helps lower the threshold for the emergence of cooperation, enabling the system to spontaneously transition from a low-cooperation state to a stable high-cooperation regime, thereby reducing the dependence on specific initial conditions. Furthermore, while lenient norms demonstrate adaptability in static environments, norms with strict discrimination are shown to be crucial for curbing opportunism and maintaining evolutionary resilience in dynamic settings. Our results reveal the evolutionary dynamics of coupled systems involving reputation institutions and environmental constraints, offering a new theoretical perspective for understanding collective cooperation and social governance in complex environments.

physics.soc-ph

Indirect reciprocity in the public goods game with collective reputations

Indirect reciprocity unveils how social cooperation is founded upon moral systems. Within the frame of dyadic games based on individual reputations, the "leading-eight" strategies distinguish themselves in promoting and sustaining cooperation. However, in the real-world societies, there are widespread interactions at the group level, where individuals need to make a singular action choice when facing multiple individuals with different reputations. Here, through introducing the assessment of collective reputations, we develop a framework that embeds group-level reputation structure into public goods game to study the evolution of group-level indirect reciprocity. We show that changing the criteria of group assessment destabilize the reputation dynamics of leading-eight strategies. In a particular range of social assessment criteria, all leading-eight strategies can break the social dilemma in public goods games and sustain cooperation. Specifically, there exists an optimal, moderately set assessment criterion that is most conducive to promoting cooperation. Moreover, in the evolution of assessment criteria, the preference of the leading-eight strategies for social strictness is inversely correlated with the payoff level. Our work reveals the impact of social strictness on prosocial behavior, highlighting the importance of group-level interactions in the analysis of evolutionary games and complex social dynamics.

physics.soc-ph

Nonlinear eco-evolutionary games with global environmental fluctuations and local environmental feedbacks

Environmental changes play a critical role in determining the evolution of social dilemmas in many natural or social systems. Generally, the environmental changes include two prominent aspects: the global time-dependent fluctuations and the local strategy-dependent feedbacks. However, the impacts of these two types of environmental changes have only been studied separately, a complete picture of the environmental effects exerted by the combination of these two aspects remains unclear. Here we develop a theoretical framework that integrates group strategic behaviors with their general dynamic environments, where the global environmental fluctuations are associated with a nonlinear factor in public goods game and the local environmental feedbacks are described by the `eco-evolutionary game'. We show how the coupled dynamics of local game-environment evolution differs in static and dynamic global environments. In particular, we find the emergence of cyclic evolutions of group cooperation and local environment, which forms an interior irregular loop in the phase plane, depending on the relative changing speed of both global and local environments compared to the strategic change. Our results provide important insights toward how diverse evolutionary outcomes could emerge from the nonlinear interactions between strategies and the changing environments.

physics.soc-ph