Searcharxiv⌕ Search

arXiv subjects

Cristiano De Nobili

Publications and source records attributed to Cristiano De Nobili.

6 recordsLinked to original sources

Microscopic dynamics of consensus formation in multi-agent LLM Naming Games

Decentralized populations of Large Language Model (LLM) agents can spontaneously reach consensus on shared conventions, yet the microscopic mechanisms by which their internal stochasticity shapes macroscopic ordering remain unexplored. We study a minimal LLM Naming Game in which the listener's decision is a single-token LLM call at decoding temperature $T$, replacing the inventory check of the deterministic Naming Game. Each interaction decomposes into an in-inventory and an out-inventory channel with conditional rates $π(T)\!\equiv\!P(\text{YES}\mid w\in P_j)$ and $ϕ(T)\!\equiv\!P(\text{YES}\mid w\notin P_j)$, whose balance controls an ordering-disordering drift. A mean-field theory of the two-rate dynamics yields an analytical ordering condition that generalizes the consensus threshold of the stochastic Naming Game to a critical line in the $(π,ϕ)$ plane. Across three open-weight architectures, consensus is always reached, but through three distinct listener regimes: permissive (repaint-noise dominated), near-deterministic, and conservative (missed-collapse dominated). The effective finite-size exponent $β(T)$ in $t_{\rm conv}\!\sim\!N^β$ shifts with temperature, and the temperature-sensitivity $α$ in $t_c\!\sim\!e^{αT}$ ranges from ${\approx}\,0.67$ to ${\approx}\,0$ across architectures. Decoding temperature thus emerges as an architecture-dependent control parameter for decentralized LLM populations, quantitatively characterized by the statistical-physics toolkit.

physics.soc-ph↗

Collective Alignment in LLM Multi-Agent Systems: Disentangling Bias from Cooperation via Statistical Physics

We investigate the emergent collective dynamics of LLM-based multi-agent systems on a 2D square lattice and present a model-agnostic statistical-physics method to disentangle social conformity from intrinsic bias, compute critical exponents, and probe the collective behavior and possible phase transitions of multi-agent systems. In our framework, each node of an $L\!\times\!L$ lattice hosts an identical LLM agent holding a binary state ($+1$/$-1$, mapped to yes/no) and updating it by querying the model conditioned on the four nearest-neighbor states. The sampler temperature $T$ serves as the sole control parameter. Across three open-weight models (llama3.1:8b, phi4-mini:3.8b, mistral:7b), we measure magnetization and susceptibility under a global-flip protocol designed to probe $\mathbb{Z}_2$ symmetry. All models display temperature-driven order-disorder crossovers and susceptibility peaks; finite-size scaling on even-$L$ lattices yields effective exponents $γ/ν$ whose values are model-dependent, close to but incompatible with the 2D Ising universality class ($γ/ν=7/4$). Our method enables the extraction of effective $β$-weighted couplings $\tilde{J}(T)$ and fields $\tilde{h}(T)$, which serve as a measure of social conformity and intrinsic bias. In the models we analyzed, we found that collective alignment is dominated by an intrinsic bias ($\tilde{h}\gg\tilde{J}$) rather than by cooperative neighbor coupling, producing field-driven crossovers instead of genuine phase transitions. These effective parameters vary qualitatively across models, providing compact collective-behavior fingerprints for LLM agents and a quantitative diagnostic for the reliability of multi-agent consensus and collective alignment.

cond-mat.stat-mech↗

More is More: Addition Bias in Large Language Models

In this paper, we investigate the presence of additive bias in Large Language Models (LLMs), drawing a parallel to the cognitive bias observed in humans where individuals tend to favor additive over subtractive changes. Using a series of controlled experiments, we tested various LLMs, including GPT-3.5 Turbo, Claude 3.5 Sonnet, Mistral, Math$Σ$tral, and Llama 3.1, on tasks designed to measure their propensity for additive versus subtractive modifications. Our findings demonstrate a significant preference for additive changes across all tested models. For example, in a palindrome creation task, Llama 3.1 favored adding letters 97.85% of the time over removing them. Similarly, in a Lego tower balancing task, GPT-3.5 Turbo chose to add a brick 76.38% of the time rather than remove one. In a text summarization task, Mistral 7B produced longer summaries in 59.40% to 75.10% of cases when asked to improve its own or others' writing. These results indicate that, similar to humans, LLMs exhibit a marked additive bias, which might have implications when LLMs are used on a large scale. Addittive bias might increase resource use and environmental impact, leading to higher economic costs due to overconsumption and waste. This bias should be considered in the development and application of LLMs to ensure balanced and efficient problem-solving approaches.

cs.CL↗

A contour for the entanglement entropies in harmonic lattices

We construct a contour function for the entanglement entropies in generic harmonic lattices. In one spatial dimension, numerical analysis are performed by considering harmonic chains with either periodic or Dirichlet boundary conditions. In the massless regime and for some configurations where the subsystem is a single interval, the numerical results for the contour function are compared to the inverse of the local weight function which multiplies the energy-momentum tensor in the corresponding entanglement hamiltonian, found through conformal field theory methods, and a good agreement is observed. A numerical analysis of the contour function for the entanglement entropy is performed also in a massless harmonic chain for a subsystem made by two disjoint intervals.

cond-mat.stat-mech↗

Entanglement negativity in a two dimensional harmonic lattice: Area law and corner contributions

We study the logarithmic negativity and the moments of the partial transpose in the ground state of a two dimensional massless harmonic square lattice with nearest neighbour interactions for various configurations of adjacent domains. At leading order for large domains, the logarithmic negativity and the logarithm of the ratio between the generic moment of the partial transpose and the moment of the reduced density matrix at the same order satisfy an area law in terms of the length of the curve shared by the adjacent regions. We give numerical evidences that the coefficient of the area law term in these quantities is related to the coefficient of the area law term in the Rényi entropies. Whenever the curve shared by the adjacent domains contains vertices, a subleading logarithmic term occurs in these quantities and the numerical values of the corner function for some pairs of angles are obtained. In the special case of vertices corresponding to explementary angles, we provide numerical evidence that the corner function of the logarithmic negativity is given by the corner function of the Rényi entropy of order 1/2.

cond-mat.stat-mech↗

Entanglement entropy and negativity of disjoint intervals in CFT: Some numerical extrapolations

The entanglement entropy and the logarithmic negativity can be computed in quantum field theory through a method based on the replica limit. Performing these analytic continuations in some cases is beyond our current knowledge, even for simple models. We employ a numerical method based on rational interpolations to extrapolate the entanglement entropy of two disjoint intervals for the conformal field theories given by the free compact boson and the Ising model. The case of three disjoint intervals is studied for the Ising model and the non compact free massless boson. For the latter model, the logarithmic negativity of two disjoint intervals has been also considered. Some of our findings have been checked against existing numerical results obtained from the corresponding lattice models.

cond-mat.stat-mech↗