SearcharxivSearch

arXiv subjects

Maria Chiara Angelini

Publications and source records attributed to Maria Chiara Angelini.

At least 19 recordsLinked to original sources

Local equations for the generalized Lotka-Volterra model on sparse asymmetric graphs

Real ecosystems are characterized by sparse and asymmetric interactions, posing a major challenge to theoretical analysis. We introduce a new method to study the generalized Lotka-Volterra model with stochastic dynamics on sparse graphs. By deriving local Fokker-Planck equations and employing a mean-field closure, we can efficiently compute stationary states for both symmetric and asymmetric interactions. We validate our approach by comparing the results with the direct integration of the dynamical equations and by reproducing known results and, for the first time, we map the phase diagram for sparse asymmetric networks. Our framework provides a versatile tool for exploring stability in realistic ecological communities and can be generalized to applications in different contexts, such as economics and evolutionary game theory.

q-bio.PE

Critical exponents of the spin glass transition in a field at zero temperature

We analyze the spin glass transition in a field in finite dimension $D$ below the upper critical dimension directly at zero temperature using a recently introduced perturbative loop expansion around the Bethe lattice solution. The expansion is generated by the so-called $M$-layer construction, and it has $1/M$ as the associated small parameter. Computing analytically and numerically these non-standard diagrams at first order in the $1/M$ expansion, we construct an $ε$-expansion around the upper critical dimension $D_\text{uc}=8$, with $ε=D_\text{uc}-D$. Following standard field theoretical methods, we can write a $β$ function, finding a new zero-temperature fixed-point associated with the spin glass transition in a field in dimensions $D<8$. We are also able to compute, at first order in the $ε$-expansion, the three independent critical exponents characterizing the transition, plus the correction-to-scaling exponent.

cond-mat.dis-nn

Benchmarking Graph Neural Networks in Solving Hard Constraint Satisfaction Problems

Graph neural networks (GNNs) are increasingly applied to hard optimization problems, often claiming superiority over classical heuristics. However, such claims risk being unsolid due to a lack of standard benchmarks on truly hard instances. From a statistical physics perspective, we propose new hard benchmarks based on random problems. We provide these benchmarks, along with performance results from both classical heuristics and GNNs. Our fair comparison shows that classical algorithms still outperform GNNs. We discuss the challenges for neural networks in this domain. Future claims of superiority can be made more robust using our benchmarks, available at https://github.com/ArtLabBocconi/RandCSPBench.

cond-mat.dis-nn

Efficient Graph Coloring with Neural Networks: A Physics-Inspired Approach for Large Graphs

Combinatorial optimization problems near algorithmic phase transitions represent a fundamental challenge for both classical algorithms and machine learning approaches. Among them, graph coloring stands as a prototypical constraint satisfaction problem exhibiting sharp dynamical and satisfiability thresholds. Here we introduce a physics-inspired neural framework that learns to solve large-scale graph coloring instances by combining graph neural networks with statistical-mechanics principles. Our approach integrates a planting-based supervised signal, symmetry-breaking regularization, and iterative noise-annealed neural dynamics to navigate clustered solution landscapes. When the number of iterations scales quadratically with graph size, the learned solver reaches algorithmic thresholds close to the theoretical dynamical transition in random graphs and achieves near-optimal detection performance in the planted inference regime. The model generalizes from small training graphs to instances orders of magnitude larger, demonstrating that neural architectures can learn scalable algorithmic strategies that remain effective in hard connectivity regions. These results establish a general paradigm for learning neural solvers that operate near fundamental phase boundaries in combinatorial optimization and inference.

cs.LG

Long-range spin glass in a field at zero temperature

We compute the critical exponents of the zero-temperature spin glass transition in a field on a one-dimensional long-range model, a proxy for higher-dimensional systems. Our approach is based on a novel loop expansion within the Bethe $M$-layer formalism, whose adaptation to this specific case is detailed here. The resulting estimates provide crucial benchmarks for numerical simulations that can access larger system sizes in one dimension, thus offering a key test of the theory of spin glasses in a field.

cond-mat.dis-nn

Generalized Lotka-Volterra model with sparse interactions: non-Gaussian effects and topological multiple-equilibria phase

We study the equilibrium phases of a generalized Lotka-Volterra model characterized by a species interaction matrix which is random, sparse and symmetric. Dynamical fluctuations are modeled by a demographic noise with amplitude proportional to the effective temperature T. The equilibrium distribution of species abundances is obtained by means of the cavity method and the Belief Propagation equations, which allow for an exact solution on sparse networks. Our results reveal a rich and non-trivial phenomenology that deviates significantly from the predictions of fully connected models. Consistently with data from real ecosystems, which are characterized by sparse rather than dense interaction networks, we find strong deviations from Gaussianity in the distribution of abundances. In addition to the study of these deviations from Gaussianity, which are not related to multiple-equilibria, we also identified a novel topological glass phase, present at both finite temperature, as shown here, and at T=0, as previously suggested in the literature. The peculiarity of this phase, which differs from the multiple-equilibria phase of fully-connected networks, is its strong dependence on the presence of extinctions. These findings provide new insights into how network topology and disorder influence ecological networks, particularly emphasizing that sparsity is a crucial feature for accurately modeling real-world ecological phenomena.

cond-mat.stat-mech

Interacting Copies of Random Constraint Satisfaction Problems

We study a system of $y=2$ coupled copies of a well-known constraint satisfaction problem (random hypergraph bicoloring) to examine how the ferromagnetic coupling between the copies affects the properties of the solution space. We solve the replicated model by applying the cavity method to the supervariables taking $2^y$ values. Our results show that a coupling of strength $γ$ between the copies decreases the clustering threshold $α_d(γ)$, at which typical solutions shatters into disconnected components, therefore preventing numerical methods such as Monte Carlo Markov Chains from reaching equilibrium in polynomial time. This result needs to be reconciled with the observation that, in models with coupled copies, denser regions of the solution space should be more accessible. Additionally, we observe a change in the nature of the clustering phase transition, from discontinuous to continuous, in a wide $γ$ range. We investigate how the coupling affects the behavior of the Belief Propagation (BP) algorithm on finite-size instances and find that BP convergence is significantly impacted by the continuous transition. These results highlight the importance of better understanding algorithmic performance at the clustering transition, and call for a further exploration into the optimal use of re-weighting strategies designed to enhance algorithmic performances.

cond-mat.dis-nn

Bethe $M$-layer construction for the percolation problem

The major difference between percolation and other phase transition models is the absence of an Hamiltonian and of a partition function. For this reason it is not straightforward to identify the corresponding field theory to be used as starting point of Renormalization Group computations. Indeed, it could be identified with the field theory of $n+1$ states Potts model in the limit of $n \to 0$ only by means of the mapping discovered by Kasteleyn and Fortuin for bond percolation. In this paper we show that it is possible to recover the epsilon expansion for critical exponents in finite dimension directly using the $M$-layer expansion, without the need to perform any analytical continuation. Moreover, we also show explicitly that the critical exponents for site and bond percolation are the same. This computation provides a reference for applications of the $M$-layer method to systems where the underlying field theory is unknown or disputed.

cond-mat.stat-mech

Bethe $M$-layer construction on the Ising model

In statistical physics, one of the standard methods to study second order phase transitions is the renormalization group that usually leads to an expansion around the corresponding fully connected solution. Unfortunately, often in disordered models, some important finite dimensional second-order phase transitions are qualitatively different or absent in the corresponding fully connected model: in such cases the standard expansion fails. Recently, a new method, the $M$-layer one, has been introduced that performs an expansion around a different soluble mean field model: the Bethe lattice one. This new method has been already used to compute the upper critical dimension $D_U$ of different disordered systems such as the Random Field Ising model or the Spin glass model with field. If then one wants to go beyond and construct an expansion around $D_U$ to understand how critical quantities get renormalized, the actual computation of all the numerical factors is needed. This next step has still not been performed, being technically more involved. In this paper we perform this computation for the ferromagnetic Ising model without quenched disorder, in finite dimensions: we show that, at one-loop order inside the $M$-layer approach, we recover the continuum quartic field theory and we are able to identify the coupling constant $g$ and the other parameters of the theory, as a function of macroscopic and microscopic details of the model such as the lattice spacing, the physical lattice dimension and the temperature. This is a fundamental step that will help in applying in the future the same techniques to more complicated systems, for which the standard field theoretical approach is impracticable.

cond-mat.stat-mech

Stochastic Gradient Descent-like relaxation is equivalent to Metropolis dynamics in discrete optimization and inference problems

Is Stochastic Gradient Descent (SGD) substantially different from Metropolis Monte Carlo dynamics? This is a fundamental question at the time of understanding the most used training algorithm in the field of Machine Learning, but it received no answer until now. Here we show that in discrete optimization and inference problems, the dynamics of an SGD-like algorithm resemble very closely that of Metropolis Monte Carlo with a properly chosen temperature, which depends on the mini-batch size. This quantitative matching holds both at equilibrium and in the out-of-equilibrium regime, despite the two algorithms having fundamental differences (e.g.\ SGD does not satisfy detailed balance). Such equivalence allows us to use results about performances and limits of Monte Carlo algorithms to optimize the mini-batch size in the SGD-like algorithm and make it efficient at recovering the signal in hard inference problems.

cond-mat.dis-nn

Loop expansion around the Bethe approximation through the $M$-layer construction

For every physical model defined on a generic graph or factor graph, the Bethe $M$-layer construction allows building a different model for which the Bethe approximation is exact in the large $M$ limit and it coincides with the original model for $M=1$. The $1/M$ perturbative series is then expressed by a diagrammatic loop expansion in terms of so-called fat-diagrams. Our motivation is to study some important second-order phase transitions that do exist on the Bethe lattice but are either qualitatively different or absent in the corresponding fully connected case. In this case the standard approach based on a perturbative expansion around the naive mean field theory (essentially a fully connected model) fails. On physical grounds, we expect that when the construction is applied to a lattice in finite dimension there is a small region of the external parameters close to the Bethe critical point where strong deviations from mean-field behavior will be observed. In this region, the $1/M$ expansion for the corrections diverges and it can be the starting point for determining the correct non-mean-field critical exponents using renormalization group arguments. In the end, we will show that the critical series for the generic observable can be expressed as a sum of Feynman diagrams with the same numerical prefactors of field theories. However, the contribution of a given diagram is not evaluated associating Gaussian propagators to its lines as in field theories: one has to consider the graph as a portion of the original lattice, replacing the internal lines with appropriate one-dimensional chains, and attaching to the internal points the appropriate number of infinite-size Bethe trees to restore the correct local connectivity of the original model.

cond-mat.dis-nn

Limits and performances of algorithms based on simulated annealing in solving sparse hard inference problems

The planted coloring problem is a prototypical inference problem for which thresholds for Bayes optimal algorithms, like Belief Propagation (BP), can be computed analytically. In this paper, we analyze the limits and performances of the Simulated Annealing (SA), a Monte Carlo-based algorithm that is more general and robust than BP, and thus of broader applicability. We show that SA is sub-optimal in the recovery of the planted solution because it gets attracted by glassy states that, instead, do not influence the BP algorithm. At variance with previous conjectures, we propose an analytic estimation for the SA algorithmic threshold by comparing the spinodal point of the paramagnetic phase and the dynamical critical temperature. This is a fundamental connection between thermodynamical phase transitions and out of equilibrium behavior of Glauber dynamics. We also study an improved version of SA, called replicated SA (RSA), where several weakly coupled replicas are cooled down together. We show numerical evidence that the algorithmic threshold for the RSA coincides with the Bayes optimal one. Finally, we develop an approximated analytical theory explaining the optimal performances of RSA and predicting the location of the transition towards the planted solution in the limit of a very large number of replicas. Our results for RSA support the idea that mismatching the parameters in the prior with respect to those of the generative model may produce an algorithm that is optimal and very robust.

cond-mat.dis-nn

Real-Space Renormalization group for spin glasses

While in the fully-connected limit the solution of the spin-glass model is known, with the existence of a complex transition on a critical line in the temperature-external field phase diagram, in finite dimensions we don't know if a transition is present or not and, if present, if its nature is the same as the one in infinite dimensions. This work contains a review of the real-space Renormalization Group methods that have been applied to Spin Glasses, highlighting both their point of strength and weakness in characterizing the finite dimensional behaviour of the model.

cond-mat.dis-nn

Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent set

The recent work ``Combinatorial Optimization with Physics-Inspired Graph Neural Networks'' [Nat Mach Intell 4 (2022) 367] introduces a physics-inspired unsupervised Graph Neural Network (GNN) to solve combinatorial optimization problems on sparse graphs. To test the performances of these GNNs, the authors of the work show numerical results for two fundamental problems: maximum cut and maximum independent set (MIS). They conclude that "the graph neural network optimizer performs on par or outperforms existing solvers, with the ability to scale beyond the state of the art to problems with millions of variables." In this comment, we show that a simple greedy algorithm, running in almost linear time, can find solutions for the MIS problem of much better quality than the GNN. The greedy algorithm is faster by a factor of $10^4$ with respect to the GNN for problems with a million variables. We do not see any good reason for solving the MIS with these GNN, as well as for using a sledgehammer to crack nuts. In general, many claims of superiority of neural networks in solving combinatorial problems are at risk of being not solid enough, since we lack standard benchmarks based on really hard problems. We propose one of such hard benchmarks, and we hope to see future neural network optimizers tested on these problems before any claim of superiority is made.

cs.LG

The Ising spin glass on random graphs at zero temperature: not all spins are glassy in the glassy phase

We investigate the replica symmetry broken (RSB) phase of spin glass (SG) models in a random field defined on Bethe lattices at zero temperature. From the properties of the RSB solution we deduce a closed equation for the extreme values of the cavity fields. This equation turns out not to depend on the parameters defining the RSB, and it predicts that the spontaneous RSB does not take place homogeneously on the whole system. Indeed, there exist spins having the same effective local field in all local ground states, exactly as in the replica symmetric (RS) phase, while the spontaneous RSB manifests only on the remaining spins, whose fraction vanishes at criticality. The characterization in terms of spins having fixed or fluctuating local fields can be extended also to the random field Ising model (RFIM), in which case the fluctuating spins are the only responsible for the spontaneous magnetization in the ferromagnetic phase. Close to criticality we are able to connect the statistics of the local fields acting on the spins in the RSB phase with the correlation functions measured in the paramagnetic phase. Identifying the two types of spins on given instances of SG and RFIM, we show that they participate very differently to avalanches produced by flipping a single spin. From the scaling of the number of spins inducing RSB effects close to the critical point and using the $M$-layer expansion we estimate the upper critical dimension $D_U \geq 8$ for SG.

cond-mat.dis-nn

Unexpected upper critical dimension for spin glass models in a field predicted by the loop expansion around the Bethe solution at zero temperature

The spin-glass transition in a field in finite dimension is analyzed directly at zero temperature using a perturbative loop expansion around the Bethe lattice solution. The loop expansion is generated by the $M$-layer construction whose first diagrams are evaluated numerically and analytically. The generalized Ginzburg criterion reveals that the upper critical dimension below which mean-field theory fails is $D_U \le 8$, at variance with the classical result $D_U = 6$ yielded by finite-temperature replica field theory. Our expansion around the Bethe lattice has two crucial differences with respect to the classical one. The finite connectivity $z$ of the lattice is directly included from the beginning in the Bethe lattice, while in the classical computation the finite connectivity is obtained through an expansion in $1/z$. Moreover, if one is interested in the zero temperature ($T = 0$) transition, one can directly expand around the $T = 0$ Bethe transition. The expansion directly at $T = 0$ is not possible in the classical framework because the fully connected spin glass does not have a transition at $T = 0$, being in the broken phase for any value of the external field.

cond-mat.dis-nn

Mismatching as a tool to enhance algorithmic performances of Monte Carlo methods for the planted clique model

Over-parametrization was a crucial ingredient for recent developments in inference and machine-learning fields. However a good theory explaining this success is still lacking. In this paper we study a very simple case of mismatched over-parametrized algorithm applied to one of the most studied inference problem: the planted clique problem. We analyze a Monte Carlo (MC) algorithm in the same class of the famous Jerrum algorithm. We show how this MC algorithm is in general suboptimal for the recovery of the planted clique. We show however how to enhance its performances by adding a (mismatched) parameter: the temperature; we numerically find that this over-parametrized version of the algorithm can reach the supposed algorithmic threshold for the planted clique problem.

cond-mat.stat-mech

Solving the fully-connected spherical $p$-spin model with the cavity method: equivalence with the replica results

The spherical $p$-spin is a fundamental model for glassy physics, thanks to its analytic solution achievable via the replica method. Unfortunately the replica method has some drawbacks: it is very hard to apply to diluted models and the assumptions beyond it are not immediately clear. Both drawbacks can be overcome by the use of the cavity method, which, however, needs to be applied with care to spherical models. Here we show how to write the cavity equations for spherical $p$-spin models on complete graphs, both in the Replica Symmetric (RS) ansatz (corresponding to Belief Propagation) and in the 1-step Replica Symmetry Breaking (1RSB) ansatz (corresponding to Survey Propagation). The cavity equations can be solved by a Gaussian (RS) and multivariate Gaussian (1RSB) ansatz for the distribution of the cavity fields. We compute the free energy in both ansatzes and check that the results are identical to the replica computation, predicting a phase transition to a 1RSB phase at low temperatures. The advantages of solving the model with the cavity method are many. The physical meaning of any ansatz for the cavity marginals is very clear. The cavity method works directly with the distribution of local quantities, which allows to generalize the method to dilute graphs. What we are presenting here is the first step towards the solution of the diluted version of the spherical $p$-spin model, which is a fundamental model in the theory of random lasers and interesting $per~se$ as an easier-to-simulate version of the classical fully-connected $p$-spin model.

cond-mat.stat-mech