Searcharxiv⌕ Search

arXiv subjects

Alfonso de Jesús Navas Gómez

Publications and source records attributed to Alfonso de Jesús Navas Gómez.

3 recordsLinked to original sources

Inferring effective interactions and task-related brain states from large-scale neural activity with Restricted Boltzmann Machines

Large-scale electrophysiological recordings now enable the simultaneous monitoring of thousands of neurons across multiple brain regions, revealing structured variability in population activity. Understanding how such collective patterns emerge from microscopic interactions requires models that are both scalable and interpretable. Here, we use Restricted Boltzmann Machines (RBMs) to model the activity of $\sim1500$--$2000$ simultaneously recorded neurons from the Allen Institute for Brain Science Visual Behavior Neuropixels dataset. Compared with conventional pairwise maximum-likelihood approaches, RBMs require substantially fewer parameters, can be trained within minutes, and accurately reproduce higher-order and global empirical statistics. They remain interpretable by defining effective interactions between neurons, including higher-order terms, and uncover dominant coordination patterns that reflect anatomical organization. Analysis of the learned free-energy landscape further identifies task-related brain states, while Monte Carlo sampling captures the global relaxation dynamics observed in the data. These results establish RBMs as efficient, scalable, and interpretable tools for extracting statistical structure from large-scale neural recordings and linking collective neural activity to brain organization and behavior.

q-bio.NC↗

Distributional simplicity bias and effective convexity in Energy Based Models

Energy-based learning is a powerful framework for generative modelling, but its training is inherently non-convex, leading potentially to sensitivity to initialisation, poor local optima, and unstable gradient dynamics. We present a dynamical analysis of energy-based learning through the lens of the effective model, which can be interpreted as either a generalised Ising model with higher-order interactions or the Fourier expansion of the energy. Under sufficient expressivity, we show that the gradient flow induced by learning strictly positive distributions over binary variables admits two types of fixed points: data-consistent points, which exactly reproduce the target distribution, and spurious points, which satisfy stationarity without matching the target distribution. Around data-consistent points, we show that perturbations are either stable or neutral, with neutral directions leaving the effective model invariant. Finally, we show that gradient dynamics induce a hierarchy in which lower-order interactions are learned before higher-order ones. This provides a mechanistic explanation for the distributional simplicity bias and clarifies why fixed points that are not data-consistent at low orders are not observed in practice.

cs.LG↗

Inferring Higher-Order Couplings with Neural Networks

Maximum entropy methods, rooted in the inverse Ising/Potts problem from statistical physics, are widely used to model pairwise interactions in complex systems across disciplines such as bioinformatics and neuroscience. While successful, these approaches often fail to capture higher-order interactions that are critical for understanding collective behavior. In contrast, modern machine learning methods can model such interactions, but their interpretability often comes at a prohibitive computational cost. Restricted Boltzmann Machines (RBMs) provide a computationally efficient alternative by encoding statistical correlations through hidden units in a bipartite architecture. In this work, we introduce a method that maps RBMs onto generalized Potts models, enabling the systematic extraction of interactions up to arbitrary order. Leveraging large-$N$ approximations, made tractable by the RBM's structure, we extract effective many-body couplings with minimal computational effort. We further propose a robust framework for recovering higher-order interactions in more complex generative models, and introduce a simple gauge-fixing scheme for the effective Potts representation. Validation on synthetic data demonstrates accurate recovery of two- and three-body interactions. Applied to protein sequence data, our method reconstructs contact maps with high fidelity and outperforms state-of-the-art inverse Potts models. These results establish RBMs as a powerful and efficient tool for modeling higher-order structure in high-dimensional categorical data.

cond-mat.dis-nn↗