SearcharxivSearch

arXiv subjects

Cosimo Lupo

Publications and source records attributed to Cosimo Lupo.

12 recordsLinked to original sources

Unsupervised sleep-like intra- and inter-layer plasticity categorizes and improves energy efficiency in a multilayer spiking network

Sleep is thought to support memory consolidation and the recovery of optimal energetic regime by reorganizing synaptic connectivity, yet how plasticity across hierarchical brain circuits contributes to abstraction and energy efficiency remains unclear. Here we study a spiking multi-layer network alternating wake-like and deep-sleep-like states, with state-dependent dendritic integration and synaptic plasticity in a biologically inspired thalamo-cortical framework. During wakefulness, the model learns from few perceived examples, while during deep sleep it undergoes spontaneous replay driven by slow oscillations. Plasticity enabled not only within intra-layer connections, but also in inter-layer pathways, is critical for memory consolidation and energetic downshift. Compared to restricted plasticity, full inter-layer plasticity yields higher post-sleep visual classification accuracy and promotes the emergence of sharper class-specific associations. Furthermore, we introduce a biophysically grounded estimator of metabolic power expressing network energy consumption in ATP units, partitioned into baseline, synaptic maintenance, action potential, and transmission costs. We find that inter-layer plasticity in sleep leads to a larger reduction in firing rates, synaptic strength and synaptic activity, corresponding to a substantially larger decrease in power consumption. This work suggests promising elements to be integrated in neuromorphic/energy-efficient AI learning systems, supported by brain state-specific apical mechanisms.

q-bio.NC

Emergent complexity and rhythms in evoked and spontaneous dynamics of human whole-brain models after tuning through analysis tools

The simulation of whole-brain dynamics should reproduce realistic spontaneous and evoked neural activity across different scales, including emergent rhythms, spatio-temporal activation patterns, and macroscale complexity. Once a mathematical model is selected, its configuration must be determined by properly setting its parameters. A critical preliminary step in this process is defining an appropriate set of observables to guide the selection of model configurations (parameter tuning), laying the groundwork for quantitative calibration of accurate whole-brain models. Here, we address this challenge by presenting a framework that integrates two complementary tools: The Virtual Brain (TVB) platform for simulating whole-brain dynamics, and the Collaborative Brain Wave Analysis Pipeline (Cobrawap) for analyzing simulation outputs using a set of standardized metrics. We apply this framework to a 998-node human connectome, using two configurations of the Larter-Breakspear neural mass model: one with the TVB default parameters, the other tuned using Cobrawap. The results reveal that the tuned configuration exhibits several biologically relevant features, absent in the default model for both spontaneous and evoked dynamics. In response to external perturbations, the tuned model generates non-stereotyped, complex spatio-temporal activity, as measured by the perturbational complexity index. In spontaneous activity, it exhibits robust alpha-band oscillations, infra-slow rhythms, scale-free characteristics, greater spatio-temporal heterogeneity, and asymmetric functional connectivity. This work demonstrates how combining TVB and Cobrawap can guide parameter tuning and lays the groundwork for data-driven calibration and validation of accurate whole-brain models.

q-bio.NC

Soft modes in vector spin glass models on sparse random graphs

We study numerically the Hessian of low-lying minima of vector spin glass models defined on random regular graphs. We consider the two-component (XY) and three-component (Heisenberg) spin glasses at zero temperature, subjected to the action of a randomly oriented external field. Varying the intensity of the external field, these models undergo a zero temperature phase transition from a paramagnet at high field to a spin glass at low field. We study how the spectral properties of the Hessian depend on the magnetic field. In particular, we study the shape of the spectrum at low frequency and the localization properties of low energy eigenvectors across the transition. We find that in both phases the edge of the spectral density behaves as $\lambda^{3/2}$: such a behavior rules out the presence of a diverging spin-glass susceptibility $\chi_{SG}=\langle 1/\lambda^2 \rangle$. As to low energy eigenvectors, we find that the softest eigenmodes are always localized in both phases of the two models. However, by studying in detail the geometry of low energy eigenmodes across different energy scales close to the lower edge of the spectrum, we find a different behavior for the two models at the transition: in the XY case, low energy modes are typically localized; at variance, in the Heisenberg case low-energy eigenmodes with a multi-modal structure (sort of ``delocalization'') appear at an energy scale that vanishes in the infinite size limit. These geometrically non-trivial excitations, which we call Concentrated and Delocalised Low Energy Modes (CDLEM), coexist with trivially localised excitations: we interpret their existence as a sign of critical behavior related to the onset of the spin glass phase.

cond-mat.dis-nn

NREM and REM: cognitive and energetic gains in thalamo-cortical sleeping and awake spiking model

Sleep is essential for learning and cognition, but the mechanisms by which it stabilizes learning, supports creativity, and manages the energy consumption of networks engaged in post-sleep task have not been yet modelled. During sleep, the brain cycles between non-rapid eye movement (NREM), a mainly unconscious state characterized by collective oscillations, and rapid eye movement (REM), associated with the integrated experience of dreaming. We propose a biologically grounded two-area thalamo-cortical plastic spiking neural network model and investigate the role of NREM - REM cycles on its awake performance. We demonstrate that sleep has a positive effect on energy consumption and cognitive performance during the post-sleep awake classification task of handwritten digits. NREM and REM simulated dynamics modify the synaptic structure into a sharper representation of training experiences. Sleep-induced synaptic modifications reduce firing rates and synaptic activity without reducing cognitive performance. Also, it creates novel multi-area associations. The model leverages the apical amplification, isolation and drive experimentally grounded principles and the combination of contextual and perceptual information. In summary, the main novelty is the proposal of a multi-area plastic model that also expresses REM and integrates information during a plastic dream-like state, with cognitive and energetic benefits during post-sleep awake classification.

q-bio.NC

Beyond spiking networks: the computational advantages of dendritic amplification and input segregation

The brain can efficiently learn a wide range of tasks, motivating the search for biologically inspired learning rules for improving current artificial intelligence technology. Most biological models are composed of point neurons, and cannot achieve the state-of-the-art performances in machine learning. Recent works have proposed that segregation of dendritic input (neurons receive sensory information and higher-order feedback in segregated compartments) and generation of high-frequency bursts of spikes would support error backpropagation in biological neurons. However, these approaches require propagating errors with a fine spatio-temporal structure to the neurons, which is unlikely to be feasible in a biological network. To relax this assumption, we suggest that bursts and dendritic input segregation provide a natural support for biologically plausible target-based learning, which does not require error propagation. We propose a pyramidal neuron model composed of three separated compartments. A coincidence mechanism between the basal and the apical compartments allows for generating high-frequency bursts of spikes. This architecture allows for a burst-dependent learning rule, based on the comparison between the target bursting activity triggered by the teaching signal and the one caused by the recurrent connections, providing the support for target-based learning. We show that this framework can be used to efficiently solve spatio-temporal tasks, such as the store and recall of 3D trajectories. Finally, we suggest that this neuronal architecture naturally allows for orchestrating ``hierarchical imitation learning'', enabling the decomposition of challenging long-horizon decision-making tasks into simpler subtasks. This can be implemented in a two-level network, where the high-network acts as a ``manager'' and produces the contextual signal for the low-network, the ``worker''.

q-bio.NC

Burst-dependent plasticity and dendritic amplification support target-based learning and hierarchical imitation learning

The brain can learn to solve a wide range of tasks with high temporal and energetic efficiency. However, most biological models are composed of simple single compartment neurons and cannot achieve the state-of-art performances of artificial intelligence. We propose a multi-compartment model of pyramidal neuron, in which bursts and dendritic input segregation give the possibility to plausibly support a biological target-based learning. In target-based learning, the internal solution of a problem (a spatio temporal pattern of bursts in our case) is suggested to the network, bypassing the problems of error backpropagation and credit assignment. Finally, we show that this neuronal architecture naturally support the orchestration of hierarchical imitation learning, enabling the decomposition of challenging long-horizon decision-making tasks into simpler subtasks.

q-bio.NC

Learning the statistics and landscape of somatic mutation-induced insertions and deletions in antibodies

Affinity maturation is crucial for improving the binding affinity of antibodies to antigens. This process is mainly driven by point substitutions caused by somatic hypermutations of the immunoglobulin gene. It also includes deletions and insertions of genomic material known as indels. While the landscape of point substitutions has been extensively studied, a detailed statistical description of indels is still lacking. Here we present a probabilistic inference tool to learn the statistics of indels from repertoire sequencing data, which overcomes the pitfalls and biases of standard annotation methods. The model includes antibody-specific maturation ages to account for variable mutational loads in the repertoire. After validation on synthetic data, we applied our tool to a large dataset of human immunoglobulin heavy chains. The inferred model allows us to identify universal statistical features of indels in heavy chains. We report distinct insertion and deletion hotspots, and show that the distribution of lengths of indels follows a geometric distribution, which puts constraints on future mechanistic models of the hypermutation process.

q-bio.GN

Simulations Approaching Data: Cortical Slow Waves in Inferred Models of the Whole Hemisphere of Mouse

Thanks to novel, powerful brain activity recording techniques, we can create data-driven models from thousands of recording channels and large portions of the cortex, which can improve our understanding of brain-states neuromodulation and the related richness of traveling waves dynamics. We investigate the inference of data-driven models and the comparison among experiments and simulations, through the characterization of the spatio-temporal features of cortical waves in experimental recordings and simulations. Inference is built in two steps: the inner loop that optimizes by likelihood maximization a mean-field model, and the outer loop that optimizes a periodic neuro-modulation by relying on direct comparison of observables apt for the characterization of cortical slow waves. The model is capable to reproduce most of the features of the non-stationary and non-linear dynamics displayed by the high-resolution recording of the in-vivo mouse brain obtained by wide-field calcium imaging techniques. The proposed approach is of interest for both experimental and computational neuroscientists.

q-bio.NC

The random field XY model on sparse random graphs shows replica symmetry breaking and marginally stable ferromagnetism

The ferromagnetic XY model on sparse random graphs in a randomly oriented field is analyzed via the belief propagation algorithm. At variance with the fully connected case and with the random field Ising model on the same topology, we find strong evidences of a tiny region with Replica Symmetry Breaking (RSB) in the limit of very low temperatures. This RSB phase is robust against different choices of the external field direction, while it rapidly vanishes when increasing the graph mean degree, the temperature or the directional bias in the external field. The crucial ingredients to have such a RSB phase seem to be the continuous nature of vector spins, mostly preserved by the O(2)-invariant random field, and the strong spatial heterogeneity, due to graph sparsity. We also uncover that the ferromagnetic phase can be marginally stable despite the presence of the random field. Finally, we study the proper correlation functions approaching the critical points to identify the ones that become more critical.

cond-mat.dis-nn

Critical properties of disordered XY model on sparse random graphs

This thesis focuses on the XY model, the simplest vector spin model, used for describing numerous physical systems. It is studied for different sources of quenched disorder: random couplings, random fields, or both them. The belief propagation algorithm and the cavity method are exploited to solve the model on the sparse topology provided by Bethe lattices. It is found that the discretized version of the XY model, the so-called $Q$-state clock model, provides a reliable and efficient proxy for the continuous model with an error going to zero exponentially in $Q$, so implying a remarkable speedup in numerical simulations. Interesting results regard the low-temperature solution of the spin glass XY model, which is by far more unstable toward the replica symmetry broken phase with respect to what happens in discrete models. Moreover, even the random field XY model with ferromagnetic couplings exhibits a replica symmetry broken phase, at variance with both the fully connected version of the same model and the diluted random field Ising model, as a further evidence of a more pronounced glassiness of the diluted XY model. Then, the instabilities of the spin glass XY model in an external field are characterized, recognizing different critical lines according to the different symmetries of the external field. Finally, the inherent structures in the energy landscape of the spin glass XY model in a random field are described, exploiting the capability of the zero-temperature belief propagation algorithm to actually reach the ground state of the system. Remarkably, the density of soft modes in the Hessian matrix shows a non-mean-field behaviour, typical of glasses in finite dimension, while the critical point of replica symmetry instability predicted by the belief propagation algorithm seems to correspond to a delocalization of such soft modes.

cond-mat.dis-nn

Comparison of Gabay-Toulouse and de Almeida-Thouless instabilities for the spin glass XY model in a field on sparse random graphs

Vector spin glasses are known to show two different kinds of phase transitions in presence of an external field: the so-called de Almeida-Thouless and Gabay-Toulouse lines. While the former has been studied to some extent on several topologies (fully connected, random graphs, finite-dimensional lattices, chains with long-range interactions), the latter has been studied only in fully connected models, which however are known to show some unphysical behaviors (e.g. the divergence of these critical lines in the zero-temperature limit). Here we compute analytically both these critical lines for XY spin glasses on random regular graphs. We discuss the different nature of these phase transitions and the dependence of the critical behavior on the field distribution. We also study the crossover between the two different critical behaviors, by suitably tuning the field distribution.

cond-mat.dis-nn

Approximating the XY model on a random graph with a $q$-state clock model

Numerical simulations of spin glass models with continuous variables set the problem of a reliable but efficient discretization of such variables. In particular, the main question is how fast physical observables computed in the discretized model converge toward the ones of the continuous model when the number of states of the discretized model increases. We answer this question for the XY model and its discretization, the $q$-state clock model, in the mean-field setting provided by random graphs. It is found that the convergence of physical observables is exponentially fast in the number $q$ of states of the clock model, so allowing a very reliable approximation of the XY model by using a rather small number of states. Furthermore, such an exponential convergence is found to be independent from the disorder distribution used. Only at $T=0$ the convergence is slightly slower (stretched exponential). Thanks to the analytical solution to the $q$-state clock model, we compute accurate phase diagrams in the temperature versus disorder strength plane. We find that, at zero temperature, spontaneous replica symmetry breaking takes place for any amount of disorder, even an infinitesimal one. We also study the one step of replica symmetry breaking (1RSB) solution in the low-temperature spin glass phase.

cond-mat.dis-nn