Searcharxiv⌕ Search

arXiv · q-bio/0505012

Dynamics of learning in coupled oscillators tutored with delayed reinforcements

Abstract

In this work we analyze the solutions of a simple system of coupled phase oscillators in which the connectivity is learned dynamically. The model is inspired in the process of learning of birdsong by oscine birds. An oscillator acts as the generator of a basic rhythm, and drives slave oscillators which are responsible for different motor actions. The driving signal arrives to each driven oscillator through two different pathways. One of them is a "direct" pathway. The other one is a "reinforcement" pathway, through which the signal arrives delayed. The coupling coefficients between the driving oscillator and the slave ones evolve in time following a Hebbian-like rule. We discuss the conditions under which a driven oscillator is capable of learning to lock to the driver. The resulting phase difference and connectivity is a function of the delay of the reinforcement. Around some specific delays, the system is capable to generate dramatic changes in the phase difference between the driver and the driven systems. We discuss the dynamical mechanism responsible for this effect, and possible applications of this learning scheme.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Marcos A. Trevisan, Sebastian Bouzat, Ines Samengo, Gabriel B. Mindlin. 2005-05-05. Dynamics of learning in coupled oscillators tutored with delayed reinforcements. https://doi.org/10.1103/physreve.72.011907

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

A multi-scale information geometry reveals the structure of mutual information in neural populations

Understanding how neural population responses represent sensory information is a central problem in systems neuroscience. One approach is to define a representational geometry on stimulus space in which distances reflect how reliably stimuli can be distinguished from neural activity. However, different constructions of these distances can lead to qualitatively different conclusions about the neural code. Here, we show that a unique Riemannian representational geometry emerges from first principles governing how distances contract as stimulus resolution is lost through coarse-graining. This results in a multi-scale extension of the Fisher information metric, capturing encoding structure from fine stimulus details to coarse global distinctions. The resulting geometry is exactly related to the mutual information encoded by the population: well-encoded stimulus directions (those contributing more to mutual information) are expanded, whereas poorly encoded directions are contracted. The metric tensor can be estimated using diffusion models, making the framework practical for large neural populations and high-dimensional stimuli. Applied to visual cortical responses to natural images, the eigenvectors of the metric tensor identify stimulus variations that contribute most to the encoded stimulus information, yielding interpretable features that are robust to modelling choices. Together, these results provide a principled, information-theoretic framework for characterising neural population codes.

q-bio.NC↗

Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry

The Strong Platonic Representation Hypothesis suggests that representational convergence in artificial neural networks can be harnessed constructively: embeddings can be translated across models through a universal latent space without paired data. We ask whether an analogous geometry can be recovered across human brains. Using fMRI data from the Natural Scenes Dataset, we propose a self-supervised encoder that learns subject-specific embeddings from brain data alone by exploiting repeated stimulus presentations. We show that these independently learned spaces can be translated across subjects using unsupervised orthogonal rotations, without paired cross-subject samples or intermediate model representations. Synchronizing pairwise rotations into a single shared latent space further improves cross-subject retrieval. These results provide evidence for a shared geometry in learned representations of human visual responses: subject-specific fMRI embeddings can be aligned across individuals within a common coordinate system.

q-bio.NC↗

Oscillatory Phase Coding Emerges in Adaptive RNNs for Flexible Working Memory

Oscillatory phase coding (OPC) is widely observed in neural systems and has been implicated in cognitive functions such as memory and sequence processing. However, its computational role and neural substrates remain largely unclear. Here, we studied OPC by training recurrent neural networks (RNNs) with adaptation to perform sequence working memory tasks with variable delays. After training, we found that OPC emerges in the RNN spontaneously: the memorized items recur at distinct phases of a shared rhythm, with oscillation amplitude encoding item identity and phase encoding serial order. Ablation studies identified three key elements required for OPC: adaptation in neural dynamics, variable delay in memory retention, and flexibility in reading out information. Neuron-type analysis revealed the emergence of content and time cells in the trained RNN, and they process item identity and sequence order separately. Recurrent connectivity analysis revealed phase-organized connections among time cells and structured connections within digit-selective content-cell groups. Inspired by these findings, we proposed a neural circuit model which reproduces OPC through interactions between content units and an adaptive time ring. Together, this study reveals how OPC arises from network structures and task demands, offers insights into the implementation and computational mechanisms of OPC in biological systems, and inspires us to develop computational models for human-like cognitive functions.

q-bio.NC↗