arXiv subjects

Sahel Azizpour

Publications and source records attributed to Sahel Azizpour.

3 recordsLinked to original sources

arXiv2026

Finite integration time can shift optimal sensitivity away from criticality

Sensitivity to small changes in the environment is crucial for many real-world tasks, enabling living and artificial systems to make correct behavioral decisions. It has been shown that such sensitivity is maximized when a system operates near the critical point of a phase transition. However, proximity to criticality introduces large fluctuations and diverging timescales. Hence, to leverage the maximal sensitivity, it would require impractically long integration periods. Here, we analytically and computationally demonstrate how the optimal tuning of a recurrent neural network is determined given a finite integration time. Rather than maximizing the theoretically available sensitivity, we find networks attain different sensitivities depending on the available time. Consequently, the optimal dynamic regime can shift away from criticality when integration times are finite, highlighting the necessity of incorporating finite-time considerations into studies of information processing.

cond-mat.dis-nn↗

arXiv2024

Reassessing prediction in the brain: Pre-onset neural encoding during natural listening does not reflect pre-activation

Predictive processing theories propose that the brain continuously anticipates upcoming input. However, direct neural evidence for predictive pre-activation during natural language comprehension remains limited and debated. Previous studies using large language model (LLM)-based encoding models with fMRI and ECoG have reported pre-onset signals that appear to encode upcoming words, but these effects may instead reflect dependencies in the stimulus or autocorrelations in neural activity. Here, we re-examined this question by aligning LLM-derived word embeddings with neural activity recorded during naturalistic listening using magnetoencephalography (MEG) and electrocorticography (ECoG). We replicated pre-onset encoding effects previously observed in ECoG across both modalities, and found that they persist even after controlling for stimulus correlations. Crucially, temporal generalization analyses revealed no stable overlap between pre- and post-onset representations, indicating that pre-onset activity does not reflect pre-activation of the next word. Consistent with this, long-range predictive effects previously reported in fMRI did not replicate in our higher-temporal-resolution data. While we found no evidence for predictive pre-activation, we observed clear signatures of postdiction, with neural activity reflecting persistent encoding of prior words. These results suggest that reported apparent predictive signals do not reflect pre-activation of upcoming input. They call for caution in interpreting LLM-based encoding models and highlight the need for a more nuanced understanding of what constitutes "prediction" in language comprehension.

q-bio.NC↗

arXiv2023

Available observation time regulates optimal balance between sensitivity and confidence

Tasks that require information about the world imply a trade-off between the time spent on observation and the variance of the response. In particular, fast decisions need to rely on uncertain information. However, standard estimates of information processing capabilities, such as the dynamic range, are defined based on mean values that assume infinite observation times. Here, we show that limiting the observation time results in distributions of responses whose variance increases with the temporal correlations in a system and, importantly, affects a system's confidence in distinguishing inputs and thereby making decisions. To quantify the ability to distinguish features of an input, we propose several measures and demonstrate them on the prime example of a recurrent neural network that represents an input rate by a response firing averaged over a finite observation time. We show analytically and in simulations that the optimal tuning of the network depends on the available observation time, implying that tasks require a ``useful'' rather than maximal sensitivity. Interestingly, this shifts the optimal dynamic regime from critical to subcritical for finite observation times and highlights the importance of incorporating the finite observation times concept in future studies of information processing capabilities in a principled manner.

q-bio.NC↗