Searcharxiv⌕ Search

arXiv subjects

Ichiro Tsuda

Publications and source records attributed to Ichiro Tsuda.

6 recordsLinked to original sources
arXiv2026

One-shot prediction of noise-induced bifurcations with reservoir computing

Dynamical systems can exhibit complex responses when noise is injected. In particular, dynamics can be qualitatively altered by dynamic noise, a phenomenon known as noise-induced bifurcation. Predicting noise-induced bifurcations is a critical challenge in nonlinear physics. Recently, it has been reported that reservoir computing, a machine learning framework, can reconstruct the unseen global structure of a dynamical system, including bifurcations, from limited time series data. However, learning global structures in random dynamical systems has not yet been systematically addressed. In this study, we report that a simple reservoir computing framework can predict the noise-induced bifurcation structure from the time series at a single noise condition. We demonstrate dynamic noise cancellation and the reconstruction of entire noise-induced bifurcation structures, including noise-induced chaos and noise-induced order, in representative dynamical systems. Additionally, we provide a theoretical explanation for noise cancellation and demonstrate noise cancellation of a neuromorphic spintronics device. Our results provide significant insights into understanding and harnessing real-world noisy complex dynamics.

nlin.CD↗
arXiv2025

Emergence of Functionally Differentiated Structures via Mutual Information Minimization in Recurrent Neural Networks

Functional differentiation in the brain emerges as distinct regions specialize and is key to understanding brain function as a complex system. Previous research has modeled this process using artificial neural networks with specific constraints. Here, we propose a novel approach that induces functional differentiation in recurrent neural networks by minimizing mutual information between neural subgroups via mutual information neural estimation. We apply our method to a 2-bit working memory task and a chaotic signal separation task involving Lorenz and R\"ossler time series. Analysis of network performance, correlation patterns, and weight matrices reveals that mutual information minimization yields high task performance alongside clear functional modularity and moderate structural modularity. Importantly, our results show that functional differentiation, which is measured through correlation structures, emerges earlier than structural modularity defined by synaptic weights. This suggests that functional specialization precedes and probably drives structural reorganization within developing neural networks. Our findings provide new insights into how information-theoretic principles may govern the emergence of specialized functions and modular structures during artificial and biological brain development.

q-bio.NC↗
arXiv2025

Less is More: some Computational Principles based on Parcimony, and Limitations of Natural Intelligence

Natural intelligence (NI) consistently achieves more with less. Infants learn language, develop abstract concepts, and acquire sensorimotor skills from sparse data, all within tight neural and energy limits. In contrast, today's AI relies on virtually unlimited computational power, energy, and data to reach high performance. This paper argues that constraints in NI are paradoxically catalysts for efficiency, adaptability, and creativity. We first show how limited neural bandwidth promotes concise codes that still capture complex patterns. Spiking neurons, hierarchical structures, and symbolic-like representations emerge naturally from bandwidth constraints, enabling robust generalization. Next, we discuss chaotic itinerancy, illustrating how the brain transits among transient attractors to flexibly retrieve memories and manage uncertainty. We then highlight reservoir computing, where random projections facilitate rapid generalization from small datasets. Drawing on developmental perspectives, we emphasize how intrinsic motivation, along with responsive social environments, drives infant language learning and discovery of meaning. Such active, embodied processes are largely absent in current AI. Finally, we suggest that adopting 'less is more' principles -- energy constraints, parsimonious architectures, and real-world interaction -- can foster the emergence of more efficient, interpretable, and biologically grounded artificial systems.

q-bio.NC↗
arXiv2024

Trans-Bifurcation Prediction of Dynamics in terms of Extreme Learning Machines with Control Inputs

By extending the extreme learning machine by additional control inputs, we achieved almost complete reproduction of bifurcation structures of dynamical systems. The learning ability of the proposed neural network system is striking in that the entire structure of the bifurcations of a target one-parameter family of dynamical systems can be nearly reproduced by training on transient dynamics using only a few parameter values. Moreover, we propose a mechanism to explain this remarkable learning ability and discuss the relationship between the present results and similar results obtained by Kim et al.

nlin.CD↗
arXiv2020

Functional differentiations in evolutionary reservoir computing networks

We propose an extended reservoir computer that shows the functional differentiation of neurons. The reservoir computer is developed to enable changing of the internal reservoir using evolutionary dynamics, and we call it an evolutionary reservoir computer. To develop neuronal units to show specificity, depending on the input information, the internal dynamics should be controlled to produce contracting dynamics after expanding dynamics. Expanding dynamics magnifies the difference of input information, while contracting dynamics contributes to forming clusters of input information, thereby producing multiple attractors. The simultaneous appearance of both dynamics indicates the existence of chaos. In contrast, sequential appearance of these dynamics during finite time intervals may induce functional differentiations. In this paper, we show how specific neuronal units are yielded in the evolutionary reservoir computer.

nlin.AO↗