SearcharxivSearch

arXiv subjects

Yuanzhao Zhang

Publications and source records attributed to Yuanzhao Zhang.

At least 19 recordsLinked to original sources

Mixed higher-order coupling stabilizes new states

Understanding how higher-order interactions affect collective behavior is a central problem in nonlinear dynamics and complex systems. Most works have focused on a single higher-order coupling function, neglecting other viable choices. Here we study coupled oscillators with dyadic and three different types of higher-order couplings. By analyzing the stability of different twisted states on rings, we show that many states are stable only for certain combinations of higher-order couplings, and thus the full range of system dynamics cannot be observed unless all types of higher-order couplings are simultaneously considered.

nlin.AO

Symmetry-based selection rules for higher-order interactions in coupled oscillators

Pairwise interactions among general nonlinear oscillators can be reduced, via phase reduction, to a Kuramoto-type phase coupling $\sin(- θ_j+θ_k )$. For higher-order interactions, multiple phase couplings exist -- such as $\sin(-2θ_j+θ_k+θ_l )$ and $\sin(-θ_j+2θ_k-θ_l)$. Since different nonpairwise coupling functions produce qualitatively different dynamics, it is important to understand which phase couplings should be included in coupled phase oscillator models. In this Letter, we establish selection rules for higher-order phase coupling functions. These selection rules, which can be applied without the need of explicit phase reduction, are solely based on the symmetry of the isolated oscillator velocity field and the $n$-body interaction functions. As phase reduction established the mechanistic basis for the Kuramoto model, our results provide a theoretical link between physical systems and higher-order phase models.

nlin.AO

Scaling World-Model Reinforcement Learning Through Diffusion Policy Optimization

Model-based reinforcement learning (RL) can be effectively supported at scale through the use of world models. However, in practice, scaling such approaches remains fundamentally limited. A commonly recognized challenge is model bias and error compounding, which degrade long-horizon predictions. Beyond these issues, we identify a more critical yet underexplored bottleneck: a structural misalignment between search and value learning in existing world model approaches. In particular, policy improvement often relies on value functions induced by a separate, non-search policy, resulting in training inconsistency and ultimately suboptimal learning. To address this limitation, we propose Model-Based Diffusion Policy Optimization (MBDPO) in world models, a framework that unifies search and policy optimization through diffusion policy representations, thereby unlocking the potential of world models for scalable policy learning. Instead of constructing an explicit planner over a learned world model, we reformulate policy optimization as a diffusion process over searched trajectories in latent world models. In this view, we extract an implicit energy function from the collected dataset that anchors the policy, enabling MBDPO to refine the score field for policy optimization while mitigating misalignment. We evaluate MBDPO across a wide range of settings, including multi-task offline pretraining, online learning, and offline-to-online fine-tuning. In the offline regime, we further investigate its scaling behavior by pretraining on large-scale datasets, observing consistent and monotonic performance gains with increasing model capacity.

cs.LG

Signature of glassy dynamics in dynamic modes decompositions

Glasses are traditionally characterized by their rugged landscape of disordered low-energy states and their slow relaxation towards thermodynamic equilibrium. Far from equilibrium, dynamical forms of glassy behavior with anomalous algebraic relaxation have also been noted, for example, in networks of coupled oscillators. Due to their disordered and high-dimensional nature, such systems have been difficult to study theoretically, but data-driven methods are emerging as a promising alternative that may aid in their analysis. Here, we characterize glassy dynamics using the dynamic mode decomposition, a data-driven spectral computation that approximates the Koopman spectrum. We show that the gap between oscillatory and decaying modes in the Koopman spectrum vanishes in systems exhibiting algebraic relaxation, and thus, we propose a model-agnostic signature for robustly detecting and analyzing glassy dynamics. We demonstrate the utility of our approach through both a minimal example of a one-dimensional ODE and a high-dimensional example of coupled oscillators.

cond-mat.dis-nn

Anomalous scaling in redirection networks

In networks that grow by isotropic redirection (IR), a new node selects an initial target node uniformly at random and attaches to a randomly chosen neighbor of the target. The emerging networks exhibit leaf proliferation, in which the number of nonleaves scales sublinearly as $N^μ$ and the degree distribution has an algebraic tail with exponent $1+μ$. To understand these mysterious properties, we introduce a class of models with redirection to leaves whenever possible. The resulting networks exhibit qualitatively similar phenomenology to IR networks, but avoid the inherent non-locality of the IR growth rule. These networks admit an analytical description of the leaf degree distribution, from which we extract the exponent $μ$.

cond-mat.stat-mech

Context parroting: A simple but tough-to-beat baseline for foundation models in scientific machine learning

Recent time-series foundation models exhibit strong abilities to predict physical systems. These abilities include zero-shot forecasting, in which a model forecasts future states of a system given only a short trajectory as context, without knowledge of the underlying physics. Here, we show that foundation models often forecast through a simple parroting strategy, and when they are not parroting they exhibit some shared failure modes such as converging to the mean. As a result, a naive context parroting model that copies directly from the context scores higher than leading time-series foundation models on predicting a diverse range of dynamical systems, including low-dimensional chaos, turbulence, coupled oscillators, and electrocardiograms, at a tiny fraction of the computational cost. We draw a parallel between context parroting and induction heads, which explains recent works showing that large language models can often be repurposed for time series forecasting. Our dynamical systems perspective also ties the scaling between forecast accuracy and context length to the fractal dimension of the underlying chaotic attractor, providing insight into previously observed in-context neural scaling laws. By revealing the performance gaps and failure modes of current time-series foundation models, context parroting can guide the design of future foundation models and help identify in-context learning strategies beyond parroting.

cs.LG

Collective dynamics on higher-order networks

Higher-order interactions that nonlinearly couple more than two nodes are important in many networked systems, and their effects on collective dynamics are increasingly being studied. Here we provide an overview of this rapidly growing field, and of the techniques that can be used to describe and analyze them. We focus in particular on new phenomena and challenges that emerge when nonpairwise interactions are considered. We conclude by discussing open questions and promising future directions on the collective dynamics of higher-order networks.

nlin.AO

Information Shapes Koopman Representation

The Koopman operator provides a powerful framework for modeling dynamical systems and has attracted growing interest from the machine learning community. However, its infinite-dimensional nature makes identifying suitable finite-dimensional subspaces challenging, especially for deep architectures. We argue that these difficulties come from suboptimal representation learning, where latent variables fail to balance expressivity and simplicity. This tension is closely related to the information bottleneck (IB) dilemma: constructing compressed representations that are both compact and predictive. Rethinking Koopman learning through this lens, we demonstrate that latent mutual information promotes simplicity, yet an overemphasis on simplicity may cause latent space to collapse onto a few dominant modes. In contrast, expressiveness is sustained by the von Neumann entropy, which prevents such collapse and encourages mode diversity. This insight leads us to propose an information-theoretic Lagrangian formulation that explicitly balances this tradeoff. Furthermore, we propose a new algorithm based on the Lagrangian formulation that encourages both simplicity and expressiveness, leading to a stable and interpretable Koopman representation. Beyond quantitative evaluations, we further visualize the learned manifolds under our representations, observing empirical results consistent with our theoretical predictions. Finally, we validate our approach across a diverse range of dynamical systems, demonstrating improved performance over existing Koopman learning methods. The implementation is publicly available at https://github.com/Wenxuan52/InformationKoopman.

cs.LG

Data-driven Control of Hypergraphs: Leveraging THIS to Damp Noise in Diffusive Hypergraphs

Controllability determines whether a system's state can be guided toward any desired configuration, making it a fundamental prerequisite for designing effective control strategies. In the context of networked systems, controllability is a well-established concept. However, many real-world systems, from biological collectives to engineered infrastructures, exhibit higher-order interactions that cannot be captured by simple graphs. Moreover, the way in which agents interact and influence one another is often unknown and must be inferred from partial observations of the system. Here, we close the loop between a hypergraph representation and our recently developed hypergraph inference algorithm, THIS, to infer the underlying multibody couplings. Building on the inferred structure, we design a parsimonious controller that, given a minimal set of controllable nodes, steers the system toward a desired configuration. We validate the proposed system identification and control framework on a network of Kuramoto oscillators evolving over a hypergraph.

eess.SY

Tempological Control of Network Dynamics

Feedback control is an effective strategy for stabilizing a desired state and has been widely adopted in maintaining the stability of systems such as flying birds and power grids. By default, this framework requires continuous control input to offset deviations from the desired state, which can be invasive and cost a considerable amount of energy. Here, we introduce tempological (temporal + topological) control -- a novel, noninvasive strategy that harnesses the inherent flexibility of time-varying networks to control the dynamics of a general nonlinear system. By strategically switching network topology on-the-fly based on the current states of the nodes, we show how it is possible to drive a system to a desired state or even stabilize otherwise unstable states, all in the absence of external forcing. We demonstrate the utility of our approach using networks of Kuramoto and Stuart-Landau oscillators, achieving synchronization out of sets of unsynchronizable networks. Finally, we develop a statistical theory that explains why tempological control will almost always succeed in the limit of large and diverse temporal networks, with diversity of network configurations overcoming the deficiencies of any snapshot in isolation.

nlin.AO

Learning Beyond Experience: Generalizing to Unseen State Space with Reservoir Computing

Machine learning techniques offer an effective approach to modeling dynamical systems solely from observed data. However, without explicit structural priors -- built-in assumptions about the underlying dynamics -- these techniques typically struggle to generalize to aspects of the dynamics that are poorly represented in the training data. Here, we demonstrate that reservoir computing -- a simple, efficient, and versatile machine learning framework often used for data-driven modeling of dynamical systems -- can generalize to unexplored regions of state space without explicit structural priors. First, we describe a multiple-trajectory training scheme for reservoir computers that supports training across a collection of disjoint time series, enabling effective use of available training data. Then, applying this training scheme to multistable dynamical systems, we show that RCs trained on trajectories from a single basin of attraction can achieve out-of-domain generalization by capturing system behavior in entirely unobserved basins.

cs.LG

The size of the sync basin resolved

Sparsely coupled Kuramoto oscillators offer a fertile playground for exploring high-dimensional basins of attraction due to their simple yet multistable dynamics. For $n$ identical Kuramoto oscillators on cycle graphs, it is well known that the only attractors are twisted states, whose phases wind around the circle with a constant gap between neighboring oscillators ($θ_j = 2πq j/n$). It was conjectured in 2006 that basin sizes of these twisted states scale as $e^{-kq^2}$ to the winding number $q$. Here, we provide new numerical and analytical evidence supporting the conjecture and uncover the dynamical mechanism behind the Gaussian scaling. The key idea is that, when starting with a random initial condition, the winding number of the solution stabilizes rapidly at $t \propto \log n$, before long-range correlation can develop among oscillators. This timescale separation allows us to calculate the winding number as a sum of weakly-dependent random variables, leading to a Central Limit Theorem derivation of the basin scaling.

math-ph

Ignition criteria for trigger waves in cell signaling

To rapidly coordinate collective behaviors in tissues, cells communicate with one another through traveling fronts of signaling activity called trigger waves. The stimulus threshold for wave propagation is a key biological parameter that determines when the system produces a global response to a local stimulus. However, it is unclear how this stimulus threshold is determined by the properties of the underlying signaling network. To address this gap, we studied a model of trigger waves with a realistic Hill-type auto-activation function. We obtained an analytic expression for the wave ignition threshold in 1D and numerical solutions in 2D and 3D. In the limit of high sensitivity, we found that the trigger wave threshold depends on both the effective dissociation constant, $K_D$, and the effective Hill coefficient, $n$, of the positive feedback circuit, with the dominant contribution scaling as $K_D^{n/(n-1)}$ in all dimensions. This result leads to a simple method for predicting the trigger wave ignition threshold from bulk activation data and is potentially of use for developing synthetic trigger wave circuits with desired sensitivities.

q-bio.CB

How more data can hurt: Instability and regularization in next-generation reservoir computing

It has been found recently that more data can, counter-intuitively, hurt the performance of deep neural networks. Here, we show that a more extreme version of the phenomenon occurs in data-driven models of dynamical systems. To elucidate the underlying mechanism, we focus on next-generation reservoir computing (NGRC) -- a popular framework for learning dynamics from data. We find that, despite learning a better representation of the flow map with more training data, NGRC can adopt an ill-conditioned ``integrator'' and lose stability. We link this data-induced instability to the auxiliary dimensions created by the delayed states in NGRC. Based on these findings, we propose simple strategies to mitigate the instability, either by increasing regularization strength in tandem with data size, or by carefully introducing noise during training. Our results highlight the importance of proper regularization in data-driven modeling of dynamical systems.

cs.LG

Hypergraph reconstruction from dynamics

A plethora of methods have been developed in the past two decades to infer the underlying network structure of an interconnected system from its collective dynamics. However, methods capable of inferring nonpairwise interactions are only starting to appear. Here, we develop an inference algorithm based on sparse identification of nonlinear dynamics (SINDy) to reconstruct hypergraphs and simplicial complexes from time-series data. Our model-free method does not require information about node dynamics or coupling functions, making it applicable to complex systems that do not have a reliable mathematical description. We first benchmark the new method on synthetic data generated from Kuramoto and Lorenz dynamics. We then use it to infer the effective connectivity in the brain from resting-state EEG data, which reveals significant contributions from non-pairwise interactions in shaping the macroscopic brain dynamics.

physics.soc-ph

Zero-shot forecasting of chaotic systems

Time-series forecasting is a challenging problem that traditionally requires specialized models custom-trained for the specific task at hand. Recently, inspired by the success of large language models, foundation models pre-trained on vast amounts of time-series data from diverse domains have emerged as a promising candidate for general-purpose time-series forecasting. The defining characteristic of these foundation models is their ability to perform zero-shot learning, that is, forecasting a new system from limited context data without explicit re-training or fine-tuning. Here, we evaluate whether the zero-shot learning paradigm extends to the challenging task of forecasting chaotic systems. Across 135 distinct chaotic dynamical systems and $10^8$ timepoints, we find that foundation models produce competitive forecasts compared to custom-trained models (including NBEATS, TiDE, etc.), particularly when training data is limited. Interestingly, even after point forecasts fail, large foundation models are able to preserve the geometric and statistical properties of the chaotic attractors. We attribute this success to foundation models' ability to perform in-context learning and identify context parroting as a simple mechanism used by these models to capture the long-term behavior of chaotic dynamical systems. Our results highlight the potential of foundation models as a tool for probing nonlinear and complex systems.

cs.LG

Deeper but smaller: Higher-order interactions increase linear stability but shrink basins

A key challenge of nonlinear dynamics and network science is to understand how higher-order interactions influence collective dynamics. Although many studies have approached this question through linear stability analysis, less is known about how higher-order interactions shape the global organization of different states. Here, we shed light on this issue by analyzing the rich patterns supported by identical Kuramoto oscillators on hypergraphs. We show that higher-order interactions can have opposite effects on linear stability and basin stability: they stabilize twisted states (including full synchrony) by improving their linear stability, but also make them hard to find by dramatically reducing their basin size. Our results highlight the importance of understanding higher-order interactions from both local and global perspectives.

nlin.AO

Catch-22s of reservoir computing

Reservoir Computing (RC) is a simple and efficient model-free framework for forecasting the behavior of nonlinear dynamical systems from data. Here, we show that there exist commonly-studied systems for which leading RC frameworks struggle to learn the dynamics unless key information about the underlying system is already known. We focus on the important problem of basin prediction -- determining which attractor a system will converge to from its initial conditions. First, we show that the predictions of standard RC models (echo state networks) depend critically on warm-up time, requiring a warm-up trajectory containing almost the entire transient in order to identify the correct attractor. Accordingly, we turn to Next-Generation Reservoir Computing (NGRC), an attractive variant of RC that requires negligible warm-up time. By incorporating the exact nonlinearities in the original equations, we show that NGRC can accurately reconstruct intricate and high-dimensional basins of attraction, even with sparse training data (e.g., a single transient trajectory). Yet, a tiny uncertainty in the exact nonlinearity can render prediction accuracy no better than chance. Our results highlight the challenges faced by data-driven methods in learning the dynamics of multistable systems and suggest potential avenues to make these approaches more robust.

cs.LG