Searcharxiv⌕ Search

arXiv subjects

Christoph Räth

Publications and source records attributed to Christoph Räth.

At least 19 recordsLinked to original sources

Causal Local States: Scalable Simultaneous Causal Network Inference and Forecasting for Dynamical Systems

Machine learning methods predict many real-world systems with remarkable accuracy, but they are typically treated as black boxes that offer no insight into which interactions drive the dynamics. Causal discovery methods reconstruct the interaction network from observational data, but without regard to whether the inferred structure supports prediction. Existing approaches combining both tasks rely on a single global hyperparameter, such as a causal threshold or a fixed neighborhood size, which cannot recover the structure of heterogeneous systems. Here we introduce causal local states (CLS), a framework that simultaneously infers an approximate Granger-causal interaction network and forecasts the system dynamics. For each node independently, we select the smallest set of neighbors that allows a predictive model to forecast the node near-optimally, and the resulting neighborhoods are then combined for a forecast of the full system. On three benchmarks of increasing difficulty, we achieve reconstruction of the underlying networks with high fidelity and forecasts on par with a model that is supplied with the true network, providing a step toward explainable and scalable forecasting of complex systems.

cs.LG↗

Towards stealthy hyperuniform networks with optimal isotropic complete photonic band gaps using a novel inverse design procedure

We present a two-stage inverse design procedure for producing disordered stealthy hyperuniform trivalent photonic networks in two dimensions with isotropic complete photonic band gaps (PBGs) blocking light regardless of direction or polarization (TE or TM) over a wide frequency range. Most ordinary disordered systems fail to maintain complete PBGs as system size increases. The only known exceptions that remain open in the largest simulations have been generated by mapping stealthy hyperuniform point patterns into trivalent networks. However, the resulting networks are not truly stealthy hyperuniform two-phase media. Although their PBGs remain open, they are relatively narrow due to limited overlap between the TE and TM band gaps and broad band tails caused by localized defect states. By contrast, our two-stage inverse design aims to make the final network itself stealthy hyperuniform, achieving unprecedented near-optimal overlap between the TE and TM band gaps and a small defect state density at the band edges. We obtain not only single realizations with large PBGs, but a striking homogeneity across a large ensemble, effectively probing a network with 100,000 vertices. This ensemble-based band gap is comparable in width to the complete PBG of an anisotropic honeycomb photonic crystal with the same network parameters and nearly an order of magnitude wider than the previously widest known isotropic complete PBGs. Our designs can be fabricated using additive manufacturing, offering new pathways to manipulate electromagnetic waves for photonic technologies.

physics.optics↗

Tailored minimal reservoir computing: on the bidirectional connection between nonlinearities in the reservoir and in data

We study how the degree of nonlinearity in the input data affects the optimal design of reservoir computers, focusing on how closely the model's nonlinearity should align with that of the data. By reducing minimal RCs to a single tunable nonlinearity parameter, we explore how the predictive performance varies with the degree of nonlinearity in the reservoir. To provide controlled testbeds, we generalize to the fractional Halvorsen system, a novel chaotic system with fractional exponents. Our experiments reveal that the prediction performance is maximized when the reservoir's nonlinearity matches the nonlinearity present in the data. In cases where multiple nonlinearities are present in the data, we find that the correlation dimension of the predicted signal is reconstructed correctly when the smallest nonlinearity is matched. We use this observation to propose a method for estimating the minimal nonlinearity in unknown time series by sweeping the reservoir exponent and identifying the transition to a successful reconstruction. Applying this method to both synthetic and real-world datasets, including financial time series, we demonstrate its practical viability. Finally, we transfer these insights to classical RC by augmenting traditional architectures with fractional, generalized reservoir states. This yields performance gains, particularly in resource-constrained scenarios such as physical reservoirs, where increasing reservoir size is impractical or economically unviable. Our work provides a principled route toward tailoring RCs to the intrinsic complexity of the systems they aim to model.

cs.LG↗

Distinguishing indistinguishable attractors: Unsupervised anomaly detection with reservoir computers

Detecting when a nonlinear dynamical system departs from its normal regime is a recurring problem across the sciences, from cardiology to climate and energy systems. We show that a very simple Kolmogorov--Smirnov test on the output weights of a reservoir computer is highly sensitive to regime changes in nonlinear dynamical systems, including those invisible to both classical nonlinear measures and modern deep-learning detectors. The core idea of our algorithm is to treat the readout layer of a reservoir computer as a representation of the input dynamics. Since the input mapping and the reservoir itself are random and fixed, the trained output weights are the only object encoding the system at hand. We summarize this fingerprint by the empirical cumulative distribution function of the readout weights and compare it to a reference band built from the training data. This unsupervised, online detector distinguishes two visually indistinguishable butterfly-shaped attractors, resolves parameter drifts seven times smaller than the strongest deep-learning baseline, flags noise four orders of magnitude below the signal, and identifies ventricular flutter in a clinical ECG recording. More broadly, we aim to establish a perspective on reservoir computers in which the trained output weights are treated as a representation of the learned system in their own right, rather than merely as a means to forecasting.

cs.LG↗

Controlling Dynamical Systems into Unseen Target States Using Machine Learning

We present a novel, model-free, and data-driven methodology for controlling complex dynamical systems into previously unseen target states, including those with significantly different and complex dynamics. Leveraging a parameter-aware realization of next-generation reservoir computing (NGRC), our approach accurately predicts system behavior in unobserved parameter regimes, enabling control over transitions to arbitrary target states utilizing a new prediction evaluation and selection scheme. Crucially, this includes states with dynamics that differ fundamentally from known regimes, such as shifts from periodic to intermittent or chaotic behavior. The method's parameter awareness facilitates non-stationary control with which control scenarios are generated and evaluated on the basis of predefined control objective. In addition to proving the method for transient-free control to extrapolated chaotic target states over transition times, we demonstrate the method's effectiveness on a nonlinear power system model. Our method successfully navigates transitions even in scenarios where system collapse is observed frequently, while ensuring fast transitions and avoiding prolonged transient behavior. By extending the applicability of machine learning-based control mechanisms to previously inaccessible target dynamics, the methodology opens the door to new control applications while maintaining exceptional efficiency.

nlin.CD↗

Two-shot learning of multiple strange attractors

The brain combines short- and long-term memory to process, store, and recall multiple different pieces of information. Inspired by this and recent results on multifunctional and parameter-aware learning, we extend a new machine learning technique that combines short- and long-term memory units, specifically, a system consisting of a next-generation reservoir computer (NGRC) and extremely randomized trees (ERT), to process, store, and recall multiple different strange attractors. We train the combined NGRC+ERT system using a two-shot learning approach which significantly improves performance by filtering out unnecessary features, thereby avoiding extensive hyperparameter optimization. We first show that an NGRC+ERT system achieves highly accurate reconstruction of the short- and long-term dynamics of both the Lorenz and Halvorsen chaotic attractors when using an exponential filtering scheme. We validate these finding by training the NGRC+ERT system to reconstruct different pairs of attractors and also a greater number of attractors. We focus on the task of training a single NGRC+ERT system to reconstruct 16 different attractors and show that sufficient index-based separation in feature space suppresses unwanted switching dynamics, thus stabilizing long-term memory recall. Finally, we identify that defects in short-term memory processing can provoke failure modes in long-term memory recall resulting in confabulation.

nlin.CD↗

Predicting three-dimensional chaotic systems with four qubit quantum systems

Reservoir computing (RC) is among the most promising approaches for AI-based prediction models of complex systems. It combines superior prediction performance with very low CPU-needs for training. Recent results demonstrated that quantum systems are also well-suited as reservoirs in RC. Due to the exponential growth of the Hilbert space dimension obtained by increasing the number of quantum elements small quantum systems are already sufficient for time series prediction. Here, we demonstrate that three-dimensional systems can already well be predicted by quantum reservoir computing with a quantum reservoir consisting of the minimal number of qubits necessary for this task, namely four. This is achieved by optimizing the encoding of the data, using spatial and temporal multiplexing and recently developed read-out-schemes that also involve higher exponents of the reservoir response. We outline, test and validate our approach using eight prototypical three-dimensional chaotic systems. Both, the short-term prediction and the reproduction of the long-term system behavior (the system's "climate") are feasible with the same setup of optimized hyperparameters. Our results may be a further step towards the realization of a dedicated small quantum computer for prediction tasks in the NISQ-era.

quant-ph↗

Predicting two-dimensional spatiotemporal chaotic patterns with optimized high-dimensional hybrid reservoir computing

As an alternative approach for predicting complex dynamical systems where physics-based models are no longer reliable, reservoir computing (RC) has gained popularity. The hybrid approach is considered an interesting option for improving the prediction performance of RC. The idea is to combine a knowledge-based model (KBM) to support the fully data-driven RC prediction. There are three types of hybridization for RC, namely full hybrid (FH), input hybrid (IH) and output hybrid (OH), where it was shown that the latter one is superior in terms of the accuracy and the robustness for the prediction of low-dimensional chaotic systems. Here, we extend the formalism to the prediction of spatiotemporal patterns in two dimensions. To overcome the curse of dimensionality for this very high-dimensional case we employ the local states ansatz, where only a few locally adjacent time series are utilized for the RC-based prediction. Using simulation data from the Barkley model describing chaotic electrical wave propagation in cardiac tissue, we outline the formalism of high-dimensional hybrid RC and assess the performance of the different hybridization schemes. We find that all three methods (FH, IH and OH) perform better than reservoir only, where improvements are small when the model is very inaccurate. For small model errors and small reservoirs FH and OH perform nearly equally well and better than IH. Given the smaller CPU needs for OH and especially the better interpretability of it, OH is to be favored. For large reservoirs the performance of OH drops below that of FH and IH. Generally, it maybe advisable to test the three setups for a given application and select the best suited one that optimizes between the counteracting factors of prediction performance and CPU needs.

cs.LG↗

Forecasting trends in food security with real time data

Early warning systems are an essential tool for effective humanitarian action. Advance warnings on impending disasters facilitate timely and targeted response which help save lives and livelihoods. In this work we present a quantitative methodology to forecast levels of food consumption for 60 consecutive days, at the sub-national level, in four countries: Mali, Nigeria, Syria, and Yemen. The methodology is built on publicly available data from the World Food Programme's global hunger monitoring system which collects, processes, and displays daily updates on key food security metrics, conflict, weather events, and other drivers of food insecurity. In this study we assessed the performance of various models including Autoregressive Integrated Moving Average (ARIMA), Extreme Gradient Boosting (XGBoost), Long Short Term Memory (LSTM) Network, Convolutional Neural Network (CNN), and Reservoir Computing (RC), by comparing their Root Mean Squared Error (RMSE) metrics. Our findings highlight Reservoir Computing as a particularly well-suited model in the field of food security given both its notable resistance to over-fitting on limited data samples and its efficient training capabilities. The methodology we introduce establishes the groundwork for a global, data-driven early warning system designed to anticipate and detect food insecurity.

cs.LG↗

Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation

We investigate the stationary (late-time) training regime of single- and two-layer underparameterized linear neural networks within the continuum limit of stochastic gradient descent (SGD) for synthetic Gaussian data. In the case of a single-layer network in the weakly underparameterized regime, the spectrum of the noise covariance matrix deviates notably from the Hessian, which can be attributed to the broken detailed balance of SGD dynamics. The weight fluctuations are in this case generally anisotropic, but effectively experience an isotropic loss. For an underparameterized two-layer network, we describe the stochastic dynamics of the weights in each layer and analyze the associated stationary covariances. We identify the inter-layer coupling as a distinct source of anisotropy for the weight fluctuations. In contrast to the single-layer case, the weight fluctuations are effectively subject to an anisotropic loss, the flatness of which is inversely related to the fluctuation variance. We thereby provide an analytical derivation of the recently observed inverse variance-flatness relation in a model of a deep linear neural network.

cs.LG↗

Morphometry on the sphere: Cartesian and irreducible Minkowski tensors explained and implemented

Minkowski tensors are comprehensive shape descriptors that robustly capture n-point information in complex random geometries and that have already been extensively applied in the Euclidean plane. Here, we devise a novel framework for Minkowski tensors on the sphere. We first advance the theory by introducing irreducible Minkowski tensors, which avoid the redundancies of previous representations. We, moreover, generalize Minkowski sky maps to the sphere, i.e., a concept of local anisotropy, which easily adjusts to masked data. We demonstrate the power of our new procedure by applying it to simulations and real data of the Cosmic Microwave Background, finding an anomalous region close to the well-known Cold Spot. The accompanying open-source software, litchi, used to generate these maps from data in the HEALPix-format is made publicly available to facilitate broader integration of Minkowski maps in other fields, such as fluid demixing, porous structures, or geosciences more generally.

astro-ph.IM↗

Linear and nonlinear causality in financial markets

Identifying and quantifying co-dependence between financial instruments is a key challenge for researchers and practitioners in the financial industry. Linear measures such as the Pearson correlation are still widely used today, although their limited explanatory power is well known. In this paper we present a much more general framework for assessing co-dependencies by identifying and interpreting linear and nonlinear causalities in the complex system of financial markets. To do so, we use two different causal inference methods, transfer entropy and convergent cross-mapping, and employ Fourier transform surrogates to separate their linear and nonlinear contributions. We find that stock indices in Germany and the U.S. exhibit a significant degree of nonlinear causality and that correlation, while a very good proxy for linear causality, disregards nonlinear effects and hence underestimates causality itself. The presented framework enables the measurement of nonlinear causality, the correlation-causality fallacy, and motivates how causality can be used for inferring market signals, pair trading, and risk management of portfolios. Our results suggest that linear and nonlinear causality can be used as early warning indicators of abnormal market behavior, allowing for better trading strategies and risk management.

q-fin.ST↗

Extrapolating tipping points and simulating non-stationary dynamics of complex systems using efficient machine learning

Model-free and data-driven prediction of tipping point transitions in nonlinear dynamical systems is a challenging and outstanding task in complex systems science. We propose a novel, fully data-driven machine learning algorithm based on next-generation reservoir computing to extrapolate the bifurcation behavior of nonlinear dynamical systems using stationary training data samples. We show that this method can extrapolate tipping point transitions. Furthermore, it is demonstrated that the trained next-generation reservoir computing architecture can be used to predict non-stationary dynamics with time-varying bifurcation parameters. In doing so, post-tipping point dynamics of unseen parameter regions can be simulated.

cs.LG↗

Controlling dynamical systems to complex target states using machine learning: next-generation vs. classical reservoir computing

Controlling nonlinear dynamical systems using machine learning allows to not only drive systems into simple behavior like periodicity but also to more complex arbitrary dynamics. For this, it is crucial that a machine learning system can be trained to reproduce the target dynamics sufficiently well. On the example of forcing a chaotic parametrization of the Lorenz system into intermittent dynamics, we show first that classical reservoir computing excels at this task. In a next step, we compare those results based on different amounts of training data to an alternative setup, where next-generation reservoir computing is used instead. It turns out that while delivering comparable performance for usual amounts of training data, next-generation RC significantly outperforms in situations where only very limited data is available. This opens even further practical control applications in real world problems where data is restricted.

cs.LG↗

Exploring the limits of multifunctionality across different reservoir computers

Multifunctional neural networks are capable of performing more than one task without changing any network connections. In this paper we explore the performance of a continuous-time, leaky-integrator, and next-generation `reservoir computer' (RC), when trained on tasks which test the limits of multifunctionality. In the first task we train each RC to reconstruct a coexistence of chaotic attractors from different dynamical systems. By moving the data describing these attractors closer together, we find that the extent to which each RC can reconstruct both attractors diminishes as they begin to overlap in state space. In order to provide a greater understanding of this inhibiting effect, in the second task we train each RC to reconstruct a coexistence of two circular orbits which differ only in the direction of rotation. We examine the critical effects that certain parameters can have in each RC to achieve multifunctionality in this extreme case of completely overlapping training data.

cs.LG↗

Minkowski tensor-based shape analysis methods on the sphere

Recently, Minkowski Tensors (MT) have gained popularity for morphological analysis tasks. As opposed to the scalar Minkowski functionals (MF; in 2D given by area, perimeter and Euler characteristic), MT can characterize symmetry and orientation of a body. This has been used for a variety of tasks, e.g. to detect interstellar bubbles by tracing back the origins of filaments in HII-regions, or to search for alignment of structures in the CMB. I present a marching-square-based method for calculating MT and MF on the sphere for maps in the Healpix format. MT are calculated for a local neighborhood and can then be summed up/averaged over a larger region, using their additivity property. This provides the possibility of localized analyses looking for CMB anisotropies and non-Gaussianities at varying scales.

astro-ph.IM↗

Heartbeat instability as auto-oscillation between dim and bright void regimes

We investigated the self-excited as well as optogalvanically stimulated heartbeat instability in RF discharge complex plasma. Three video cameras measured the motion of the microparticles, the plasma emission, and the laser-induced fluorescence simultaneously. Comprehensive studies of the optogalvanic control of the heartbeat instability revealed that the microparticle suspension can be stabilized by a continuous laser, whereas a modulated laser beam induces the void contraction either transiently or resonantly. The resonance occurred when the laser modulation frequency coincided with the frequency of small breathing oscillations of the microparticle suspension, which are known to be a prerequisite to the heartbeat instability. Based on the experimental results we suggest that the void contraction during the instability is caused by an abrupt void transition from the dim to the bright regime [Pikalev et al., Plasma Sources Sci. Technol. 30, 035014 (2021)]. In the bright regime, a time-averaged electric field at the void boundary heats the electrons causing bright plasma emission inside the void. The dim void has much lower electric field at the boundary and exhibits therefore no emission feature associated with it.

physics.plasm-ph↗

Predicting high-dimensional heterogeneous time series employing generalized local states

We generalize the concept of local states (LS) for the prediction of high-dimensional, potentially mixed chaotic systems. The construction of generalized local states (GLS) relies on defining distances between time series on the basis of their (non-)linear correlations. We demonstrate the prediction capabilities of our approach based on the reservoir computing (RC) paradigm using the Kuramoto-Sivashinsky (KS), the Lorenz-96 (L96) and a combination of both systems. In the mixed system a separation of the time series belonging to the two different systems is made possible with GLS. More importantly, prediction remains possible with GLS, where the LS approach must naturally fail. Applications for the prediction of very heterogeneous time series with GLSs are briefly outlined.

physics.data-an↗