Searcharxiv⌕ Search

arXiv subjects

Thomas Geert de Jong

Publications and source records attributed to Thomas Geert de Jong.

7 recordsLinked to original sources

Designing learning in high dimensional oscillator networks with low dimensional read-out

In this paper we investigate a oscillator network based reservoir computer with a large number of oscillators and a low dimensional read-out. The read-out is a function on the average phases with respect to each oscillator population. Hence, this read-out provides a robust measurement of the oscillator states. We consider a low number of populations which leads to a low-dimensional read-out. Here, the task is time-series prediction. The input time-series is introduced via a forcing term. After a training phase the input is learned. Importantly, the training weights are introduced in the forcing term meaning that the oscillator network is left untouched. Hence, we can apply classical methods for oscillator networks. Here, we consider the continuum limit for Kuramoto oscillators by using the Ott-Antonsen Ansatz. Consequently, a mean field reservoir computer arises. The success and failure of the reservoir computer is then studied by bifurcations in the coupling and forcing parameter space. We will also show that the average phase read-out can naturally arise when considering the read-out on the phase states. Finally, we give numerical evidence that at least 4 oscillator populations are necessary to learn chaotic target dynamics.

nlin.CD↗

Harnessing omnipresent oscillator networks as computational resource

Nature is pervaded with oscillatory dynamics. In networks of coupled oscillators patterns can arise when the system synchronizes to an external input. Hence, these networks provide processing and memory of input. We present a universal framework for harnessing oscillator networks as computational resource. This computing framework is introduced by the ubiquitous model for phase-locking, the Kuramoto model. We force the Kuramoto model by a nonlinear target-system, then after substituting the target-system with a trained feedback-loop it emulates the target-system. Our results are two-fold. Firstly, the trained network inherits performance properties of the Kuramoto model, where all-to-all coupling is performed in linear time with respect to the number of nodes and parameters for synchronization are abundant. The latter implies that the network is generically successful since the system learns via sychronization. Secondly, the learning capabilities of the oscillator network, which describe a type of collective intelligence, can be explained using Kuramoto model's order parameter. In summary, this work provides the foundation for utilizing nature's oscillator networks as a new class of information processing systems.

cs.LG↗

Well-posedness results for general reaction-diffusion transport of oxygen in encapsulated cells

In this paper, we provide well-posedness results for nonlinear parabolic PDEs given by reaction-diffusion equations describing the concentration of oxygen in encapsulated cells. The cells are described in terms of a core and a shell, which introduces a discontinuous diffusion coefficient as the material properties of the core and shell differ. In addition, the cells are subject to general nonlinear consumption of oxygen. As no monotonicity condition is imposed on the consumption monotone operator theory cannot be used. Moreover, the discontinuity in the diffusion coefficient bars us to apply classical results. However, by directly applying a Galerkin method we obtain uniqueness and existence of the strong form solution. These results will provide the basis to study the dynamics of cells in critical states.

math.AP↗

Hölder regularity for the trajectories of generalized charged particles in 1D

We prove Hölder regularity for the trajectories of an interacting particle system. The particle velocities are given by the nonlocal and singular interactions with the other particles. Particle collisions occur in finite time. Prior to collisions the particle velocities become unbounded, and thus the trajectories fail to be of class $C^1$. Our Hölder-regularity result supplements earlier studies on the well-posedness of the particle system which imply only continuity of the trajectories. Moreover, it extends and unifies several of the previously obtained estimates on the trajectories. Our proof method relies on standard ODE techniques: we transform the system into different variables to expose and exploit the hidden monotonicity properties.

math.DS↗

Virtual reservoir acceleration for CPU and GPU: Case study for coupled spin-torque oscillator reservoir

We provide high-speed implementations for simulating reservoirs described by $N$-coupled spin-torque oscillators. Here $N$ also corresponds to the number of reservoir nodes. We benchmark a variety of implementations based on CPU and GPU. Our new methods are at least 2.6 times quicker than the baseline for $N$ in range $1$ to $10^4$. More specifically, over all implementations the best factor is 78.9 for $N=1$ which decreases to 2.6 for $N=10^3$ and finally increases to 23.8 for $N=10^4$. GPU outperforms CPU significantly at $N=2500$. Our results show that GPU implementations should be tested for reservoir simulations. The implementations considered here can be used for any reservoir with evolution that can be approximated using an explicit method.

cs.DC↗

How neural networks learn to classify chaotic time series

Neural networks are increasingly employed to model, analyze and control non-linear dynamical systems ranging from physics to biology. Owing to their universal approximation capabilities, they regularly outperform state-of-the-art model-driven methods in terms of accuracy, computational speed, and/or control capabilities. On the other hand, neural networks are very often they are taken as black boxes whose explainability is challenged, among others, by huge amounts of trainable parameters. In this paper, we tackle the outstanding issue of analyzing the inner workings of neural networks trained to classify regular-versus-chaotic time series. This setting, well-studied in dynamical systems, enables thorough formal analyses. We focus specifically on a family of networks dubbed Large Kernel Convolutional Neural Networks (LKCNN), recently introduced by Boullé et al. (2021). These non-recursive networks have been shown to outperform other established architectures (e.g. residual networks, shallow neural networks and fully convolutional networks) at this classification task. Furthermore, they outperform ``manual'' classification approaches based on direct reconstruction of the Lyapunov exponent. We find that LKCNNs use qualitative properties of the input sequence. In particular, we show that the relation between input periodicity and activation periodicity is key for the performance of LKCNN models. Low performing models show, in fact, analogous periodic activations to random untrained models. This could give very general criteria for identifying, a priori, trained models that have poor accuracy.

math.DS↗

Uniqueness of local, analytic solutions to singular ODEs

We study local, analytic solutions for a class of initial value problems for singular ODEs. We prove existence and uniqueness of such solutions under a certain non-resonance condition. Our proof translates the singular initial value problem to an equilibrium problem of a regular ODE. Then, we apply classical invariant manifold theory. We demonstrate that the class of ODEs under consideration captures models which describe the shape of axially symmetric surfaces which are closed on one side. Our main result guarantees smoothness at the tip of the surface.

math.DS↗