SearcharxivSearch

arXiv subjects

William Kalies

Publications and source records attributed to William Kalies.

7 recordsLinked to original sources

Characterizing High-dimensional Dynamics by Combinatorial-Topological Methods on a Latent Space

Combinatorial-topological methods for characterizing dynamics are rigorous, generalizable, computable, and they only require approximations, but the dimension of the phase space is a computational bottleneck to their wider application. Motivated by the growing number of machine learning techniques for obtaining lower-dimensional latent representations of dynamics, we present an initial study of combinatorial-topological techniques in the dimensionality reduction setting. We establish bounds under which an algebraic structure that organizes dynamics can be lifted from the latent space to the original system. As a corollary, one can conclude the existence of attractors within certain regions of the original phase space. The hypothesis of these results is expressed in terms of an approximate semiconjugacy between the original and latent dynamics. To demonstrate the ideas, we combine autoencoder-based models with Conley-Morse graph computations for Leslie population models, a thirteen-dimensional Mediterranean red coral population model, and the Chafee--Infante equation. While the lift of the Conley index is still an open question, the examples recover the expected algebraic topological invariants in several settings.

math.DS

Conley Index Theory for Hybrid Systems

We define a homological Conley index for a class of hybrid dynamical systems. This is achieved by factoring through the hybrid suspension semiflow, which views a class of hybrid dynamics as a continuous semiflow. We establish that this invariant is well-defined, invariant under continuation, and satisfies the Wa\.zewski property and other reconstruction results. We compute the index for several examples, showcasing how classical reconstruction theorems apply in this setting to characterize hybrid dynamics.

math.DS

Topological Dynamics via Learned Hybrid Systems

The analysis of global dynamics, particularly the identification and characterization of attractors and their regions of attraction, is essential for complex nonlinear and hybrid systems. Combinatorial methods based on Conley's index theory have provided a rigorous framework for this analysis. However, the computation relies on rigorous outer approximations of the dynamics over a discretized state space, which is challenging to obtain from scattered trajectory data. We propose a methodology that integrates recent advances in switching system identification via convex optimization to bridge this gap between data and topological analysis. We leverage the identified switching system to construct combinatorial outer approximations. This paper outlines the integration of these methods and evaluates the efficacy of computing Morse graphs versus data-driven and statistical approaches.

math.DS

Data-driven Identification of Attractors Using Machine Learning

In this paper we explore challenges in developing a topological framework in which machine learning can be used to robustly characterize global dynamics. Specifically, we focus on learning a useful discretization of the phase space of a flow on compact, hyperrectangle in $\mathbb{R}^n$ from a neural network trained on labeled orbit data. A characterization of the structure of the global dynamics is obtained from approximations of attracting neighborhoods provided by the phase space discretization. The perspective that motivates this work is based on Conley's topological approach to dynamics, which provides a means to evaluate the efficacy and efficiency of our approach.

math.DS

Priestley duality and representations of recurrent dynamics

For an arbitrary dynamical system there is a strong relationship between global dynamics and the order structure of an appropriately constructed Priestley space. This connection provides an order-theoretic framework for studying global dynamics. In the classical setting, the chain recurrent set, introduced by C. Conley, is an example of an ordered Stone space or Priestley space. Priestley duality can be applied in the setting of dynamics on arbitrary topological spaces and yields a notion of Hausdorff compactification of the (chain) recurrent set.

math.DS

Identifying Nonlinear Dynamics with High Confidence from Sparse Data

We introduce a novel procedure that, given sparse data generated from a stationary deterministic nonlinear dynamical system, can characterize specific local and/or global dynamic behavior with rigorous probability guarantees. More precisely, the sparse data is used to construct a statistical surrogate model based on a Gaussian process (GP). The dynamics of the surrogate model is interrogated using combinatorial methods and characterized using algebraic topological invariants (Conley index). The GP predictive distribution provides a lower bound on the confidence that these topological invariants, and hence the characterized dynamics, apply to the unknown dynamical system (a sample path of the GP). The focus of this paper is on explaining the ideas, thus we restrict our examples to one-dimensional systems and show how to capture the existence of fixed points, periodic orbits, connecting orbits, bistability, and chaotic dynamics.

math.DS

Extracting Global Dynamics of Loss Landscape in Deep Learning Models

Deep learning models evolve through training to learn the manifold in which the data exists to satisfy an objective. It is well known that evolution leads to different final states which produce inconsistent predictions of the same test data points. This calls for techniques to be able to empirically quantify the difference in the trajectories and highlight problematic regions. While much focus is placed on discovering what models learn, the question of how a model learns is less studied beyond theoretical landscape characterizations and local geometric approximations near optimal conditions. Here, we present a toolkit for the Dynamical Organization Of Deep Learning Loss Landscapes, or DOODL3. DOODL3 formulates the training of neural networks as a dynamical system, analyzes the learning process, and presents an interpretable global view of trajectories in the loss landscape. Our approach uses the coarseness of topology to capture the granularity of geometry to mitigate against states of instability or elongated training. Overall, our analysis presents an empirical framework to extract the global dynamics of a model and to use that information to guide the training of neural networks.

math.DS