Searcharxiv⌕ Search

arXiv subjects

Péter Koltai

Publications and source records attributed to Péter Koltai.

50 records · Page 3Linked to original sources

Optimal data-driven estimation of generalized Markov state models for non-equilibrium dynamics

There are multiple ways in which a stochastic system can be out of statistical equilibrium. It might be subject to time-varying forcing; or be in a transient phase on its way towards equilibrium; it might even be in equilibrium without us noticing it, due to insufficient observations; and it even might be a system failing to admit an equilibrium distribution at all. We review some of the approaches that model the effective statistical behavior of equilibrium and non-equilibrium dynamical systems, and show that both cases can be considered under the unified framework of optimal low-rank approximation of so-called transfer operators. Particular attention is given to the connection between these methods, Markov state models, and the concept of metastability, further to the estimation of such reduced order models from finite simulation data. We illustrate our considerations by numerical examples.

math.DS↗

Transition manifolds of complex metastable systems: Theory and data-driven computation of effective dynamics

We consider complex dynamical systems showing metastable behavior but no local separation of fast and slow time scales. The article raises the question of whether such systems exhibit a low-dimensional manifold supporting its effective dynamics. For answering this question, we aim at finding nonlinear coordinates, called reaction coordinates, such that the projection of the dynamics onto these coordinates preserves the dominant time scales of the dynamics. We show that, based on a specific reducibility property, the existence of good low-dimensional reaction coordinates preserving the dominant time scales is guaranteed. Based on this theoretical framework, we develop and test a novel numerical approach for computing good reaction coordinates. The proposed algorithmic approach is fully local and thus not prone to the curse of dimension with respect to the state space of the dynamics. Hence, it is a promising method for data-based model reduction of complex dynamical systems such as molecular dynamics.

math.DS↗

Data-driven model reduction and transfer operator approximation

In this review paper, we will present different data-driven dimension reduction techniques for dynamical systems that are based on transfer operator theory as well as methods to approximate transfer operators and their eigenvalues, eigenfunctions, and eigenmodes. The goal is to point out similarities and differences between methods developed independently by the dynamical systems, fluid dynamics, and molecular dynamics communities such as time-lagged independent component analysis (TICA), dynamic mode decomposition (DMD), and their respective generalizations. As a result, extensions and best practices developed for one particular method can be carried over to other related methods.

math.DS↗

Estimating long-term behavior of periodically driven flows without trajectory integration

Periodically driven flows are fundamental models of chaotic behavior and the study of their transport properties is an active area of research. A well-known analytic construction is the augmentation of phase space with an additional time dimension; in this augmented space, the flow becomes autonomous or time-independent. We prove several results concerning the connections between the original time-periodic representation and the time-extended representation, focusing on transport properties. In the deterministic setting, these include single-period outflows and time-asymptotic escape rates from time-parameterized families of sets. We also consider stochastic differential equations with time-periodic advection term. In this stochastic setting one has a time-periodic generator (the differential operator given by the right-hand-side of the corresponding time-periodic Fokker-Planck equation). We define in a natural way an autonomous generator corresponding to the flow on time-extended phase space. We prove relationships between these two generator representations and use these to quantify decay rates of observables and to determine time-periodic families of sets with slow escape rate. Finally, we use the generator on the time-extended phase space to create efficient numerical schemes to implement the various theoretical constructions. These ideas build on the work of Froyland et al (SINUM, 2013), and no expensive time integration is required. We introduce an efficient new hybrid approach, which treats the space and time dimensions separately.

math.DS↗

On the numerical approximation of the Perron-Frobenius and Koopman operator

Information about the behavior of dynamical systems can often be obtained by analyzing the eigenvalues and corresponding eigenfunctions of linear operators associated with a dynamical system. Examples of such operators are the Perron-Frobenius and the Koopman operator. In this paper, we will review different methods that have been developed over the last decades to compute finite-dimensional approximations of these infinite-dimensional operators - e.g. Ulam's method and Extended Dynamic Mode Decomposition (EDMD) - and highlight the similarities and differences between these approaches. The results will be illustrated using simple stochastic differential equations and molecular dynamics examples.

math.DS↗

Understanding the geometry of transport: diffusion maps for Lagrangian trajectory data unravel coherent sets

Dynamical systems often exhibit the emergence of long-lived coherent sets, which are regions in state space that keep their geometric integrity to a high extent and thus play an important role in transport. In this article, we provide a method for extracting coherent sets from possibly sparse Lagrangian trajectory data. Our method can be seen as an extension of diffusion maps to trajectory space, and it allows us to construct "dynamical coordinates" which reveal the intrinsic low-dimensional organization of the data. The only a priori knowledge about the dynamics that we require is a locally valid notion of distance, which renders our method highly suitable for automated data analysis. We show convergence of our method to the analytic transfer operator framework of coherence in the infinite data limit, and illustrate its potential on several two- and three-dimensional examples as well as real world data.

math.DS↗

Pseudo generators of spatial transfer operators

Metastable behavior in dynamical systems may be a significant challenge for a simulation based analysis. In recent years, transfer operator based approaches to problems exhibiting metastability have matured. In order to make these approaches computationally feasible for larger systems, various reduction techniques have been proposed: For example, Schütte introduced a spatial transfer operator which acts on densities on configuration space, while Weber proposed to avoid trajectory simulation (like Froyland et al.) by considering a discrete generator. In this manuscript, we show that even though the family of spatial transfer operators is not a semigroup, it possesses a well defined generating structure. What is more, the pseudo generators up to order 4 in the Taylor expansion of this family have particularly simple, explicit expressions involving no momentum averaging. This makes collocation methods particularly easy to implement and computationally efficient, which in turn may open the door for further efficiency improvements in, e.g., the computational treatment of conformation dynamics. We experimentally verify the predicted properties of these pseudo generators by means of two academic examples.

math.DS↗

Pseudo generators for under-resolved molecular dynamics

Many features of a molecule which are of physical interest (e.g. molecular conformations, reaction rates) are described in terms of its dynamics in configuration space. This article deals with the projection of molecular dynamics in phase space onto configuration space. Specifically, we study the situation that the phase space dynamics is governed by a stochastic Langevin equation and study its relation with the configurational Smoluchowski equation in the three different scaling regimes: Firstly, the Smoluchowski equations in non-Cartesian geometries are derived from the overdamped limit of the Langevin equation. Secondly, transfer operator methods are used to describe the metastable behaviour of the system at hand, and an explicit small-time asymptotics is derived on which the Smoluchowski equation turns out to govern the dynamics of the position coordinate (without any assumptions on the damping). By using an adequate reduction technique, these considerations are then extended to one-dimensional reaction coordinates. Thirdly, we sketch three different approaches to approximate the metastable dynamics based on time-local information only.

math.DS↗

Split optimal policy iteration for LQR problems

This technical report is concerned with the convergence properties of what we call the split optimal policy iteration for coupled LQR problems; see section 3.1 in the manuscript. Interestingly, the iteration shows different convergence behavior for continuous and discrete time systems: while global convergence holds for both cases, we have local quadratic convergence for the continuous time case, but only linear convergence for the discrete time case - even though quadratic convergence is retained in the limit as the coupling between the subsystems vanishes.

math.OC↗

Optimizing the stable behavior of parameter-dependent dynamical systems - maximal domains of attraction, minimal absorption times

We propose a method for approximating solutions to optimization problems involving the global stability properties of parameter-dependent continuous-time autonomous dynamical systems. The method relies on an approximation of the infinite-state deterministic system by a finite-state non-deterministic one - a Markov jump process. The key properties of the method are that it does not use any trajectory simulation, and that the parameters and objective function are in a simple (and except for a system of linear equations) explicit relationship.

math.OC↗

Optimal value functions for weakly coupled systems: a posteriori estimates

We consider weakly coupled LQ optimal control problems and derive estimates on the sensitivity of the optimal value function in dependence of the coupling strength. In order to improve these sensitivity estimates a "coupling adapted" norm is proposed. Our main result is that if a weak coupling suffices to destabilize the closed loop system with the optimal feedback of the uncoupled system then the value function might change drastically with the coupling. As a consequence, it is not reasonable to expect that a weakly coupled system possesses a weakly coupled optimal value function. Also, for a known result on the connection of the separation operator and the stability radius a new and simpler proof is given.

math.OC↗

Discrete infinitesimal generator of the Frobenius-Perron operator semigroup associated with "outflow systems"

In this technical report the $C_0$ semigroup of Frobenius-Perron operators on $L^1(X)$ is considered, where the underlying dynamical system is such that trajectories may leave the state space $X$ and terminate. We introduce a discrete infinitesimal generator and show, that the operator semigroup generated by this discrete generator converges in $L^1(X)$ pointwise to the Frobenius-Perron operator of the system.

math.DS↗

Estimating long term behavior of flows without trajectory integration: the infinitesimal generator approach

The long-term distributions of trajectories of a flow are described by invariant densities, i.e. fixed points of an associated transfer operator. In addition, global slowly mixing structures, such as almost-invariant sets, which partition phase space into regions that are almost dynamically disconnected, can also be identified by certain eigenfunctions of this operator. Indeed, these structures are often hard to obtain by brute-force trajectory-based analyses. In a wide variety of applications, transfer operators have proven to be very efficient tools for an analysis of the global behavior of a dynamical system. The computationally most expensive step in the construction of an approximate transfer operator is the numerical integration of many short term trajectories. In this paper, we propose to directly work with the infinitesimal generator instead of the operator, completely avoiding trajectory integration. We propose two different discretization schemes; a cell based discretization and a spectral collocation approach. Convergence can be shown in certain circumstances. We demonstrate numerically that our approach is much more efficient than the operator approach, sometimes by several orders of magnitude.

math.NA↗

Mean field approximation in conformation dynamics

We propose a new approach to the transfer operator based analysis of the conformation dynamics of molecules. It is based on a statistical independence ansatz for the eigenfunctions of the operator related to a partitioning into subsystems. Numerical tests performed on small systems show excellent qualitative agreement between mean field and exact model, at greatly reduced computational cost.

math.NA↗