arXiv subjects

Tryphon Georgiou

Publications and source records attributed to Tryphon Georgiou.

At least 19 recordsLinked to original sources

arXiv2025

Gradient Flows as Optimal Controlled Evolutions: From Rn to Wasserstein product spaces

We show that the continuous-time gradient descent in Rn can be viewed as an optimal controlled evolution for a suitable action functional; a similar result holds for stochastic gradient descent. We then provide an analogous characterization for the Wasserstein gradient flow of the (relative) entropy, with an action that mirrors the classical case where the Euclidean gradient is replaced by the Wasserstein gradient of the relative entropy. In the small-step limit, these continuous-time actions align with the Jordan Kinderlehrer Otto scheme. Next, we consider gradient flows for the relative entropy over a Wasserstein product space-a study motivated by the stochastic-control formulation of Schrodinger bridges. We characterize the product-space steepest descent as the solution to a variational problem with two control velocities and a product-space Wasserstein gradient, and we show that the induced fluxes in the two components are equal and opposite. This framework suggests applications to the optimal control evolution of microrobotic swarms that can communicate their present distribution to the other swarm.

math.OC↗

arXiv2025

Analytic continuation of time in Brownian motion. Stochastic distributions approach

With the use of Hida's white noise space theory space theory and spaces of stochastic distributions, we present a detailed analytic continuation theory for classes of Gaussian processes, with focus here on Brownian motion. For the latter, we prove and make use a priori bounds, in the complex plane, for the Hermite functions; as well as a new approach to stochastic distributions. This in turn allows us to present an explicit formula for an analytically continued white noise process, realized this way in complex domain. With the use of the Wick product, we then apply our complex white noise analysis in a derivation of a new realization of Hilbert space-valued stochastic integrals

math.PR↗

arXiv2023

Classical Stability Margins by PID Control

Proportional-Integral-Derivative (PID) control has been the workhorse of control technology for about a century. Yet to this day, designing and tuning PID controllers relies mostly on either tabulated rules (Ziegler-Nichols) or on classical graphical techniques (Bode). Our goal in this paper is to take a fresh look on PID control in the context of optimizing stability margins for low-order (first- and second-order) linear time-invariant systems. Specifically, we seek to derive explicit expressions for gain and phase margins that are achievable using PID control, and thereby gain insights on the role of unstable poles and nonminimum-phase zeros in attaining robust stability. In particular, stability margins attained by PID control for minimum-phase systems match those obtained by more general control, while for nonminimum-phase systems, PID control achieves margins that are no worse than those of general control modulo a predetermined factor. Furthermore, integral action does not contribute to robust stabilization beyond what can be achieved by PD control alone.

math.OC↗

arXiv2020

Fitting IVIM with Variable Projection and Simplicial Optimization

Fitting multi-exponential models to Diffusion MRI (dMRI) data has always been challenging due to various underlying complexities. In this work, we introduce a novel and robust fitting framework for the standard two-compartment IVIM microstructural model. This framework provides a significant improvement over the existing methods and helps estimate the associated diffusion and perfusion parameters of IVIM in an automatic manner. As a part of this work we provide capabilities to switch between more advanced global optimization methods such as simplicial homology (SH) and differential evolution (DE). Our experiments show that the results obtained from this simultaneous fitting procedure disentangle the model parameters in a reduced subspace. The proposed framework extends the seminal work originated in the MIX framework, with improved procedures for multi-stage fitting. This framework has been made available as an open-source Python implementation and disseminated to the community through the DIPY project.

eess.IV↗

arXiv2019

Optimal steering for non-Markovian Gaussian processes

At present, the problem to steer a non-Markovian process with minimum energy between specified end-point marginal distributions remains unsolved. Herein, we consider the special case for a non-Markovian process y(t) which, however, assumes a finite-dimensional stochastic realization with a Markov state process that is fully observable. In this setting, and over a finite time horizon [0,T], we determine an optimal (least) finite-energy control law that steers the stochastic system to a final distribution that is compatible with a specified distribution for the terminal output process y(T); the solution is given in closed-form. This work provides a key step towards the important problem to steer a stochastic system based on partial observations of the state (i.e., an output process) corrupted by noise, which will be the subject of forthcoming work.

math.OC↗

arXiv2018

Stochastic control and non-equilibrium thermodynamics: fundamental limits

We consider damped stochastic systems in a controlled (time-varying) quadratic potential and study their transition between specified Gibbs-equilibria states in finite time. By the second law of thermodynamics, the minimum amount of work needed to transition from one equilibrium state to another is the difference between the Helmholtz free energy of the two states and can only be achieved by a reversible (infinitely slow) process. The minimal gap between the work needed in a finite-time transition and the work during a reversible one, turns out to equal the square of the optimal mass transport (Wasserstein-2) distance between the two end-point distributions times the inverse of the duration needed for the transition. This result, in fact, relates non-equilibrium optimal control strategies (protocols) to gradient flows of entropy functionals via and the Jordan-Kinderlehrer-Otto scheme. The purpose of this paper is to introduce ideas and results from the emerging field of stochastic thermodynamics in the setting of classical regulator theory, and to draw connections and derive such fundamental relations from a control perspective in a multivariable setting.

cond-mat.stat-mech↗

arXiv2018

Relaxed Schroedinger bridges and robust network routing

We consider network routing under random link failures with a desired final distribution. We provide a mathematical formulation of a relaxed transport problem where the final distribution only needs to be close to the desired one. The problem is a maximum entropy problem for path distributions with an extra terminal cost. We show that the unique solution may be obtained solving a generalized Schroedinger system. An iterative algorithm to compute the solution is provided. It contracts the Hilbert metric with contraction ratio less than 1/2 leading to extremely fast convergence.

math.OC↗

arXiv2017

Diffusion Dynamics and Optimal Coupling in Directed Multiplex Networks

We study the dynamics of diffusion processes acting on directed multiplex networks, i.e., coupled multilayer networks where at least one layer consists of a directed graph. We reveal that directed multiplex networks may exhibit a faster diffusion at an intermediate degree of coupling than when the two layers are fully coupled. We use three simple multiplex examples and a real-world topology to illustrate the characteristics of the directed dynamics that give rise to a regime in which an optimal coupling exists. Given the ubiquity of both directed and multilayer networks in nature, our results could have important implications for the dynamics of multilevel complex systems towards optimality.

physics.soc-ph↗

arXiv2016

Stochastic control, entropic interpolation and gradient flows on Wasserstein product spaces

Since the early nineties, it has been observed that the Schroedinger bridge problem can be formulated as a stochastic control problem with atypical boundary constraints. This in turn has a fluid dynamic counterpart where the flow of probability densities represents an entropic interpolation between the given initial and final marginals. In the zero noise limit, such entropic interpolation converges in a suitable sense to the displacement interpolation of optimal mass transport (OMT). We consider two absolutely continuous curves in Wasserstein space ${\cal W}_2$ and study the evolution of the relative entropy on ${\cal W}_2\times {\cal W}_2$ on a finite time interval. Thus, this study differs from previous work in OMT theory concerning relative entropy from a fixed (often equilibrium) distribution (density). We derive a gradient flow on Wasserstein product space. We find the remarkable property that fluxes in the two components are opposite. Plugging in the "steepest descent" into the evolution of the relative entropy we get what appears to be a new formula: The two flows approach each other at a faster rate than that of two solutions of the same Fokker-Planck. We then study the evolution of relative entropy in the case of uncontrolled-controlled diffusions. In two special cases of the Schroedinger bridge problem, we show that such relative entropy may be monotonically decreasing or monotonically increasing.

math.PR↗

arXiv2015

Market Fragility, Systemic Risk, and Ricci Curvature

Measuring systemic risk or fragility of financial systems is a ubiquitous task of fundamental importance in analyzing market efficiency, portfolio allocation, and containment of financial contagions. Recent attempts have shown that representing such systems as a weighted graph characterizing the complex web of interacting agents over some information flow (e.g., debt, stock returns, shareholder ownership) may provide certain keen insights. Here, we show that fragility, or the ability of system to be prone to failures in the face of random perturbations, is negatively correlated with geometric notion of Ricci curvature. The key ingredient relating fragility and curvature is entropy. As a proof of concept, we examine returns from a set of stocks comprising the S\&P 500 over a 15 year span to show that financial crashes are more robust compared to normal "business as usual" fragile market behavior - i.e., Ricci curvature is a "crash hallmark." Perhaps more importantly, this work lays the foundation of understanding of how to design systems and policy regulations in a manner that can combat financial instabilities exposed during the 2007-2008 crisis.

q-fin.RM↗

arXiv2015

Graph Curvature and the Robustness of Cancer Networks

The importance of studying properties of networks is manifest in diverse fields ranging from biology, engineering, physics, chemistry, neuroscience, and medicine. The functionality of networks with regard to performance, throughput, reliability and robustness is strongly linked to the underlying geometric and topological properties of the network and this is the focus of this paper, especially as applied to certain biological networks. The fundamental mathematical abstraction of a network as a weighted graph brings to bear the tools of graph theory--a highly developed subject of mathematical research. But more importantly, recently proposed geometric notions of curvature on very general metric measure spaces allow us to utilize a whole new set of tools and ideas that help quantify functionality and robustness of graphs. In particular, robustness is closely connected to network entropy which, in turn, is very closely related to curvature. We will see that there are a number of alternative notions of discrete curvature that are compatible with the classical Riemannian definition, each having its own advantages and disadvantages, and are relevant to networks of interest. We will concentrate on the role of curvature for certain key cancer networks in order to quantitatively indicate their apparent functional robustness relative to their normal counterparts.

q-bio.MN↗

arXiv2015

Optimal control of the state statistics for a linear stochastic system

We consider a variant of the classical linear quadratic Gaussian regulator (LQG) in which penalties on the endpoint state are replaced by the specification of the terminal state distribution. The resulting theory considerably differs from LQG as well as from formulations that bound the probability of violating state constraints. We develop results for optimal state-feedback control in the two cases where i) steering of the state distribution is to take place over a finite window of time with minimum energy, and ii) the goal is to maintain the state at a stationary distribution over an infinite horizon with minimum power. For both problems the distribution of noise and state are Gaussian. In the first case, we show that provided the system is controllable, the state can be steered to any terminal Gaussian distribution over any specified finite time-interval. In the second case, we characterize explicitly the covariance of admissible stationary state distributions that can be maintained with constant state-feedback control. The conditions for optimality are expressed in terms of a system of dynamically coupled Riccati equations in the finite horizon case and in terms of algebraic conditions for the stationary case. In the case where the noise and control share identical input channels, the Riccati equations for finite-horizon steering become homogeneous and can be solved in closed form. The present paper is largely based on our recent work in arxiv.org/abs/1408.2222, arxiv.org/abs/1410.3447 and presents an overview of certain key results.

math.OC↗

arXiv2015

Optimal mass transport over bridges

We present an overview of our recent work on implementable solutions to the Schroedinger bridge problem and their potential application to optimal transport and various generalizations.

math.OC↗

arXiv2015

Optimal transport over a linear dynamical system

We consider the problem of steering an initial probability density for the state vector of a linear system to a final one, in finite time, using minimum energy control. In the case where the dynamics correspond to an integrator ($\dot x(t) = u(t)$) this amounts to a Monge-Kantorovich Optimal Mass Transport (OMT) problem. In general, we show that the problem can again be reduced to solving an OMT problem and that it has a unique solution. In parallel, we study the optimal steering of the state-density of a linear stochastic system with white noise disturbance; this is known to correspond to a Schr\"odinger bridge. As the white noise intensity tends to zero, the flow of densities converges to that of the deterministic dynamics and can serve as a way to compute the solution of its deterministic counterpart. The solution can be expressed in closed-form for Gaussian initial and final state densities in both cases.

math.OC↗

arXiv2014

On the relation between optimal transport and Schr\"odinger bridges: A stochastic control viewpoint

We take a new look at the relation between the optimal transport problem and the Schr\"{o}dinger bridge problem from the stochastic control perspective. We show that the connections are richer and deeper than described in existing literature. In particular: a) We give an elementary derivation of the Benamou-Brenier fluid dynamics version of the optimal transport problem; b) We provide a new fluid dynamics version of the Schr\"{o}dinger bridge problem; c) We observe that the latter provides an important connection with optimal transport without zero noise limits; d) We propose and solve a fluid dynamic version of optimal transport with prior; e) We can then view optimal transport with prior as the zero noise limit of Schr\"{o}dinger bridges when the prior is any Markovian evolution. In particular, we work out the Gaussian case. A numerical example of the latter convergence involving Brownian particles is also provided.

eess.SY↗

arXiv2014

Fast cooling for a system of stochastic oscillators

We study feedback control of coupled nonlinear stochastic oscillators in a force field. We first consider the problem of asymptotically driving the system to a desired {\em steady state} corresponding to reduced thermal noise. Among the feedback controls achieving the desired asymptotic transfer, we find that the most efficient one {from an energy point of view} is characterized by {\em time-reversibility}. We also extend the theory of Schr\"{o}dinger bridges to this model, thereby steering the system in {\em finite time} and with minimum effort to a target steady-state distribution. The system can then be maintained in this state through the optimal steady-state feedback control. The solution, in the finite-horizon case, involves a space-time harmonic function $\varphi$, and $-\log\varphi$ plays the role of an artificial, time-varying potential in which the desired evolution occurs. This framework appears extremely general and flexible and can be viewed as a considerable generalization of existing active control strategies such as macromolecular cooling. In the case of a quadratic potential, the results assume a form particularly attractive from the algorithmic viewpoint as the optimal control can be computed via deterministic matricial differential equations. An example involving inertial particles illustrates both transient and steady state optimal feedback control.

math-ph↗

arXiv2014

Optimal steering of a linear stochastic system to a final probability distribution, part II

We consider the problem of minimum energy steering of a linear stochastic system to a final prescribed distribution over a finite horizon and to maintain a stationary distribution over an infinite horizon. We present sufficient conditions for optimality in terms of a system of dynamically coupled Riccati equations in the finite horizon case and algebraic in the stationary case. We then address the question of feasibility for both problems. For the finite-horizon case, provided the system is controllable, we prove that without any restriction on the directionality of the stochastic disturbance it is always possible to steer the state to any arbitrary Gaussian distribution over any specified finite time-interval. For the stationary infinite horizon case, it is not always possible to maintain the state at an arbitrary Gaussian distribution through constant state-feedback. It is shown that covariances of admissible stationary Gaussian distributions are characterized by a certain Lyapunov-like equation. We finally present an alternative to solving the system of coupled Riccati equations, by expressing the optimal controls in the form of solutions to (convex) semi-definite programs for both cases. We conclude with an example to steer the state covariance of the distribution of inertial particles to an admissible stationary Gaussian distribution over a finite interval, to be maintained at that stationary distribution thereafter by constant-gain state-feedback control.

eess.SY↗

arXiv2014

Optimal steering of a linear stochastic system to a final probability distribution

We consider the problem to steer a linear dynamical system with full state observation from an initial gaussian distribution in state-space to a final one with minimum energy control. The system is stochastically driven through the control channels; an example for such a system is that of an inertial particle experiencing random "white noise" forcing. We show that a target probability distribution can always be achieved in finite time. The optimal control is given in state-feedback form and is computed explicitely by solving a pair of differential Lyapunov equations that are coupled through their boundary values. This result, given its attractive algorithmic nature, appears to have several potential applications such as to active control of nanomechanical systems and molecular cooling. The problem to steer a diffusion process between end-point marginals has a long history (Schr\"odinger bridges) and therefore, the present case of steering a linear stochastic system constitutes a Schr\"odinger bridge for possibly degenerate diffusions. Our results, however, provide the first implementable form of the optimal control for a general Gauss-Markov process. Illustrative examples of the optimal evolution and control for inertial particles and a stochastic oscillator are provided. A final result establishes directly the property of Schr\"{o}dinger bridges as the most likely random evolution between given marginals to the present context of linear stochastic systems.

eess.SY↗