SearcharxivSearch

arXiv subjects

Trevor Teolis

Publications and source records attributed to Trevor Teolis.

9 recordsLinked to original sources

Target-adapted Green-Bessel SVGD: uniform-in-time propagation of chaos and last-iterate consistency

We prove uniform-in-time propagation of chaos and last-iterate consistency for a target-adapted Stein variational gradient descent (SVGD) flow on compact connected manifolds. The target has a smooth positive density, and the particles start independently from a fixed smooth nonnegative density ratio. The construction uses the Green--Bessel operator $Q_{r,\pi}=A_\pi^{-1}(\mathrm{Id}+A_\pi)^{-r}$ of the reversible target Langevin generator. Sufficient Bessel smoothing gives a scalar kernel with finite diagonal, and a positive matrix lift realizes its potential force as a Stein velocity. Population and empirical flows then dissipate the same finite target discrepancy. Population entropy and the target spectral gap give decay of this discrepancy; a finite-time particle comparison reaches a time after which common-energy monotonicity controls every later time. The resulting expected uniform discrepancy is $O((\log N)^{-1/2})$, with a corresponding logarithmic $W_1$ bound and consistency along every sequence $t_N\to\infty$. We also prove an exact finite-mode approximation theorem with an explicit spatial-resolution error and a feature-factorized particle implementation. For confining Euclidean targets, we establish static kernel and moment results and give a conditional dynamical extension under explicit population-regularity and transport hypotheses.

math.PR

On the Diverse Dynamical Behaviors Arising in Deep Linear Transformers

We study the inference-time behavior of deep linear encoder-only transformers through the lens of interacting particle systems. In this perspective, tokens are modeled as particles that interact dynamically through successive linear self-attention layers. We show that in embedding dimension two, for any key, query, and value matrices, the dynamics can be reformulated as a generalized Kuramoto-type model with pure second-harmonic coupling. This formulation is amenable to Watanabe--Strogatz theory which reveals the dynamics are intrinsically low-dimensional regardless of the parameter matrices. For a class of token initializations associated with the Ott--Antonsen (OA) manifold, we show that the parameter matrices induce a diverse variety of long-time behaviors in linear transformers, including clustering, oscillations, and bifurcations. The oscillations and bifurcations are characterized by uncovering a hidden Hamiltonian structure in the dynamics. By establishing a structural stability result, we further show that dynamics initialized near the OA manifold exhibit the same long-time behavior as those initialized exactly on the manifold. Motivated by our theory in dimension two, we conduct numerical experiments for analogous parameter regimes in higher-dimensional transformers. Our numerical experiments suggest that the long-time behaviors characterized in our theoretical results persist in higher dimensions.

cs.LG

Riesz-Kernel Stein Variational Gradient Descent: Renormalized Entropy and Long-Time Particle Limits

Stein variational gradient descent (SVGD) transports interacting particles toward a target distribution through deterministic kernelized dynamics. Singular Riesz kernels are attractive because they can provide quantitative population-level convergence, but at the finite-particle level the corresponding Stein energy has infinite self-interaction. We study periodic Riesz SVGD with self-interaction removed and prove a many-particle, long-time sampling theorem. Throughout the range in which the singular Stein energy is locally integrable, under a uniform bound on the initial relative entropy per particle, the time-averaged empirical-measure law converges weakly to the point mass \(\delta_\pi\) at the target as the particle number and any diverging averaging horizon tend to infinity. We also show that the empirical-measure laws induced by invariant particle laws of finite relative entropy converge weakly to \(\delta_\pi\), without a uniform entropy bound. Below the logarithmic singularity threshold, we obtain an explicit algebraic finite-particle error bound. These results extend the joint-entropy approach for smooth-kernel SVGD to singular interactions.

math.AP

Hybrid operator learning of wave scattering maps in high-contrast media

Surrogate modeling of wave propagation and scattering (i.e. the wave speed and source to wave field map) in heterogeneous media has significant potential in applications such as seismic imaging and inversion. High-contrast settings, such as subsurface models with salt bodies, exhibit strong scattering and phase sensitivity that challenge existing neural operators. We propose a hybrid architecture that decomposes the scattering operator into two separate contributions: a smooth background propagation and a high-contrast scattering correction. The smooth component is learned with a Fourier Neural Operator (FNO), which produces globally coupled feature tokens encoding background wave propagation; these tokens are then passed to a vision transformer, where attention is used to model the high-contrast scattering correction dominated by strong, spatial interactions. Evaluated on high-frequency Helmholtz problems with strong contrasts, the hybrid model achieves substantially improved phase and amplitude accuracy compared to standalone FNOs or transformers, with favorable accuracy-parameter scaling.

eess.SP

Unconditional alignment of solutions to the Fokker-Planck-Navier-Stokes system with locally averaged Brinkman force

We study a coupled Fokker-Planck--Navier-Stokes (FPNS) system modeling the dynamics of interacting particles suspended in a viscous incompressible fluid, where the coupling occurs through a locally averaged Brinkman drag force. Our main result is the unconditional alignment and synchronization of particle and fluid velocities for all weak solutions, in any dimension, on the periodic domain. The proof leverages a new entropy method and a hypocoercivity framework, which together yield quantitative decay estimates and prevent density concentration, a key obstacle in previous analyses. Our approach applies to a broad class of nonlocal alignment protocols, including the Cucker-Smale model. We also prove develop well-posedness theory for global weak solutions with hypoelliptic regularization in any dimension, and global strong solutions in two dimensions.

math.AP

Modulation of the Monokinetic Limit for Models of Collective Dynamics

In this work, we perform modulation analysis of monokinetic limits from the kinetic Cucker- Smale model to the pressureless Euler alignment system. Two regimes are considered -- a strong Fokker- Planck force with vanishing noise and Knudsen number, and a pure noiseless Vlasov scheme. In the former case, we demonstrate convergence of the modulated profile to the standard Gaussian distribution, while in the latter case, the distribution converges to a profile satisfying an explicit transport equation along limiting characteristics.

math.AP

Microscopic, mesoscopic, and macroscopic descriptions of the Euler alignment system with adaptive communication strength

This is a continuation of our previous joint work on the $\st$-model in[\textit{Well-posedness and long time behavior of the Euler Alignment System with adaptive communication strength}, accepted at the Abel Symposium Proceedings, also arXiv:2310.00269, 2023]. The $\st$-model, introduced by the first author in [\textit{Environmental averaging}. EMS Surv. Math. Sci., 11 (2024), no. 2, 277413],is an alignment model with the property that the strength of the alignment force, $\st$, is transported along an averaged velocity field. The transport of the strength is designed so that it admits an $e$-quantity, $e = \partial_x u + \st$, which controls regularity in 1D similarly to the classical Cucker-Smale case. The utility of the $\st$-model is that it has the versatility to behave qualitatively like the Motsch-Tadmor model, for which global regularity theory is not known. This paper aims to put the $\st$-model on firmer physical grounds by formulating and justifying the microscopic and mesoscopic descriptions from which it arises. A distinctive feature of the microscopic system is that it is a discrete-continuous system: the position and velocity of the particles are discrete objects, while the strength is an active continuum scalar function. We establish a rigorous passage from the microscopic to the mesoscopic description via the Mean Field Limit and from the mesoscopic to the macroscopic description in the monokinetic and Maxwellian limiting regimes. We also address the long-time behavior of the kinetic Fokker-Planck-Alignment equation by establishing the relaxation to the Maxwellian in 1D when the velocity averaging is given by the Favre filtration. As a supplement to the numerical results already presented in our previous work, we provide additional numerical evidence, via a particle simulation, that the $\st$-model behaves qualitatively like the Motsch-Tadmor model.

math.AP

Well-posedness and Long Time Behavior of the Euler Alignment System with Adaptive Communication Strength

We study a new flocking model which has the versatility to capture the physically realistic qualitative behavior of the Motsch-Tadmor model, while also retaining the entropy law, which lends to a similar 1D global well-posedness analysis to the Cucker-Smale model. This is an improvement to the situation in the Cucker-Smale case, which may display the physically unrealistic behavior that large flocks overpower the dynamics of small, far away flocks; and it is an improvement in the situation in the Motsch-Tadmor case, where 1D global well-posedness is not known. The new model was proposed in arXiv:2211.00117v3 and has a similar structure to the Cucker-Smale and Motsch-Tadmor hydrodynamic systems, but with a new feature: the communication strength is not fixed, but evolves in time according to its own transport equation along the Favre-filtered velocity field. This transport of the communication strength is precisely what preserves the entropy law. A variety of phenomenological behavior can be obtained from various choices of the initial communication strength, including the aforementioned Motsch-Tadmor-like behavior. We develop the general well-posedness theory for the new model and study the long time behavior -- including alignment, strong flocking in 1D, and entropy estimates to estimate the distribution of the limiting flock, all of which extend the classical results of the Cucker-Smale case. In addition, we provide numerical evidence to show the similar qualitative behavior

math.AP

Local equilibrium in planar non interacting particle systems

Particles are injected to a large planar rectangle through the boundary. Assuming that the particles move independently from one another and the boundary is also absorbing, we identify a set of abstract conditions which imply the local equilibrium of the particle density in diffusive scaling limit. We verify that our abstract conditions hold in two examples: iid random walks and the periodic Lorentz process.

math-ph