Searcharxiv⌕ Search

arXiv subjects

Hoang-Son Do

Publications and source records attributed to Hoang-Son Do.

At least 19 recordsLinked to original sources

Two-Clustering Regime of Token Dynamics in Causal Attention

We partially resolve Conjecture 1 of [Karagodin et al., Clustering in Causal Attention Masking (NeurIPS 2024)] and extend it to time-dependent parameter regimes. The conjecture predicts that causal attention dynamics converge to two clusters aligned with the eigenvectors associated with the largest eigenvalue $λ_{\max}$ of the value transformation. We prove that this behavior holds when $λ_{\max}>0$ and is generally false when $λ_{\max}\le0$. The resulting two-cluster regime is common in practice and substantially more challenging than the classical single-cluster setting studied previously. A central contribution of our work is the identification of a rigorous dimension reduction phenomenon: despite evolving in a high-dimensional embedding space, token trajectories collapse onto a two-dimensional structure governed by a small number of dominant directions. Building on this insight, we introduce a new analytical framework--instability within the flow--inspired by instability phenomena in physical systems. This framework enables the analysis of steady-regime behavior in non-monotone, non-autonomous attention dynamics. Our theoretical findings are illustrated through simulations and experimental studies using Group Query Attention (GQA) layers.

cs.AI↗

First-Token Attraction in Mamba Dynamics

We study token dynamics in deep Mamba models, with a particular focus on the attracting role of the first token. Unlike attention mechanisms, where token interactions are governed by positive scalar coefficients, Mamba dynamics involve full matrix-valued interaction coefficients with no positivity or definiteness guarantees. This structural difference makes Mamba dynamics substantially harder to analyze and prevents the direct application of existing techniques for attention-based models. To overcome this challenge, we introduce a new analytical framework based on a high-dimensional invariant box and a sharp exit-time argument, which together recover an effective form of sign-definiteness. Using this framework, we characterize the possible limit points of token trajectories and prove explicit exponential convergence rates. Our analysis reveals that the first token has privileged dynamics: its limiting direction attracts subsequent tokens, inducing token clustering and attention-sink phenomena in deep Mamba models. We further show that this attraction mechanism extends to broader sequence dynamics, including state-space models, causal attention, and classical time-series models. Experiments on Falcon-Mamba-7B validate our predictions, showing that concentration on the first token increases with depth and dominates in later layers.

cs.AI↗

Integration by parts for plurisubharmonic functions

In this paper, we provide an integration by parts formula for plurisubharmonic functions on a hyperconvex domain that are bounded outside a compact set. This extends a previous result of Urban Cegrell.

math.CV↗

Singularities vs non-pluripolar Monge--Ampère masses

The aim of this paper is to compare singularities of closed positive currents whose non-pluripolar complex Monge--Ampère masses equal. We also provide a short alternative proof for the monotonicity of non-pluripolar complex Monge--Ampère masses, generalizing results of Witt-Nyström, Darvas--Di Nezza--Lu, Lu--Nguyên and Vu.

math.CV↗

Log continuity of solutions of complex Monge-Ampère equations

Let $X$ be a compact Kähler manifold whose anticanonical cohomology class is semipositive. Let $L$ be a big and semi-ample line bundle on $X$ and $α$ be the Chern class of $L$. We give a sufficient condition ensuring that the solution of the complex Monge-Ampère equations in $α$ with $L^p$ right-hand side ($p>1$) is $\log^M$-continuous for every constant $M>0$. As an application, we show that every singular Ricci-flat metric in a semi-ample integral class in a projective Calabi-Yau surface $X$ is globally $\log^M$-continuous with respect to a smooth metric on $X$.

math.CV↗

A Dirichlet type problem for non-pluripolar complex Monge-Ampère equations

In this paper, we study a Dirichlet type problem for the non-pluripolar complex Monge - Ampère equation with prescribed singularity on a bounded domain of $\mathbb{C}^n$. We provide a local version for an existence and uniqueness theorem proved by Darvas, Di Nezza and Lu. Our work also extends a result of Ahag, Cegrell, Czyz and Pham.

math.CV↗

Quantitative stability for the complex Monge-Ampère equations I

We generalize several known stability estimates for complex Monge-Ampère equations to the setting of low (or high) energy potentials. We apply our estimates to obtain, among other things, a quantitative domination principle, and metric properties of the space of potentials of finite energy. Further applications will be given in subsequent papers.

math.CV↗

Quantitative stability for the complex Monge-Ampere equations

We prove several quantitative stability estimates for solutions of complex Monge-Ampere equations when both the cohomology class and the prescribed singularity vary. In a broad sense, our results fit well into the study of degeneration of families of Kaehler-Einstein metrics. The key mechanism in our method is the pluripotential theory in the space of potentials of finite lower energy.

math.CV↗

A comparison principle for parabolic complex Monge-Ampère equations

In this paper, we study the Cauchy-Dirichlet problem for Parabolic complex Monge-Ampère equations on strongly pseudoconvex domains using the viscosity method. We prove a comparison principle for Parabolic complex Monge-Ampère equations and use it to study the existence and uniqueness of viscosity solution in certain cases where the sets $\{z\inΩ: f(t, z)=0 \}$ may be pairwise disjoint.

math.CV↗

On the viscosity approach to a class of fully nonlinear elliptic equations

In this paper, we study some properties of viscosity sub/super-solutions of a class of fully nonlinear elliptic equations relative to the eigenvalues of the complex Hessian. We show that every viscosity subsolution is approximated by a decreasing sequence of smooth subsolutions. When the equations satisfy some conditions on the limit at infinity, we verify that the comparison principle holds, and as a sequence, we obtain a result about the existence of solution of the Dirichlet problem. Using the comparison principle, we show that, under suitable conditions, a Perron-Bremermann envelope can be approximated by a decreasing sequence of viscosity solutions.

math.AP↗

Viscosity solutions to parabolic complex Monge-Ampère equations

In this paper, we study the Cauchy-Dirichlet problem for Parabolic complex Monge-Ampère equations on a strongly pseudoconvex domain by the viscosity method. We extend the results in [EGZ15b] on the existence of solution and the convergence at infinity. We also establish the Hölder regularity of the solutions when the Cauchy-Dirichlet data are Hölder continuous.

math.CV↗

Some remarks on the Cegrell's class $\mathcal{F}$

In this paper, we study the near-boundary behavior of functions $u\in\mathcal{F}(Ω)$ in the case where $Ω$ is strictly pseudoconvex. We also introduce a sufficient condition for belonging to $\mathcal{F}$ in the case where $Ω$ is the unit ball.

math.CV↗

Complex Monge-Ampère equation in strictly pseudoconvex domains

We study the complex Monge-Ampère equation $(dd^c u)^n=μ$ in a strictly pseudoconvex domain $Ω$ with the boundary condition $u=φ$, where $φ\in C(\partialΩ)$. We provide a non-trivial sufficient condition for continuity of the solution $u$ outside "small sets".

math.CV↗

Approximation of maximal plurisubharmonic functions

Let $u$ be a maximal plurisubharmonic function in a domain $Ω\subset\mathbb{C}^n$ ($n\geq 2$). It is classical that, for any $U\SubsetΩ$, there exists a sequence of bounded plurisubharmonic functions $PSH(U)\ni u_j\searrow u$ satisfying the property: $(dd^c u_j)^n$ is weakly convergent to $0$ as $j\rightarrow\infty$. In general, this property does not hold for arbitrary sequence. In this paper, we show that for any sequence of bounded plurisubharmonic functions $PSH(U)\ni u_j\searrow u$, $(|u_j|+1)^{-a} (dd^cu_j)^n$ is weakly convergent to $0$ as $j\rightarrow\infty$, where $a>n-1$. We also generalize some well-known results about approximation of maximal plurisubharmonic functions.

math.CV↗