Searcharxiv⌕ Search

arXiv · 2610.26137

Structural conditions on trust-region radius updates. Part II: second-order convergence and asymptotic radius behaviour

Abstract

Continuing Part I (arXiv:2606.30202), we ask not which structural conditions on $\{Δ_k\}$ suffice for global convergence but what the radius does; the answers separate the mechanisms by whether the radius is tied to a criticality measure. We identify three asymptotic regimes: the criticality-anchored rules give $\sum_k Δ_k^2/M_k < +\infty$, hence $\liminf_k Δ_k = 0$, and $Δ_k \to 0$ once the model Hessians are bounded; the step-driven rules inherit the summability of the step series, hence $\sum_k Δ_k < +\infty$; the fixed-factor rules keep $Δ_k$ bounded away from zero. Near a critical point with positive definite Hessian, convergence of a subsequence forces convergence of the full sequence. We then extend the framework to second-order criticality through $τ_k = \max\{\|g_k\|, -λ_k^-\}$, obtaining convergence to second-order critical points with the worst-case complexity $\mathcal{O}(\max\{\varepsilon_g^{-2}\varepsilon_H^{-1}, \varepsilon_H^{-3}\})$, which reduces to $\mathcal{O}(\varepsilon^{-3})$ for a common tolerance and is sharp for quadratic models. Finally we establish eventual inactivity of the constraint and superlinear convergence, isolating the two properties of the radius rule through which the mechanism enters; the rate itself is mechanism-independent. The criticality-anchored and capped gradient-scaled rules reach inactivity only under a side condition, $ζ> \overlineκ$ or $\overlineμ > \overlineκ$, with $\overlineκ$ a constant of the solution that cannot be checked in advance. These conditions are necessary, not artefacts: on $f(x) = \sin(x)/x$, $\overlineκ$ is unbounded over the minimisers, so no parameter value meets the condition at all of them. Among the rules tied to a criticality measure, only those with an unbounded multiplier escape such a constant.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Jérémy Rieussec, Fabian Bastin. 2026-10-19. Structural conditions on trust-region radius updates. Part II: second-order convergence and asymptotic radius behaviour. https://arxiv.org/abs/2610.26137

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Exploring chordal sparsity in semidefinite programming with sparse plus low-rank data matrices

Semidefinite programming (SDP) problems are challenging to solve because of their high dimensionality. However, solving sparse SDP problems with small tree-width are known to be relatively easier because: (1) they can be decomposed into smaller multi-block SDP problems through chordal conversion; (2) they have low-rank optimal solutions. In this paper, we study more general SDP problems whose coefficient matrices have sparse plus low-rank (SPLR) structure. We develop a unified framework to convert such problems into sparse SDP problems with bounded tree-width. Based on this, we derive rank bounds for SDP problems with SPLR structure, which are tight in the worst case.

math.OC↗

Bellman Optimality of Average-Reward Robust Markov Decision Processes with a Constant Gain

Learning and optimal control under robust Markov decision processes (MDPs) have received increasing attention, yet most existing theory, algorithms, and applications focus on finite-horizon or discounted models. Long-run average-reward formulations, while natural in many operations research and management contexts, remain underexplored. This is primarily because the dynamic programming foundations are technically challenging and only partially understood, with several fundamental questions remaining open. This paper steps toward a general framework for average-reward robust MDPs by analyzing the constant-gain setting. We study the average-reward robust control problem with possible information asymmetries between the controller and an S-rectangular adversary. Our analysis centers on the constant-gain robust Bellman equation, examining both the existence of solutions and their relationship to the optimal average reward. Specifically, we identify when solutions to the robust Bellman equation characterize the optimal average reward and stationary policies, and we provide one-sided weak communication conditions ensuring solutions' existence. These findings expand the dynamic programming theory for average-reward robust MDPs and lay a foundation for robust dynamic decision making under long-run average criteria in operational environments.

math.OC↗

Service-Induced Congestion in Memory-Constrained LLM Serving

In large language model (LLM) serving, each request accumulates persistent graphics processing unit (GPU) memory during service as its key-value cache grows with every generated token. Under high concurrency, aggregate memory usage therefore increases endogenously over time: the service process itself creates future capacity pressure. When memory capacity is exceeded, systems evict active requests, discarding cached state and restarting them later, which wastes computation and reduces throughput. We develop a discrete-time dynamical model of memory-constrained LLM inference that captures admission, memory growth, and eviction under continuous batching. In the saturated-input regime, the system admits both eviction-free fixed points and limit cycles with evictions. For homogeneous workloads, we show that the eviction-free equilibrium is unstable and that, except for a Lebesgue-measure-zero exact-capture set, the system converges to a unique worst-case limit cycle that is asymptotically stable outside this exceptional set, with throughput losses as large as 50%. For heterogeneous workloads, we prove a stability criterion in the two-class common-input setting and explain how the survival-polynomial mechanism generalizes to multiple classes and heterogeneous-input lengths. Under an input-dominated scaling regime, coprime decoding lengths stabilize the eviction-free equilibrium, while non-coprime lengths create synchronized modes that drive instability. These results characterize when workload heterogeneity desynchronizes completions and helps stabilize memory-constrained serving. More broadly, we identify service-induced congestion as a structural instability mechanism and derive scheduling design principles for sustaining high throughput.

math.OC↗