Searcharxiv⌕ Search
Home/Archive/arXiv

arXiv · 2609.35631

Accelerated Algorithms for Stochastic Monotone Inclusions with Fixed Queries

Sucheol Lee·Donghwan Kim
View original source ↗Read source document ↗Export metadata ↓

Abstract

We study acceleration of stochastic first-order methods for monotone Lipschitz inclusions with a fixed number of oracle queries per iteration, measured by the expected squared residual. Existing methods either have suboptimal oracle complexity, require an increasing number of oracle queries per iteration, or both. Under same-sample oracle access and mean-square Lipschitz stochastic noise, we develop variance-reduced anchored forward-backward (VRAF), an anytime composite method that makes two oracle queries per iteration. VRAF attains the first log-free $O(1/ε)$ complexity under these oracle assumptions and hence the optimal $O(σ^2/ε)$ variance dependence. This, however, leaves open whether the optimal $O(1/\sqrtε)$ deterministic term can also be attained. We establish an impossibility result by extending the lower bound of Foster et al. (2019) to stochastic oracles permitting repeated queries to sampled stochastic operators, showing that $O(LD/\sqrtε+σ^2/ε)$ oracle complexity is unattainable in general. We therefore develop recentered regularized stochastic extragradient (RRSEG), which attains the near-optimal oracle complexity previously achievable only with an increasing number of queries per iteration, while using a fixed number of queries.

Explore related subjects

math.OC

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Sucheol Lee, Donghwan Kim. 2026-09-28. Accelerated Algorithms for Stochastic Monotone Inclusions with Fixed Queries. https://arxiv.org/abs/2609.35631

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Verifiable constraint qualifications for infinite-dimensional optimization problems and their applications to optimal control problems

This paper employs a finite codimensionality condition to establish an enhanced Fritz John condition for general constrained nonlinear infinite-dimensional optimization problems. In applications, this approach provides a new, unified framework for deriving first-order necessary conditions across a broad class of optimal control problems involving both deterministic and stochastic systems. Compared to existing constraint qualifications, our finite codimensionality condition, which is equivalent to the validity of certain \textit{a priori} estimates, yields a direct and analytically tractable verification method for each application. Furthermore, the core ideas of this method can be further extended to investigate the KKT conditions for infinite-dimensional optimization problems.

math.OC↗
arXiv2026

Arrival-Intensity Control for A Single-Server Queue in Heavy Traffic

We study a single-server queue control problem (QCP) in a heavy-traffic regime, extending the framework from Lee and Weerasinghe (2011). The state process represents the offered waiting time. Service times and patience times form independent i.i.d. sequences with general distributions. We formulate an infinite-horizon discounted QCP that balances the cost of controlling the arrival intensity against a penalty for server idleness. A distinctive feature of the formulation is the nonstandard decreasing operational running cost arising from the arrival-intensity control mechanism. Under suitable heavy-traffic assumptions, the diffusion-scaled offered waiting-time process converges to a regulated diffusion, leading to an associated diffusion control problem (DCP). We find the optimal control of the associated DCP by incorporating the Legendre-Fenchel transform and a formal Hamilton-Jacobi-Bellman (HJB) equation. We then construct a sequence of intensity controls for the prelimit queueing systems from the DCP-optimal feedback and establish its asymptotic optimality within the specified heavy-traffic admissible control class. Beyond theoretical analysis, numerical experiments further examine whether reinforcement learning can approximate the optimal policy with discounted costs close to the HJB reference. Policies are trained from simulated state transitions and realized costs, and are evaluated against the independently computed HJB feedback.

math.OC↗
arXiv2026

Information-Theoretic Upper Bounds for Deterministic Noise in Zeroth-Order Convex Optimization

We study zeroth-order convex optimization on Euclidean balls with function values corrupted by a fixed, uniformly bounded deterministic perturbation. For a query budget $T$, the maximum admissible level of noise (MALN) is the supremum of noise levels for which an $\eps$-accurate solution can be found with probability $1-β$. We construct an explicit hard family: the support function of a spherical belt combined with an affine branch along a hidden random direction. It yields finite-budget upper bounds on the MALN for Lipschitz, strongly convex, uniformly convex, smooth, Hölder, and smooth strongly convex classes. For Lipschitz objectives the bound has order $\eps^2\sqrt\ell/(\sqrt nMR)+\eps\ell/n$, where $\ell=\log(2(T+1)/(1-β))$ and $n-1\ge32\ell$; this is the scale of Li and Risteski with explicit logarithmic factors. A tangential-gradient estimate for the Moreau envelope yields the smooth scale $\eps^{3/2}/(\sqrt n\sqrt L\,R)$ and, for $L-μ\ge5μ$, the smooth strongly convex scale $\eps\sqrt{μ/((L-μ)n)}$. These bounds are tight: on explicit parameter ranges and subclasses, polynomial-query two-point methods tolerate noise of the order of the terms of order $n^{-1/2}$, so that the MALN is determined up to $O(\sqrt\ell)$ and absolute constants whenever these terms dominate. At $L=μ$, simplex interpolation with $n+1$ queries tolerates noise $R\sqrt{2μ\eps/n}$, which is optimal up to $O(\sqrt\ell)$ for $\eps\leμR^2/3$, while with at most $n$ exact queries no randomized algorithm guarantees success probability greater than $1/2$ uniformly over the class. We also quantify noise tolerance near this endpoint and illustrate the hiding mechanism and the breakdown of a two-point method numerically.

math.OC↗