SearcharxivSearch

arXiv subjects

Yonghong Yao

Publications and source records attributed to Yonghong Yao.

4 recordsLinked to original sources

Anderson acceleration of the proximal point method: the exact adaptive minimax, a spectral phase transition, and optimal safeguarding

\noindent We study residual-polynomial acceleration of the proximal point method (PPM) for maximal monotone inclusions, with Anderson acceleration (AA) as the prototypical adaptive scheme. We answer three questions exactly. (i)~The minimax complexity over all adaptive methods is precisely $d_0/(K+1)$ per $K$ resolvent evaluations. The upper bound is attained by the averaged-reflection estimator; the matching lower bound uses an explicit skew-adjoint instance with resolvent eigenvalues at the roots of $u^{K+1}=-1$ and $\csc^2$-distributed masses, on which every degree-$K$ polynomial method satisfies $\|r(y_K)\|\ge 1/(K+1)$. The optimal polynomial is uniquely the Fejér kernel, and the same instance certifies a per-step floor. (ii)~A sharp phase transition separates regimes: Jackson-kernel polynomials achieve $O(d_0/(K^2 s))$ when the spectral floor $s$ satisfies $sK\to\infty$, while at the critical scale $s\asymp 1/K$ the barrier is exactly $1/(K+1)$. The picture extends to normal operators and the nonlinear family $M=S+N_C$. (iii)~On linear problems AA-PPM needs no safeguarding; on nonlinear problems certification of the $O(1/k)$ envelope requires exactly two oracle evaluations per iteration, and this factor is optimal. We also correct and complete the theory for structured problems---affine, strongly monotone, piecewise-affine, and Hölderian growth---and confirm all predictions numerically.

math.NA

New Douglas-Rashford Splitting Algorithms for Generalized DC Programming with Applications in Machine Learning

In this work, we propose some new Douglas-Rashford splitting algorithms for solving a class of generalized DC (difference of convex functions) in real Hilbert spaces. The proposed methods leverage the proximal properties of the nonsmooth component and a fasten control parameter which improves the convergence rate of the algorithms. We prove the convergence of these methods to the critical points of nonconvex optimization under reasonable conditions. We evaluate the performance and effectiveness of our methods through experimentation with three practical examples in machine learning. Our findings demonstrated that our methods offer efficiency in problem-solving and outperform state-of-the-art techniques like the DCA (DC Algorithm) and ADMM.

math.OC

Linear Convergence Results for Inertial Type Projection Algorithm for Quasi-Variational Inequalities

Many recently proposed gradient projection algorithms with inertial extrapolation step for solving quasi-variational inequalities in Hilbert spaces are proven to be strongly convergent with no linear rate given when the cost operator is strongly monotone and Lipschitz continuous. In this paper, our aim is to design an inertial type gradient projection algorithm for quasi-variational inequalities and obtain its linear rate of convergence. Therefore, our results fill in the gap for linear convergence results for inertial type gradient projection algorithms for quasi variational inequalities in Hilbert spaces. We perform numerical implementations of our proposed algorithm and give numerical comparisons with other related inertial type gradient projection algorithms for quasi variational inequalities in the literature.

math.OC

Some identities involving special numbers and moments of random variables

In this paper, we derive some identities involving special numbers and moments of random variables by using the generating functions of the moments of certain random variables. Here the related special numbers are Stirling numbers of the first and second kinds, degenerate Stirling numbers of the first and second kinds, derangement numbers, higher-order Bernoulli numbers and Bernoulli numbers of the second kind.

math.NT