SearcharxivSearch

arXiv subjects

Yingdong Yin

Publications and source records attributed to Yingdong Yin.

4 recordsLinked to original sources

Fast Convergence of Multiobjective Inertial Gradient Systems with Time Scaling

In multiobjective optimization, inertial gradient systems accelerate convergence toward weakly Pareto optimal solutions. To achieve even faster convergence, we introduce a multiobjective inertial gradient system with time scaling (MITS), formulated as a second-order differential equation comprising an inertial term, asymptotically vanishing damping, and a time-scaled gradient term. We first establish the existence of solution trajectories for MITS. Through Lyapunov analysis, we show that with suitable parameters, the trajectory attains a convergence rate of $O(1/t^{2}β(t))$ with respect to a merit function, where $β(t)$ is a time-scaling function. Specifically, choosing $β(t)=t^{p}$ for $0\leq p<α-3$ yields the rate $O(1/t^{2+p})$, enabling arbitrarily fast sublinear convergence by tuning $p$. We also prove that the trajectory converges to a weakly Pareto optimal solution. Furthermore, an implicit discretization of MITS leads to a multiobjective inertial proximal point method (MIPP), whose iterates share the $O(1/k^{2}β_{k})$ rate and converge to a weakly Pareto optimum under appropriate conditions. Numerical experiments support the theoretical findings.

math.OC

Multiobjective Accelerated Gradient-like Flow with Asymptotic Vanishing Normalized Gradient

This paper generalizes the dynamical system proposed by Wang et al. [Siam. J. Sci. Comput., 2021] to multiobjective optimization by investigating a multiobjective accelerated gradient-like flow with asymptotically vanishing normalized gradient. Using Lyapunov analysis, we obtain convergence rates of $O(1/t^2)$ and $O(\ln^2 t / t^2)$ for the trajectory solution under two distinct parameter selections. Under certain assumptions, we further prove that the trajectory solution of this gradient flow converges to a weak Pareto solution for convex multiobjective optimization problems. Through corresponding discretization, we derive a new class of multiobjective gradient methods achieving a convergence rate of $O(\ln^2 k / k^2)$. Additionally, numerical experiments validate the theoretical results, demonstrating that this gradient flow outperforms other existing dynamical systems in the literature regarding convergence speed, and our algorithm exhibits corresponding advantages.

math.OC

Point Convergence Analysis of the Accelerated Gradient Method for Multiobjective Optimization: Continuous and Discrete

This paper investigates the point convergence of accelerated gradient methods for multiobjective optimization, in both continuous and discrete settings. We address the open problems of whether the solution trajectory of the multiobjective inertial gradient-like dynamical system (MAVD) with asymptotic vanishing damping converges when $α= 3$, and whether the sequence generated by the multiobjective Nesterov accelerated method (MAG) converges to a weakly Pareto optimal solution. For the continuous system (MAVD) with $α= 3$, we prove that the trajectory $x(t)$ converges to a weakly Pareto optimal solution. For the discrete case, we propose a multiobjective accelerated gradient method with a generalized momentum factor (MAG-GM), and prove that the generated sequence $\{x_k\}$ converges to a weakly Pareto optimal solution.

math.OC

Multiobjective Balanced Gradient Flow: A Dynamical Perspective on a Class of Optimization Algorithms

This paper proposes a novel dynamical system called the Multiobjective Balanced Gradient Flow (MBGF), offering a dynamical perspective for normalized gradient methods in a class of multi-objective optimization problems. Under certain assumptions, we prove the existence of solutions for MBGF trajectories and establish their convergence to weak Pareto points in the case of convex objective functions. For both convex and non-convex scenarios, we provide convergence rates of $O(1/t)$ and $O(1/\sqrt{t})$, respectively.

math.OC