arXiv subjects

Yuchao Tang

Publications and source records attributed to Yuchao Tang.

18 recordsLinked to original sources

arXiv2026

An Event-Driven Framework for Fly-Inspired Visual Motion Detection

Fast and reliable motion detection is essential for machine vision and autonomous systems operating in dynamic environments. This work integrates emerging event-based sensing with biologically structured neural computation to establish an efficient computational paradigm for visual motion detection. The proposed framework is built upon a recently developed fly-inspired neural network that emulates motion-processing circuits in the optic lobe. Owing to its feed-forward and training-free architecture, the neural model requires only a small number of interpretable parameters and is well suited for real-time implementation. Event cameras provide low-latency, low-power, and high-dynamic-range visual sensing by asynchronously transmitting brightness-change events. However, their performance can be degraded by event noise, including temporal noise and junction-leakage-induced activity, particularly under low-light conditions. Moreover, effective integration between event-based visual representations and biologically inspired neural processing remains under-explored. To address these challenges, we propose an event-driven computational framework that combines time-surface encoding for front-end event representation with a fly optic-lobe-inspired neural network for foreground motion-direction estimation. A bottom-up attention mechanism is further incorporated to suppress background motion and enhance the saliency of foreground targets. The proposed method is evaluated via real-world datasets of ground-vehicle detection and compared with a baseline frame-based model and an optimization-based approach. Experimental results demonstrate that the framework effectively combines the temporal advantages of event-driven vision with the efficiency and interpretability of bio-inspired neural processing.

cs.CV↗

arXiv2026

A primal-dual splitting algorithm for monotone inclusions with applications

In this paper, we study a broad class of structured monotone inclusion problems in real Hilbert spaces. We propose a novel primal-dual splitting algorithm for solving such inclusions, which accommodates multiple monotone operators and cocoercive terms, as well as a composite monotone operator involving the linear map. The algorithm combines forward evaluations for the cocoercive components with backward resolvent steps for the monotone operators and employs a dual update for the linear composition term. It generalizes and unifies several existing methods, while requiring only a single resolvent or operator evaluation per iteration. We prove weak convergence of the iterates under standard assumptions on monotonicity and cocoercivity. Furthermore, we establish strong convergence under a mild regularity condition, such as uniform monotonicity. Numerical experiments on image deblurring and denoising problems demonstrate the efficiency and flexibility of the proposed algorithm.

math.OC↗

arXiv2025

Nonlinear three-operator splitting algorithms with momentum for monotone inclusions

In this paper, we introduce three novel splitting algorithms for solving structured monotone inclusion problems involving the sum of a maximally monotone operator, a monotone and Lipschitz continuous operator and a cocoercive operator. Each proposed method extends one of the classical schemes: the semi-forward-reflected-backward splitting algorithm, the semi-reflected-forward-backward splitting algorithm, and the outer reflected forward-backward splitting algorithm by incorporating a nonlinear momentum term. Under appropriate step-size conditions, we establish the weak convergence of all three algorithms, and further prove their $R$-linear convergence rates under strong monotonicity assumptions. Preliminary numerical experiments on both synthetic datasets and real-world quadratic programming problems in portfolio optimization demonstrate the effectiveness and superiority of the proposed algorithms.

math.OC↗

arXiv2025

Nonlinear forward-backward-half forward splitting with momentum for monotone inclusions

In this work, we propose a new splitting algorithm for solving structured monotone inclusion problems composed of a maximally monotone operator, a maximally monotone and Lipschitz continuous operator and a cocoercive operator. Our method augments the forward-backward-half forward splitting algorithm with a nonlinear momentum term. Under appropriate conditions on the step-size, we prove the weak convergence of the proposed algorithm. A linear convergence rate is also obtained under the strong monotonicity assumption. Furthermore, we investigate a stochastic variance-reduced forward-backward-half forward splitting algorithm with momentum for solving finite-sum monotone inclusion problems. Weak almost sure convergence and linear convergence are also established under standard condition. Preliminary numerical experiments on synthetic datasets and real-world quadratic programming problems in portfolio optimization demonstrate the effectiveness and superiority of the proposed algorithm.

math.OC↗

arXiv2025

On $\alpha$-monotone operators and their resolvent in Banach spaces

This paper introduces a new definition of $\alpha$-monotone operators in real 2-uniformly convex and smooth Banach spaces. Based on this new definition, we establish several novel structural and analytical properties of such operators, which not only extend classical results from Hilbert spaces but also reveal new insights into the geometry of Banach spaces. In particular, we examine the resolvent of $\alpha$-maximal monotone operators and demonstrate how its behavior is consistent with, and generalizes, the well-known firmly nonexpansive property in the Hilbert space setting. Building upon this theoretical framework, we further investigate algorithmic applications. Specifically, we analyze the forward-reflected-backward splitting algorithm under the new $\alpha$-monotonicity assumption and prove its strong convergence as well as its $R$-linear convergence rate in real 2-uniformly convex and smooth Banach spaces.

math.FA↗

arXiv2025

H\"{o}lder property of the resolvent of a monotone operator in Banach spaces

Let $E$ be a Banach space, and let $J: E \to E^{*}$ denote the normalized duality mapping. In this paper, we establish an upper bound for $\|Jx - Jy\|$ in $q$-uniformly smooth Banach spaces, where the bound is expressed in terms of a relatively simple function of $\|x - y\|$. Subsequently, we derive the H\"{o}lder property of mappings of firmly nonexpansive type in 2-uniformly convex and $q$-uniformly smooth Banach spaces ($1<q\leq 2$). As an application, we apply this result to the resolvent of a monotone operator in Banach spaces.

math.FA↗

arXiv2024

Optimizing ADMM and Over-Relaxed ADMM Parameters for Linear Quadratic Problems

The Alternating Direction Method of Multipliers (ADMM) has gained significant attention across a broad spectrum of machine learning applications. Incorporating the over-relaxation technique shows potential for enhancing the convergence rate of ADMM. However, determining optimal algorithmic parameters, including both the associated penalty and relaxation parameters, often relies on empirical approaches tailored to specific problem domains and contextual scenarios. Incorrect parameter selection can significantly hinder ADMM's convergence rate. To address this challenge, in this paper we first propose a general approach to optimize the value of penalty parameter, followed by a novel closed-form formula to compute the optimal relaxation parameter in the context of linear quadratic problems (LQPs). We then experimentally validate our parameter selection methods through random instantiations and diverse imaging applications, encompassing diffeomorphic image registration, image deblurring, and MRI reconstruction.

math.OC↗

arXiv2022

Four-operator splitting algorithms for solving monotone inclusions

Monotone inclusions involving the sum of three maximally monotone operators or more have received much attention in recent years. In this paper, we propose three splitting algorithms for finding a zero of the sum of four monotone operators, which are two maximally monotone operators, one monotone Lipschitz operator, and one cocoercive operator. These three splitting algorithms are based on the forward-reflected-Douglas-Rachford splitting algorithm, backward-forward-reflected-backward splitting algorithm, and backward-reflected-forward-backward splitting algorithm, respectively. As applications, we apply the proposed algorithms to solve the monotone inclusions problem involving a finite sum of maximally monotone operators. Numerical results on the Projection on Minkowski sums of convex sets demonstrate the effectiveness of the proposed algorithms.

math.OC↗

arXiv2022

Forward-partial inverse-half-forward splitting algorithm for solving monotone inclusions

In this paper we provide a splitting algorithm for solving coupled monotone inclusions in a real Hilbert space involving the sum of a normal cone to a vector subspace, a maximally monotone, a monotone-Lipschitzian, and a cocoercive operator. The proposed method takes advantage of the intrinsic properties of each operator and generalizes the method of partial inverses and the forward-backward-half forward splitting, among other methods. At each iteration, our algorithm needs two computations of the Lipschitzian operator while the cocoercive operator is activated only once. By using product space techniques, we derive a method for solving a composite monotone primal-dual inclusions including linear operators and we apply it to solve constrained composite convex optimization problems. Finally, we apply our algorithm to a constrained total variation least-squares problem and we compare its performance with efficient methods in the literature.

math.OC↗

arXiv2021

Convergence analysis of a relaxed inertial alternating minimization algorithm with applications

The alternating direction method of multipliers (ADMM) is a popular method for solving convex separable minimization problems with linear equality constraints. The generalization of the two-block ADMM to the three-block ADMM is not trivial since the three-block ADMM is not convergence in general. Many variants of three-block ADMM have been developed with guarantee convergence. Besides the ADMM, the alternating minimization algorithm (AMA) is also an important algorithm for solving the convex separable minimization problem with linear equality constraints. The AMA is first proposed by Tseng, and it is equivalent to the forward-backward splitting algorithm applied to the corresponding dual problem. In this paper, we design a variant of three-block AMA, which is derived by employing an inertial extension of the three-operator splitting algorithm to the dual problem. Compared with three-block ADMM, the first subproblem of the proposed algorithm only minimizing the Lagrangian function. As a by-product, we obtain a relaxed algorithm of Davis and Yin. Under mild conditions on the parameters, we establish the convergence of the proposed algorithm in infinite-dimensional Hilbert spaces. Finally, we conduct numerical experiments on the stable principal component pursuit (SPCP) to verify the efficiency and effectiveness of the proposed algorithm.

math.OC↗

arXiv2021

An inertial alternating direction method of multipliers for solving a two-block separable convex minimization problem

The alternating direction method of multipliers (ADMM) is a widely used method for solving many convex minimization models arising in signal and image processing. In this paper, we propose an inertial ADMM for solving a two-block separable convex minimization problem with linear equality constraints. This algorithm is obtained by making use of the inertial Douglas-Rachford splitting algorithm to the corresponding dual of the primal problem. We study the convergence analysis of the proposed algorithm in infinite-dimensional Hilbert spaces. Furthermore, we apply the proposed algorithm on the robust principal component pursuit problem and also compare it with other state-of-the-art algorithms. Numerical results demonstrate the advantage of the proposed algorithm.

math.OC↗

arXiv2020

An outer reflected forward-backward splitting algorithm for solving monotone inclusions

Monotone inclusions have wide applications in solving various convex optimization problems arising in signal and image processing, machine learning, and medical image reconstruction. In this paper, we propose a new splitting algorithm for finding a zero of the sum of a maximally monotone operator, a monotone Lipschitzian operator, and a cocoercive operator, which is called outer reflected forward-backward splitting algorithm. Under mild conditions on the iterative parameters, we prove the convergence of the proposed algorithm. As applications, we employ the proposed algorithm to solve composite monotone inclusions involving monotone Lipschitzian operator, cocoercive operator, and the parallel sum of operators. The advantage of the obtained algorithm is that it is a completely splitting algorithm, in which the Lipschitzian operator and the cocoercive operator are processed via explicit steps and the maximally monotone operators are processed via their resolvents.

math.OC↗

arXiv2020

Convergence analysis of an inexact inertial Krasnoselskii-Mann algorithm with applications

The classical Krasnoselskii-Mann iteration is broadly used for approximating fixed points of nonexpansive operators. To accelerate the convergence of the Krasnoselskii-Mann iteration, the inertial methods were received much attention in recent years. In this paper, we propose an inexact inertial Krasnoselskii-Mann algorithm. In comparison with the original inertial Krasnoselskii-Mann algorithm, our algorithm allows error for updating the iterative sequence, which makes it more flexible and useful in practice. We establish weak convergence results for the proposed algorithm under different conditions on parameters and error terms. Furthermore, we provide a nonasymptotic convergence rate for the proposed algorithm. As applications, we propose and study inexact inertial proximal point algorithm and inexact inertial forward-backward splitting algorithm for solving monotone inclusion problems and the corresponding convex minimization problems.

math.FA↗

arXiv2019

An inertial three-operator splitting algorithm with applications to image inpainting

The three-operators splitting algorithm is a popular operator splitting method for finding the zeros of the sum of three maximally monotone operators, with one of which is cocoercive operator. In this paper, we propose a class of inertial three-operator splitting algorithm. The convergence of the proposed algorithm is proved by applying the inertial Krasnoselskii-Mann iteration under certain conditions on the iterative parameters in real Hilbert spaces. As applications, we develop an inertial three-operator splitting algorithm to solve the convex minimization problem of the sum of three convex functions, where one of them is differentiable with Lipschitz continuous gradient. Finally, we conduct numerical experiments on a constrained image inpainting problem with nuclear norm regularization. Numerical results demonstrate the advantage of the proposed inertial three-operator splitting algorithms.

math.OC↗

arXiv2019

Convergence analysis of a variable metric forward-backward splitting algorithm with applications

The forward-backward splitting algorithm is a popular operator-splitting method for solving monotone inclusion of the sum of a maximal monotone operator and a cocoercive operator. In this paper, we present a new convergence analysis of a variable metric forward-backward splitting algorithm with extended relaxation parameters in real Hilbert spaces. We prove that this algorithm is weakly convergent when certain weak conditions are imposed upon the relaxation parameters. Consequently, we recover the forward-backward splitting algorithm with variable step sizes. As an application, we obtain a variable metric forward-backward splitting algorithm for solving the minimization problem of the sum of two convex functions, where one of them is differentiable with a Lipschitz continuous gradient. Furthermore, we discuss the applications of this algorithm to the fundamental of the variational inequalities problem, constrained convex minimization problem, and split feasibility problem. Numerical experimental results on LASSO problem in statistical learning demonstrate the effectiveness of the proposed iterative algorithm.

math.FA↗

arXiv2018

A Warm Restart Strategy for Solving Sudoku by Sparse Optimization Methods

This paper is concerned with the popular Sudoku problem. We proposed a warm restart strategy for solving Sudoku puzzles, based on the sparse optimization technique. Furthermore, we defined a new difficulty level for Sudoku puzzles. The efficiency of the proposed method is tested using a dataset of Sudoku puzzles, and the numerical results show that the accurate recovery rate can be enhanced from 84%+ to 99%+ using the L1 sparse optimization method.

math.OC↗

arXiv2016

Efficient primal-dual fixed point algorithm with dynamic stepsize for convex problems with applications to imaging restoration

We consider the problem of finding the minimization of the sum of a convex function and the composition of another convex function with a continuous linear operator from the view of fixed point algorithms based on proximity operators. We design a primal-dual fixed point algorithm with dynamic stepsize based on the proximity operator and obtain a scheme with a closed form solution for each iteration. Based on Modified Mann iteration and the firmly nonexpansive properties of the proximity operator, we achieve the convergence of the proposed algorithm.

math.OC↗

arXiv2016

A stochastic coordinate descent primal-dual algorithm with dynamic stepsize for large-scale composite optimization

In this paper we consider the problem of finding the minimizations of the sum of two convex functions and the composition of another convex function with a continuous linear operator. With the idea of coordinate descent, we design a stochastic coordinate descent primal-dual splitting algorithm with dynamic stepsize. Based on randomized Modified Krasnosel'skii-Mann iterations and the firmly nonexpansive properties of the proximity operator, we achieve the convergence of the proposed algorithms. Moreover, we give two applications of our method.

math.OC↗