arXiv subjects

Ting-Zhu Huang

Publications and source records attributed to Ting-Zhu Huang.

At least 37 records · Page 2Linked to original sources

arXiv2020

Two CSCS-based iteration methods for solving absolute value equations

Recently, two families of HSS-based iteration methods are constructed for solving the system of absolute value equations (AVEs), which is a class of non-differentiable NP-hard problems. In this study, we establish the Picard-CSCS iteration method and the nonlinear CSCS-like iteration method for AVEs involving the Toeplitz matrix. Then, we analyze the convergence of the Picard-CSCS iteration method for solving AVEs. By using the theory about nonsmooth analysis, we particularly prove the convergence of the nonlinear CSCS-like iterationsolver for AVEs. The advantage of these methods is that they do not require the storage of coefficient matrices at all, and the sub-system of linear equations can be solved efficiently via the fast Fourier transforms (FFTs). Therefore, computational cost and storage can be saved in practical implementations. Numerical examples including numerical solutions of nonlinear fractional diffusion equations are reported to show the effectiveness of the proposed methods in comparison with some existing methods.

math.NA↗

arXiv2019

Efficient variants of the CMRH method for solving a sequence of multi-shifted non-Hermitian linear systems simultaneously

Multi-shifted linear systems with non-Hermitian coefficient matrices arise in numerical solutions of time-dependent partial/fractional differential equations (PDEs/FDEs), in control theory, PageRank problems, and other research fields. We derive efficient variants of the restarted Changing Minimal Residual method based on the cost-effective Hessenberg procedure (CMRH) for this problem class. Then, we introduce a flexible variant of the algorithm that allows to use variable preconditioning at each iteration to further accelerate the convergence of shifted CMRH. We analyse the performance of the new class of methods in the numerical solution of PDEs and FDEs, also against other multi-shifted Krylov subspace methods.

math.NA↗

arXiv2018

Tensor N-tubal rank and its convex relaxation for low-rank tensor recovery

As low-rank modeling has achieved great success in tensor recovery, many research efforts devote to defining the tensor rank. Among them, the recent popular tensor tubal rank, defined based on the tensor singular value decomposition (t-SVD), obtains promising results. However, the framework of the t-SVD and the tensor tubal rank are applicable only to three-way tensors and lack of flexibility to handle different correlations along different modes. To tackle these two issues, we define a new tensor unfolding operator, named mode-$k_1k_2$ tensor unfolding, as the process of lexicographically stacking the mode-$k_1k_2$ slices of an $N$-way tensor into a three-way tensor, which is a three-way extension of the well-known mode-$k$ tensor matricization. Based on it, we define a novel tensor rank, the tensor $N$-tubal rank, as a vector whose elements contain the tubal rank of all mode-$k_1k_2$ unfolding tensors, to depict the correlations along different modes. To efficiently minimize the proposed $N$-tubal rank, we establish its convex relaxation: the weighted sum of tensor nuclear norm (WSTNN). Then, we apply WSTNN to low-rank tensor completion (LRTC) and tensor robust principal component analysis (TRPCA). The corresponding WSTNN-based LRTC and TRPCA models are proposed, and two efficient alternating direction method of multipliers (ADMM)-based algorithms are developed to solve the proposed models. Numerical experiments demonstrate that the proposed models significantly outperform the compared ones.

cs.CV↗

arXiv2018

Rain Streak Removal for Single Image via Kernel Guided CNN

Rain streak removal is an important issue and has recently been investigated extensively. Existing methods, especially the newly emerged deep learning methods, could remove the rain streaks well in many cases. However the essential factor in the generative procedure of the rain streaks, i.e., the motion blur, which leads to the line pattern appearances, were neglected by the deep learning rain streaks approaches and this resulted in over-derain or under-derain results. In this paper, we propose a novel rain streak removal approach using a kernel guided convolutional neural network (KGCNN), achieving the state-of-the-art performance with simple network architectures. We first model the rain streak interference with its motion blur mechanism. Then, our framework starts with learning the motion blur kernel, which is determined by two factors including angle and length, by a plain neural network, denoted as parameter net, from a patch of the texture component. Then, after a dimensionality stretching operation, the learned motion blur kernel is stretched into a degradation map with the same spatial size as the rainy patch. The stretched degradation map together with the texture patch is subsequently input into a derain convolutional network, which is a typical ResNet architecture and trained to output the rain streaks with the guidance of the learned motion blur kernel. Experiments conducted on extensive synthetic and real data demonstrate the effectiveness of the proposed method, which preserves the texture and the contrast while removing the rain streaks.

cs.CV↗

arXiv2018

FastDeRain: A Novel Video Rain Streak Removal Method Using Directional Gradient Priors

Rain streak removal is an important issue in outdoor vision systems and has recently been investigated extensively. In this paper, we propose a novel video rain streak removal approach FastDeRain, which fully considers the discriminative characteristics of rain streaks and the clean video in the gradient domain. Specifically, on the one hand, rain streaks are sparse and smooth along the direction of the raindrops, whereas on the other hand, clean videos exhibit piecewise smoothness along the rain-perpendicular direction and continuity along the temporal direction. Theses smoothness and continuity results in the sparse distribution in the different directional gradient domain, respectively. Thus, we minimize 1) the $\ell_1$ norm to enhance the sparsity of the underlying rain streaks, 2) two $\ell_1$ norm of unidirectional Total Variation (TV) regularizers to guarantee the anisotropic spatial smoothness, and 3) an $\ell_1$ norm of the time-directional difference operator to characterize the temporal continuity. A split augmented Lagrangian shrinkage algorithm (SALSA) based algorithm is designed to solve the proposed minimization model. Experiments conducted on synthetic and real data demonstrate the effectiveness and efficiency of the proposed method. According to comprehensive quantitative performance measures, our approach outperforms other state-of-the-art methods especially on account of the running time. The code of FastDeRain can be downloaded at https://github.com/TaiXiangJiang/FastDeRain.

cs.CV↗

arXiv2018

A fast second-order accurate difference schemes for time distributed-order and Riesz space fractional diffusion equations

The aim of this paper is to develop fast second-order accurate difference schemes for solving one- and two-dimensional time distributed-order and Riesz space fractional diffusion equations. We adopt the same measures for one- and two-dimensional problems as follows: we first transform the time distributed-order fractional diffusion problem into the multi-term time-space fractional diffusion problem with the composite trapezoid formula. Then, we propose a second-order accurate difference scheme based on the interpolation approximation on a special point to solve the resultant problem. Meanwhile, the unconditional stability and convergence of the new difference scheme in $L_2$-norm are proved. Furthermore, we find that the discretizations lead to a series of Toeplitz systems which can be efficiently solved by Krylov subspace methods with suitable circulant preconditioners. Finally, numerical results are presented to show the effectiveness of the proposed difference methods and demonstrate the fast convergence of our preconditioned Krylov subspace methods.

math.NA↗

arXiv2018

A fast second-order implicit difference method for time-space fractional advection-diffusion equation

In this paper, we consider a fast and second-order implicit difference method for approximation of a class of time-space fractional variable coefficients advection-diffusion equation. To begin with, we construct an implicit difference scheme, based on $L2-1_σ$ formula [A. A. Alikhanov, A new difference scheme for the time fractional diffusion equation, \emph{J. Comput. Phys.}, 280 (2015)] for the temporal discretization and weighted and shifted Grünwald method for the spatial discretization. Then, unconditional stability of the implicit difference scheme is proved, and we theoretically and numerically show that it converges in the $L_2$-norm with the optimal order $\mathcal{O}(τ^2 + h^2)$ with time step $τ$ and mesh size $h$. Secondly, three fast Krylov subspace solvers with suitable circulant preconditioners are designed to solve the discretized linear systems with the Toeplitz matrix. In each iterative step, these methods reduce the memory requirement of the resulting linear equations from $\mathcal{O}(N^2)$ to $\mathcal{O}(N)$ and the computational complexity from $\mathcal{O}(N^3)$ to $\mathcal{O}(N \log N)$, where $N$ is the number of grid nodes. Finally, numerical experiments are carried out to demonstrate that these methods are more practical than the traditional direct solvers of the implicit difference methods, in terms of memory requirement and computational cost.

math.NA↗

arXiv2018

Non-local tensor completion for multitemporal remotely sensed images inpainting

Remotely sensed images may contain some missing areas because of poor weather conditions and sensor failure. Information of those areas may play an important role in the interpretation of multitemporal remotely sensed data. The paper aims at reconstructing the missing information by a non-local low-rank tensor completion method (NL-LRTC). First, nonlocal correlations in the spatial domain are taken into account by searching and grouping similar image patches in a large search window. Then low-rankness of the identified 4-order tensor groups is promoted to consider their correlations in spatial, spectral, and temporal domains, while reconstructing the underlying patterns. Experimental results on simulated and real data demonstrate that the proposed method is effective both qualitatively and quantitatively. In addition, the proposed method is computationally efficient compared to other patch based methods such as the recent proposed PM-MTGSR method.

eess.SP↗

arXiv2017

Restarted Hessenberg method for solving shifted nonsymmetric linear systems

It is known that the restarted full orthogonalization method (FOM) outperforms the restarted generalized minimum residual (GMRES) method in several circumstances for solving shifted linear systems when the shifts are handled simultaneously. Many variants of them have been proposed to enhance their performance. We show that another restarted method, the restarted Hessenberg method [M. Heyouni, Méthode de Hessenberg Généralisée et Applications, Ph.D. Thesis, Université des Sciences et Technologies de Lille, France, 1996] based on Hessenberg procedure, can effectively be employed, which can provide accelerating convergence rate with respect to the number of restarts. Theoretical analysis shows that the new residual of shifted restarted Hessenberg method is still collinear with each other. In these cases where the proposed algorithm needs less enough CPU time elapsed to converge than the earlier established restarted shifted FOM, weighted restarted shifted FOM, and some other popular shifted iterative solvers based on the short-term vector recurrence, as shown via extensive numerical experiments involving the recent popular applications of handling the time fractional differential equations.

math.NA↗

arXiv2016

Fast iterative method with a second order implicit difference scheme for time-space fractional convection-diffusion equations

In this paper we want to propose practical numerical methods to solve a class of initial-boundary problem of time-space fractional convection-diffusion equations (TSFCDEs). To start with, an implicit difference method based on two-sided weighted shifted Grünwald formulae is proposed with a discussion of the stability and convergence. We construct an implicit difference scheme (IDS) and show that it converges with second order accuracy in both time and space. Then, we develop fast solution methods for handling the resulting system of linear equation with the Toeplitz matrix. The fast Krylov subspace solvers with suitable circulant preconditioners are designed to deal with the resulting Toeplitz linear systems. Each time level of these methods reduces the memory requirement of the proposed implicit difference scheme from $\mathcal{O}(N^2)$ to $\mathcal{O}(N)$ and the computational complexity from $O(N^3)$ to $O(N\log N)$ in each iterative step, where $N$ is the number of grid nodes. Extensive numerical example runs show the utility of these methods over the traditional direct solvers of the implicit difference methods, in terms of computational cost and memory requirements.

math.NA↗

arXiv2016

Block variants of the COCG and COCR methods for solving complex symmetric linear systems with multiple right-hand sides

In the present study, we establish two new block variants of the Conjugate Orthogonal Conjugate Gradient (COCG) and the Conjugate A-Orthogonal Conjugate Residual (COCR) Krylov subspace methods for solving complex symmetric linear systems with multiple right hand sides. The proposed Block iterative solvers can fully exploit the complex symmetry property of coefficient matrix of the linear system. We report on extensive numerical experiments to show the favourable convergence properties of our newly developed Block algorithms for solving realistic electromagnetic simulations.

math.NA↗

arXiv2015

Regularization preconditioners for frame-based image deblurring with reduced boundary artifacts

Thresholding iterative methods are recently successfully applied to image deblurring problems. In this paper, we investigate the modified linearized Bregman algorithm (MLBA) used in image deblurring problems, with a proper treatment of the boundary artifacts. We consider two standard approaches: the imposition of boundary conditions and the use of the rectangular blurring matrix. The fast convergence of the MLBA depends on a regularizing preconditioner that could be computationally expensive and hence it is usually chosen as a block circulant circulant block (BCCB) matrix, diagonalized by discrete Fourier transform. We show that the standard approach based on the BCCB preconditioner may provide low quality restored images and we propose different preconditioning strategies, that improve the quality of the restoration and save some computational cost at the same time. Motivated by a recent nonstationary preconditioned iteration, we propose a new algorithm that combines such method with the MLBA.We prove that it is a regularizing and convergent method. A variant with a stationary preconditioner is also considered. Finally, a large number of numerical experiments shows that our methods provide accurate and fast restorations, when compared with the state of the art.

math.NA↗

arXiv2015

Single image super-resolution by approximated Heaviside functions

Image super-resolution is a process to enhance image resolution. It is widely used in medical imaging, satellite imaging, target recognition, etc. In this paper, we conduct continuous modeling and assume that the unknown image intensity function is defined on a continuous domain and belongs to a space with a redundant basis. We propose a new iterative model for single image super-resolution based on an observation: an image is consisted of smooth components and non-smooth components, and we use two classes of approximated Heaviside functions (AHFs) to represent them respectively. Due to sparsity of the non-smooth components, a $L_{1}$ model is employed. In addition, we apply the proposed iterative model to image patches to reduce computation and storage. Comparisons with some existing competitive methods show the effectiveness of the proposed method.

cs.CV↗

arXiv2014

Solving the collective-risk social dilemma with risky assets in well-mixed and structured populations

In the collective-risk social dilemma, players lose their personal endowments if contributions to the common pool are too small. This fact alone, however, does not always deter selfish individuals from defecting. The temptations to free-ride on the prosocial efforts of others are strong because we are hardwired to maximize our own fitness regardless of the consequences this might have for the public good. Here we show that the addition of risky assets to the personal endowments, both of which are lost if the collective target is not reached, can contribute to solving the collective-risk social dilemma. In infinite well-mixed populations risky assets introduce new stable and unstable mixed steady states, whereby the stable mixed steady state converges to full cooperation as either the risk of collective failure or the amount of risky assets increases. Similarly, in finite well-mixed populations the introduction of risky assets enforces configurations where cooperative behavior thrives. In structured populations cooperation is promoted as well, but the distribution of assets amongst the groups is crucial. Surprisingly, we find that the completely rational allocation of assets only to the most successful groups is not optimal, and this regardless of whether the risk of collective failure is high or low. Instead, in low-risk situations bounded rational allocation of assets works best, while in high-risk situations the simplest uniform distribution of assets among all the groups is optimal. These results indicate that prosocial behavior depends sensitively on the potential losses individuals are likely to endure if they fail to cooperate.

physics.soc-ph↗

arXiv2014

From Sylvester's determinant identity to Cramer's rule

The object of this paper is to introduce a new and fascinating method of solving large linear equations, based on Cramer's rule or Gaussian elimination but employing Sylvester's determinant identity in its computation process. In addition, a scheme suitable for parallel computing is presented for this kind of generalized Chiò's determinant condensation processes, which makes this new method have a property of natural parallelism. Finally, some numerical experiments also confirm our theoretical analysis.

math.NA↗

arXiv2014

New explicit thresholding/shrinkage formulas for one class of regularization problems with overlapping group sparsity and their applications

The least-square regression problems or inverse problems have been widely studied in many fields such as compressive sensing, signal processing, and image processing. To solve this kind of ill-posed problems, a regularization term (i.e., regularizer) should be introduced, under the assumption that the solutions have some specific properties, such as sparsity and group sparsity. Widely used regularizers include the $\ell_1$ norm, total variation (TV) semi-norm, and so on. Recently, a new regularization term with overlapping group sparsity has been considered. Majorization minimization iteration method or variable duplication methods are often applied to solve them. However, there have been no direct methods for solve the relevant problems because of the difficulty of overlapping. In this paper, we proposed new explicit shrinkage formulas for one class of these relevant problems, whose regularization terms have translation invariant overlapping groups. Moreover, we apply our results in TV deblurring and denoising with overlapping group sparsity. We use alternating direction method of multipliers to iterate solve it. Numerical results also verify the validity and effectiveness of our new explicit shrinkage formulas.

math.NA↗

arXiv2013

Total variation with overlapping group sparsity for image deblurring under impulse noise

The total variation (TV) regularization method is an effective method for image deblurring in preserving edges. However, the TV based solutions usually have some staircase effects. In this paper, in order to alleviate the staircase effect, we propose a new model for restoring blurred images with impulse noise. The model consists of an $\ell_1$-fidelity term and a TV with overlapping group sparsity (OGS) regularization term. Moreover, we impose a box constraint to the proposed model for getting more accurate solutions. An efficient and effective algorithm is proposed to solve the model under the framework of the alternating direction method of multipliers (ADMM). We use an inner loop which is nested inside the majorization minimization (MM) iteration for the subproblem of the proposed method. Compared with other methods, numerical results illustrate that the proposed method, can significantly improve the restoration quality, both in avoiding staircase effects and in terms of peak signal-to-noise ratio (PSNR) and relative error (ReE).

math.NA↗

arXiv2013

Image Restoration using Total Variation with Overlapping Group Sparsity

Image restoration is one of the most fundamental issues in imaging science. Total variation (TV) regularization is widely used in image restoration problems for its capability to preserve edges. In the literature, however, it is also well known for producing staircase-like artifacts. Usually, the high-order total variation (HTV) regularizer is an good option except its over-smoothing property. In this work, we study a minimization problem where the objective includes an usual $l_2$ data-fidelity term and an overlapping group sparsity total variation regularizer which can avoid staircase effect and allow edges preserving in the restored image. We also proposed a fast algorithm for solving the corresponding minimization problem and compare our method with the state-of-the-art TV based methods and HTV based method. The numerical experiments illustrate the efficiency and effectiveness of the proposed method in terms of PSNR, relative error and computing time.

cs.CV↗