arXiv subjects

Haiquan Zhao

Publications and source records attributed to Haiquan Zhao.

At least 55 records · Page 3Linked to original sources

arXiv2022

Robust Multitask Diffusion Normalized M-estimate Subband Adaptive Filtering Algorithm Over Adaptive Networks

In recent years, the multitask diffusion least mean square (MD-LMS) algorithm has been extensively applied in the distributed parameter estimation and target tracking of multitask network. However, its performance is mainly limited by two aspects, i.e, the correlated input signal and impulsive noise interference. To overcome these two limitations simultaneously, this paper firstly introduces the subband adaptive filter (SAF) into the multitask network. Then, a robust multitask diffusion normalized M-estimate subband adaptive filtering (MD-NMSAF) algorithm is proposed by solving the modified Huber function based global network optimization problem in a distributed manner, which endows the multitask network strong decorrelation ability for correlated inputs and robustness to impulsive noise interference, and accelerates the convergence of the algorithm significantly. Compared with the robust multitask diffusion affine projection M-estimate (MD-APM) algorithm, the computational complexity of the proposed MD-NMSAF is greatly reduced. In addition, the stability condition, the analytical expressions of the theoretical transient and steady-state network mean square deviation (MSD) of the MD-NMSAF are also provided and verified through computer simulations. Simulation results under different input signals and impulsive noise environment fully demonstrate the performance advantages of the MD-NMSAF algorithm over some other competitors in terms of steady-state accuracy and tracking speed.

eess.SP↗

arXiv2019

Mean-Square Performance Analysis of Noise-Robust Normalized Subband Adaptive Filter Algorithm

This paper studies the statistical models of the noise-robust normalized subband adaptive filter (NR-NSAF) algorithm in the mean and mean square deviation senses involving transient-state and steady-state behavior by resorting to the method of the vectorization operation and the Kronecker product. The analysis method does not require the Gaussian input signal. Moreover, the proposed analysis removes the paraunitary assumption imposed on the analysis filter banks as in the existing analyses of subband adaptive algorithms. Simulation results in various conditions demonstrate the effectiveness of our theoretical analysis. For a special form of the algorithm, the proposed steady-state expression is also better accurate than the previous analysis.

eess.SP↗

arXiv2018

Diffusion Leaky Zero Attracting Least Mean Square Algorithm and Its Performance Analysis

Recently, the leaky diffusion least-mean-square (DLMS) algorithm has obtained much attention because of its good performance for high input eigenvalue spread and low signal-to-noise ratio (SNR). However, the leaky DLMS algorithm may suffer from performance deterioration in the sparse system. To overcome this drawback, the leaky zero attracting DLMS (LZA-DLMS) algorithm is developed in this paper, which adds an l1-norm penalty to the cost function to exploit the property of sparse system. The leaky reweighted zero attracting DLMS (LRZA-DLMS) algorithm is also put forward, which can improve the estimation performance in the presence of time-varying sparsity. Instead of using the l1-norm penalty, in the reweighted version, a log-sum function is employed as the substitution. Based on the weight error variance relation and several common assumptions, we analyze the transient behavior of our findings and determine the stability bound of the step-size. Moreover, we implement the steady state theoretical analysis for the proposed algorithms. Simulations in the context of distributed network system identification illustrate that the proposed schemes outperform various existing algorithms and validate the accuracy of the theoretical results.

eess.SP↗

arXiv2018

Set-membership NLMS algorithm based on bias-compensated and regression noise variance estimation for noisy inputs

The bias-compensated set-membership normalised LMS (BCSMNLMS) algorithm is proposed based on the concept of set-membership filtering, which incorporates the bias-compensation technique to mitigate the negative effect of noisy inputs. Moreover, an efficient regression noise variance estimation method is developed by taking the iterative-shrinkage method. Simulations in the context of system identification demonstrate that the misalignment of the proposed BCSM-NLMS algorithm is low for noisy inputs.

eess.SY↗

arXiv2018

Variable-mixing parameter quantized kernel robust mixed-norm algorithms for combating impulsive interference

Although the kernel robust mixed-norm (KRMN) algorithm outperforms the kernel least mean square (KLMS) algorithm in impulsive noise, it still has two major problems as follows: (1) The choice of the mixing parameter in the KRMN is crucial to obtain satisfactory performance. (2) The structure of the KRMN algorithm grows linearly as the iteration goes on, thus it has high computational complexity and memory requirements. To solve the parameter selection problem, two variable-mixing parameter KRMN (VPKRMN) algorithms are developed in this paper. Moreover, a sparsification algorithm, quantized VPKRMN (QVPKRMN) algorithm is introduced for nonlinear system identification with impulsive interferences. The energy conservation relation (ECR) and convergence property of the QVPKRMN algorithm are analyzed. Simulation results in the context of nonlinear system identification under impulsive interference demonstrate the superior performance of the proposed VPKRMN and QVPKRMN algorithms as compared with the existing algorithms.

eess.SY↗

arXiv2017

Robustness of Maximum Correntropy Estimation Against Large Outliers

The maximum correntropy criterion (MCC) has recently been successfully applied in robust regression, classification and adaptive filtering, where the correntropy is maximized instead of minimizing the well-known mean square error (MSE) to improve the robustness with respect to outliers (or impulsive noises). Considerable efforts have been devoted to develop various robust adaptive algorithms under MCC, but so far little insight has been gained as to how the optimal solution will be affected by outliers. In this work, we study this problem in the context of parameter estimation for a simple linear errors-in-variables (EIV) model where all variables are scalar. Under certain conditions, we derive an upper bound on the absolute value of the estimation error and show that the optimal solution under MCC can be very close to the true value of the unknown parameter even with outliers (whose values can be arbitrarily large) in both input and output variables. Illustrative examples are presented to verify and clarify the theory.

stat.ML↗

arXiv2017

KLMAT: A Kernel Least Mean Absolute Third Algorithm

In this paper, a kernel least mean absolute third (KLMAT) algorithm is developed for adaptive prediction. Combining the benefits of the kernel method and the least mean absolute third (LMAT) algorithm, the proposed KLMAT algorithm performs robustly against noise with different probability densities. To further enhance the convergence rate of the KLMAT algorithm, a variable step-size version (VSS-KLMAT algorithm) is proposed based on a Lorentzian function. Moreover, the stability and convergence property of the proposed algorithms are analyzed. Simulation results in the context of time series prediction demonstrate that the effectiveness of proposed algorithms.

eess.SY↗

arXiv2017

Diffusion leaky LMS algorithm: analysis and implementation

The diffusion least-mean square (dLMS) algorithms have attracted much attention owing to its robustness for distributed estimation problems. However, the performance of such filters may change when they are implemented for suppressing noises from speech signals. To overcome this problem, a diffusion leaky dLMS algorithm is proposed in this work, which is characterized by its numerical stability and small misadjustment for noisy speech signals when the unknown system is a lowpass filter. Finally, two implementations of the leaky dLMS are introduced. It is demonstrated that the leaky dLMS can be effectively introduced into a noise reduction network for speech signals.

eess.SY↗

arXiv2017

Set-membership improved normalized subband adaptive filter algorithms for acoustic echo cancellation

In order to improve the performances of recently-presented improved normalized subband adaptive filter (INSAF) and proportionate INSAF algorithms for highly noisy system, this paper proposes their set-membership versions by exploiting the theory of set-membership filtering. Apart from obtaining smaller steady-state error, the proposed algorithms significantly reduce the overall computational complexity. In addition, to further improve the steady-state performance for the algorithms, their smooth variants are developed by using the smoothed absolute subband output errors to update the step sizes. Simulation results in the context of acoustic echo cancellation have demonstrated the superiority of the proposed algorithms.

eess.SY↗

arXiv2017

A Class of Diffusion Algorithms with Logarithmic Cost over Adaptive Sparse Volterra Network

In this Letter, we present a novel class of diffusion algorithms that can be used to estimate the coefficients of sparse Volterra network (SVN). The development of the algorithms is based on the logarithmic cost and l0-norm constraint. Simulations for Gaussian and impulsive scenarios are conducted to demonstrate the superior performance of the proposed algorithms as compared with the existing algorithms.

eess.SY↗

arXiv2017

Subband adaptive filter trained by differential evolution for channel estimation

The normalized subband adaptive filter (NSAF) is widely accepted as a preeminent adaptive filtering algorithm because of its efficiency under the colored excitation. However, the convergence rate of NSAF is slow. To address this drawback, in this paper, a variant of the NSAF, called the differential evolution (DE)-NSAF (DE-NSAF), is proposed for channel estimation based on DE strategy. It is worth noticing that there are several papers concerning designing DE strategies for adaptive filter. But their signal models are still the single adaptive filter model rather than the fullband adaptive filter model considered in this paper. Thus, the problem considered in our work is quite different from those. The proposed DE-NSAF algorithm is based on real-valued manipulations and has fast convergence rate for searching the global solution of optimized weight vector. Moreover, a design step of new algorithm is given in detail. Simulation results demonstrate the improved performance of the proposed DE-NSAF algorithm in terms of the convergence rate.

cs.IT↗

arXiv2017

Adaptive beamforming method based on recursive maximum correntropy in impulsive noise with alpha-stable process

As a well-established adaptation criterion, the maximum correntropy criterion (MCC) has been receiving increasing attention due to its robust against outliers. In this paper, a new complex recursive maximum correntropy (CRMC) algorithm without any priori information on the noise characteristics, is proposed under the MCC. The proposed algorithm is useful for adaptive beamforming, when the desired signal is contaminated by the impulsive noises. Moreover, the analysis of convergence property of the CRMC algorithm is performed. The results obtained from simulation study establish the effectiveness of this new beamformer.

eess.SY↗

arXiv2016

A joint-optimization NSAF algorithm based on the first-order Markov model

Recently, the normalized subband adaptive filter (NSAF) algorithm has attracted much attention for handling the colored input signals. Based on the first-order Markov model of the optimal tap-weight vector, this paper provides a convergence analysis of the standard NSAF. Following the analysis, both the step size and the regularization parameter in the NSAF are jointly optimized in such a way that minimizes the mean square deviation. The resulting joint-optimization step size and regularization parameter (JOSR-NSAF) algorithm achieves a good tradeoff between fast convergence rate and low steady-state error. Simulation results in the context of acoustic echo cancellation demonstrate good features of the proposed algorithm.

eess.SY↗

arXiv2016

Kernel Risk-Sensitive Loss: Definition, Properties and Application to Robust Adaptive Filtering

Nonlinear similarity measures defined in kernel space, such as correntropy, can extract higher-order statistics of data and offer potentially significant performance improvement over their linear counterparts especially in non-Gaussian signal processing and machine learning. In this work, we propose a new similarity measure in kernel space, called the kernel risk-sensitive loss (KRSL), and provide some important properties. We apply the KRSL to adaptive filtering and investigate the robustness, and then develop the MKRSL algorithm and analyze the mean square convergence performance. Compared with correntropy, the KRSL can offer a more efficient performance surface, thereby enabling a gradient based method to achieve faster convergence speed and higher accuracy while still maintaining the robustness to outliers. Theoretical analysis results and superior performance of the new algorithm are confirmed by simulation.

stat.ML↗

arXiv2016

A Band-independent Variable Step Size Proportionate Normalized Subband Adaptive Filter Algorithm

Proportionate-type normalized suband adaptive filter (PNSAF-type) algorithms are very attractive choices for echo cancellation. To further obtain both fast convergence rate and low steady-state error, in this paper, a variable step size (VSS) version of the presented improved PNSAF (IPNSAF) algorithm is proposed by minimizing the square of the noise-free a posterior subband error signals. A noniterative shrinkage method is used to recover the noise-free a priori subband error signals from the noisy subband error signals. Significantly, the proposed VSS strategy can be applied to any other PNSAF-type algorithm, since it is independent of the proportionate principles. Simulation results in the context of acoustic echo cancellation have demonstrated the effectiveness of the proposed method.

eess.SY↗

arXiv2016

Two improved normalized subband adaptive filter algorithms with good robustness against impulsive interferences

To improve the robustness of subband adaptive filter (SAF) against impulsive interferences, we propose two modified SAF algorithms with an individual scale function for each subband, which are derived by maximizing correntropy-based cost function and minimizing logarithm-based cost function, respectively, called MCC-SAF and LC-SAF. Whenever the impulsive interference happens, the subband scale functions can sharply drop the step size, which eliminate the influence of outliers on the tap-weight vector update. Therefore, the proposed algorithms are robust against impulsive interferences, and exhibit the faster convergence rate and better tracking capability than the sign SAF (SSAF) algorithm. Besides, in impulse-free interference environments, the proposed algorithms achieve similar convergence performance as the normalized SAF (NSAF) algorithm. Simulation results have demonstrated the performance of our proposed algorithms.

cs.OH↗

arXiv2016

Diffusion Maximum Correntropy Criterion Algorithms for Robust Distributed Estimation

Robust diffusion adaptive estimation algorithms based on the maximum correntropy criterion (MCC), including adaptation to combination MCC and combination to adaptation MCC, are developed to deal with the distributed estimation over network in impulsive (long-tailed) noise environments. The cost functions used in distributed estimation are in general based on the mean square error (MSE) criterion, which is desirable when the measurement noise is Gaussian. In non-Gaussian situations, such as the impulsive-noise case, MCC based methods may achieve much better performance than the MSE methods as they take into account higher order statistics of error distribution. The proposed methods can also outperform the robust diffusion least mean p-power(DLMP) and diffusion minimum error entropy (DMEE) algorithms. The mean and mean square convergence analysis of the new algorithms are also carried out.

stat.ML↗

arXiv2015

A novel normalized sign algorithm for system identification under impulsive noise interference

To overcome the performance degradation of adaptive filtering algorithms in the presence of impulsive noise, a novel normalized sign algorithm (NSA) based on a convex combination strategy, called NSA-NSA, is proposed in this paper. The proposed algorithm is capable of solving the conflicting requirement of fast convergence rate and low steady-state error for an individual NSA filter. To further improve the robustness to impulsive noises, a mixing parameter updating formula based on a sign cost function is derived. Moreover, a tracking weight transfer scheme of coefficients from a fast NSA filter to a slow NSA filter is proposed to speed up the convergence rate. The convergence behavior and performance of the new algorithm are verified by theoretical analysis and simulation studies.

eess.SY↗