arXiv subjects

Mingjie Shao

Publications and source records attributed to Mingjie Shao.

34 records · Page 2Linked to original sources

arXiv2024

Extending Whisper with prompt tuning to target-speaker ASR

Target-speaker automatic speech recognition (ASR) aims to transcribe the desired speech of a target speaker from multi-talker overlapped utterances. Most of the existing target-speaker ASR (TS-ASR) methods involve either training from scratch or fully fine-tuning a pre-trained model, leading to significant training costs and becoming inapplicable to large foundation models. This work leverages prompt tuning, a parameter-efficient fine-tuning approach, to extend Whisper, a large-scale single-talker ASR model, to TS-ASR. Variants of prompt tuning approaches along with their configurations are explored and optimized for TS-ASR.Experimental results show that prompt tuning can achieve performance comparable to state-of-the-art full training approaches while only requiring about 1\% of task-specific model parameters. Notably, the original Whisper's features, such as inverse text normalization and timestamp tagging, are retained in target-speaker ASR, keeping the generated transcriptions natural and informative.

cs.CL↗

arXiv2023

Efficient CI-Based One-Bit Precoding for Multiuser Downlink Massive MIMO Systems with PSK Modulation

In this paper, we consider the one-bit precoding problem for the multiuser downlink massive multiple-input multiple-output (MIMO) system with phase shift keying (PSK) modulation. We focus on the celebrated constructive interference (CI)-based problem formulation. We first establish the NP-hardness of the problem (even in the single-user case), which reveals the intrinsic difficulty of globally solving the problem. Then, we propose a novel negative $\ell_1$ penalty model for the considered problem, which penalizes the one-bit constraint into the objective by a negative $\ell_1$-norm term, and show the equivalence between (global and local) solutions of the original problem and the penalty problem when the penalty parameter is sufficiently large. We further transform the penalty model into an equivalent min-max problem and propose an efficient alternating proximal/projection gradient descent ascent (APGDA) algorithm for solving it, which performs a proximal gradient decent over one block of variables and a projection gradient ascent over the other block of variables alternately. The APGDA algorithm enjoys a low per-iteration complexity and is guaranteed to converge to a stationary point of the min-max problem and a local minimizer of the penalty problem. To further reduce the computational cost, we also propose a low-complexity implementation of the APGDA algorithm, where the values of the variables will be fixed in later iterations once they satisfy the one-bit constraint. Numerical results show that, compared to the state-of-the-art CI-based algorithms, both of the proposed algorithms generally achieve better bit-error-rate (BER) performance with lower computational cost.

cs.IT↗

arXiv2023

A Spatial Sigma-Delta Approach to Mitigation of Power Amplifier Distortions in Massive MIMO Downlink

In massive multiple-input multiple-output (MIMO) downlink systems, the physical implementation of the base stations (BSs) requires the use of cheap and power-efficient power amplifiers (PAs) to avoid high hardware cost and high power consumption. However, such PAs usually have limited linear amplification ranges. Nonlinear distortions arising from operation beyond the linear amplification ranges can significantly degrade system performance. Existing approaches to handle the nonlinear distortions, such as digital predistortion (DPD), typically require accurate knowledge, or acquisition, of the PA transfer function. In this paper, we present a new concept for mitigation of the PA distortions. Assuming a uniform linear array (ULA) at the BS, the idea is to apply a Sigma-Delta ($ΣΔ$) modulator to spatially shape the PA distortions to the high-angle region. By having the system operating in the low-angle region, the received signals are less affected by the PA distortions. To demonstrate the potential of this spatial $ΣΔ$ approach, we study the application of our approach to the multi-user MIMO-orthogonal frequency division modulation (OFDM) downlink scenario. A symbol-level precoding (SLP) scheme and a zero-forcing (ZF) precoding scheme, with the new design requirement by the spatial $ΣΔ$ approach being taken into account, are developed. Numerical simulations are performed to show the effectiveness of the developed $ΣΔ$ precoding schemes.

eess.SP↗

arXiv2023

An Efficient Global Algorithm for One-Bit Maximum-Likelihood MIMO Detection

There has been growing interest in implementing massive MIMO systems by one-bit analog-to-digital converters (ADCs), which have the benefit of reducing the power consumption and hardware complexity. One-bit MIMO detection arises in such a scenario. It aims to detect the multiuser signals from the one-bit quantized received signals in an uplink channel. In this paper, we consider one-bit maximum-likelihood (ML) MIMO detection in massive MIMO systems, which amounts to solving a large-scale nonlinear integer programming problem. We propose an efficient global algorithm for solving the one-bit ML MIMO detection problem. We first reformulate the problem as a mixed integer linear programming (MILP) problem that has a massive number of linear constraints. The massive number of linear constraints raises computational challenges. To solve the MILP problem efficiently, we custom build a light-weight branch-and-bound tree search algorithm, where the linear constraints are incrementally added during the tree search procedure and only small-size linear programming subproblems need to be solved at each iteration. We provide simulation results to demonstrate the efficiency of the proposed method.

cs.IT↗

arXiv2022

Covariance Regularization for Probabilistic Linear Discriminant Analysis

Probabilistic linear discriminant analysis (PLDA) is commonly used in speaker verification systems to score the similarity of speaker embeddings. Recent studies improved the performance of PLDA in domain-matched conditions by diagonalizing its covariance. We suspect such brutal pruning approach could eliminate its capacity in modeling dimension correlation of speaker embeddings, leading to inadequate performance with domain adaptation. This paper explores two alternative covariance regularization approaches, namely, interpolated PLDA and sparse PLDA, to tackle the problem. The interpolated PLDA incorporates the prior knowledge from cosine scoring to interpolate the covariance of PLDA. The sparse PLDA introduces a sparsity penalty to update the covariance. Experimental results demonstrate that both approaches outperform diagonal regularization noticeably with domain adaptation. In addition, in-domain data can be significantly reduced when training sparse PLDA for domain adaptation.

cs.SD↗

arXiv2022

SISAL Revisited

Simplex identification via split augmented Lagrangian (SISAL) is a popularly-used algorithm in blind unmixing of hyperspectral images. Developed by José M. Bioucas-Dias in 2009, the algorithm is fundamentally relevant to tackling simplex-structured matrix factorization, and by extension, non-negative matrix factorization, which have many applications under their umbrellas. In this article, we revisit SISAL and provide new meanings to this quintessential algorithm. The formulation of SISAL was motivated from a geometric perspective, with no noise. We show that SISAL can be explained as an approximation scheme from a probabilistic simplex component analysis framework, which is statistical and is principally more powerful in accommodating the presence of noise. The algorithm for SISAL was designed based on a successive convex approximation method, with a focus on practical utility. It was not known, by analyses, whether the SISAL algorithm has any kind of guarantee of convergence to a stationary point. By establishing associations between the SISAL algorithm and a line-search-based proximal gradient method, we confirm that SISAL can indeed guarantee convergence to a stationary point. Our re-explanation of SISAL also reveals new formulations and algorithms. The performance of these new possibilities is demonstrated by numerical experiments.

eess.SP↗

arXiv2022

Symbol-Level Precoding Through the Lens of Zero Forcing and Vector Perturbation

Symbol-level precoding (SLP) has recently emerged as a new paradigm for physical-layer transmit precoding in multiuser multi-input-multi-output (MIMO) channels. It exploits the underlying symbol constellation structure, which the conventional paradigm of linear precoding does not, to enhance symbol-level performance such as symbol error probability (SEP). It also allows the precoder to take a more general form than linear precoding. This paper aims to better understand the relationships between SLP and linear precoding, subsequent design implications, and further connections beyond the existing SLP scope. Focused on the quadrature amplitude modulation (QAM) constellations, our study is built on a basic signal observation, namely, that SLP can be equivalently represented by a zero-forcing (ZF) linear precoding scheme augmented with some appropriately chosen symbol-dependent perturbation terms, and that some extended form of SLP is equivalent to a vector perturbation (VP) nonlinear precoding scheme augmented with the above-noted perturbation terms. We examine how insights arising from this perturbed ZF and VP interpretations can be leveraged to i) substantially simplify the optimization of certain SLP design criteria, namely, total or peak power minimization subject to SEP quality guarantees; and ii) draw connections with some existing SLP designs. We also touch on the analysis side by showing that, under the total power minimization criterion, the basic ZF scheme is a near-optimal SLP scheme when the QAM order is very high -- which gives a vital implication that SLP is more useful for lower-order QAM cases. Numerical results further indicate the merits and limitations of the different SLP designs derived from the perturbed ZF and VP interpretations.

eess.SP↗

arXiv2021

Divide and Conquer: One-Bit MIMO-OFDM Detection by Inexact Expectation Maximization

Adopting one-bit analog-to-digital convertors (ADCs) for massive multiple-input multiple-output (MIMO) implementations has great potential in reducing the hardware cost and power consumption. However, distortions caused by quantization raise great challenges. In MIMO orthogonal frequency-division modulation (OFDM) detection, coarse quantization renders the orthogonal separation among subcarriers inapplicable, forcing us to deal with a problem that has a very large problem size. In this paper we study the expectation-maximization (EM) approach for one-bit MIMO-OFDM detection. The idea is to iteratively decouple the MIMO-OFDM detection problem among subcarriers. Using the perspective of block coordinate descent, we describe inexact variants of the classical EM method for providing more flexible and computationally efficient designs. Simulation results are provided to illustrate the potential of the divide-and-conquer strategy enabled by EM.

cs.IT↗

arXiv2021

Binary MIMO Detection via Homotopy Optimization and Its Deep Adaptation

In this paper we consider maximum-likelihood (ML) MIMO detection under one-bit quantized observations and binary symbol constellations. This problem is motivated by the recent interest in adopting coarse quantization in massive MIMO systems--as an effective way to scale down the hardware complexity and energy consumption. Classical MIMO detection techniques consider unquantized observations, and many of them are not applicable to the one-bit MIMO case. We develop a new non-convex optimization algorithm for the one-bit ML MIMO detection problem, using a strategy called homotopy optimization. The idea is to transform the ML problem into a sequence of approximate problems, from easy (convex) to hard (close to ML), and with each problem being a gradual modification of its previous. Then, our attempt is to iteratively trace the solution path of these approximate problems. This homotopy algorithm is well suited to the application of deep unfolding, a recently popular approach for turning certain model-based algorithms into data-driven, and performance enhanced, ones. While our initial focus is on one-bit MIMO detection, the proposed technique also applies naturally to the classical unquantized MIMO detection. We performed extensive simulations and show that the proposed homotopy algorithms, both non-deep and deep, have satisfactory bit-error probability performance compared to many state-of-the-art algorithms. Also, the deep homotopy algorithm has attractively low computational complexity.

cs.IT↗

arXiv2020

One-Bit Symbol-Level Precoding for MU-MISO Downlink with Intelligent Reflecting Surface

This paper considers symbol-level precoding (SLP) for multiuser multi-input single-output (MISO) downlink transmission with the aid of intelligent reflecting surface (IRS). Specifically, by assuming one-bit transmitted signals at the base station (BS), which arises from the use of low-resolution DACs in the regime of massive transmit antennas, a joint design of one-bit SLP at the BS and the phase shifts at the IRS is proposed with a goal of minimizing the worst-case symbol error probability (SEP) of the users under the PSK modulation. This joint design problem is essentially a mixed integer nonlinear program (MINLP). To tackle it, we alternately optimize the one-bit signal and the phase shifts. For the former, a dual of the relaxed one-bit SLP problem is solved by the mirror descent (MD) method with the maximum block improvement (MBI) heuristics. For the latter, the accelerated projected gradient (APG) method is employed to optimize the phases. Numerical results demonstrate that the proposed joint design can attain better SEP performance than the conventional linear precoding and one-bit SLP.

eess.SP↗

arXiv2020

Minimum Symbol-Error Probability Symbol-Level Precoding with Intelligent Reflecting Surface

Recently, the use of intelligent reflecting surface (IRS) has gained considerable attention in wireless communications. By intelligently adjusting the passive reflection angle, IRS is able to assist the base station (BS) to extend the coverage and improve spectral efficiency. This paper considers a joint symbol-level precoding (SLP) and IRS reflecting design to minimize the symbol-error probability (SEP) of the intended users in an IRS-aided multiuser MISO downlink. We formulate the SEP minimization problems to pursue uniformly good performance for all users for both QAM and PSK constellations. The resulting problem is non-convex and we resort to alternating minimization to obtain a stationary solution. Simulation results demonstrate that under the aid of IRS our proposed design indeed enhances the bit-error rate performance. In particular, the performance improvement is significant when the number of IRS elements is large.

eess.SP↗

arXiv2019

A Framework for One-Bit and Constant-Envelope Precoding over Multiuser Massive MISO Channels

Consider the following problem: A multi-antenna base station (BS) sends multiple symbol streams to multiple single-antenna users via precoding. However, unlike conventional multiuser precoding, the transmitted signals are subjected to binary, unit-modulus, or even discrete unit-modulus constraints. Such constraints arise in the one-bit and constant-envelope (CE) massive MIMO scenarios, wherein high-resolution digital-to-analog converters (DACs) are replaced by one-bit DACs and phase shifters, respectively, for cutting down hardware cost and energy consumption. Multiuser precoding under one-bit and CE restrictions poses significant design difficulty. In this paper we establish a framework for designing multiuser precoding under the one-bit, continuous CE and discrete CE scenarios---all within one theme. We first formulate a precoding design that focuses on minimizations of symbol-error probabilities (SEPs), assuming quadrature amplitude modulation (QAM) constellations. We then devise an algorithm for our SEP-based design. The algorithm combines i) a novel penalty method for handling binary, unit-modulus and discrete unit-modulus constraints; and ii) a first-order non-convex optimization recipe custom-built for the design. Specifically, the latter is an inexact majorization-minimization method via accelerated projected gradient, which, as shown by simulations, runs very fast and can handle a large number of decision variables. Simulation results indicate that the proposed design offers significantly better bit-error rate performance than the existing designs.

cs.IT↗

arXiv2019

One-Bit Sigma-Delta MIMO Precoding

Coarsely quantized MIMO signalling methods have gained popularity in the recent developments of massive MIMO as they open up opportunities for massive MIMO implementation using cheap and power-efficient radio-frequency front-ends. This paper presents a new one-bit MIMO precoding approach using spatial Sigma-Delta ($ΣΔ$) modulation. In previous one-bit MIMO precoding research, one mainly focuses on using optimization to tackle the difficult binary signal optimization problem that arises from the precoding design. Our approach attempts a different route. Assuming angular MIMO channels, we apply $ΣΔ$ modulation---a classical concept in analog-to-digital conversion of temporal signals---in space. The resulting $ΣΔ$ precoding approach has two main advantages: First, we no longer need to deal with binary optimization in $ΣΔ$ precoding design. Particularly, the binary signal restriction is replaced by peak signal amplitude constraints. Second, the impact of the quantization error can be well controlled via modulator design and under appropriate operating conditions. Through symbol error probability analysis, we reveal that the very large number of antennas in massive MIMO provides favorable operating conditions for $ΣΔ$ precoding. In addition, we develop a new $ΣΔ$ modulation architecture that is capable of adapting the channel to achieve nearly zero quantization error for a targeted user. Furthermore, we consider multi-user $ΣΔ$ precoding using the zero-forcing and symbol-level precoding schemes. These two $ΣΔ$ precoding schemes perform considerably better than their direct one-bit quantized counterparts, as simulation results show.

cs.IT↗

arXiv2018

Multiuser One-Bit Massive MIMO Precoding Under MPSK Signaling

Most recently, there has been a flurry of research activities on studying how massive MIMO precoding should be designed when the digital-to-analog conversion at the transmitter side is operated by cheap one-bit digital-to-analog converters (DACs). Such research is motivated by the desire to substantially cut down the hardware cost and power consumption of the radio-frequency chain, which is unaffordable in massive MIMO if high-resolution DACs are still used. One-bit MIMO precoding design problems are much harder to solve than their high-resolution DAC counterparts. In our previous work, we developed a minimum symbol-error probability (SEP) design for one-bit precoding under the multiuser MISO downlink scenario and under quadrature amplitude modulation signaling. Leveraging on the previous work, this work shows how the minimum SEP design is applied to M-ary phase shift keying (MPSK) signaling. Simulation results show that our minimum SEP design delivers significantly better bit-error rate (BER) performance than the other designs for higher-order PSK such as 8-PSK and 16-PSK. As a minor, but useful, side contribution, we also tackle an MPSK SEP characterization problem which was only intuitively treated in the prior arts.

cs.IT↗

arXiv2018

Minimum Symbol Error Rate-Based Constant Envelope Precoding for Multiuser Massive MISO Downlink

This paper considers the problem of constant envelope (CE) precoder designs for multiuser massive MISO downlink channels. The use of CE signals allows one to employ low-cost radio frequency chains and thereby facilitates the implementation of massive MIMO. However, the subsequent CE precoder designs are usually challenging owing to the non-convex CE constraints. The existing CE precoder designs consider minimization of some measures on the distortion levels of the received symbols, and they usually aim at improving the symbol-error rate (SER) performances. In this paper we formulate a minimum SER-based design for CE precoding. The design formulation is non-convex and we propose two low-complexity first-order algorithms using gradient projection. Curiously, our simulation results show that the proposed designs can achieve bit-error rate performance close to that of zero-forcing beamforming without CE signaling restrictions.

cs.IT↗

arXiv2018

One-bit massive MIMO precoding via a minimum symbol-error probability design

Massive multiple-input multiple-output (MIMO) has the potential to substantially improve the spectral efficiency, robustness and coverage of mobile networks. However, such potential is limited by hardware cost and power consumption associated with a large number of RF chains. Recently, one-bit quantization is proposed to address this issue by replacing high-resolution digital-to-analog converters (DACs) with one-bit DACs, thereby simplifying the RF chains. Despite low system cost, advanced signal processing techniques are needed to compensate for quantization distortions caused by low resolution DACs. In this paper, a symbol-error-rate (SER)-based one-bit precoding scheme is proposed to minimize the detection error probability of all users under one-bit constraints. The problem is recast as a continuous optimization problem with a biconvex objective. By applying the block coordinate descent (BCD) method and the FISTA method, we develop an efficient iterative algorithm to obtain a one-bit precoding solution. Simulation results demonstrate its superiority over state-of-the-art algorithms in terms of bit error rate performance in high-order modulation cases.

cs.IT↗