SearcharxivSearch

arXiv subjects

Lingjiang Kong

Publications and source records attributed to Lingjiang Kong.

18 recordsLinked to original sources

VidFormer: A novel end-to-end framework fused by 3DCNN and Transformer for Video-based Remote Physiological Measurement

Remote physiological signal measurement based on facial videos, also known as remote photoplethysmography (rPPG), involves predicting changes in facial vascular blood flow from facial videos. While most deep learning-based methods have achieved good results, they often struggle to balance performance across small and large-scale datasets due to the inherent limitations of convolutional neural networks (CNNs) and Transformer. In this paper, we introduce VidFormer, a novel end-to-end framework that integrates 3-Dimension Convolutional Neural Network (3DCNN) and Transformer models for rPPG tasks. Initially, we conduct an analysis of the traditional skin reflection model and subsequently introduce an enhanced model for the reconstruction of rPPG signals. Based on this improved model, VidFormer utilizes 3DCNN and Transformer to extract local and global features from input data, respectively. To enhance the spatiotemporal feature extraction capabilities of VidFormer, we incorporate temporal-spatial attention mechanisms tailored for both 3DCNN and Transformer. Additionally, we design a module to facilitate information exchange and fusion between the 3DCNN and Transformer. Our evaluation on five publicly available datasets demonstrates that VidFormer outperforms current state-of-the-art (SOTA) methods. Finally, we discuss the essential roles of each VidFormer module and examine the effects of ethnicity, makeup, and exercise on its performance.

cs.CV

Subspace-Based Detection in OFDM ISAC Systems under Different Constellations

This paper investigates subspace-based target detection in OFDM integrated sensing and communications (ISAC) systems, considering the impact of various constellations. To meet diverse communication demands, different constellation schemes with varying modulation orders (e.g., PSK, QAM) can be employed, which in turn leads to variations in peak sidelobe levels (PSLs) within the radar functionality. These PSL fluctuations pose a significant challenge in the context of multi-target detection, particularly in scenarios where strong sidelobe masking effects manifest. To tackle this challenge, we have devised a subspace-based approach for a step-by-step target detection process, systematically eliminating interference stemming from detected targets. Simulation results corroborate the effectiveness of the proposed method in achieving consistently high target detection performance under a wide range of constellation options in OFDM ISAC systems.

eess.SP

Maximum Correntropy Value Decomposition for Multi-agent Deep Reinforcemen Learning

We explore value decomposition solutions for multi-agent deep reinforcement learning in the popular paradigm of centralized training with decentralized execution(CTDE). As the recognized best solution to CTDE, Weighted QMIX is cutting-edge on StarCraft Multi-agent Challenge (SMAC), with a weighting scheme implemented on QMIX to place more emphasis on the optimal joint actions. However, the fixed weight requires manual tuning according to the application scenarios, which painfully prevents Weighted QMIX from being used in broader engineering applications. In this paper, we first demonstrate the flaw of Weighted QMIX using an ordinary One-Step Matrix Game (OMG), that no matter how the weight is chosen, Weighted QMIX struggles to deal with non-monotonic value decomposition problems with a large variance of reward distributions. Then we characterize the problem of value decomposition as an Underfitting One-edged Robust Regression problem and make the first attempt to give a solution to the value decomposition problem from the perspective of information-theoretical learning. We introduce the Maximum Correntropy Criterion (MCC) as a cost function to dynamically adapt the weight to eliminate the effects of minimum in reward distributions. We simplify the implementation and propose a new algorithm called MCVD. A preliminary experiment conducted on OMG shows that MCVD could deal with non-monotonic value decomposition problems with a large tolerance of kernel bandwidth selection. Further experiments are carried out on Cooperative-Navigation and multiple SMAC scenarios, where MCVD exhibits unprecedented ease of implementation, broad applicability, and stability.

cs.MA

Distributed multi-view multi-target tracking based on CPHD filtering

This paper addresses distributed multi-target tracking (DMTT) over a network of sensors having different fields-of-view (FoVs). Specifically, a cardinality probability hypothesis density (CPHD) filter is run at each sensor node. Due to the fact that each sensor node has a limited FoV, the commonly adopted fusion methods become unreliable. In fact, the monitored area of multiple sensor nodes consists of several parts that are either exclusive of a single node, i.e. exclusive FoVs (eFoVs) or common to multiple (at least two) nodes, i.e. common FoVs (cFoVs). In this setting, the crucial issue is how to account for this different information sets in the fusion rule. The problem is particularly challenging when the knowledge of the FoVs is unreliable, for example because of the presence of obstacles and target misdetection, or when the FoVs are time-varying. Considering these issues, we propose an effective fusion algorithm for the case of unknown FoVs, where: i) the intensity function is decomposed into multiple sub-intensities/groups by means of a clustering algorithm; ii) the corresponding cardinality distribution is reconstructed by approximating the target random finite set (RFS) as multi-Bernoulli; and iii) fusion is performed in parallel according to either generalized covariance intersection (GCI) or arithmetic average (AA) rule. Simulation experiments are provided to demonstrate the effectiveness of the proposed approach.

eess.SY

Computationally Efficient Distributed Multi-sensor Fusion with Multi-Bernoulli Filter

This paper proposes a computationally efficient algorithm for distributed fusion in a sensor network in which multi-Bernoulli (MB) filters are locally running in every sensor node for multi-target tracking. The generalized Covariance Intersection (GCI) fusion rule is employed to fuse multiple MB random finite set densities. The fused density comprises a set of fusion hypotheses that grow exponentially with the number of Bernoulli components. Thus, GCI fusion with MB filters can become computationally intractable in practical applications that involve tracking of even a moderate number of objects. In order to accelerate the multi-sensor fusion procedure, we derive a theoretically sound approximation to the fused density. The number of fusion hypotheses in the resulting density is significantly smaller than the original fused density. It also has a parallelizable structure that allows multiple clusters of Bernoulli components to be fused independently. By carefully clustering Bernoulli components into isolated clusters using the GCI divergence as the distance metric, we propose an alternative to build exactly the approximated density without exhaustively computing all the fusion hypotheses. The combination of the proposed approximation technique and the fast clustering algorithm can enable a novel and fast GCIMB fusion implementation. Our analysis shows that the proposed fusion method can dramatically reduce the computational and memory requirements with small bounded L1-error. The Gaussian mixture implementation of the proposed method is also presented. In various numerical experiments, including a challenging scenario with up to forty objects, the efficacy of the proposed fusion method is demonstrated.

eess.SY

WRFRFT-based Coherent Detection and Parameter Estimation of Radar Moving Target With Unknown Entry/Departure Time

A moving target may enter a radar coverage area unannounced and leave after an unspecified period, which implies that the target's entry time and departure time are unknown. In the absence of these time information, target detection and parameter estimation (DAPE) will be severely impacted. In this paper, we consider the coherent detection and parameters estimation problem for a radar moving target with unknown entry time and departure time (that is, the time when the target appears-in/leaves the radar detection field is unknown), involving across range cell (ARC) and Doppler spread (DS) effects within the observation period. A new algorithm, known as window Radon Fractional Fourier transform (WRFRFT) is proposed to detect and estimate the target's time parameters (i.e., entry time and departure time) and motion parameters (i.e., range, velocity and acceleration). The observation values of a maneuvering target are first intercepted and extracted by the window function and searching along the motion trajectory. Then these values are fractional Fourier transformed and well accumulated in the WRFRFT domain, where the DAPE of target could be accomplished thereafter. Experiments with simulated and real radar data sets prove its effectiveness.

eess.SP

Distributed Multi-sensor Multi-view Fusion based on Generalized Covariance Intersection

Distributed multi-target tracking (DMTT) is addressed for sensors having different fields of view (FoVs). The proposed approach is based on the idea of fusing the posterior Probability Hypotheses Densities (PHDs) generated by the sensors on the basis of the local measurements. An efficient and robust distributed fusion algorithm combining the Generalized Covariance Intersection (GCI) rule with a suitable Clustering Algorithm (CA) is proposed. The CA is used to decompose each posterior PHD into well-separated components (clusters). For the commonly detected targets, an efficient parallelized GCI fusion strategy is proposed and analyzed in terms of $L_1$ error. For the remaining targets, a suitable compensation strategy is adopted so as to counteract the GCI sensitivity to independent detections while reducing the occurrence of false targets. Detailed implementation steps using a Gaussian Mixture (GM) representation of the PHDs are provided. Numerical experiments clearly confirms the effectiveness of the proposed CA-GCI fusion algorithm.

eess.SY

Robust Distributed Fusion with Labeled Random Finite Sets

This paper considers the problem of the distributed fusion of multi-object posteriors in the labeled random finite set filtering framework, using Generalized Covariance Intersection (GCI) method. Our analysis shows that GCI fusion with labeled multi-object densities strongly relies on label consistencies between local multi-object posteriors at different sensor nodes, and hence suffers from a severe performance degradation when perfect label consistencies are violated. Moreover, we mathematically analyze this phenomenon from the perspective of Principle of Minimum Discrimination Information and the so called yes-object probability. Inspired by the analysis, we propose a novel and general solution for the distributed fusion with labeled multi-object densities that is robust to label inconsistencies between sensors. Specifically, the labeled multi-object posteriors are firstly marginalized to their unlabeled posteriors which are then fused using GCI method. We also introduce a principled method to construct the labeled fused density and produce tracks formally. Based on the developed theoretical framework, we present tractable algorithms for the family of generalized labeled multi-Bernoulli (GLMB) filters including $\delta$-GLMB, marginalized $\delta$-GLMB and labeled multi-Bernoulli filters. The robustness and efficiency of the proposed distributed fusion algorithm are demonstrated in challenging tracking scenarios via numerical experiments.

eess.SY

Antenna Deployment Method for MIMO Radar under the Situation of Multiple Interference Regions

In this paper, considering multiple interference regions simultaneously, an optimal antenna deployment problem for distributed Multi-Input Multi-Output (MIMO) radar is investigated. The optimal antenna deployment problem is solved by proposing an antenna deployment method based on Multi-Objective Particle Swarm Optimization (MOPSO). Firstly, we construct a multi-objective optimization problem for MIMO radar antenna deployment by choosing the interference power densities of different regions as objective functions. Then, to obtain the optimal deployment result without wasting time and computational resources, an iteration convergence criterion based on interval distance is proposed. The iteration convergence criterion can be used to stop the MOPSO optimization process efficiently when the optimal antenna deployment algorithm reaches the desired convergence level. Finally, numerical results are provided to verify the validity of the proposed algorithm.

cs.IT

Optimal Deployment of Multistatic Radar System Using Multi-Objective Particle Swarm Optimization

We consider an optimization deployment problem of multistatic radar system (MSRS). Through the antenna placing and the transmitted power allocating, we optimally deploy the MSRS for two goals: 1) the first one is to improve the coverage ratio of surveillance region; 2) the second goal is to get a even distribution of signal energy in surveillance region. In two typical working modes of MSRS, we formulate the optimization problem by introducing two objective functions according to the two mentioned goals, respectively. Addressing on two main challenges of applying multi-objective particle swarm optimization (MOPSO) in solving the proposed optimization problem, we propose a deployment algorithm based on multiobjective particle swarm optimization with non-dominated relative crowding distance (MOPSO-NRCD). For the challenge of value difference, we propose a novel selection method with a non-dominated relative crowding distance. For the challenge of particle allocation, a multi-swarm structure of MOPSO is also introduced. Finally, simulation results are given out to prove the advantages and validity of the proposed deployment algorithm. It is shown that with same number of employed particles, the proposed MOPSO-NRCD algorithm can achieve better optimization performance than that of traditional multiobjective particle swarm optimization with crowding distance (MOPSO-CD).

cs.IT

Multi-object Tracking for Generic Observation Model Using Labeled Random Finite Sets

This paper presents an exact Bayesian filtering solution for the multi-object tracking problem with the generic observation model. The proposed solution is designed in the labeled random finite set framework, using the product styled representation of labeled multi-object densities, with the standard multi-object transition kernel and no particular simplifying assumptions on the multi-object likelihood. Computationally tractable solutions are also devised by applying a principled approximation involving the replacement of the full multi-object density with a labeled multi-Bernoulli density that minimizes the Kullback-Leibler divergence and preserves the first-order moment. To achieve the fast performance, a dynamic grouping procedure based implementation is presented with a step-by-step algorithm. The performance of the proposed filter and its tractable implementations are verified and compared with the state-of-the-art in numerical experiments.

eess.SY

Distributed Fusion of Labeled Multi-Object Densities Via Label Spaces Matching

In this paper, we address the problem of the distributed multi-target tracking with labeled set filters in the framework of Generalized Covariance Intersection (GCI). Our analyses show that the label space mismatching (LS-DM) phenomenon, which means the same realization drawn from label spaces of different sensors does not have the same implication, is quite common in practical scenarios and may bring serious problems. Our contributions are two-fold. Firstly, we provide a principled mathematical definition of "label spaces matching (LS-DM)" based on information divergence, which is also referred to as LS-M criterion. Then, to handle the LS-DM, we propose a novel two-step distributed fusion algorithm, named as GCI fusion via label spaces matching (GCI-LSM). The first step is to match the label spaces from different sensors. To this end, we build a ranked assignment problem and design a cost function consistent with LS-M criterion to seek the optimal solution of matching correspondence between label spaces of different sensors. The second step is to perform the GCI fusion on the matched label space. We also derive the GCI fusion with generic labeled multi-object (LMO) densities based on LS-M, which is the foundation of labeled distributed fusion algorithms. Simulation results for Gaussian mixture implementation highlight the performance of the proposed GCI-LSM algorithm in two different tracking scenarios.

eess.SY

Principled Random Finite Set Approximations of Labeled Multi-Object Densities

As a fundamental piece of multi-object Bayesian inference, multi-object density has the ability to describe the uncertainty of the number and values of objects, as well as the statistical correlation between objects, thus perfectly matches the behavior of multi-object system. However, it also makes the set integral suffer from the curse of dimensionality and the inherently combinatorial nature of the problem. In this paper, we study the approximations for the universal labeled multi-object (LMO) density and derive several principled approximations including labeled multi-Bernoulli, labeled Poisson and labeled independent identically clustering process based approximations. Also, a detailed analysis on the characteristics (e.g., approximation error and computational complexity) of the proposed approximations is provided. Then some practical suggestions are made for the applications of these approximations based on the preceding analysis and discussion. Finally, an numerical example is given to support our study.

eess.SY

Multi-Sensor Control for Multi-Target Tracking Using Cauchy-Schwarz Divergence

The paper addresses the problem of multi-sensor control for multi-target tracking via labelled random finite sets (RFS) in the sensor network systems. Based on an information theoretic divergence measure, namely Cauchy-Schwarz (CS) divergence which admits a closed form solution for GLMB densities, we propose two novel multi-sensor control approaches in the framework of generalized Covariance Intersection (GCI). The first joint decision making (JDM) method is optimal and can achieve overall good performance, while the second independent decision making (IDM) method is suboptimal as a fast realization with smaller amount of computations. Simulation in challenging situation is presented to verify the effectiveness of the two proposed approaches.

eess.SY

Distributed Fusion with Multi-Bernoulli Filter based on Generalized Covariance Intersection

In this paper, we propose a distributed multi-object tracking algorithm through the use of multi-Bernoulli (MB) filter based on generalized Covariance Intersection (G-CI). Our analyses show that the G-CI fusion with two MB posterior distributions does not admit an accurate closed-form expression. To solve this challenging problem, we firstly approximate the fused posterior as the unlabeled version of $\delta$-generalized labeled multi-Bernoulli ($\delta$-GLMB) distribution, referred to as generalized multi-Bernoulli (GMB) distribution. Then, to allow the subsequent fusion with another multi-Bernoulli posterior distribution, e.g., fusion with a third sensor node in the sensor network, or fusion in the feedback working mode, we further approximate the fused GMB posterior distribution as an MB distribution which matches its first-order statistical moment. The proposed fusion algorithm is implemented using sequential Monte Carlo technique and its performance is highlighted by numerical results.

eess.SY

Distributed Multi-Sensor Fusion Using Generalized Multi-Bernoulli Densities

The paper addresses distributed multi-target tracking in the framework of generalized Covariance Intersection (GCI) over multistatic radar system. The proposed method is based on the unlabeled version of generalized labeled multi-Bernoulli (GLMB) family by discarding the labels, referred as generalized multi-Bernoulli (GMB) family. However, it doesn't permit closed form solution for GCI fusion with GMB family. To solve this challenging problem, firstly, we propose an efficient approximation to the GMB family which preserves both the probability hypothesis density (PHD) and cardinality distribution, named as second-order approximation of GMB (SO-GMB) density. Then, we derive explicit expression for the GCI fusion with SO-GMB density. Finally, we compare the first-order approximation of GMB (FO-GMB) density with SO-GMB density in two scenarios and make a concrete analysis of the advantages of the second-order approximation. Simulation results are presented to verify the proposed approach.

stat.ME

MIMO OFDM Radar IRCI Free Range Reconstruction with Sufficient Cyclic Prefix

In this paper, we propose MIMO OFDM radar with sufficient cyclic prefix (CP), where all OFDM pulses transmitted from different transmitters share the same frequency band and are orthogonal to each other for every subcarrier in the discrete frequency domain. The orthogonality is not affected by time delays from transmitters. Thus, our proposed MIMO OFDM radar has the same range resolution as single transmitter radar and achieves full spatial diversity. Orthogonal designs are used to achieve this orthogonality across the transmitters, with which it is only needed to design OFDM pulses for the first transmitter. We also propose a joint pulse compression and pulse coherent integration for range reconstruction. In order to achieve the optimal SNR for the range reconstruction, we apply the paraunitary filterbank theory to design the OFDM pulses. We then propose a modified iterative clipping and filtering (MICF) algorithm for the designs of OFDM pulses jointly, when other important factors, such as peak-to-average power ratio (PAPR) in time domain, are also considered. With our proposed MIMO OFDM radar, there is no interference for the range reconstruction not only across the transmitters but also across the range cells in a swath called inter-range-cell interference (IRCI) free that is similar to our previously proposed CP based OFDM radar for single transmitter. Simulations are presented to illustrate our proposed theory and show that the CP based MIMO OFDM radar outperforms the existing frequency-band shared MIMO radar with polyphase codes and also frequency division MIMO radar.

cs.IT

IRCI Free Range Reconstruction for SAR Imaging with Arbitrary Length OFDM Pulse

Our previously proposed OFDM with sufficient cyclic prefix (CP) synthetic aperture radar (SAR) imaging algorithm is inter-range-cell interference (IRCI) free and achieves ideally zero range sidelobes for range reconstruction. In this OFDM SAR imaging algorithm, the minimum required CP length is almost equal to the number of range cells in a swath, while the number of subcarriers of an OFDM signal needs to be more than the CP length. This makes the length of a transmitted OFDM sequence at least almost twice of the number of range cells in a swath and for a wide swath imaging, the transmitted OFDM pulse length becomes long, which may cause problems in some radar applications. In this paper, we propose a CP based OFDM SAR imaging with arbitrary pulse length, which has IRCI free range reconstruction and its pulse length is independent of a swath width. We then present a novel design method for our proposed arbitrary length OFDM pulses. Simulation results are presented to illustrate the performances of the OFDM pulse design and the arbitrary pulse length CP based OFDM SAR imaging.

cs.IT