arXiv subjects

Gang Liu

Publications and source records attributed to Gang Liu.

At least 145 records · Page 8Linked to original sources

arXiv2022

Dendrite Net with Acceleration Module for Faster Nonlinear Mapping and System Identification

Nonlinear mapping is an essential and common demand in online systems, such as sensor systems and mobile phones. Accelerating nonlinear mapping will directly speed up online systems. Previously the authors of this paper proposed a Dendrite Net (DD) with enormously lower time complexity than the existing nonlinear mapping algorithms; however, there still are redundant calculations in DD. This paper presents a DD with an acceleration module (AC) to accelerate nonlinear mapping further. We conduct three experiments to verify whether DD with AC has lower time complexity while retaining DD's nonlinear mapping properties and system identification properties: The first experiment is the precision and identification of unary nonlinear mapping, reflecting the calculation performance using DD with AC for basic functions in online systems. The second experiment is the mapping precision and identification of the multi-input nonlinear system, reflecting the performance for designing online systems via DD with AC. Finally, this paper compares the time complexity of DD and DD with AC and analyzes the theoretical reasons through repeated experiments. Results: DD with AC retains DD's excellent mapping and identification properties and has lower time complexity. Significance: DD with AC can be used for most engineering systems, such as sensor systems, and will speed up computation in these online systems. The code of DD with AC is available on https://github.com/liugang1234567/Gang-neuron

cs.LG↗

arXiv2022

Self-supervised vision-language pretraining for Medical visual question answering

Medical image visual question answering (VQA) is a task to answer clinical questions, given a radiographic image, which is a challenging problem that requires a model to integrate both vision and language information. To solve medical VQA problems with a limited number of training data, pretrain-finetune paradigm is widely used to improve the model generalization. In this paper, we propose a self-supervised method that applies Masked image modeling, Masked language modeling, Image text matching and Image text alignment via contrastive learning (M2I2) for pretraining on medical image caption dataset, and finetunes to downstream medical VQA tasks. The proposed method achieves state-of-the-art performance on all the three public medical VQA datasets. Our codes and models are available at https://github.com/pengfeiliHEU/M2I2.

cs.CV↗

arXiv2022

Efficient Rigid Body Localization based on Euclidean Distance Matrix Completion for AGV Positioning under Harsh Environment

In real-world applications for automatic guided vehicle (AGV) navigation, the positioning system based on the time-of-flight (TOF) measurements between anchors and tags is confronted with the problem of insufficient measurements caused by blockages to radio signals or lasers, etc. Mounting multiple tags at different positions of the AGV to collect more TOFs is a feasible solution to tackle this difficulty. Vehicle localization by exploiting the measurements between multiple tags and anchors is a rigid body localization (RBL) problem, which estimates both the position and attitude of the vehicle. However, the state-of-the-art solutions to the RBL problem do not deal with missing measurements, and thus will result in degraded localization availability and accuracy in harsh environments. In this paper, different from these existing solutions for RBL, we model this problem as a sensor network localization problem with missing TOFs. To solve this problem, we propose a new efficient RBL solution based on Euclidean distance matrix (EDM) completion, abbreviated as ERBL-EDMC. Firstly, we develop a method to determine the upper and lower bounds of the missing measurements to complete the EDM reliably, using the known relative positions between tags and the statistics of the TOF measurements. Then, based on the completed EDM, the global tag positions are obtained from a coarse estimation followed by a refinement step assisted with inter-tag distances. Finally, the optimal vehicle position and attitude are obtained iteratively based on the estimated tag positions from the previous step. Theoretical analysis and simulation results show that the proposed ERBL-EDMC method effectively solves the RBL problem with incomplete measurements. It obtains the optimal positioning results while maintaining low computational complexity compared with the existing RBL methods based on semi-definite relaxation.

eess.SP↗

arXiv2022

Ultrahigh thermoelectric performance of Janus α-STe2 and α-SeTe2 monolayers

Combined with first-principles calculations and semiclassical Boltzmann transport theory, Janus α-STe2 and α-SeTe2 monolayers are investigated systematically. Janus α-STe2 and α-SeTe2 monolayers are indirect semiconductors with band gaps of 1.20 and 0.96 eV. It is found they possess ultrahigh figure of merit (ZT) values of 3.9 and 4.4 at 500 K, much higher than that of the pristine α-Te monolayer (2.8). The higher ZT originates from Janus structures reduce lattice thermal conductivities remarkably compared with pristine α-Te monolayer. The much higher phonon anharmonicity in Janus monolayers leads to significant lower lattice thermal conductivity. It is also found electronic thermal conductivity can play an important role in thermoelectric efficiency for the materials with quite low lattice thermal conductivity. This work suggests the potential applications of Janus α-STe2 and α-SeTe2 monolayers as thermoelectric materials and highlights Janus structure as an effective way to enhance thermoelectric performance.

cond-mat.mtrl-sci↗

arXiv2022

Equality scale-based and sound horizon-based analysis of the Hubble tension

The Hubble horizon at matter-radiation equality ($k^{-1}_{\rm{eq}}$) and the sound horizon at the last scattering surface ($r_s(z_*)$) provides interesting consistency check for the $Λ$CDM model and its extensions. It is well known that the reduction of $r_s$ can be compensated by the increase of $H_0$, while the same is true for the standard rulers $k_{\rm{eq}}$. Adding extra radiational component to the early universe can reduce $k_{\rm{eq}}$. The addition of early dark energy (EDE), however, tends to increase $k_{\rm{eq}}$. We perform $k_{\rm{eq}}$- and $r_s$-based analyses in both the EDE model and the Wess-Zumino Dark Radiation (WZDR) model. In the latter case we find $ΔH_0 = 0.4$ between the $r_s$- and $k_{\rm{eq}}$-based datasets, while in the former case we find $ΔH_0 = 1.2$. This result suggests that the dark radiation scenario is more consistent in the fit of the two standard rulers ($k_{\rm{eq}}$ and $r_s$). As a forecast analyses, we fit the two models with a mock $k_{\rm{eq}}$ prior derived from \emph{Planck} best-fit $Λ$CDM model. Compared with the best-fit $H_0$ in baseline $Λ$CDM model, we find $ΔH_0 = 1.1$ for WZDR model and $ΔH_0 = - 2.4$ for EDE model.

astro-ph.CO↗

arXiv2022

Graph Rationalization with Environment-based Augmentations

Rationale is defined as a subset of input features that best explains or supports the prediction by machine learning models. Rationale identification has improved the generalizability and interpretability of neural networks on vision and language data. In graph applications such as molecule and polymer property prediction, identifying representative subgraph structures named as graph rationales plays an essential role in the performance of graph neural networks. Existing graph pooling and/or distribution intervention methods suffer from lack of examples to learn to identify optimal graph rationales. In this work, we introduce a new augmentation operation called environment replacement that automatically creates virtual data examples to improve rationale identification. We propose an efficient framework that performs rationale-environment separation and representation learning on the real and augmented examples in latent spaces to avoid the high complexity of explicit graph decoding and encoding. Comparing against recent techniques, experiments on seven molecular and four polymer real datasets demonstrate the effectiveness and efficiency of the proposed augmentation-based graph rationalization framework.

cs.LG↗

arXiv2022

The Microsoft System for VoxCeleb Speaker Recognition Challenge 2022

In this report, we describe our submitted system for track 2 of the VoxCeleb Speaker Recognition Challenge 2022 (VoxSRC-22). We fuse a variety of good-performing models ranging from supervised models to self-supervised learning(SSL) pre-trained models. The supervised models, trained using VoxCeleb-2 dev data, consist of ECAPA-TDNN and Res2Net in a very deep structure. The SSL pre-trained models, wav2vec and wavLM, are trained using large scale unlabeled speech data up to million hours. These models are cascaded with ECAPA-TDNN and further fine-tuned in a supervised fashion to extract the speaker representations. All 13 models are applied with score normalization and calibration and then fused into the the submitted system. We also explore the audio quality measures in the calibration stage such as duration, SNR, T60, and MOS. The best submitted system achieves 0.073 in minDCF and 1.436% in EER on the VoxSRC-22 evaluation set.

cs.SD↗

arXiv2022

D&D: Learning Human Dynamics from Dynamic Camera

3D human pose estimation from a monocular video has recently seen significant improvements. However, most state-of-the-art methods are kinematics-based, which are prone to physically implausible motions with pronounced artifacts. Current dynamics-based methods can predict physically plausible motion but are restricted to simple scenarios with static camera view. In this work, we present D&D (Learning Human Dynamics from Dynamic Camera), which leverages the laws of physics to reconstruct 3D human motion from the in-the-wild videos with a moving camera. D&D introduces inertial force control (IFC) to explain the 3D human motion in the non-inertial local frame by considering the inertial forces of the dynamic camera. To learn the ground contact with limited annotations, we develop probabilistic contact torque (PCT), which is computed by differentiable sampling from contact probabilities and used to generate motions. The contact state can be weakly supervised by encouraging the model to generate correct motions. Furthermore, we propose an attentive PD controller that adjusts target pose states using temporal information to obtain smooth and accurate pose control. Our approach is entirely neural-based and runs without offline optimization or simulation in physics engines. Experiments on large-scale 3D human motion benchmarks demonstrate the effectiveness of D&D, where we exhibit superior performance against both state-of-the-art kinematics-based and dynamics-based methods. Code is available at https://github.com/Jeffsjtu/DnD

cs.CV↗

arXiv2022

On the Relationship Between Counterfactual Explainer and Recommender

Recommender systems employ machine learning models to learn from historical data to predict the preferences of users. Deep neural network (DNN) models such as neural collaborative filtering (NCF) are increasingly popular. However, the tangibility and trustworthiness of the recommendations are questionable due to the complexity and lack of explainability of the models. To enable explainability, recent techniques such as ACCENT and FIA are looking for counterfactual explanations that are specific historical actions of a user, the removal of which leads to a change to the recommendation result. In this work, we present a general framework for both DNN and non-DNN models so that the counterfactual explainers all belong to it with specific choices of components. This framework first estimates the influence of a certain historical action after its removal and then uses search algorithms to find the minimal set of such actions for the counterfactual explanation. With this framework, we are able to investigate the relationship between the explainers and recommenders. We empirically study two recommender models (NCF and Factorization Machine) and two datasets (MovieLens and Yelp). We analyze the relationship between the performance of the recommender and the quality of the explainer. We observe that with standard evaluation metrics, the explainers deliver worse performance when the recommendations are more accurate. This indicates that having good explanations to correct predictions is harder than having them to wrong predictions. The community needs more fine-grained evaluation metrics to measure the quality of counterfactual explanations to recommender systems.

cs.IR↗

arXiv2022

Off-Network Communications For Future Railway Mobile Communication Systems: Challenges and Opportunities

GSM-R is predicted to be obsoleted by 2030, and a suitable successor is needed. Defined by the International Union of Railways (UIC), the Future Railway Mobile Communication System (FRMCS) contains many future use cases with strict requirements. These use cases should ensure regular communication not only in network coverage but also uncovered scenarios. There is still a lack of standards on off-network communication in FRMCS, so this article focuses on off-network communication and intends to provide reference and direction for standardization. We first provide a comprehensive summary and analysis of off-network use cases in FRMCS. Then we give an overview of existing technologies (GSM-R, TETRA, DMR, LTE-V2X, and NR-V2X) that may support off-network communication. In addition, we simulate and evaluate the performance of existing technologies. Simulation results show that it is possible to satisfy the off-network communication requirements in FRMCS with enhancements based on LTE-V2X or NR-V2X. Finally, we give some future research directions to provide insights for industry and academia.

cs.NI↗

arXiv2022

Robust Vehicle Positioning based on Multi-Epoch and Multi-Antenna TOAs in Harsh Environments

For radio-based time-of-arrival (TOA) positioning systems applied in harsh environments, obstacles in the surroundings and on the vehicle itself will block the signals from the anchors, reduce the number of available TOA measurements and thus degrade the localization performance. Conventional multi-antenna positioning technique requires a good initialization to avoid local minima, and suffers from location ambiguity due to insufficient number of TOA measurements and/or poor geometry of anchors at a single epoch. A new initialization method based on semidefinite programming (SDP), namely MEMA-SDP, is first designed to address the initialization problem of the MEMA-TOA method. Then, an iterative refinement step is developed to obtain the optimal positioning result based on the MEMA-SDP initialization. We derive the Cramer-Rao lower bound (CRLB) to analyze the accuracy of the new MEMA-TOA method theoretically, and show its superior positioning performance over the conventional single-epoch and multi-antenna (SEMA) localization method. Simulation results in harsh environments demonstrate that i) the new MEMA-SDP provides an initial estimation that is close to the real location, and empirically guarantees the global optimality of the final refined positioning solution, and ii) compared with the conventional SEMA method, the new MEMA-TOA method has higher positioning accuracy without location ambiguity, consistent with the theoretical analysis.

eess.SP↗

arXiv2022

Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition?

Recently, self-supervised learning (SSL) has demonstrated strong performance in speaker recognition, even if the pre-training objective is designed for speech recognition. In this paper, we study which factor leads to the success of self-supervised learning on speaker-related tasks, e.g. speaker verification (SV), through a series of carefully designed experiments. Our empirical results on the Voxceleb-1 dataset suggest that the benefit of SSL to SV task is from a combination of mask speech prediction loss, data scale, and model size, while the SSL quantizer has a minor impact. We further employ the integrated gradients attribution method and loss landscape visualization to understand the effectiveness of self-supervised learning for speaker recognition performance.

cs.CL↗

arXiv2022

Critical Quantum Metrology in the Non-Linear Quantum Rabi Model

The quantum Rabi model (QRM) with linear coupling between light mode and qubit exhibits the analog of a second order phase transition for vanishing mode frequency which allows for criticality-enhanced quantum metrology in a few-body system. We show that the QRM including a non-linear coupling term exhibits much higher measurement precisions due to its first order like phase transition at \emph{finite} frequency, avoiding the detrimental slowing-down effect close to the critical point of the linear QRM. When a bias term is added to the Hamiltonian, the system can be used as a fluxmeter or magnetometer if implemented in circuit QED platforms.

quant-ph↗

arXiv2022

Learning from Counterfactual Links for Link Prediction

Learning to predict missing links is important for many graph-based applications. Existing methods were designed to learn the association between observed graph structure and existence of link between a pair of nodes. However, the causal relationship between the two variables was largely ignored for learning to predict links on a graph. In this work, we visit this factor by asking a counterfactual question: "would the link still exist if the graph structure became different from observation?" Its answer, counterfactual links, will be able to augment the graph data for representation learning. To create these links, we employ causal models that consider the information (i.e., learned representations) of node pairs as context, global graph structural properties as treatment, and link existence as outcome. We propose a novel data augmentation-based link prediction method that creates counterfactual links and learns representations from both the observed and counterfactual links. Experiments on benchmark data show that our graph learning method achieves state-of-the-art performance on the task of link prediction.

cs.LG↗

arXiv2022

Limit on the dark matter mass from its interaction with photons

In this work, we explore the phenomenology of generalized dark matter (GDM) which interacts with photons ($γ$). We assume that DM establishes elastic scattering with $γ$ when it has already become nonrelativistic, otherwise the abundance of DM today is disfavored by current observations. Within this scenario, the equation of state (EoS) of DM is determined by its mass ($m_χ$) and the DM-$γ$ scattering cross-section. The distinctive imprints of a nonzero EoS of DM on CMB angular power spectrum allow us to set a lower limit on $m_χ$ with Planck 2018 data alone, i.e., $m_χ > 8.7$ keV at $95\%$ C.L. In the study of cosmic concordance problems, we find that the GDM scenario preserves the sound horizon ($r_s(z_*)$) predicted in the fiducial $Λ$CDM model, and thus does not solve the $H_0$ tension. When performing the joint analysis of Planck+LSS datasets, the best-fit $S_8= 0.785\pm 0.017$ closely matches the given $S_8$ prior. This suggests that the GDM scenario can be counted as a viable candidate to restore the $S_8$ ($σ_{8}$) tension.

astro-ph.CO↗

arXiv2022

Pressure-induced superconductivity reentrant in transition metal dichalcogenide TiSe2

Through either elements intercalation or application of pressure, transition metal dichalcogenide 1T-TiSe2 exhibits superconductivity in proximity to a charge density wave (CDW) quantum critical point (QCP), thus providing an ideal avenue to study the correlation between the two symmetry-breaking exotic quantum electronic states. We report herein that, in addition to the well-known superconducting dome that emerges within the low pressure range of 2 - 4 GPa and peaks with the maximal Tc of about 1.8 K, the pressure induces another separate superconducting transition starting around 15 GPa with a substantially higher Tc that reaches 5.6 K at about 21.5 GPa. The high-pressure X-ray diffraction and Raman spectroscopy measurements unveil that the superconductivity reentrant is caused by a first-order structural phase transition (from P-3m1 space group to Pnma space group), which is also supported by the density functional theory calculation. A comparative theoretical calculation also reveals that the conventional phonon-mediated mechanism can account for the superconductivity of 1T-TiSe2 under low pressure, while the electron-phonon coupling of 4O-TiSe2 under high pressure is too weak to induce the superconductivity with a Tc as high as 5.6 K. This implies that the emergent superconductivity in the 4O-TiSe2 may have an unconventional origin. Our finding would open a new window toward the discovery of more exotic quantum states in transition metal dichalcogenides via high pressure.

cond-mat.supr-con↗

arXiv2022

The Miniature Optical Transmitter and Transceiver For the High-Luminosity LHC (HL-LHC) experiments

We present the design and test results of the Miniature optical Transmitter (MTx) and Transceiver (MTRx) for the high luminosity LHC (HL-LHC) experiments. MTx and MTRx are Transmitter Optical Subassembly (TOSA) and Receiver Optical Subassembly (ROSA) based. There are two major developments: the Vertical Cavity Surface Emitting Laser (VCSEL) driver ASIC LOCld and the mechanical latch that provides the connection to fibers. In this paper, we concentrate on the justification of this work, the design of the latch and the test results of these two modules with a Commercial Off-The-Shelf (COTS) VCSEL driver.

physics.ins-det↗

arXiv2022

Component Prototypes towards a Low-Latency, Small-form-factor Optical Link for the ATLAS Liquid Argon Calorimeter Phase-I Trigger Upgrade

This paper presents several component prototypes towards a low-latency, small-form-factor optical link designed for the ATLAS Liquid Argon Calorimeter Phase-I trigger upgrade. A prototype of the custom-made dual-channel optical transmitter module, the Miniature optical Transmitter (MTx), with separate transmitter optical sub-assemblies (TOSAs) has been demonstrated at data rates up to 8 Gbps per channel. A Vertical-Cavity Surface-Emitting Laser (VCSEL) driver ASIC has been developed and is used in the current MTx prototypes. A serializer ASIC prototype, operating at up to 8 Gbps per channel, has been designed and tested. A low-latency, low-overhead encoder ASIC prototype has been designed and tested. The latency of the whole link, including the transmitter latency and the receiver latency but not the latency of the fiber, is estimated to be less than 57.9 ns. The size of the MTx is 45 mm x 15 mm x 6 mm.

physics.ins-det↗