arXiv subjects

Qingsong Xie

Publications and source records attributed to Qingsong Xie.

21 records · Page 2Linked to original sources

arXiv2024

PEA-Diffusion: Parameter-Efficient Adapter with Knowledge Distillation in non-English Text-to-Image Generation

Text-to-image diffusion models are well-known for their ability to generate realistic images based on textual prompts. However, the existing works have predominantly focused on English, lacking support for non-English text-to-image models. The most commonly used translation methods cannot solve the generation problem related to language culture, while training from scratch on a specific language dataset is prohibitively expensive. In this paper, we are inspired to propose a simple plug-and-play language transfer method based on knowledge distillation. All we need to do is train a lightweight MLP-like parameter-efficient adapter (PEA) with only 6M parameters under teacher knowledge distillation along with a small parallel data corpus. We are surprised to find that freezing the parameters of UNet can still achieve remarkable performance on the language-specific prompt evaluation set, demonstrating that PEA can stimulate the potential generation ability of the original UNet. Additionally, it closely approaches the performance of the English text-to-image model on a general prompt evaluation set. Furthermore, our adapter can be used as a plugin to achieve significant results in downstream tasks in cross-lingual text-to-image generation. Code will be available at: https://github.com/OPPO-Mente-Lab/PEA-Diffusion

cs.CV↗

arXiv2023

HumanBench: Towards General Human-centric Perception with Projector Assisted Pretraining

Human-centric perceptions include a variety of vision tasks, which have widespread industrial applications, including surveillance, autonomous driving, and the metaverse. It is desirable to have a general pretrain model for versatile human-centric downstream tasks. This paper forges ahead along this path from the aspects of both benchmark and pretraining methods. Specifically, we propose a \textbf{HumanBench} based on existing datasets to comprehensively evaluate on the common ground the generalization abilities of different pretraining methods on 19 datasets from 6 diverse downstream tasks, including person ReID, pose estimation, human parsing, pedestrian attribute recognition, pedestrian detection, and crowd counting. To learn both coarse-grained and fine-grained knowledge in human bodies, we further propose a \textbf{P}rojector \textbf{A}ssis\textbf{T}ed \textbf{H}ierarchical pretraining method (\textbf{PATH}) to learn diverse knowledge at different granularity levels. Comprehensive evaluations on HumanBench show that our PATH achieves new state-of-the-art results on 17 downstream datasets and on-par results on the other 2 datasets. The code will be publicly at \href{https://github.com/OpenGVLab/HumanBench}{https://github.com/OpenGVLab/HumanBench}.

cs.CV↗

arXiv2018

Heart Rate Estimation from Ballistocardiography Based on Hilbert Transform and Phase Vocoder

This paper presents a robust method to monitor heart rate (HR) from BCG (Ballistocardiography) signal, which is acquired from the sensor embedded in a chair or a mattress. The proposed algorithm addresses the shortfalls in traditional Fast Fourier Transform (FFT) based approaches by introducing Hilbert Transform to extract the pulse envelope that models the repetition of J-peaks in BCG signal. The frequency resolution is further enhanced by applying FFT and phase vocoder to the pulse envelope. The performance of the proposed algorithm is verified by experiment from 7 subjects. For HR estimation, mean absolute error (MAE) of 0.90 beats per minute (BPM) and standard deviation of absolute error (STD) of 1.14 BPM are obtained. Pearson correlation coefficient between estimated HR and ground truth HR of 0.98 is also achieved.

eess.SP↗