arXiv subjects

Tong Shen

Publications and source records attributed to Tong Shen.

At least 37 records · Page 2Linked to original sources

arXiv2023

Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesis

Deep person generation has attracted extensive research attention due to its wide applications in virtual agents, video conferencing, online shopping and art/movie production. With the advancement of deep learning, visual appearances (face, pose, cloth) of a person image can be easily generated or manipulated on demand. In this survey, we first summarize the scope of person generation, and then systematically review recent progress and technical trends in deep person generation, covering three major tasks: talking-head generation (face), pose-guided person generation (pose) and garment-oriented person generation (cloth). More than two hundred papers are covered for a thorough overview, and the milestone works are highlighted to witness the major technical breakthrough. Based on these fundamental tasks, a number of applications are investigated, e.g., virtual fitting, digital human, generative data augmentation. We hope this survey could shed some light on the future prospects of deep person generation, and provide a helpful foundation for full applications towards digital human.

cs.CV↗

arXiv2023

Measurement of Investment activity in China based on Natural language processing technology

The purpose of this study is to propose a new index to measure and reflect China's investment activity in time, and to analyze the changes of China's investment activity in the past five years. This study first uses the NEZHA model for semantic representation, and expand the indicator system based on semantic similarity. Then we calculate China's investment activity index by using the network search data. This study shows that China's investment activity began to decline in 2019, rebounded for a period of time after the outbreak of COVID-19 in 2020, and then continued to maintain a downward trend. Private investment activity has declined significantly, while government investment activity has increased. Among the provinces in Chinese Mainland, the investment activity of economically developed provinces has decreased significantly, while the investment activity of some economically less developed provinces in the north and south is higher. After the outbreak of COVID-19, the investment period became shorter. Our research will provide timely investment information for the government, decision makers and managers, as well as provide other researchers who also pay attention to investment with a perspective other than investment in fixed asset.

stat.AP↗

arXiv2023

UAV Deployment Optimization for Secure Precise Wireless Transmission

This paper develops an unmanned aerial vehicle (UAV) deployment scheme in the context of the directional modulation-based secure precise wireless transmissions (SPWTs), where the optimal UAV position for the SPWT is derived to maximum the secrecy rate (SR) without injecting any artificial noise (AN) signaling. To be specific, the proposed scheme reveals that the optimal position of UAV for maximizing the SR performance has to be placed at the null space of Eves channel, which impels the received energy of the confidential message at the unintended receiver deteriorating to zero whilst benefits the one at the intended receiver achieving its maximum value. Finally, simulation results verify the optimality of our proposed scheme in terms of the achievable SR performance.

eess.SP↗

arXiv2022

A Stable, Recursive Auxiliary Field Quantum Monte Carlo Algorithm in the Canonical Ensemble: Applications to Thermometry and the Hubbard Model

Many experimentally-accessible, finite-sized interacting quantum systems are most appropriately described by the canonical ensemble of statistical mechanics. Conventional numerical simulation methods either approximate them as being coupled to a particle bath, or use projective algorithms which may suffer from non-optimal scaling with system size or large algorithmic prefactors. In this paper, we introduce a highly stable, recursive Auxiliary Field Quantum Monte Carlo approach that can directly simulate systems in the canonical ensemble. We apply the method to the fermion Hubbard model in one and two spatial dimensions in a regime known to exhibit a significant "sign" problem and find improved performance over existing approaches including rapid convergence to ground state expectation values. The effects of excitations above the ground state are quantified using an estimator-agnostic approach including studying the temperature dependence of the purity and overlap fidelity of the canonical and grand canonical density matrices. As an important application, we show that thermometry approaches often exploited in ultra-cold atoms that employ an analysis of the velocity distribution in the grand canonical ensemble may be subject to errors leading to an under-estimation of extracted temperatures with respect to the Fermi temperature.

cond-mat.str-el↗

arXiv2022

A Novel Autonomous Robotics System for Aquaculture Environment Monitoring

Implementing fully automatic unmanned surface vehicles (USVs) monitoring water quality is challenging since effectively collecting environmental data while keeping the platform stable and environmental-friendly is hard to approach. To address this problem, we construct a USV that can automatically navigate an efficient path to sample water quality parameters in order to monitor the aquatic environment. The detection device needs to be stable enough to resist a hostile environment or climates while enormous volumes will disturb the aquaculture environment. Meanwhile, planning an efficient path for information collecting needs to deal with the contradiction between the restriction of energy and the amount of information in the coverage region. To tackle with mentioned challenges, we provide a USV platform that can perfectly balance mobility, stability, and portability attributed to its special round-shape structure and redundancy motion design. For informative planning, we combined the TSP and CPP algorithms to construct an optimistic plan for collecting more data within a certain range and limiting energy restrictions.We designed a fish existence prediction scenario to verify the novel system in both simulation experiments and field experiments. The novel aquaculture environment monitoring system significantly reduces the burden of manual operation in the fishery inspection field. Additionally, the simplicity of the sensor setup and the minimal cost of the platform enables its other possible applications in aquatic exploration and commercial utilization.

cs.RO↗

arXiv2022

On Performance Loss of DOA Measurement Using Massive MIMO Receiver with Mixed-ADCs

High hardware cost and high power consumption of massive multiple-input and multiple output (MIMO) are two challenges for the future wireless communications including beyond fifth generation (B5G) and sixth generation (6G). Adopting the low-resolution analog-to-digital converter (ADC) is viewed as a promising solution. Additionally, the direction of arrival (DOA) estimation is an indispensable technology for beam alignment and tracking in massive MIMO systems. Thus, in this paper, the performance of DOA estimation with mixed-ADC structure is firstly investigated. The Cramer-Rao lower bound (CRLB) for this architecture is derived based on the additive quantization noise model. Eventually, a performance loss factor and the associated energy efficiency factor is defined for analysis in detail. Simulation results show that the mixed-ADC architecture can strike a good balance among performance loss, circuit cost and energy efficiency. More importantly, just a few bits (up to 4 bits) of low-resolution ADCs can achieve a satisfactory performance for DOA measurement.

cs.IT↗

arXiv2022

Multi-RIS Aided 3D Secure Precise Wireless Transmission

In this paper, multiple reconfigurable intelligent surfaces (RIS) aided secure precise wireless transmission (SPWT) schemes are proposed in the three-dimensional (3D) wireless communication scenario. Unavailable direct path channels from transmitter to receivers are considered when the direct paths are obstructed by obstacles. Then, multiple RISs are utilized to achieve SPWT through the reflection path among transmitter, RISs and receivers in order to enhance the communication performance and energy efficiency simultaneously. First, a maximum-signal-to-interference-and-noise ratio (MSINR) scheme is proposed in a single user scenario. Then, the multi-user scenario is considered where the illegitimate users are regarded as eavesdroppers. A maximum-secrecy-rate (MSR) scheme and a maximum-signal-to-leakage-and-noise ratio (MSLNR) are proposed. The former achieves a better secrecy rate (SR) performance but incurs a higher complexity. The latter has a lower complexity than the MSR scheme with an SR performance loss. Simulation results show that both single-user scheme and multi-user scheme can achieve SPWT which transmits confidential message precisely to location of desired users. Moreover, MSLNR scheme has a lower complexity than the MSR scheme, while the SR performance is close to that of the MSR scheme.

eess.SP↗

arXiv2021

ViDA-MAN: Visual Dialog with Digital Humans

We demonstrate ViDA-MAN, a digital-human agent for multi-modal interaction, which offers realtime audio-visual responses to instant speech inquiries. Compared to traditional text or voice-based system, ViDA-MAN offers human-like interactions (e.g, vivid voice, natural facial expression and body gestures). Given a speech request, the demonstration is able to response with high quality videos in sub-second latency. To deliver immersive user experience, ViDA-MAN seamlessly integrates multi-modal techniques including Acoustic Speech Recognition (ASR), multi-turn dialog, Text To Speech (TTS), talking heads video generation. Backed with large knowledge base, ViDA-MAN is able to chat with users on a number of topics including chit-chat, weather, device control, News recommendations, booking hotels, as well as answering questions via structured knowledge.

cs.CV↗

arXiv2021

Unsupervised Domain Adaptation for Object Detection via Cross-Domain Semi-Supervised Learning

Current state-of-the-art object detectors can have significant performance drop when deployed in the wild due to domain gaps with training data. Unsupervised Domain Adaptation (UDA) is a promising approach to adapt models for new domains/environments without any expensive label cost. However, without ground truth labels, most prior works on UDA for object detection tasks can only perform coarse image-level and/or feature-level adaptation by using adversarial learning methods. In this work, we show that such adversarial-based methods can only reduce the domain style gap, but cannot address the domain content distribution gap that is shown to be important for object detectors. To overcome this limitation, we propose the Cross-Domain Semi-Supervised Learning (CDSSL) framework by leveraging high-quality pseudo labels to learn better representations from the target domain directly. To enable SSL for cross-domain object detection, we propose fine-grained domain transfer, progressive-confidence-based label sharpening and imbalanced sampling strategy to address two challenges: (i) non-identical distribution between source and target domain data, (ii) error amplification/accumulation due to noisy pseudo labeling on the target domain. Experiment results show that our proposed approach consistently achieves new state-of-the-art performance (2.2% - 9.5% better than prior best work on mAP) under various domain gap scenarios. The code will be released.

cs.CV↗

arXiv2021

Force-dependent bond dissociation explains the rate-dependent fracture of vitrimers

We investigate the rate-dependent fracture of vitrimers by conducting a tear test. Based on the relationship between the frac-ture energy and the thickness of vitrimer films, we, for the first time, obtain the intrinsic fracture energy and bulk dissipation of vitrimers during crack extension. The intrinsic fracture energy strongly depends on tear speed, and such dependence can be well explained by Eyring theory. In contrast, the bulk dissipation only weakly depends on tear speed, which is drastically different from observations on traditional viscoelastic polymers. We ascribe such a weak rate-dependence to the strong force-sensitivity of the exchange reaction of the dynamic covalent bond in the vitrimer.

cond-mat.soft↗

arXiv2021

Ridge-penalized adaptive Mantel test and its application in imaging genetics

We propose a ridge-penalized adaptive Mantel test (AdaMant) for evaluating the association of two high-dimensional sets of features. By introducing a ridge penalty, AdaMant tests the association across many metrics simultaneously. We demonstrate how ridge penalization bridges Euclidean and Mahalanobis distances and their corresponding linear models from the perspective of association measurement and testing. This result is not only theoretically interesting but also has important implications in penalized hypothesis testing, especially in high dimensional settings such as imaging genetics. Applying the proposed method to an imaging genetic study of visual working memory in health adults, we identified interesting associations of brain connectivity (measured by EEG coherence) with selected genetic features.

stat.ME↗

arXiv2021

To Deconvolve, or Not to Deconvolve: Inferences of Neuronal Activities using Calcium Imaging Data

With the increasing popularity of calcium imaging data in neuroscience research, methods for analyzing calcium trace data are critical to address various questions. The observed calcium traces are either analyzed directly or deconvolved to spike trains to infer neuronal activities. When both approaches are applicable, it is unclear whether deconvolving calcium traces is a necessary step. In this article, we compare the performance of using calcium traces or their deconvolved spike trains for three common analyses: clustering, principal component analysis (PCA), and population decoding. Our simulations and applications to real data suggest that the estimated spike data outperform calcium trace data for both clustering and PCA. Although calcium trace data show higher predictability than spike data at each time point, spike history or cumulative spike counts is comparable to or better than calcium traces in population decoding.

q-bio.NC↗

arXiv2021

Time-varying $\ell_0$ optimization for Spike Inference from Multi-Trial Calcium Recordings

Optical imaging of genetically encoded calcium indicators is a powerful tool to record the activity of a large number of neurons simultaneously over a long period of time from freely behaving animals. However, determining the exact time at which a neuron spikes and estimating the underlying firing rate from calcium fluorescence data remains challenging, especially for calcium imaging data obtained from a longitudinal study. We propose a multi-trial time-varying $\ell_0$ penalized method to jointly detect spikes and estimate firing rates by robustly integrating evolving neural dynamics across trials. Our simulation study shows that the proposed method performs well in both spike detection and firing rate estimation. We demonstrate the usefulness of our method on calcium fluorescence trace data from two studies, with the first study showing differential firing rate functions between two behaviors and the second study showing evolving firing rate function across trials due to learning.

stat.AP↗

arXiv2021

Change-point detection using spectral PCA for multivariate time series

We propose a two-stage approach Spec PC-CP to identify change points in multivariate time series. In the first stage, we obtain a low-dimensional summary of the high-dimensional time series by Spectral Principal Component Analysis (Spec-PCA). In the second stage, we apply cumulative sum-type test on the Spectral PCA component using a binary segmentation algorithm. Compared with existing approaches, the proposed method is able to capture the lead-lag relationship in time series. Our simulations demonstrate that the Spec PC-CP method performs significantly better than competing methods for detecting change points in high-dimensional time series. The results on epileptic seizure EEG data and stock data also indicate that our new method can efficiently {detect} change points corresponding to the onset of the underlying events.

stat.AP↗

arXiv2020

Towards Latency-aware DNN Optimization with GPU Runtime Analysis and Tail Effect Elimination

Despite the superb performance of State-Of-The-Art (SOTA) DNNs, the increasing computational cost makes them very challenging to meet real-time latency and accuracy requirements. Although DNN runtime latency is dictated by model property (e.g., architecture, operations), hardware property (e.g., utilization, throughput), and more importantly, the effective mapping between these two, many existing approaches focus only on optimizing model property such as FLOPS reduction and overlook the mismatch between DNN model and hardware properties. In this work, we show that the mismatch between the varied DNN computation workloads and GPU capacity can cause the idle GPU tail effect, leading to GPU under-utilization and low throughput. As a result, the FLOPs reduction cannot bring effective latency reduction, which causes sub-optimal accuracy versus latency trade-offs. Motivated by this, we propose a GPU runtime-aware DNN optimization methodology to eliminate such GPU tail effect adaptively on GPU platforms. Our methodology can be applied on top of existing SOTA DNN optimization approaches to achieve better latency and accuracy trade-offs. Experiments show 11%-27% latency reduction and 2.5%-4.0% accuracy improvement over several SOTA DNN pruning and NAS methods, respectively

cs.AR↗

arXiv2020

Structural and electronic properties of solid molecular hydrogen from many-electron theories

We study the structural and electronic properties of phase III of solid hydrogen using accurate many-electron theories and compare to state-of-the-art experimental findings. The atomic structures of phase III modelled by C2/c-24 crystals are fully optimized on the level of second-order perturbation theory, demonstrating that previously employed structures optimized on the level of approximate density functionals exhibit errors in the H$_2$ bond lengths that cause significant discrepancies in the computed quasi particle band gaps and vibrational frequencies compared to experiment. Using the newly optimized atomic structures, we study the band gap closure and change in vibrational frequencies as a function of pressure. Our findings are in good agreement with recent experimental observations and may prove useful in resolving long-standing discrepancies between experimental estimates of metallization pressures possibly caused by disagreeing pressure calibrations.

cond-mat.mtrl-sci↗

arXiv2020

Finite Temperature Auxiliary Field Quantum Monte Carlo in the Canonical Ensemble

Finite temperature auxiliary field-based Quantum Monte Carlo methods, including Determinant Quantum Monte Carlo (DQMC) and Auxiliary Field Quantum Monte Carlo (AFQMC), have historically assumed pivotal roles in the investigation of the finite temperature phase diagrams of a wide variety of multidimensional lattice models and materials. Despite their utility, however, these techniques are typically formulated in the grand canonical ensemble, which makes them difficult to apply to condensates like superfluids and difficult to benchmark against alternative methods that are formulated in the canonical ensemble. Working in the grand canonical ensemble is furthermore accompanied by the increased overhead associated with having to determine the chemical potentials that produce desired fillings. Given this backdrop, in this work, we present a new recursive approach for performing AFQMC simulations in the canonical ensemble that does not require knowledge of chemical potentials. To derive this approach, we exploit the convenient fact that AFQMC solves the many-body problem by decoupling many-body propagators into integrals over one-body problems to which non-interacting theories can be applied. We benchmark the accuracy of our technique on illustrative Bose and Fermi Hubbard models and demonstrate that it can converge more quickly to the ground state than grand canonical AFQMC simulations. We believe that our novel use of HS-transformed operators to implement algorithms originally derived for non-interacting systems will motivate the development of a variety of other methods and anticipate that our technique will enable direct performance comparisons against other many-body approaches formulated in the canonical ensemble.

quant-ph↗

arXiv2020

Unveiling the Finite Temperature Physics of Hydrogen Chains via Auxiliary Field Quantum Monte Carlo

The ability to accurately predict the finite temperature properties of realistic quantum solids is central to uncovering new phases and engineering materials with novel properties. Nonetheless, there remain comparatively few many-body techniques capable of elucidating the finite temperature physics of solids from first principles. In this work, we take a significant step towards developing such a technique by generalizing our previous, fully ab initio finite temperature Auxiliary Field Quantum Monte Carlo (FT-AFQMC) method to model periodic solids and employing it to uncover the finite temperature physics of periodic hydrogen chains. Based upon our calculations of these chains' many-body thermodynamic quantities and correlation functions, we outline their metal-insulator and magnetic ordering as a function of both H-H bond distance and temperature. At low temperatures approaching the ground state, we observe both metal-insulator and ferromagnetic-antiferromagnetic crossovers at bond lengths between 0.5 and 0.75 Å. We then demonstrate how this low-temperature ordering evolves into a metallic phase with decreasing magnetic order at higher temperatures. By comparing the features we observe to those previously seen in one-dimensional, half-filled Hubbard models at finite temperature and in ground state hydrogen chains, interestingly, we identify signatures of the Pomeranchuk effect in hydrogen chains for the first time and show that spin and charge excitations that typically arise at distinct temperatures in the Hubbard model are indistinguishably coupled in these systems. Beyond qualitatively revealing the many-body phase behavior of hydrogen chains, our efforts shed light on the further theoretical developments that will be required to construct the phase diagrams of the more complex transition metal, lanthanide, and actinide solids of longstanding interest to physicists.

cond-mat.str-el↗