arXiv subjects

Qian Zhang

Publications and source records attributed to Qian Zhang.

At least 379 records · Page 21Linked to original sources

arXiv2020

AutoPose: Searching Multi-Scale Branch Aggregation for Pose Estimation

We present AutoPose, a novel neural architecture search(NAS) framework that is capable of automatically discovering multiple parallel branches of cross-scale connections towards accurate and high-resolution 2D human pose estimation. Recently, high-performance hand-crafted convolutional networks for pose estimation show growing demands on multi-scale fusion and high-resolution representations. However, current NAS works exhibit limited flexibility on scale searching, they dominantly adopt simplified search spaces of single-branch architectures. Such simplification limits the fusion of information at different scales and fails to maintain high-resolution representations. The presentedAutoPose framework is able to search for multi-branch scales and network depth, in addition to the cell-level microstructure. Motivated by the search space, a novel bi-level optimization method is presented, where the network-level architecture is searched via reinforcement learning, and the cell-level search is conducted by the gradient-based method. Within 2.5 GPU days, AutoPose is able to find very competitive architectures on the MS COCO dataset, that are also transferable to the MPII dataset. Our code is available at https://github.com/VITA-Group/AutoPose.

cs.CV↗

arXiv2020

Intensity-only Mode Decomposition on Multimode Fibers using a Densely Connected Convolutional Network

The use of multimode fibers offers advantages in the field of communication technology in terms of transferable information density and information security. For applications using physical layer security or mode division multiplexing, the complex transmission matrix must be known. To measure the transmission matrix, the individual modes of the multimode fiber are excited sequentially at the input and a mode decomposition is performed at the output. Mode decomposition is usually performed using digital holography, which requires the provision of a reference wave and leads to high efforts. To overcome these drawbacks, a neural network is proposed, which performs mode decomposition with intensity-only camera recordings of the multimode fiber facet. Due to the high computational complexity of the problem, this approach was usually limited to a number of 6 modes. In this work, it could be shown for the first time that by using a DenseNet with 121 layers it is possible to break through the hurdle of 6 modes. The advancement is demonstrated by a mode decomposition with 10 modes experimentally. The training process is based on synthetic data. The proposed method is quantitatively compared to the conventional approach with digital holography. In addition, it is shown that the network can perform mode decomposition on a 55-mode fiber, which also supports modes unknown to the neural network. The smart detection using a DenseNet opens new ways for the application of multimode fibers in optical communication networks for physical layer security.

eess.IV↗

arXiv2020

Three families of grad-div-conforming finite elements

Several smooth finite element de Rham complexes are constructed in three-dimensional space, which yield three families of grad-div conforming finite elements. The simplest element has only 8 degrees of freedom (DOFs) for a tetrahedron and 14 DOFs for a cuboid. These elements naturally lead to conforming approximations to quad-div problems. Numerical experiments for each family validate the correctness and efficiency of the elements for solving the quad-div problem.

math.NA↗

arXiv2020

Learning Where to Focus for Efficient Video Object Detection

Transferring existing image-based detectors to the video is non-trivial since the quality of frames is always deteriorated by part occlusion, rare pose, and motion blur. Previous approaches exploit to propagate and aggregate features across video frames by using optical flow-warping. However, directly applying image-level optical flow onto the high-level features might not establish accurate spatial correspondences. Therefore, a novel module called Learnable Spatio-Temporal Sampling (LSTS) has been proposed to learn semantic-level correspondences among adjacent frame features accurately. The sampled locations are first randomly initialized, then updated iteratively to find better spatial correspondences guided by detection supervision progressively. Besides, Sparsely Recursive Feature Updating (SRFU) module and Dense Feature Aggregation (DFA) module are also introduced to model temporal relations and enhance per-frame features, respectively. Without bells and whistles, the proposed method achieves state-of-the-art performance on the ImageNet VID dataset with less computational complexity and real-time speed. Code will be made available at https://github.com/jiangzhengkai/LSTS.

cs.CV↗

arXiv2020

SiamParseNet: Joint Body Parsing and Label Propagation in Infant Movement Videos

General movement assessment (GMA) of infant movement videos (IMVs) is an effective method for the early detection of cerebral palsy (CP) in infants. Automated body parsing is a crucial step towards computer-aided GMA, in which infant body parts are segmented and tracked over time for movement analysis. However, acquiring fully annotated data for video-based body parsing is particularly expensive due to the large number of frames in IMVs. In this paper, we propose a semi-supervised body parsing model, termed SiamParseNet (SPN), to jointly learn single frame body parsing and label propagation between frames in a semi-supervised fashion. The Siamese-structured SPN consists of a shared feature encoder, followed by two separate branches: one for intra-frame body parts segmentation, and one for inter-frame label propagation. The two branches are trained jointly, taking pairs of frames from the same videos as their input. An adaptive training process is proposed that alternates training modes between using input pairs of only labeled frames and using inputs of both labeled and unlabeled frames. During testing, we employ a multi-source inference mechanism, where the final result for a test frame is either obtained via the segmentation branch or via propagation from a nearby key frame. We conduct extensive experiments on a partially-labeled IMV dataset where SPN outperforms all prior arts, demonstrating the effectiveness of our proposed method.

cs.CV↗

arXiv2020

A priori and a posteriori error estimates for the quad-curl eigenvalue problem

In this paper, we propose a new family of H(curl^2)-conforming elements for the quad-curl eigenvalue problem in 2D. The accuracy of this family is one order higher than that in [32]. We prove a priori and a posteriori error estimates. The a priori estimate of the eigenvalue with a convergence order 2(s-1) is obtained if the eigenvector u\in H^{s+1}(Ω). For the a posteriori estimate, by analyzing the associated source problem, we obtain lower and upper bounds for the eigenvector in an energy norm and an upper bound for the eigenvalues. Numerical examples are presented for validation.

math.NA↗

arXiv2020

The oxygen partial pressure in solid oxide electrolysis cells with two layer electrolytes

A number of degradation mechanisms have been observed during the long-term operation of solid oxide electrolysis cells (SOEC). Using an electrolyte charge carrier transport model, we quantify the oxygen potentials across the electrolyte and thereby provide insights into these degradation mechanisms. Our model describes the transport of charge carriers in the electrolyte when the oxygen partial pressure is extremely low by accounting for the spatial variation of the concentration of oxygen vacancies in the electrolyte. Moreover, we identify four quantities that characterize the distribution of oxygen partial pressure in the electrolyte, which are directly related to the degradation mechanisms in the electrolyte as well: the two oxygen partial pressures at the interfaces of the electrodes and the electrolyte, the oxygen partial pressure at the interface of YSZ/GDC, and the position of the abrupt change in oxygen potential near the p-n junction that develops in YSZ when one side of the cell is exposed to fuel (low oxygen potential, n-type conduction) and the other side is exposed to oxidant (high oxygen potential, p-type conduction). We give analytical estimates for all of these quantities. These analytical expressions provide guidance on the parameters that need to be controlled to suppress the degradation observed in the electrolyte. In addition, the effects of operating conditions, particularly current density and operating temperature, on degradation are discussed.

physics.app-ph↗

arXiv2020

Half-Heusler thermoelectric materials: NMR studies

We report $^{59}$Co, $^{93}$Nb, and $^{121}$Sb nuclear magnetic resonance (NMR) measurements combined with density functional theory (DFT) calculations on a series of half-Heusler semiconductors, including NbCoSn, ZrCoSb, TaFeSb and NbFeSb, to better understand their electronic properties and general composition-dependent trends. These materials are of interest as potentially high efficiency thermoelectric materials. Compared to the other materials, we find that ZrCoSb tends to have a relatively large amount of local disorder, apparently antisite defects. This contributes to a small excitation gap corresponding to an impurity band near the band edge. In NbCoSn and TaFeSb, Curie-Weiss-type behavior is revealed, which indicates a small density of interacting paramagnetic defects. Very large paramagnetic chemical shifts are observed associated with a Van Vleck mechanism due to closely spaced $d$ bands splitting between the conduction and valence bands. Meanwhile, DFT methods were generally successful in reproducing the chemical shift trend for these half-Heusler materials, and we identify an enhancement of the larger-magnitude shifts, which we connect to electron interaction effects. The general trend is connected to changes in $d$-electron hybridization across the series.

cond-mat.mtrl-sci↗

arXiv2020

Role of rotational coherence in femtosecond-pulse-driven nitrogen ion lasing

We experimentally investigated the rotationally resolved polarization characteristics of N$_2^+$ lasing at 391 and 428 nm using a pump-seed scheme. By varying the relative angle between the linear polarizations of the pump and seed, it is found that the polarizations of the P and R branches of 391-nm lasing are counter-rotated. By contrast, both branches of 428-nm lasing remain polarized along the pump. The origin of the puzzled abnormal polarization characteristics is found based on a complete physical model that simultaneously includes the transient photoionization and the subsequent coupling among the electronic, vibrational and rotational quantum states of ions.It suggests that the cascaded resonant Raman processes following ionization create negative coherence between the rotational states of $J$ and $J$+2 in the ionic ground state X$^2Σ_g^+(ν=0)$, which leads to mirror-symmetrical polarization for the P and R branches of 391-nm lasing. Both the experiment and theory indicate that the demonstrated rotational coherence plays an extremely pivotal role in clarifying the gain mechanism of N$_2^+$ lasing and opens up the route toward quantum optics under ultrafast strong fields.

physics.atom-ph↗

arXiv2020

Authenticating On-Body IoT Devices: An Adversarial Learning Approach

By adding users as a new dimension to connectivity, on-body Internet-of-Things (IoT) devices have gained considerable momentum in recent years, while raising serious privacy and safety issues. Existing approaches to authenticate these devices limit themselves to dedicated sensors or specified user motions, undermining their widespread acceptance. This paper overcomes these limitations with a general authentication solution by integrating wireless physical layer (PHY) signatures with upper-layer protocols. The key enabling techniques are constructing representative radio propagation profiles from received signals, and developing an adversarial multi-player neural network to accurately recognize underlying radio propagation patterns and facilitate on-body device authentication. Once hearing a suspicious transmission, our system triggers a PHY-based challenge-response protocol to defend in depth against active attacks. We prove that at equilibrium, our adversarial model can extract all information about propagation patterns and eliminate any irrelevant information caused by motion variances and environment changes. We build a prototype of our system using Universal Software Radio Peripheral (USRP) devices and conduct extensive experiments with various static and dynamic body motions in typical indoor and outdoor environments. The experimental results show that our system achieves an average authentication accuracy of 91.6%, with a high area under the receiver operating characteristic curve (AUROC) of 0.96 and a better generalization performance compared with the conventional non-adversarial approach.

cs.CR↗

arXiv2020

VarGNet: Variable Group Convolutional Neural Network for Efficient Embedded Computing

In this paper, we propose a novel network design mechanism for efficient embedded computing. Inspired by the limited computing patterns, we propose to fix the number of channels in a group convolution, instead of the existing practice that fixing the total group numbers. Our solution based network, named Variable Group Convolutional Network (VarGNet), can be optimized easier on hardware side, due to the more unified computing schemes among the layers. Extensive experiments on various vision tasks, including classification, detection, pixel-wise parsing and face recognition, have demonstrated the practical value of our VarGNet.

cs.CV↗

arXiv2020

Densely Connected Search Space for More Flexible Neural Architecture Search

Neural architecture search (NAS) has dramatically advanced the development of neural network design. We revisit the search space design in most previous NAS methods and find the number and widths of blocks are set manually. However, block counts and block widths determine the network scale (depth and width) and make a great influence on both the accuracy and the model cost (FLOPs/latency). In this paper, we propose to search block counts and block widths by designing a densely connected search space, i.e., DenseNAS. The new search space is represented as a dense super network, which is built upon our designed routing blocks. In the super network, routing blocks are densely connected and we search for the best path between them to derive the final architecture. We further propose a chained cost estimation algorithm to approximate the model cost during the search. Both the accuracy and model cost are optimized in DenseNAS. For experiments on the MobileNetV2-based search space, DenseNAS achieves 75.3% top-1 accuracy on ImageNet with only 361MB FLOPs and 17.9ms latency on a single TITAN-XP. The larger model searched by DenseNAS achieves 76.1% accuracy with only 479M FLOPs. DenseNAS further promotes the ImageNet classification accuracies of ResNet-18, -34 and -50-B by 1.5%, 0.5% and 0.3% with 200M, 600M and 680M FLOPs reduction respectively. The related code is available at https://github.com/JaminFong/DenseNAS.

cs.CV↗

arXiv2020

Fast Neural Network Adaptation via Parameter Remapping and Architecture Search

Deep neural networks achieve remarkable performance in many computer vision tasks. Most state-of-the-art (SOTA) semantic segmentation and object detection approaches reuse neural network architectures designed for image classification as the backbone, commonly pre-trained on ImageNet. However, performance gains can be achieved by designing network architectures specifically for detection and segmentation, as shown by recent neural architecture search (NAS) research for detection and segmentation. One major challenge though, is that ImageNet pre-training of the search space representation (a.k.a. super network) or the searched networks incurs huge computational cost. In this paper, we propose a Fast Neural Network Adaptation (FNA) method, which can adapt both the architecture and parameters of a seed network (e.g. a high performing manually designed backbone) to become a network with different depth, width, or kernels via a Parameter Remapping technique, making it possible to utilize NAS for detection/segmentation tasks a lot more efficiently. In our experiments, we conduct FNA on MobileNetV2 to obtain new networks for both segmentation and detection that clearly out-perform existing networks designed both manually and by NAS. The total computation cost of FNA is significantly less than SOTA segmentation/detection NAS approaches: 1737$\times$ less than DPC, 6.8$\times$ less than Auto-DeepLab and 7.4$\times$ less than DetNAS. The code is available at https://github.com/JaminFong/FNA.

cs.CV↗

arXiv2020

Cardiovascular risk and work stress in biomedical researchers in China: An observational, big data study protocol

Introduction: Internet technologies could strengthen data collection and integration and have been used extensively in public health research. It is necessary to apply this technology to further investigate the behaviour and health of biomedical researchers. A browser-based extension was developed by researchers and clinicians to promote the collection and analysis of researchers' behavioural and psychological data. This protocol illustrates an observational study aimed at (1) characterising the health status of biomedical researchers in China and assessing work stress, job satisfaction, role conflict, role ambiguity, and family support; (2) identifying the association between work, behaviour, and health; and (3) investigating the association between behaviour and mental status. Our findings will contribute to the understanding of the influences of job, work environment, and family support on the mental and physical health of biomedical researchers. Methods and analysis: This is a prospective observational study; all candidates will be recruited from China. Participants will install an extension on their Internet browsers, which will collect data when they are accessing PubMed. A web-based survey will be sent to the user interfaces every 6 months that will involve sociodemographic variables, perceived stress scale, job satisfaction scale, role conflict and ambiguity scale, and family support scale. Machine-learning algorithms will analyse the data generated during daily access. Ethics and dissemination: This study received ethical approval from the ethics committee of the Shanghai Children's Medical Centre (reference number SCMCIRB-K2018082). Study results will be disseminated through peer-reviewed publications and conference presentations.

cs.CY↗

arXiv2020

Boundary Guidance Hierarchical Network for Real-Time Tongue Segmentation

Automated tongue image segmentation in tongue images is a challenging task for two reasons: 1) there are many pathological details on the tongue surface, which affect the extraction of the boundary; 2) the shapes of the tongues captured from various persons (with different diseases) are quite different. To deal with the challenge, a novel end-to-end Boundary Guidance Hierarchical Network (BGHNet) with a new hybrid loss is proposed in this paper. In the new approach, firstly Context Feature Encoder Module (CFEM) is built upon the bottomup pathway to confront with the shrinkage of the receptive field. Secondly, a novel hierarchical recurrent feature fusion module (HRFFM) is adopt to progressively and hierarchically refine object maps to recover image details by integrating local context information. Finally, the proposed hybrid loss in a four hierarchy-pixel, patch, map and boundary guides the network to effectively segment the tongue regions and accurate tongue boundaries. BGHNet is applied to a set of tongue images. The experimental results suggest that the proposed approach can achieve the latest tongue segmentation performance. And in the meantime, the lightweight network contains only 15.45M parameters and performs only 11.22GFLOPS.

eess.IV↗

arXiv2020

Active Lighting Recurrence by Parallel Lighting Analogy for Fine-Grained Change Detection

This paper studies a new problem, namely active lighting recurrence (ALR) that physically relocalizes a light source to reproduce the lighting condition from single reference image for a same scene, which may suffer from fine-grained changes during twice observations. ALR is of great importance for fine-grained visual inspection and change detection, because some phenomena or minute changes can only be clearly observed under particular lighting conditions. Therefore, effective ALR should be able to online navigate a light source toward the target pose, which is challenging due to the complexity and diversity of real-world lighting and imaging processes. To this end, we propose to use the simple parallel lighting as an analogy model and based on Lambertian law to compose an instant navigation ball for this purpose. We theoretically prove the feasibility, i.e., equivalence and convergence, of this ALR approach for realistic near point light source and small near surface light source. Besides, we also theoretically prove the invariance of our ALR approach to the ambiguity of normal and lighting decomposition. The effectiveness and superiority of the proposed approach have been verified by both extensive quantitative experiments and challenging real-world tasks on fine-grained change detection of cultural heritages. We also validate the generality of our approach to non-Lambertian scenes.

cs.CV↗

arXiv2020

Enabling Low-Power OFDM for IoT by Exploiting Asymmetric Clock Rates

The conventional high-speed Wi-Fi has recently become a contender for low-power Internet-of-Things (IoT) communications. OFDM continues its adoption in the new IoT Wi-Fi standard due to its spectrum efficiency that can support the demand of massive IoT connectivity. While the IoT Wi-Fi standard offers many new features to improve power and spectrum efficiency, the basic physical layer (PHY) structure of transceiver design still conforms to its conventional design rationale where access points (AP) and clients employ the same OFDM PHY. In this paper, we argue that current Wi-Fi PHY design does not take full advantage of the inherent asymmetry between AP and IoT. To fill the gap, we propose an asymmetric design where IoT devices transmit uplink packets using the lowest power while pushing all the decoding burdens to the AP side. Such a design utilizes the sufficient power and computational resources at AP to trade for the transmission (TX) power of IoT devices. The core technique enabling this asymmetric design is that the AP takes full power of its high clock rate to boost the decoding ability. We provide an implementation of our design and show that it can reduce up to 88% of the IoT's TX power when the AP sets $8\times$ clock rate.

cs.NI↗

arXiv2020

Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Loss

In this paper we present an end-to-end speech recognition model with Transformer encoders that can be used in a streaming speech recognition system. Transformer computation blocks based on self-attention are used to encode both audio and label sequences independently. The activations from both audio and label encoders are combined with a feed-forward layer to compute a probability distribution over the label space for every combination of acoustic frame position and label history. This is similar to the Recurrent Neural Network Transducer (RNN-T) model, which uses RNNs for information encoding instead of Transformer encoders. The model is trained with the RNN-T loss well-suited to streaming decoding. We present results on the LibriSpeech dataset showing that limiting the left context for self-attention in the Transformer layers makes decoding computationally tractable for streaming, with only a slight degradation in accuracy. We also show that the full attention version of our model beats the-state-of-the art accuracy on the LibriSpeech benchmarks. Our results also show that we can bridge the gap between full attention and limited attention versions of our model by attending to a limited number of future frames.

eess.AS↗