Searcharxiv⌕ Search

arXiv subjects

Liang Xu

Publications and source records attributed to Liang Xu.

At least 145 records · Page 8Linked to original sources

Low-cost and high-performance data augmentation for deep-learning-based skin lesion classification

Although deep convolutional neural networks (DCNNs) have achieved significant accuracy in skin lesion classification comparable or even superior to those of dermatologists, practical implementation of these models for skin cancer screening in low resource settings is hindered by their limitations in computational cost and training dataset. To overcome these limitations, we propose a low-cost and high-performance data augmentation strategy that includes two consecutive stages of augmentation search and network search. At the augmentation search stage, the augmentation strategy is optimized in the search space of Low-Cost-Augment (LCA) under the criteria of balanced accuracy (BACC) with 5-fold cross validation. At the network search stage, the DCNNs are fine-tuned with the full training set in order to select the model with the highest BACC. The efficiency of the proposed data augmentation strategy is verified on the HAM10000 dataset using EfficientNets as a baseline. With the proposed strategy, we are able to reduce the search space to 60 and achieve a high BACC of 0.853 by using a single DCNN model without external database, suitable to be implemented in mobile devices for DCNN-based skin lesion detection in low resource settings.

cs.CV↗

CLUE: A Chinese Language Understanding Evaluation Benchmark

The advent of natural language understanding (NLU) benchmarks for English, such as GLUE and SuperGLUE allows new NLU models to be evaluated across a diverse set of tasks. These comprehensive benchmarks have facilitated a broad range of research and applications in natural language processing (NLP). The problem, however, is that most such benchmarks are limited to English, which has made it difficult to replicate many of the successes in English NLU for other languages. To help remedy this issue, we introduce the first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark. CLUE is an open-ended, community-driven project that brings together 9 tasks spanning several well-established single-sentence/sentence-pair classification tasks, as well as machine reading comprehension, all on original Chinese text. To establish results on these tasks, we report scores using an exhaustive set of current state-of-the-art pre-trained Chinese models (9 in total). We also introduce a number of supplementary datasets and additional tools to help facilitate further progress on Chinese NLU. Our benchmark is released at https://www.CLUEbenchmarks.com

cs.CL↗

Astronomical Site Monitoring System at Lijiang Observatory

We installed two sets of Astronomical Site Monitoring System(ASMS) at Lijiang Observatory(GMG), for the running of the 2.4-meter Lijiang optical telescope(LJT) and the 1.6-meter Multi-channel Photometric Survey Telescope (Mephisto). The Mephistro is under construction. ASMS has been running on robotic mode since 2017. The core instruments: Cloud Sensor, All-Sky Camera and Autonomous-DIMM that are developed by our group, together with the commercial Meteorological Station and Sky Quality Meter, are combined into the astronomical optical site monitoring system. The new Cloud Sensor's Cloud-Clear Relationship is presented for the first time, which is used to calculate the All-Sky cloud cover. We designed the Autonomous-DIMM located on a tower, with the same height as LJT. The seeing data have been observed for a full year. ASMS's data for the year 2019 are also analysed in detail, which are valuable to observers.

astro-ph.IM↗

OCNLI: Original Chinese Natural Language Inference

Despite the tremendous recent progress on natural language inference (NLI), driven largely by large-scale investment in new datasets (e.g., SNLI, MNLI) and advances in modeling, most progress has been limited to English due to a lack of reliable datasets for most of the world's languages. In this paper, we present the first large-scale NLI dataset (consisting of ~56,000 annotated sentence pairs) for Chinese called the Original Chinese Natural Language Inference dataset (OCNLI). Unlike recent attempts at extending NLI to other languages, our dataset does not rely on any automatic translation or non-expert annotation. Instead, we elicit annotations from native speakers specializing in linguistics. We follow closely the annotation protocol used for MNLI, but create new strategies for eliciting diverse hypotheses. We establish several baseline results on our dataset using state-of-the-art pre-trained models for Chinese, and find even the best performing models to be far outpaced by human performance (~12% absolute performance gap), making it a challenging new resource that we hope will help to accelerate progress in Chinese NLU. To the best of our knowledge, this is the first human-elicited MNLI-style corpus for a non-English language.

cs.CL↗

Approaching quantum-limited metrology with imperfect detectors by using weak-value amplification

Weak value amplification (WVA) is a metrological protocol that amplifies ultra-small physical effects. However, the amplified outcomes necessarily occur with highly suppressed probabilities, leading to the extensive debate on whether the overall measurement precision is improved in comparison to that of conventional measurement (CM). Here, we experimentally demonstrate the unambiguous advantages of WVA that overcome practical limitations including noise and saturation of photo-detection and maintain a shot-noise-scaling precision for a large range of input light intensity well beyond the dynamic range of the photodetector. The precision achieved by WVA is six times higher than that of CM in our setup. Our results clear the way for the widespread use of WVA in applications involving the measurement of small signals including precision metrology and commercial sensors.

quant-ph↗

PaStaNet: Toward Human Activity Knowledge Engine

Existing image-based activity understanding methods mainly adopt direct mapping, i.e. from image to activity concepts, which may encounter performance bottleneck since the huge gap. In light of this, we propose a new path: infer human part states first and then reason out the activities based on part-level semantics. Human Body Part States (PaSta) are fine-grained action semantic tokens, e.g. , which can compose the activities and help us step toward human activity knowledge engine. To fully utilize the power of PaSta, we build a large-scale knowledge base PaStaNet, which contains 7M+ PaSta annotations. And two corresponding models are proposed: first, we design a model named Activity2Vec to extract PaSta features, which aim to be general representations for various activities. Second, we use a PaSta-based Reasoning method to infer activities. Promoted by PaStaNet, our method achieves significant improvements, e.g. 6.4 and 13.9 mAP on full and one-shot sets of HICO in supervised learning, and 3.2 and 4.2 mAP on V-COCO and images-based AVA in transfer learning. Code and data are available at http://hake-mvig.cn/.

cs.CV↗

Self-acceleration and energy channeling in the saturation of the ion-sound instability in a bounded plasma

A novel regime of the saturation of the Pierce-type ion-sound instability in bounded ion-beam-plasma system is revealed in 1D PIC simulations. It is found that the saturation of the instability is mediated by the oscillating virtual anode potential structure. The periodically oscillating potential barrier separates the incoming beam ions into two groups. One component forms a supersonic beam which is accelerated to an energy exceeding the energy of the initial cold ion beam. The other component is organized as a self-consistent phase space structure of trapped ions with a wide energy spread - the ion hole. The effective temperature (energy spread) of the ions trapped in the hole is lower than the initial beam energy. In the final stage the ion hole expands over the whole system length.

physics.plasm-ph↗

Consensusability of linear interconnected multi-agent systems

Consensusability is an important property for many multi-agent systems (MASs) as it implies the existence of networked controllers driving the states of MAS subsystems to the same value. Consensusability is of interest even when the MAS subsystems are physically coupled, which is the case for real-world systems such as power networks. In this paper, we study necessary and sufficient conditions for the consensusability of linear interconnected MASs. These conditions are given in terms of the parameters of the subsystem matrices, as well as the eigenvalues of the physical and communication graph Laplacians. Our results show that weak coupling between subsystems and fast information diffusion rates in the physical and communication graphs favor consensusability. Technical results are verified through computer simulations.

eess.SY↗

CLUECorpus2020: A Large-scale Chinese Corpus for Pre-training Language Model

In this paper, we introduce the Chinese corpus from CLUE organization, CLUECorpus2020, a large-scale corpus that can be used directly for self-supervised learning such as pre-training of a language model, or language generation. It has 100G raw corpus with 35 billion Chinese characters, which is retrieved from Common Crawl. To better understand this corpus, we conduct language understanding experiments on both small and large scale, and results show that the models trained on this corpus can achieve excellent performance on Chinese. We release a new Chinese vocabulary with a size of 8K, which is only one-third of the vocabulary size used in Chinese Bert released by Google. It saves computational cost and memory while works as good as original vocabulary. We also release both large and tiny versions of the pre-trained model on this corpus. The former achieves the state-of-the-art result, and the latter retains most precision while accelerating training and prediction speed for eight times compared to Bert-base. To facilitate future work on self-supervised learning on Chinese, we release our dataset, new vocabulary, codes, and pre-trained models on Github.

cs.CL↗

CLUENER2020: Fine-grained Named Entity Recognition Dataset and Benchmark for Chinese

In this paper, we introduce the NER dataset from CLUE organization (CLUENER2020), a well-defined fine-grained dataset for named entity recognition in Chinese. CLUENER2020 contains 10 categories. Apart from common labels like person, organization, and location, it contains more diverse categories. It is more challenging than current other Chinese NER datasets and could better reflect real-world applications. For comparison, we implement several state-of-the-art baselines as sequence labeling tasks and report human performance, as well as its analysis. To facilitate future work on fine-grained NER for Chinese, we release our dataset, baselines, and leader-board.

cs.CL↗

3D Objectness Estimation via Bottom-up Regret Grouping

3D objectness estimation, namely discovering semantic objects from 3D scene, is a challenging and significant task in 3D understanding. In this paper, we propose a 3D objectness method working in a bottom-up manner. Beginning with over-segmented 3D segments, we iteratively group them into object proposals by learning an ingenious grouping predictor to determine whether two 3D segments can be grouped or not. To enhance robustness, a novel regret mechanism is presented to withdraw incorrect grouping operations. Hence the irreparable consequences brought by mistaken grouping in prior bottom-up works can be greatly reduced. Our experiments show that our method outperforms state-of-the-art 3D objectness methods with a small number of proposals in two difficult datasets, GMU-kitchen and CTD. Further ablation study also demonstrates the effectiveness of our grouping predictor and regret mechanism.

cs.CV↗

Active Galactic Nuclei with Ultra-fast Outflows Monitoring Project: The Broad-line Region of Mrk 79 as a Disk Wind

We developed a spectroscopic monitoring project to investigate the kinematics of the broad-line region (BLR) in active galactic nuclei (AGN) with ultra-fast outflows (UFOs). Mrk~79 is a radio-quiet AGN with UFOs and warm absorbers, had been monitored by three reverberation mapping (RM) campaigns, but its BLR kinematics is not understood yet. In this paper, we report the results from a new RM-campaign of Mrk~79, which was undertaken by Lijiang 2.4-m telescope. Mrk~79 is seeming to come out the faint state, the mean flux approximates a magnitude fainter than historical record. We successfully measured the lags of the broad emission lines including H$β~\lambda4861$, H$γ~\lambda4340$, He II $\lambda4686$ and He I $\lambda5876$ with respect to the varying AGN continuum. Based on the broad H$β~\lambda4861$ line, we measured black hole (BH) mass of $M_{\bullet}=5.13^{+1.57}_{-1.55}\times10^{7}M_{\odot}$, estimated accretion rates of ${\dot{M}_{\bullet}}=(0.05\pm0.02)~L_{\rm Edd}~c^{-2}$, indicating that Mrk~79 is a sub-Eddington accretor. We found that Mrk~79 deviates from the canonical Radius$-$Luminosity relationship. The marginal blueshift of the broad He II $\lambda4686$ line detected from rms spectrum indicates outflow of high-ionization gas. The velocity-resolved lag profiles of the broad H$γ~\lambda4340$, H$β~\lambda4861$, and He I $\lambda5876$ lines show similar signatures that the largest lag occurs in the red wing of the lines then the lag decreases to both sides. These signatures should suggest that the BLR of Keplerian motion probably exists the outflow gas motion. All findings including UFOs, warm absorbers, and the kinematics of high- and low-ionization BLR, may provide an indirect evidence that the BLR of Mrk~79 probably originates from disk wind.

astro-ph.GA↗

HAKE: Human Activity Knowledge Engine

Human activity understanding is crucial for building automatic intelligent system. With the help of deep learning, activity understanding has made huge progress recently. But some challenges such as imbalanced data distribution, action ambiguity, complex visual patterns still remain. To address these and promote the activity understanding, we build a large-scale Human Activity Knowledge Engine (HAKE) based on the human body part states. Upon existing activity datasets, we annotate the part states of all the active persons in all images, thus establish the relationship between instance activity and body part states. Furthermore, we propose a HAKE based part state recognition model with a knowledge extractor named Activity2Vec and a corresponding part state based reasoning network. With HAKE, our method can alleviate the learning difficulty brought by the long-tail data distribution, and bring in interpretability. Now our HAKE has more than 7 M+ part state annotations and is still under construction. We first validate our approach on a part of HAKE in this preliminary paper, where we show 7.2 mAP performance improvement on Human-Object Interaction recognition, and 12.38 mAP improvement on the one-shot subsets.

cs.CV↗

Transferable Interactiveness Knowledge for Human-Object Interaction Detection

Human-Object Interaction (HOI) Detection is an important problem to understand how humans interact with objects. In this paper, we explore Interactiveness Knowledge which indicates whether human and object interact with each other or not. We found that interactiveness knowledge can be learned across HOI datasets, regardless of HOI category settings. Our core idea is to exploit an Interactiveness Network to learn the general interactiveness knowledge from multiple HOI datasets and perform Non-Interaction Suppression before HOI classification in inference. On account of the generalization of interactiveness, interactiveness network is a transferable knowledge learner and can be cooperated with any HOI detection models to achieve desirable results. We extensively evaluate the proposed method on HICO-DET and V-COCO datasets. Our framework outperforms state-of-the-art HOI detection results by a great margin, verifying its efficacy and flexibility. Code is available at https://github.com/DirtyHarryLYL/Transferable-Interactiveness-Network.

cs.CV↗

Stimulated emission depletion microscopy with array detection and photon reassignment

We propose a novel stimulated emission depletion (STED) microscopy based on array detection and photon reassignment. By replacing the single-point detector in traditional STED with a detector array and utilizing the photon reassignment method to recombine the images acquired by each detector, the final photon reassignment STED (prSTED) image could be obtained. We analyze the principle and imaging characteristics of prSTED, and the results indicate that, compared with traditional STED, prSTED can improve the signal-to-noise ratio (SNR) of the image by increasing the obtained photon flux while maintaining the original spatial resolution of STED. In addition, the SNR and resolution of prSTED are strongly correlated with the intensity of depletion beam. Corresponding theoretical and experimental analysis about this feature are also conducted. In general, considering the enhanced signal strength, imaging speed and compatibility with some other imaging techniques, we believe prSTED would be a helpful promotion in biomedical imaging.

physics.optics↗

Lijiang 2.4-meter Telescope and its Instruments

Lijiang 2.4-meter Telescope(LJT), the largest common-purpose optical telescope in China, has been applied to the world-wide astronomers since 2008. It is located at Gaomeigu site, Lijiang Observatory(LJO), the southwest of China. The site has very good observational conditions. Since 10-year operation, several instruments have been equipped on the LJT. Astronomers can perform both photometric and spectral observations. The main scientific goals of LJT include photometric and spectral evolution of supernova, reverberation mapping of active galactic nucleus, physical properties of binary star and near-earth object(comet and asteroid), identification of exoplanet, and all kinds of transients. Until now, the masses of 41 high accretion rate black holes have been measured, and more than 168 supernova have been identified by the LJT. More than 190 papers related to the LJT have been published. In this paper, the general observation condition of the Gaomeigu site is introduced at first. Then, the LJT structure is described in detail, including the optical, mechanical, motion and control system. The specification of all the instruments, and some detailed parameters of the YFOSC is also presented. Finally, some important scientific results and future expectations are summarized.

astro-ph.IM↗

Remote State Estimation with Stochastic Event-triggered Sensor Schedule in the Presence of Packet Drops

This paper studies the remote state estimation problem of linear time-invariant systems with stochastic event-triggered sensor schedules in the presence of packet drops between the sensor and the estimator. It is shown that the system state conditioned on the available information at the estimator side is Gaussian mixture distributed. Minimum mean square error (MMSE) estimators are subsequently derived for both open-loop and closed-loop schedules. Since the optimal estimators require exponentially increasing computation and memory, sub-optimal estimators to reduce the computational complexities are further provided. In the end, simulations are conducted to illustrate the performance of the optimal and sub-optimal estimators.

math.OC↗

Hierarchical method for cataract grading based on retinal images using improved Haar wavelet

Cataracts, which are lenticular opacities that may occur at different lens locations, are the leading cause of visual impairment worldwide. Accurate and timely diagnosis can improve the quality of life of cataract patients. In this paper, a feature extraction-based method for grading cataract severity using retinal images is proposed. To obtain more appropriate features for the automatic grading, the Haar wavelet is improved according to the characteristics of retinal images. Retinal images of non-cataract, as well as mild, moderate, and severe cataracts, are automatically recognized using the improved Haar wavelet. A hierarchical strategy is used to transform the four-class classification problem into three adjacent two-class classification problems. Three sets of two-class classifiers based on a neural network are trained individually and integrated together to establish a complete classification system. The accuracies of the two-class classification (cataract and non-cataract) and four-class classification are 94.83% and 85.98%, respectively. The performance analysis demonstrates that the improved Haar wavelet feature achieves higher accuracy than the original Haar wavelet feature, and the fusion of three sets of two-class classifiers is superior to a simple four-class classifier. The discussion indicates that the retinal image-based method offers significant potential for cataract detection.

cs.CV↗