Searcharxiv⌕ Search

arXiv subjects

Xin Zhao

Publications and source records attributed to Xin Zhao.

At least 163 records · Page 9Linked to original sources

Synergic Adversarial Label Learning for Grading Retinal Diseases via Knowledge Distillation and Multi-task Learning

The need for comprehensive and automated screening methods for retinal image classification has long been recognized. Well-qualified doctors annotated images are very expensive and only a limited amount of data is available for various retinal diseases such as age-related macular degeneration (AMD) and diabetic retinopathy (DR). Some studies show that AMD and DR share some common features like hemorrhagic points and exudation but most classification algorithms only train those disease models independently. Inspired by knowledge distillation where additional monitoring signals from various sources is beneficial to train a robust model with much fewer data. We propose a method called synergic adversarial label learning (SALL) which leverages relevant retinal disease labels in both semantic and feature space as additional signals and train the model in a collaborative manner. Our experiments on DR and AMD fundus image classification task demonstrate that the proposed method can significantly improve the accuracy of the model for grading diseases. In addition, we conduct additional experiments to show the effectiveness of SALL from the aspects of reliability and interpretability in the context of medical imaging application.

cs.CV↗

Study On Coding Tools Beyond Av1

The Alliance for Open Media has recently initiated coding tool exploration activities towards the next-generation video coding beyond AV1. With this regard, this paper presents a package of coding tools that have been investigated, implemented and tested on top of the codebase, known as libaom, which is used for the exploration of next-generation video compression tools. The proposed tools cover several technical areas based on a traditional hybrid video coding structure, including block partitioning, prediction, transform and loop filtering. The proposed coding tools are integrated as a package, and a combined coding gain over AV1 is demonstrated in this paper. Furthermore, to better understand the behavior of each tool, besides the combined coding gain, the tool-on and tool-off tests are also simulated and reported for each individual coding tool. Experimental results show that, compared to libaom, the proposed methods achieve an average 8.0% (up to 22.0%) overall BD-rate reduction for All Intra coding configuration a wide range of image and video content.

cs.MM↗

Linearized physics and gravitational-waves polarizations in the Palatini formalism of GBD theory

A generalized Brans-Dicke (GBD) theory in the framework of Palatini formalism are proposed in this paper. We derive the field equations by using the variational approach and obtain the linearized equations by using the weak-field approximation method. We show various properties of the geometrical scalar field in the Palatini-formalism of GBD theory: it is massless and source-free, which are different from the results given in the metric-formalism of GBD theory. Also, we investigate the polarization modes of gravitational waves (GWs) by using the the geodesic deviation method and the Newman-Penrose method in the Palatini-GBD theory. It is observed that there are three polarizations modes and four oscillation in the Palatini-GBD theory. Concretely, they are the two transverse tensor ($+$) and ($\times$) standard polarization modes, and one breathing mode (with two oscillation). The results of GWs polarization in the Palatini-GBD theory are different from that in the metric-GBD theory, where there are four polarizations modes: the two standard tensorial modes ($+$ and $\times$), a scalar breathing mode, and a massive scalar mode that is a mix of the longitudinal and the breathing polarization. Comparing with the Palatini-$f(\tilde{R})$ theory and the General Relativity, we can see that the extra breathing mode of GWs polarization can be found in the Palatini-GBD theory. At last, the expression of the parameterized post Newton (PPN) parameter is derived, which could pass through the experimental test.

gr-qc↗

Consistency types for replicated data in a higher-order distributed programming language

Distributed systems address the increasing demand for fast access to resources and fault tolerance for data. However, due to scalability requirements, software developers need to trade consistency for performance. For certain data, consistency guarantees may be weakened if application correctness is unaffected. In contrast, data flow from data with weak consistency to data with strong consistency requirements is problematic, since application correctness may be broken. In this paper, we propose lattice-based consistency types for replicated data (CTRD), a higher-order static consistency-typed language with replicated data types. The type system of CTRD supports shared data among multiple clients, and statically enforces noninterference between data types with weaker consistency and data types with stronger consistency. The language can be applied to many distributed applications and guarantees that updates of weakly-consistent data can never affect strongly-consistent data. We also extend the basic CTRD with an optimization that reduces synchronization for generating reference graphs.

cs.PL↗

Hölder regularity of the integrated density of states for quasi-periodic long-range operators on $\ell^2(\Z^d)$

We prove the Hölder continuity of the integrated density of states for a class of quasi-periodic long-range operators on $\ell^2(\Z^d)$ with large trigonometric polynomial potentials and Diophantine frequencies. Moreover, we give the Hölder exponent in terms of the cardinality of the level sets of the potentials, which improves, in the perturbative regime, the result obtained by Goldstein and Schlag \cite{gs2}. Our approach is a combination of Aubry duality, generalized Thouless formula and the regularity of the Lyapunov exponents of analytic quasi-periodic $GL(m,\C)$ cocycles which is proved by quantitative almost reducibility method.

math.DS↗

A Multi-scale CNN-CRF Framework for Environmental Microorganism Image Segmentation

To assist researchers to identify Environmental Microorganisms (EMs) effectively, a Multiscale CNN-CRF (MSCC) framework for the EM image segmentation is proposed in this paper. There are two parts in this framework: The first is a novel pixel-level segmentation approach, using a newly introduced Convolutional Neural Network (CNN), namely, "mU-Net-B3", with a dense Conditional Random Field (CRF) postprocessing. The second is a VGG-16 based patch-level segmentation method with a novel "buffer" strategy, which further improves the segmentation quality of the details of the EMs. In the experiment, compared with the state-of-the-art methods on 420 EM images, the proposed MSCC method reduces the memory requirement from 355 MB to 103 MB, improves the overall evaluation indexes (Dice, Jaccard, Recall, Accuracy) from 85.24%, 77.42%, 82.27%, and 96.76% to 87.13%, 79.74%, 87.12%, and 96.91%, respectively, and reduces the volume overlap error from 22.58% to 20.26%. Therefore, the MSCC method shows great potential in the EM segmentation field.

cs.CV↗

PET Quantification of Ultra Low Activity via Inhomogeneous Poisson Process Parameters Estimation Directly from Listmode Data

Metabolic imaging with PET/CT using $^{18}$F-Fludeoxyglucose ($^{18}$F-FDG) as well as other imaging biomarkers has achieved wide acceptance in oncology, cardiology and neurology not only because of the unique metabolic information generated by this modality, but also because of its ability to quantify biological processes. However, PET quantification is affected by many technical and physiologic factors, and then recognized as an important problem for diagnosis, determination of prognosis, and response monitoring in oncology. In this work, we investigated the effect of reduced PET emission count statistics on the accuracy and precision of tracer quantification, and proposed Inhomogeneous Poisson Process Parameter Estimation (I3PE) method. In I3PE method, we modelled the coincidence event as Inhomogeneous Poisson Process, and estimate its parameter directly from the streaming listmode data. To evaluate the effectiveness, a experiment using $^{18}$F-FDG was implemented on LIGHTNING. The results not only demonstrate I3PE method, but also evaluated the minimal detectable activity of the using PET machine. According $0.3\%$ mean error rate criterion, LIGHTNING can detect several nano-Curie, cooperated with I3PE method.

physics.med-ph↗

A Lite Microphone Array Beamforming Scheme with Maximum Signal-to-Noise Ratio Filter

Since space-domain information can be utilized, microphone array beamforming is often used to enhance the quality of the speech by suppressing directional disturbance. However, with the increasing number of microphone, the complexity would be increased. In this paper, a concise beamforming scheme using Maximum Signal-to-Noise Ratio (SNR) filter is proposed to reduce the beamforming complexity. The maximum SNR filter is implemented by using the estimated direction-of-arrival (DOA) of the speech source localization (SSL) and the solving method of independent vector analysis (IVA). Our experiments show that when compared with other widely-used algorithms, the proposed algorithm obtain higher gain of signal-to-interference and noise ratio (SINR).

cs.SD↗

Hybrid Transceiver Optimization for Multi-Hop Communications

Multi-hop communication with the aid of large-scale antenna arrays will play a vital role in future emergence communication systems. In this paper, we investigate amplify-and-forward based and multiple-input multiple-output assisted multi-hop communication, in which all nodes employ hybrid transceivers. Moreover, channel errors are taken into account in our hybrid transceiver design. Based on the matrix-monotonic optimization framework, the optimal structures of the robust hybrid transceivers are derived. By utilizing these optimal structures, the optimizations of analog transceivers and digital transceivers can be separated without loss of optimality. This fact greatly simplifies the joint optimization of analog and digital transceivers. Since the optimization of analog transceivers under unit-modulus constraints is non-convex, a projection type algorithm is proposed for analog transceiver optimization to overcome this difficulty. Based on the derived analog transceivers, the optimal digital transceivers can then be derived using matrix-monotonic optimization. Numeral results obtained demonstrate the performance advantages of the proposed hybrid transceiver designs over other existing solutions.

cs.IT↗

GlobalTrack: A Simple and Strong Baseline for Long-term Tracking

A key capability of a long-term tracker is to search for targets in very large areas (typically the entire image) to handle possible target absences or tracking failures. However, currently there is a lack of such a strong baseline for global instance search. In this work, we aim to bridge this gap. Specifically, we propose GlobalTrack, a pure global instance search based tracker that makes no assumption on the temporal consistency of the target's positions and scales. GlobalTrack is developed based on two-stage object detectors, and it is able to perform full-image and multi-scale search of arbitrary instances with only a single query as the guide. We further propose a cross-query loss to improve the robustness of our approach against distractors. With no online learning, no punishment on position or scale changes, no scale smoothing and no trajectory refinement, our pure global instance search based tracker achieves comparable, sometimes much better performance on four large-scale tracking benchmarks (i.e., 52.1% AUC on LaSOT, 63.8% success rate on TLP, 60.3% MaxGM on OxUvA and 75.4% normalized precision on TrackingNet), compared to state-of-the-art approaches that typically require complex post-processing. More importantly, our tracker runs without cumulative errors, i.e., any type of temporary tracking failures will not affect its performance on future frames, making it ideal for long-term tracking. We hope this work will be a strong baseline for long-term tracking and will stimulate future works in this area. Code is available at https://github.com/huanglianghua/GlobalTrack.

cs.CV↗

TANet: Robust 3D Object Detection from Point Clouds with Triple Attention

In this paper, we focus on exploring the robustness of the 3D object detection in point clouds, which has been rarely discussed in existing approaches. We observe two crucial phenomena: 1) the detection accuracy of the hard objects, e.g., Pedestrians, is unsatisfactory, 2) when adding additional noise points, the performance of existing approaches decreases rapidly. To alleviate these problems, a novel TANet is introduced in this paper, which mainly contains a Triple Attention (TA) module, and a Coarse-to-Fine Regression (CFR) module. By considering the channel-wise, point-wise and voxel-wise attention jointly, the TA module enhances the crucial information of the target while suppresses the unstable cloud points. Besides, the novel stacked TA further exploits the multi-level feature attention. In addition, the CFR module boosts the accuracy of localization without excessive computation cost. Experimental results on the validation set of KITTI dataset demonstrate that, in the challenging noisy cases, i.e., adding additional random noisy points around each object,the presented approach goes far beyond state-of-the-art approaches. Furthermore, for the 3D object detection task of the KITTI benchmark, our approach ranks the first place on Pedestrian class, by using the point clouds as the only input. The running speed is around 29 frames per second.

cs.CV↗

GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild

We introduce here a large tracking database that offers an unprecedentedly wide coverage of common moving objects in the wild, called GOT-10k. Specifically, GOT-10k is built upon the backbone of WordNet structure and it populates the majority of over 560 classes of moving objects and 87 motion patterns, magnitudes wider than the most recent similar-scale counterparts. The contributions of this paper are summarized in the following: (1) GOT-10k offers over 10,000 video segments with more than 1.5 million manually labeled bounding boxes, enabling unified training and stable evaluation of deep trackers. (2) GOT-10k is by far the first video trajectory dataset that uses the semantic hierarchy of WordNet to guide class population. (3) For the first time, GOT-10k introduces the one-shot protocol for tracker evaluation, where the training and test classes are zero-overlapped. The protocol avoids biased evaluation results towards familiar objects and it promotes generalization in tracker development. (4) We conduct extensive tracking experiments with 39 typical tracking algorithms on GOT-10k and analyze their results in this paper. (5) Finally, we develop a comprehensive platform for the tracking community that offers full-featured evaluation toolkits, an online evaluation server, and a responsive leaderboard. The annotations of GOT-10k's test data are kept private to avoid tuning parameters on it. The database, toolkits, evaluation server and baseline results are available at http://got-10k.aitestunion.com.

cs.CV↗

UER: An Open-Source Toolkit for Pre-training Models

Existing works, including ELMO and BERT, have revealed the importance of pre-training for NLP tasks. While there does not exist a single pre-training model that works best in all cases, it is of necessity to develop a framework that is able to deploy various pre-training models efficiently. For this purpose, we propose an assemble-on-demand pre-training toolkit, namely Universal Encoder Representations (UER). UER is loosely coupled, and encapsulated with rich modules. By assembling modules on demand, users can either reproduce a state-of-the-art pre-training model or develop a pre-training model that remains unexplored. With UER, we have built a model zoo, which contains pre-trained models based on different corpora, encoders, and targets (objectives). With proper pre-trained models, we could achieve new state-of-the-art results on a range of downstream datasets.

cs.CL↗

A Fast algorithm of PET System Response Matrix based on Straight Line Truncation

In the calculation of Positron Emission Tomography (PET) image reconstruction, System Response Matrix (SRM) characterizes the numerical relationship between measurement space and image space. Due to a significant amount of calculation and low efficiency of the current SRM algorithm, the application of iterative reconstruction in the medical and industrial fields is limited. The time and space of computing SRM are the most important factors that researchers are concerned about. In this paper, the Straight Line Truncation (hereinafter referred to as SLT) method is applied to calculate the SRM. We verified that it improves the speed of calculating the SRM and reduces its spatial complexity. The experimental results show that the forward projection speed of SLT algorithm is six times more than that of the traditional Ray-Tracing algorithm. Besides, the forward projection speed of the small angle of SLT is about 23 times that of the traditional Ray-Tracing algorithm, and the storage space of SLT is about one sixty-fourth of the storage space of traditional Ray-Tracing algorithm.

physics.med-ph↗

SSAP: Single-Shot Instance Segmentation With Affinity Pyramid

Recently, proposal-free instance segmentation has received increasing attention due to its concise and efficient pipeline. Generally, proposal-free methods generate instance-agnostic semantic segmentation labels and instance-aware features to group pixels into different object instances. However, previous methods mostly employ separate modules for these two sub-tasks and require multiple passes for inference. We argue that treating these two sub-tasks separately is suboptimal. In fact, employing multiple separate modules significantly reduces the potential for application. The mutual benefits between the two complementary sub-tasks are also unexplored. To this end, this work proposes a single-shot proposal-free instance segmentation method that requires only one single pass for prediction. Our method is based on a pixel-pair affinity pyramid, which computes the probability that two pixels belong to the same instance in a hierarchical manner. The affinity pyramid can also be jointly learned with the semantic class labeling and achieve mutual benefits. Moreover, incorporating with the learned affinity pyramid, a novel cascaded graph partition module is presented to sequentially generate instances from coarse to fine. Unlike previous time-consuming graph partition methods, this module achieves $5\times$ speedup and 9% relative improvement on Average-Precision (AP). Our approach achieves state-of-the-art results on the challenging Cityscapes dataset.

cs.CV↗

An End-to-End Solution for Effectively Demoting Watermarked Images in Image Search

We propose an end-to-end solution, from watermark feature generation to metric design, for effectively demoting watermarked images surfed by a real world image search engine. We use a few fundamental techniques to obtain effective watermark features of images in the image search index, and utilize the signals in a commercial search engine to improve the image search quality. We collect a diverse and large set (about 1M) of images with human labels indicating whether the image contains visible watermark. We train a few deep convolutional neural networks to extract watermark information from the raw images. The deep CNN classifiers we trained can achieve high accuracy on the watermark test data set. We also analyze the images based on their domains to get watermark information from a domain-based watermark classifier. We design a new novel hybrid metric which includes the relevance, image attractiveness and watermark information all together. We demonstrate that using these watermark signals together with the new metric in image search ranker can significantly demote the watermarked images during the online image ranking.

cs.CV↗

Comb-mode-resolved adaptive sampling terahertz dual-comb spectroscopy with a free-running single-cavity fiber laser

Mode-resolved dual-comb spectroscopy (DCS) is an emerging spectroscopic tool with the potential to simultaneously achieve a broad spectral coverage and ultrahigh spectral resolution in terahertz (THz) spectroscopy. However, the need for two independently stabilized ultrafast lasers significantly hampers the potential application of DCS techniques. In this article, we demonstrate mode-resolved DCS in the THz region based on a free-running single-cavity dual-comb fiber laser with adaptive sampling. Low-pressure spectroscopy of acetonitrile gas with absorption features approaching the Doppler limit is demonstrated by comb-mode-resolved measurements with a spectral sampling spacing of 48.8 MHz, a spectral resolution of less than 5 MHz and a signal-to-noise ratio of ~50 dB. The successful demonstration of the proposed method clearly indicates the great potential for the realization of low-complexity, MHz-resolution THz spectroscopy instrumentation.

physics.ins-det↗