arXiv subjects

Jun Liu

Publications and source records attributed to Jun Liu.

At least 703 records · Page 39Linked to original sources

arXiv2020

Can Synthetic Data Improve Object Detection Results for Remote Sensing Images?

Deep learning approaches require enough training samples to perform well, but it is a challenge to collect enough real training data and label them manually. In this letter, we propose the use of realistic synthetic data with a wide distribution to improve the performance of remote sensing image aircraft detection. Specifically, to increase the variability of synthetic data, we randomly set the parameters during rendering, such as the size of the instance and the class of background images. In order to make the synthetic images more realistic, we then refine the synthetic images at the pixel level using CycleGAN with real unlabeled images. We also fine-tune the model with a small amount of real data, to obtain a higher accuracy. Experiments on NWPU VHR-10, UCAS-AOD and DIOR datasets demonstrate that the proposed method can be applied for augmenting insufficient real data.

cs.CV↗

arXiv2020

High-temperature and Abrasion Resistant Selective Solar Absorber under Ambient Environment

Selective solar absorbers (SSAs) with high performance are the key to concentrated solar power systems. Optical metamaterials are emerging as a promising strategy to enhance selective photon absorption, however, the high-temperature resistance (>500C) remains as one of the main challenges for their practical applications. Here, a multilayered metamaterial system (Al2O3/W/SiO2/W) based on metal-insulator-metal (MIM) resonance effect has been demonstrated with high solar absorptance over 92%, low thermal emittance loss below 6%, and significant high-temperature resistance: it has been proved that the optical performance remains 93.6% after 1-hour thermal annealing under ambient environment up to 500C, and 94.1% after 96-hour thermal cycle test at 400C, which is also confirmed by the microscopic morphology characterization. The spectral selectivity of fabricated SSAs is angular independent and polarization insensitive. Outdoor tests demonstrate that a peak temperature rise (193.5C) can be achieved with unconcentrated solar irradiance and surface abrasion resistance test yields that SSAs have a robust resistance to abrasion attack for engineering applications.

physics.app-ph↗

arXiv2020

Knowledge forest: a novel model to organize knowledge fragments

With the rapid growth of knowledge, it shows a steady trend of knowledge fragmentization. Knowledge fragmentization manifests as that the knowledge related to a specific topic in a course is scattered in isolated and autonomous knowledge sources. We term the knowledge of a facet in a specific topic as a knowledge fragment. The problem of knowledge fragmentization brings two challenges: First, knowledge is scattered in various knowledge sources, which exerts users' considerable efforts to search for the knowledge of their interested topics, thereby leading to information overload. Second, learning dependencies which refer to the precedence relationships between topics in the learning process are concealed by the isolation and autonomy of knowledge sources, thus causing learning disorientation. To solve the knowledge fragmentization problem, we propose a novel knowledge organization model, knowledge forest, which consists of facet trees and learning dependencies. Facet trees can organize knowledge fragments with facet hyponymy to alleviate information overload. Learning dependencies can organize disordered topics to cope with learning disorientation. We conduct extensive experiments on three manually constructed datasets from the Data Structure, Data Mining, and Computer Network courses, and the experimental results show that knowledge forest can effectively organize knowledge fragments, and alleviate information overload and learning disorientation.

cs.AI↗

arXiv2020

In-house beam-splitting pulse compressor with compensated spatiotemporal coupling for high-energy petawatt lasers

One of the most serious bottleneck on achieving kilojoule-level high-energy petawatt (PW) to hundreds-petawatt (100PW) lasers with ps to fs pulse duration is the requirement of as large as meter-sized gratings in the compressor so as to avoid the laser-induced damage to the gratings. However, this kind of meter-sized grating with high quality is hard to manufacture so far. Here, we propose a new in-house beam-splitting compressor based on the property that the damage threshold of gratings depend on the pulse duration. The new scheme will simultaneously improve the stability, save expensive gratings, and simplify the size of compressor because the split beams share the first two parallel gratings. Furthermore, based on the fact that the transmitted wavefront of a glass plate can be much better and more precisely controlled than that of the diffraction wavefront of a large grating, then glass plates with designed transmitted wavefront are proposed to compensate the wavefront distortion introduced by the second, the third gratings, and other optics in-house such as the beam splitter. This simple and economical method can compensate the space-time distortion in the compressor and then improve the focal intensity, which otherwise cannot be compensated by the deformable mirror outside the compressor due to angular chirp. Together with multi-beams tiled-aperture combining scheme, the novel compressor provides a new scheme to achieve high-energy PW-100PW lasers or even exawatt lasers with relatively small gratings in the future.

physics.optics↗

arXiv2020

Synergistic Learning of Lung Lobe Segmentation and Hierarchical Multi-Instance Classification for Automated Severity Assessment of COVID-19 in CT Images

Understanding chest CT imaging of the coronavirus disease 2019 (COVID-19) will help detect infections early and assess the disease progression. Especially, automated severity assessment of COVID-19 in CT images plays an essential role in identifying cases that are in great need of intensive clinical care. However, it is often challenging to accurately assess the severity of this disease in CT images, due to variable infection regions in the lungs, similar imaging biomarkers, and large inter-case variations. To this end, we propose a synergistic learning framework for automated severity assessment of COVID-19 in 3D CT images, by jointly performing lung lobe segmentation and multi-instance classification. Considering that only a few infection regions in a CT image are related to the severity assessment, we first represent each input image by a bag that contains a set of 2D image patches (with each cropped from a specific slice). A multi-task multi-instance deep network (called M$^2$UNet) is then developed to assess the severity of COVID-19 patients and also segment the lung lobe simultaneously. Our M$^2$UNet consists of a patch-level encoder, a segmentation sub-network for lung lobe segmentation, and a classification sub-network for severity assessment (with a unique hierarchical multi-instance learning strategy). Here, the context information provided by segmentation can be implicitly employed to improve the performance of severity assessment. Extensive experiments were performed on a real COVID-19 CT image dataset consisting of 666 chest CT images, with results suggesting the effectiveness of our proposed method compared to several state-of-the-art methods.

eess.IV↗

arXiv2020

Dual-Sampling Attention Network for Diagnosis of COVID-19 from Community Acquired Pneumonia

The coronavirus disease (COVID-19) is rapidly spreading all over the world, and has infected more than 1,436,000 people in more than 200 countries and territories as of April 9, 2020. Detecting COVID-19 at early stage is essential to deliver proper healthcare to the patients and also to protect the uninfected population. To this end, we develop a dual-sampling attention network to automatically diagnose COVID- 19 from the community acquired pneumonia (CAP) in chest computed tomography (CT). In particular, we propose a novel online attention module with a 3D convolutional network (CNN) to focus on the infection regions in lungs when making decisions of diagnoses. Note that there exists imbalanced distribution of the sizes of the infection regions between COVID-19 and CAP, partially due to fast progress of COVID-19 after symptom onset. Therefore, we develop a dual-sampling strategy to mitigate the imbalanced learning. Our method is evaluated (to our best knowledge) upon the largest multi-center CT data for COVID-19 from 8 hospitals. In the training-validation stage, we collect 2186 CT scans from 1588 patients for a 5-fold cross-validation. In the testing stage, we employ another independent large-scale testing dataset including 2796 CT scans from 2057 patients. Results show that our algorithm can identify the COVID-19 images with the area under the receiver operating characteristic curve (AUC) value of 0.944, accuracy of 87.5%, sensitivity of 86.9%, specificity of 90.1%, and F1-score of 82.0%. With this performance, the proposed algorithm could potentially aid radiologists with COVID-19 diagnosis from CAP, especially in the early stage of the COVID-19 outbreak.

cs.CV↗

arXiv2020

Convex Shape Prior for Deep Neural Convolution Network based Eye Fundus Images Segmentation

Convex Shapes (CS) are common priors for optic disc and cup segmentation in eye fundus images. It is important to design proper techniques to represent convex shapes. So far, it is still a problem to guarantee that the output objects from a Deep Neural Convolution Networks (DCNN) are convex shapes. In this work, we propose a technique which can be easily integrated into the commonly used DCNNs for image segmentation and guarantee that outputs are convex shapes. This method is flexible and it can handle multiple objects and allow some of the objects to be convex. Our method is based on the dual representation of the sigmoid activation function in DCNNs. In the dual space, the convex shape prior can be guaranteed by a simple quadratic constraint on a binary representation of the shapes. Moreover, our method can also integrate spatial regularization and some other shape prior using a soft thresholding dynamics (STD) method. The regularization can make the boundary curves of the segmentation objects to be simultaneously smooth and convex. We design a very stable active set projection algorithm to numerically solve our model. This algorithm can form a new plug-and-play DCNN layer called CS-STD whose outputs must be a nearly binary segmentation of convex objects. In the CS-STD block, the convexity information can be propagated to guide the DCNN in both forward and backward propagation during training and prediction process. As an application example, we apply the convexity prior layer to the retinal fundus images segmentation by taking the popular DeepLabV3+ as a backbone network. Experimental results on several public datasets show that our method is efficient and outperforms the classical DCNN segmentation methods.

cs.CV↗

arXiv2020

A Necessary Condition on Chain Reachable Robustness of Dynamical Systems

It is ``folklore'' that the solution to a set reachability problem for a dynamical system is only noncomputable because of non-robustness reasons. A robustness condition that can be imposed on a dynamical system is the requirement of the chain reachable set to equal the closure of the reachable set. We claim that this condition necessarily imposes strong conditions on the dynamical system. For instance, if the space is connected and compact and we are computing a chain reachable robust single valued function $f$ then $f$ cannot have an unstable fixed point or unstable periodic cycle.

math.OC↗

arXiv2020

A Sparse Learning Approach to the Detection of Multiple Noise-Like Jammers

In this paper, we address the problem of detecting multiple Noise-Like Jammers (NLJs) through a radar system equipped with an array of sensors. To this end, we develop an elegant and systematic framework wherein two architectures are devised to jointly detect an unknown number of NLJs and to estimate their respective angles of arrival. The followed approach relies on the likelihood ratio test in conjunction with a cyclic estimation procedure which incorporates at the design stage a sparsity promoting prior. As a matter of fact, the problem at hand owns an inherent sparse nature which is suitably exploited. This methodological choice is dictated by the fact that, from a mathematical point of view, classical maximum likelihood approach leads to intractable optimization problems (at least to the best of authors' knowledge) and, hence, a suboptimum approach represents a viable means to solve them. Performance analysis is conducted on simulated data and shows the effectiveness of the proposed architectures in drawing a reliable picture of the electromagnetic threats illuminating the radar system.

eess.SP↗

arXiv2020

Glassy Li Metal Anode for High-Performance Rechargeable Li Batteries

Controlling nanostructure from molecular, crystal lattice to the electrode level remains as arts in practice, where nucleation and growth of the crystals still require more fundamental understanding and precise control to shape the microstructure of metal deposits and their properties. This is vital to achieve dendrite-free Li metal anodes with high electrochemical reversibility for practical high-energy rechargeable Li batteries. Here, cryogenic-transmission electron microscopy was used to capture the dynamic growth and atomic structure of Li metal deposits at the early nucleation stage, in which a phase transition from amorphous, disordered states to a crystalline, ordered one was revealed as a function of current density and deposition time. The real-time atomic interaction over wide spatial and temporal scales was depicted by the reactive-molecular dynamics simulations. The results show that the condensation accompanied with the amorphous-to-crystalline phase transition requires sufficient exergy, mobility and time to carry out, contrary to what the classical nucleation theory predicts. These variabilities give rise to different kinetic pathways and temporal evolutions, resulting in various degrees of order and disorder nanostructure in nano-sized domains that dominate in the morphological evolution and reversibility of Li metal electrode. Compared to crystalline Li, amorphous/glassy Li outperforms in cycle life in high-energy rechargeable batteries and is the desired structure to achieve high kinetic stability for long cycle life.

physics.app-ph↗

arXiv2020

Severity Assessment of Coronavirus Disease 2019 (COVID-19) Using Quantitative Features from Chest CT Images

Background: Chest computed tomography (CT) is recognized as an important tool for COVID-19 severity assessment. As the number of affected patients increase rapidly, manual severity assessment becomes a labor-intensive task, and may lead to delayed treatment. Purpose: Using machine learning method to realize automatic severity assessment (non-severe or severe) of COVID-19 based on chest CT images, and to explore the severity-related features from the resulting assessment model. Materials and Method: Chest CT images of 176 patients (age 45.3$\pm$16.5 years, 96 male and 80 female) with confirmed COVID-19 are used, from which 63 quantitative features, e.g., the infection volume/ratio of the whole lung and the volume of ground-glass opacity (GGO) regions, are calculated. A random forest (RF) model is trained to assess the severity (non-severe or severe) based on quantitative features. Importance of each quantitative feature, which reflects the correlation to the severity of COVID-19, is calculated from the RF model. Results: Using three-fold cross validation, the RF model shows promising results, i.e., 0.933 of true positive rate, 0.745 of true negative rate, 0.875 of accuracy, and 0.91 of area under receiver operating characteristic curve (AUC). The resulting importance of quantitative features shows that the volume and its ratio (with respect to the whole lung volume) of ground glass opacity (GGO) regions are highly related to the severity of COVID-19, and the quantitative features calculated from the right lung are more related to the severity assessment than those of the left lung. Conclusion: The RF based model can achieve automatic severity assessment (non-severe or severe) of COVID-19 infection, and the performance is promising. Several quantitative features, which have the potential to reflect the severity of COVID-19, were revealed.

eess.IV↗

arXiv2020

TrajectoryNet: a new spatio-temporal feature learning network for human motion prediction

Human motion prediction is an increasingly interesting topic in computer vision and robotics. In this paper, we propose a new 2D CNN based network, TrajectoryNet, to predict future poses in the trajectory space. Compared with most existing methods, our model focuses on modeling the motion dynamics with coupled spatio-temporal features, local-global spatial features and global temporal co-occurrence features of the previous pose sequence. Specifically, the coupled spatio-temporal features describe the spatial and temporal structure information hidden in the natural human motion sequence, which can be mined by covering the space and time dimensions of the input pose sequence with the convolutional filters. The local-global spatial features that encode different correlations of different joints of the human body (e.g. strong correlations between joints of one limb, weak correlations between joints of different limbs) are captured hierarchically by enlarging the receptive field layer by layer and residual connections from the lower layers to the deeper layers in our proposed convolutional network. And the global temporal co-occurrence features represent the co-occurrence relationship that different subsequences in a complex motion sequence are appeared simultaneously, which can be obtained automatically with our proposed TrajectoryNet by reorganizing the temporal information as the depth dimension of the input tensor. Finally, future poses are approximated based on the captured motion dynamics features. Extensive experiments show that our method achieves state-of-the-art performance on three challenging benchmarks (e.g. Human3.6M, G3D, and FNTU), which demonstrates the effectiveness of our proposed method. The code will be available if the paper is accepted.

cs.CV↗

arXiv2020

Towards Cognitive Routing based on Deep Reinforcement Learning

Routing is one of the key functions for stable operation of network infrastructure. Nowadays, the rapid growth of network traffic volume and changing of service requirements call for more intelligent routing methods than before. Towards this end, we propose a definition of cognitive routing and an implementation approach based on Deep Reinforcement Learning (DRL). To facilitate the research of DRL-based cognitive routing, we introduce a simulator named RL4Net for DRL-based routing algorithm development and simulation. Then, we design and implement a DDPG-based routing algorithm. The simulation results on an example network topology show that the DDPG-based routing algorithm achieves better performance than OSPF and random weight algorithms. It demonstrate the preliminary feasibility and potential advantage of cognitive routing for future network.

cs.NI↗

arXiv2020

Energy-based Periodicity Mining with Deep Features for Action Repetition Counting in Unconstrained Videos

Action repetition counting is to estimate the occurrence times of the repetitive motion in one action, which is a relatively new, important but challenging measurement problem. To solve this problem, we propose a new method superior to the traditional ways in two aspects, without preprocessing and applicable for arbitrary periodicity actions. Without preprocessing, the proposed model makes our method convenient for real applications; processing the arbitrary periodicity action makes our model more suitable for the actual circumstance. In terms of methodology, firstly, we analyze the movement patterns of the repetitive actions based on the spatial and temporal features of actions extracted by deep ConvNets; Secondly, the Principal Component Analysis algorithm is used to generate the intuitive periodic information from the chaotic high-dimensional deep features; Thirdly, the periodicity is mined based on the high-energy rule using Fourier transform; Finally, the inverse Fourier transform with a multi-stage threshold filter is proposed to improve the quality of the mined periodicity, and peak detection is introduced to finish the repetition counting. Our work features two-fold: 1) An important insight that deep features extracted for action recognition can well model the self-similarity periodicity of the repetitive action is presented. 2) A high-energy based periodicity mining rule using deep features is presented, which can process arbitrary actions without preprocessing. Experimental results show that our method achieves comparable results on the public datasets YT Segments and QUVA.

cs.CV↗

arXiv2020

ZSTAD: Zero-Shot Temporal Activity Detection

An integral part of video analysis and surveillance is temporal activity detection, which means to simultaneously recognize and localize activities in long untrimmed videos. Currently, the most effective methods of temporal activity detection are based on deep learning, and they typically perform very well with large scale annotated videos for training. However, these methods are limited in real applications due to the unavailable videos about certain activity classes and the time-consuming data annotation. To solve this challenging problem, we propose a novel task setting called zero-shot temporal activity detection (ZSTAD), where activities that have never been seen in training can still be detected. We design an end-to-end deep network based on R-C3D as the architecture for this solution. The proposed network is optimized with an innovative loss function that considers the embeddings of activity labels and their super-classes while learning the common semantics of seen and unseen activities. Experiments on both the THUMOS14 and the Charades datasets show promising performance in terms of detecting unseen activities.

cs.CV↗

arXiv2020

Robustly Complete Synthesis of Memoryless Controllers for Nonlinear Systems with Reach-and-Stay Specifications

This paper proposes a finitely terminating algorithm to solve reach-and-stay control problems for nonlinear systems. The algorithm is guaranteed to return a control strategy if the specification is robustly realizable. Such a feature is desirable as the commonly used abstraction-based methods are sound but not complete for systems that are not incrementally stable. Fundamental to the proposed method is a fixed-point characterization of the winning set of the system with respect to a given specification, i.e., the initial states that can be controlled to satisfy the specification. The use of an adaptive partitioning scheme not only guarantees the approximation precision of the winning set but also reduces computational time. The effectiveness and efficiency are illustrated by several benchmarking examples.

math.OC↗

arXiv2020

A Variational Image Segmentation Model based on Normalized Cut with Adaptive Similarity and Spatial Regularization

Image segmentation is a fundamental research topic in image processing and computer vision. In the last decades, researchers developed a large number of segmentation algorithms for various applications. Amongst these algorithms, the Normalized cut (Ncut) segmentation method is widely applied due to its good performance. The Ncut segmentation model is an optimization problem whose energy is defined on a specifically designed graph. Thus, the segmentation results of the existing Ncut method are largely dependent on a pre-constructed similarity measure on the graph since this measure is usually given empirically by users. This flaw will lead to some undesirable segmentation results. In this paper, we propose a Ncut-based segmentation algorithm by integrating an adaptive similarity measure and spatial regularization. The proposed model combines the Parzen-Rosenblatt window method, non-local weights entropy, Ncut energy, and regularizer of phase field in a variational framework. Our method can adaptively update the similarity measure function by estimating some parameters. This adaptive procedure enables the proposed algorithm finding a better similarity measure for classification than the Ncut method. We provide some mathematical interpretation of the proposed adaptive similarity from multi-viewpoints such as statistics and convex optimization. In addition, the regularizer of phase field can guarantee that the proposed algorithm has a robust performance in the presence of noise, and it can also rectify the similarity measure with a spatial priori. The well-posed theory such as the existence of the minimizer for the proposed model is given in the paper. Compared with some existing segmentation methods such as the traditional Ncut-based model and the classical Chan-Vese model, the numerical experiments show that our method can provide promising segmentation results.

cs.CV↗

arXiv2020

Cross-stained Segmentation from Renal Biopsy Images Using Multi-level Adversarial Learning

Segmentation from renal pathological images is a key step in automatic analyzing the renal histological characteristics. However, the performance of models varies significantly in different types of stained datasets due to the appearance variations. In this paper, we design a robust and flexible model for cross-stained segmentation. It is a novel multi-level deep adversarial network architecture that consists of three sub-networks: (i) a segmentation network; (ii) a pair of multi-level mirrored discriminators for guiding the segmentation network to extract domain-invariant features; (iii) a shape discriminator that is utilized to further identify the output of the segmentation network and the ground truth. Experimental results on glomeruli segmentation from renal biopsy images indicate that our network is able to improve segmentation performance on target type of stained images and use unlabeled data to achieve similar accuracy to labeled data. In addition, this method can be easily applied to other tasks.

eess.IV↗