Searcharxiv⌕ Search

arXiv subjects

Rui Xu

Publications and source records attributed to Rui Xu.

At least 235 records · Page 13Linked to original sources

Class specific or shared? A cascaded dictionary learning framework for image classification

Dictionary learning methods can be split into: i) class specific dictionary learning ii) class shared dictionary learning. The difference between the two categories is how to use discriminative information. With the first category, samples of different classes are mapped into different subspaces, which leads to some redundancy with the class specific base vectors. While for the second category, the samples in each specific class can not be described accurately. In this paper, we first propose a novel class shared dictionary learning method named label embedded dictionary learning (LEDL). It is the improvement based on LCKSVD, which is easier to find out the optimal solution. Then we propose a novel framework named cascaded dictionary learning framework (CDLF) to combine the specific dictionary learning with shared dictionary learning to describe the feature to boost the performance of classification sufficiently. Extensive experimental results on six benchmark datasets illustrate that our methods are capable of achieving superior performance compared to several state-of-art classification algorithms.

cs.CV↗

Weak Form Theory-guided Neural Network (TgNN-wf) for Deep Learning of Subsurface Single and Two-phase Flow

Deep neural networks (DNNs) are widely used as surrogate models in geophysical applications; incorporating theoretical guidance into DNNs has improved the generalizability. However, most of such approaches define the loss function based on the strong form of conservation laws (via partial differential equations, PDEs), which is subject to deteriorated accuracy when the PDE has high order derivatives or the solution has strong discontinuities. Herein, we propose a weak form theory-guided neural network (TgNN-wf), which incorporates the weak form formulation of the PDE into the loss function combined with data constraint and initial and boundary conditions regularizations to tackle the aforementioned difficulties. In the weak form, high order derivatives in the PDE can be transferred to the test functions by performing integration-by-parts, which reduces computational error. We use domain decomposition with locally defined test functions, which captures local discontinuity effectively. Two numerical cases demonstrate the superiority of the proposed TgNN-wf over the strong form TgNN, including the hydraulic head prediction for unsteady-state 2D single-phase flow problems and the saturation profile prediction for 1D two-phase flow problems. Results show that TgNN-wf consistently has higher accuracy than TgNN, especially when strong discontinuity in the solution is present. TgNN-wf also trains faster than TgNN when the number of integration subdomains is not too large (<10,000). Moreover, TgNN-wf is more robust to noises. Thus, the proposed TgNN-wf paves the way for which a variety of deep learning problems in the small data regime can be solved more accurately and efficiently.

cs.LG↗

Local probe of the interlayer coupling strength of few-layers SnSe by contact-resonance atomic force microscopy

The interlayer bonding in two dimensional materials is particularly important because it is not only related to their physical and chemical stability but also affects their mechanical, thermal, electronic, optical, and other properties. To address this issue, we report the direct characterization of the interlayer bonding in 2D SnSe using contact-resonance atomic force microscopy in this study. Site specific CR spectroscopy and CR force spectroscopy measurements are performed on both SnSe and its supporting SiO2 substrate comparatively. Based on the cantilever and contact mechanic models, the contact stiffness and vertical Young's modulus are evaluated in comparison with SiO2 as a reference material. The interlayer bonding of SnSe is further analyzed in combination with the semi-analytical model and density functional theory calculations. The direct characterization of interlayer interactions using this nondestructive methodology of CR AFM would facilitate a better understanding of the physical and chemical properties of 2D layered materials, specifically for interlayer intercalation and vertical heterostructures.

cond-mat.mtrl-sci↗

Strong-field effects in massive scalar-tensor gravity for slowly spinning neutron stars and application to X-ray pulsar pulse profiles

Neutron stars (NSs) in scalar-tensor (ST) theories of gravitation can acquire scalar charges and generate distinct spacetimes from those in General Relativity (GR) through the celebrated phenomenon of spontaneous scalarization. Taking on an ST theory with the mass term of the scalar field, we determine the theory parameter space for spontaneous scalarization by investigating the linearized scalar field equation. Then the full numerical solutions for slowly rotating NSs are obtained and studied in great detail. The resulted spacetime is used to calculate test-particle geodesics. The lightlike geodesics are used to construct the profile of X-ray radiation from a pair of hot spots on the surface of scalarized NSs, which potentially can be compared with the data from the Neutron star Interior Composition Explorer (NICER) mission for testing the ST theory.

gr-qc↗

Triaxially-deformed Freely-precessing Neutron Stars: Continuous electromagnetic and gravitational radiation

The shape of a neutron star (NS) is closely linked to its internal structure and the equation of state of supranuclear matters. A rapidly rotating, asymmetric NS in the Milky Way undergoes free precession, making it a potential source for multimessenger observation. The free precession could manifest in (i) the spectra of continuous gravitational waves (GWs) in the kilohertz band for ground-based GW detectors, and (ii) the timing behavior and pulse-profile characteristics if the NS is monitored as a pulsar with radio and/or X-ray telescopes. We extend previous work and investigate in great detail the free precession of a triaxially deformed NS with analytical and numerical approaches. In particular, its associated continuous GWs and pulse signals are derived. Explicit examples are illustrated for the continuous GWs, as well as timing residuals in both time and frequency domains. These results are ready to be used for future multimessenger observation of triaxially-deformed freely-precessing NSs, in order to extract scientific implication as much as possible.

astro-ph.HE↗

Top-Down Shape Abstraction Based on Greedy Pole Selection

Motivated by the fact that the medial axis transform is able to encode nearly the complete shape, we propose to use as few medial balls as possible to approximate the original enclosed volume by the boundary surface. We progressively select new medial balls, in a top-down style, to enlarge the region spanned by the existing medial balls. The key spirit of the selection strategy is to encourage large medial balls while imposing given geometric constraints. We further propose a speedup technique based on a provable observation that the intersection of medial balls implies the adjacency of power cells (in the sense of the power crust). We further elaborate the selection rules in combination with two closely related applications. One application is to develop an easy-to-use ball-stick modeling system that helps non-professional users to quickly build a shape with only balls and wires, but any penetration between two medial balls must be suppressed. The other application is to generate porous structures with convex, compact (with a high isoperimetric quotient) and shape-aware pores where two adjacent spherical pores may have penetration as long as the mechanical rigidity can be well preserved.

cs.GR↗

Progressive Point Cloud Deconvolution Generation Network

In this paper, we propose an effective point cloud generation method, which can generate multi-resolution point clouds of the same shape from a latent vector. Specifically, we develop a novel progressive deconvolution network with the learning-based bilateral interpolation. The learning-based bilateral interpolation is performed in the spatial and feature spaces of point clouds so that local geometric structure information of point clouds can be exploited. Starting from the low-resolution point clouds, with the bilateral interpolation and max-pooling operations, the deconvolution network can progressively output high-resolution local and global feature maps. By concatenating different resolutions of local and global feature maps, we employ the multi-layer perceptron as the generation network to generate multi-resolution point clouds. In order to keep the shapes of different resolutions of point clouds consistent, we propose a shape-preserving adversarial loss to train the point cloud deconvolution generation network. Experimental results demonstrate the effectiveness of our proposed method.

cs.CV↗

Electron acceleration in non-relativistic quasi-perpendicular collisionless shocks

We study diffusive shock acceleration (DSA) of electrons in non-relativistic quasi-perpendicular shocks using self-consistent one-dimensional particle-in-cell (PIC) simulations. By exploring the parameter space of sonic and Alfvénic Mach numbers we find that high Mach number quasi-perpendicular shocks can efficiently accelerate electrons to power-law downstream spectra with slopes consistent with DSA prediction. Electrons are reflected by magnetic mirroring at the shock and drive non-resonant waves in the upstream. Reflected electrons are trapped between the shock front and upstream waves and undergo multiple cycles of shock drift acceleration before the injection into DSA. Strong current-driven waves also temporarily change the shock obliquity and cause mild proton pre-acceleration even in quasi-perpendicular shocks, which otherwise do not accelerate protons. These results can be used to understand nonthermal emission in supernova remnants and intracluster medium in galaxy clusters.

astro-ph.HE↗

Boosting Connectivity in Retinal Vessel Segmentation via a Recursive Semantics-Guided Network

Many deep learning based methods have been proposed for retinal vessel segmentation, however few of them focus on the connectivity of segmented vessels, which is quite important for a practical computer-aided diagnosis system on retinal images. In this paper, we propose an efficient network to address this problem. A U-shape network is enhanced by introducing a semantics-guided module, which integrates the enriched semantics information to shallow layers for guiding the network to explore more powerful features. Besides, a recursive refinement iteratively applies the same network over the previous segmentation results for progressively boosting the performance while increasing no extra network parameters. The carefully designed recursive semantics-guided network has been extensively evaluated on several public datasets. Experimental results have shown the efficiency of the proposed method.

eess.IV↗

Implications of the virus-encoded miRNA and host miRNA in the pathogenicity of SARS-CoV-2

The outbreak of COVID-19 caused by SARS-CoV-2 has rapidly spread worldwide and has caused over 1,400,000 infections and 80,000 deaths. There are currently no drugs or vaccines with proven efficacy for its prevention and little knowledge was known about the pathogenicity mechanism of SARS-CoV-2 infection. Previous studies showed both virus and host-derived MicroRNAs (miRNAs) played crucial roles in the pathology of virus infection. In this study, we use computational approaches to scan the SARS-CoV-2 genome for putative miRNAs and predict the virus miRNA targets on virus and human genome as well as the host miRNAs targets on virus genome. Furthermore, we explore miRNAs involved dysregulation caused by the virus infection. Our results implicated that the immune response and cytoskeleton organization are two of the most notable biological processes regulated by the infection-modulated miRNAs. Impressively, we found hsa-miR-4661-3p was predicted to target the S gene of SARS-CoV-2, and a virus-encoded miRNA MR147-3p could enhance the expression of TMPRSS2 with the function of strengthening SARS-CoV-2 infection in the gut. The study may provide important clues for the mechisms of pathogenesis of SARS-CoV-2.

q-bio.GN↗

When NAS Meets Robustness: In Search of Robust Architectures against Adversarial Attacks

Recent advances in adversarial attacks uncover the intrinsic vulnerability of modern deep neural networks. Since then, extensive efforts have been devoted to enhancing the robustness of deep networks via specialized learning algorithms and loss functions. In this work, we take an architectural perspective and investigate the patterns of network architectures that are resilient to adversarial attacks. To obtain the large number of networks needed for this study, we adopt one-shot neural architecture search, training a large network for once and then finetuning the sub-networks sampled therefrom. The sampled architectures together with the accuracies they achieve provide a rich basis for our study. Our "robust architecture Odyssey" reveals several valuable observations: 1) densely connected patterns result in improved robustness; 2) under computational budget, adding convolution operations to direct connection edge is effective; 3) flow of solution procedure (FSP) matrix is a good indicator of network robustness. Based on these observations, we discover a family of robust architectures (RobNets). On various datasets, including CIFAR, SVHN, Tiny-ImageNet, and ImageNet, RobNets exhibit superior robustness performance to other widely used architectures. Notably, RobNets substantially improve the robust accuracy (~5% absolute gains) under both white-box and black-box attacks, even with fewer parameter numbers. Code is available at https://github.com/gmh14/RobNets.

cs.LG↗

Neutron Star Structure in the Minimal Gravitational Standard-Model Extension and the Implication to Continuous Gravitational Waves

Tiny violation of Lorentz invariance has been the subject of theoretic study and experimental test for a long time. We use the Standard-Model Extension (SME) framework to investigate the effect of the minimal Lorentz violation on the structure of a neutron star. A set of hydrostatic equations with modifications from Lorentz violation are derived, and then the modifications are isolated and added to the Tolman-Oppenheimer-Volkoff (TOV) equation as the leading-order Lorentz-violation corrections in relativistic systems. A perturbation solution to the leading-order modified TOV equations is found. The quadrupole moments due to the anisotropy in the structure of neutron stars are calculated and used to estimate the quadrupole radiation of a spinning neutron star with the same deformation. The calculation puts forward a new test for Lorentz invariance in the strong-field regime when continuous gravitational waves are observed in the future.

gr-qc↗

A Cascade Sequence-to-Sequence Model for Chinese Mandarin Lip Reading

Lip reading aims at decoding texts from the movement of a speaker's mouth. In recent years, lip reading methods have made great progress for English, at both word-level and sentence-level. Unlike English, however, Chinese Mandarin is a tone-based language and relies on pitches to distinguish lexical or grammatical meaning, which significantly increases the ambiguity for the lip reading task. In this paper, we propose a Cascade Sequence-to-Sequence Model for Chinese Mandarin (CSSMCM) lip reading, which explicitly models tones when predicting sentence. Tones are modeled based on visual information and syntactic structure, and are used to predict sentence along with visual information and syntactic structure. In order to evaluate CSSMCM, a dataset called CMLR (Chinese Mandarin Lip Reading) is collected and released, consisting of over 100,000 natural sentences from China Network Television website. When trained on CMLR dataset, the proposed CSSMCM surpasses the performance of state-of-the-art lip reading frameworks, which confirms the effectiveness of explicit modeling of tones for Chinese Mandarin lip reading.

cs.CV↗

Hearing Lips: Improving Lip Reading by Distilling Speech Recognizers

Lip reading has witnessed unparalleled development in recent years thanks to deep learning and the availability of large-scale datasets. Despite the encouraging results achieved, the performance of lip reading, unfortunately, remains inferior to the one of its counterpart speech recognition, due to the ambiguous nature of its actuations that makes it challenging to extract discriminant features from the lip movement videos. In this paper, we propose a new method, termed as Lip by Speech (LIBS), of which the goal is to strengthen lip reading by learning from speech recognizers. The rationale behind our approach is that the features extracted from speech recognizers may provide complementary and discriminant clues, which are formidable to be obtained from the subtle movements of the lips, and consequently facilitate the training of lip readers. This is achieved, specifically, by distilling multi-granularity knowledge from speech recognizers to lip readers. To conduct this cross-modal knowledge distillation, we utilize an efficacious alignment scheme to handle the inconsistent lengths of the audios and videos, as well as an innovative filtering strategy to refine the speech recognizer's prediction. The proposed method achieves the new state-of-the-art performance on the CMLR and LRS2 datasets, outperforming the baseline by a margin of 7.66% and 2.75% in character error rate, respectively.

cs.CV↗

Learning Symbolic Physics with Graph Networks

We introduce an approach for imposing physically motivated inductive biases on graph networks to learn interpretable representations and improved zero-shot generalization. Our experiments show that our graph network models, which implement this inductive bias, can learn message representations equivalent to the true force vector when trained on n-body gravitational and spring-like simulations. We use symbolic regression to fit explicit algebraic equations to our trained model's message function and recover the symbolic form of Newton's law of gravitation without prior knowledge. We also show that our model generalizes better at inference time to systems with more bodies than had been experienced during training. Our approach is extensible, in principle, to any unknown interaction law learned by a graph network, and offers a valuable technique for interpreting and inferring explicit causal theories about the world from implicit knowledge captured by deep learning.

cs.LG↗

CARAFE: Content-Aware ReAssembly of FEatures

Feature upsampling is a key operation in a number of modern convolutional network architectures, e.g. feature pyramids. Its design is critical for dense prediction tasks such as object detection and semantic/instance segmentation. In this work, we propose Content-Aware ReAssembly of FEatures (CARAFE), a universal, lightweight and highly effective operator to fulfill this goal. CARAFE has several appealing properties: (1) Large field of view. Unlike previous works (e.g. bilinear interpolation) that only exploit sub-pixel neighborhood, CARAFE can aggregate contextual information within a large receptive field. (2) Content-aware handling. Instead of using a fixed kernel for all samples (e.g. deconvolution), CARAFE enables instance-specific content-aware handling, which generates adaptive kernels on-the-fly. (3) Lightweight and fast to compute. CARAFE introduces little computational overhead and can be readily integrated into modern network architectures. We conduct comprehensive evaluations on standard benchmarks in object detection, instance/semantic segmentation and inpainting. CARAFE shows consistent and substantial gains across all the tasks (1.2%, 1.3%, 1.8%, 1.1db respectively) with negligible computational overhead. It has great potential to serve as a strong building block for future research. It has great potential to serve as a strong building block for future research. Code and models are available at https://github.com/open-mmlab/mmdetection.

cs.CV↗

Modifications to Plane Gravitational Waves from Minimal Lorentz Violation

General Relativity predicts two modes for plane gravitational waves. When a tiny violation of Lorentz invariance occurs, the two gravitational wave modes are modified. We use perturbation theory to study the detailed form of the modifications to the two gravitational wave modes from the minimal Lorentz-violation coupling. The perturbation solution for the metric fluctuation up to the first order in Lorentz violation is discussed. Then, we investigate the motions of test particles under the influence of the plane gravitational waves with Lorentz violation. First-order deviations from the usual motions are found.

gr-qc↗

MIN: Co-Governing Multi-Identifier Network Architecture and its Prototype on Operator's Network

IP protocol is the core of TCP/IP network layer. However, since IP address and its Domain Name are allocated and managed by a single agency, there are risks of centralization. The semantic overload of IP address also reduces its scalability and mobility, which further hinders the security. This paper proposes a co-governing Multi-Identifier Network (MIN) architecture that constructs a network layer with parallel coexistence of multiple identifiers, including identity, content, geographic information, and IP address. On the management plane, we develop an efficient management system using consortium blockchain with voting consensus, so the network can simultaneously manage and support by hundreds or thousands of nodes with high throughput. On the data plane, we propose an algorithm merging hash table and prefix tree (HTP) for FIB, which avoids the false-negative error and can inter-translate different identifiers with tens of billions of entries. Further, we propose a scheme to transport IP packets using CCN as a tunnel for supporting progressive deployment. We deployed the prototype of MIN to the largest operators' network in Mainland China, Hongkong and Macao, and demonstrated that the network can register identifier under co-governing consensus algorithm, support VoD service very well.

cs.NI↗