arXiv subjects

Rui Li

Publications and source records attributed to Rui Li.

At least 397 records · Page 22Linked to original sources

arXiv2022

Velocity-resolved Reverberation Mapping of Changing-look Active Galactic Nucleus NGC~4151 During Outburst Stage: Evidence for Kinematics Evolution of Broad-line Region

Changing-look active galactic nucleus NGC~4151, which has attracted a lot of attention, is undergoing the second dramatic outburst stage in its evolutionary history. To investigate the geometry and kinematics of the broad-line region (BLR), and measure the mass of supermassive black hole in NGC~4151, we perform a seven-month photometric and spectroscopic monitoring program in 2020--2021, using the 2.4 m telescope at Lijiang Observatory. We successfully measure the time lags of the responses from broad \ha, \hb, \hg, \hei, and \heii\ emission lines to continuum variation, which are $7.63_{-2.62}^{+1.85}$, $6.21_{-1.13}^{+1.41}$, $5.67_{-1.94}^{+1.65}$, $1.59_{-1.11}^{+0.86}$, and $0.46_{-1.06}^{+1.22}$ days, respectively, following radial stratification. The ratios of time lags among these lines are $1.23 : 1.00 : 0.91 : 0.26 : 0.07$. We find that the continuum lag between the ultraviolet and optical bands can significantly affect the lag measurements of \hei\ and \heii. Virial and infalling gas motions coexist in this campaign, which is different from previous results, implying the evolutionary kinematics of BLR. Based on our measurements and previous ones in the literature, we confirm that the BLR of NGC~4151 is basically virialized. Finally, we compute the black hole mass through multiple lines, and the measurement from \hb\ to be $ 3.94_{-0.72}^{+0.90} \times 10^7 M_{\odot}$, which is consistent with previous results. The corresponding accretion rate is $0.02_{-0.01}^{+0.01} L_{\rm Edd} c^{-2}$, implying a sub-Eddington accretor.

astro-ph.GA↗

arXiv2022

Galaxy morphoto-Z with neural Networks (GaZNets). I. Optimized accuracy and outlier fraction from Imaging and Photometry

In the era of large sky surveys, photometric redshifts (photo-z) represent crucial information for galaxy evolution and cosmology studies. In this work, we propose a new Machine Learning (ML) tool called Galaxy morphoto-Z with neural Networks (GaZNet-1), which uses both images and multi-band photometry measurements to predict galaxy redshifts, with accuracy, precision and outlier fraction superior to standard methods based on photometry only. As a first application of this tool, we estimate photo-z of a sample of galaxies in the Kilo-Degree Survey (KiDS). GaZNet-1 is trained and tested on $\sim140 000$ galaxies collected from KiDS Data Release 4 (DR4), for which spectroscopic redshifts are available from different surveys. This sample is dominated by bright (MAG$\_$AUTO$<21$) and low redshift ($z < 0.8$) systems, however, we could use $\sim$ 6500 galaxies in the range $0.8 < z < 3$ to effectively extend the training to higher redshift. The inputs are the r-band galaxy images plus the 9-band magnitudes and colours, from the combined catalogs of optical photometry from KiDS and near-infrared photometry from the VISTA Kilo-degree Infrared survey. By combining the images and catalogs, GaZNet-1 can achieve extremely high precision in normalized median absolute deviation (NMAD=0.014 for lower redshift and NMAD=0.041 for higher redshift galaxies) and low fraction of outliers ($0.4$\% for lower and $1.27$\% for higher redshift galaxies). Compared to ML codes using only photometry as input, GaZNet-1 also shows a $\sim 10-35$% improvement in precision at different redshifts and a $\sim$ 45% reduction in the fraction of outliers. We finally discuss that, by correctly separating galaxies from stars and active galactic nuclei, the overall photo-z outlier fraction of galaxies can be cut down to $0.3$\%.

astro-ph.GA↗

arXiv2022

Finding Top-r Influential Communities under Aggregation Functions

Community search is a problem that seeks cohesive and connected subgraphs in a graph that satisfy certain topology constraints, e.g., degree constraints. The majority of existing works focus exclusively on the topology and ignore the nodes' influence in the communities. To tackle this deficiency, influential community search is further proposed to include the node's influence. Each node has a weight, namely influence value, in the influential community search problem to represent its network influence. The influence value of a community is produced by an aggregated function, e.g., max, min, avg, and sum, over the influence values of the nodes in the same community. The objective of the influential community search problem is to locate the top-r communities with the highest influence values while satisfying the topology constraints. Existing studies on influential community search have several limitations: (i) they focus exclusively on simple aggregation functions such as min, which may fall short of certain requirements in many real-world scenarios, and (ii) they impose no limitation on the size of the community, whereas most real-world scenarios do. This motivates us to conduct a new study to fill this gap. We consider the problem of identifying the top-r influential communities with/without size constraints while using more complicated aggregation functions such as sum or avg. We give a theoretical analysis demonstrating the hardness of the problems and propose efficient and effective heuristic solutions for our topr influential community search problems. Extensive experiments on real large graphs demonstrate that our proposed solution is significantly more efficient than baseline solutions.

cs.SI↗

arXiv2022

UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagery

Semantic segmentation of remotely sensed urban scene images is required in a wide range of practical applications, such as land cover mapping, urban change detection, environmental protection, and economic assessment.Driven by rapid developments in deep learning technologies, the convolutional neural network (CNN) has dominated semantic segmentation for many years. CNN adopts hierarchical feature representation, demonstrating strong capabilities for local information extraction. However, the local property of the convolution layer limits the network from capturing the global context. Recently, as a hot topic in the domain of computer vision, Transformer has demonstrated its great potential in global information modelling, boosting many vision-related tasks such as image classification, object detection, and particularly semantic segmentation. In this paper, we propose a Transformer-based decoder and construct a UNet-like Transformer (UNetFormer) for real-time urban scene segmentation. For efficient segmentation, the UNetFormer selects the lightweight ResNet18 as the encoder and develops an efficient global-local attention mechanism to model both global and local information in the decoder. Extensive experiments reveal that our method not only runs faster but also produces higher accuracy compared with state-of-the-art lightweight models. Specifically, the proposed UNetFormer achieved 67.8% and 52.4% mIoU on the UAVid and LoveDA datasets, respectively, while the inference speed can achieve up to 322.4 FPS with a 512x512 input on a single NVIDIA GTX 3090 GPU. In further exploration, the proposed Transformer-based decoder combined with a Swin Transformer encoder also achieves the state-of-the-art result (91.3% F1 and 84.1% mIoU) on the Vaihingen dataset. The source code will be freely available at https://github.com/WangLibo1995/GeoSeg.

cs.CV↗

arXiv2022

A New Perspective on the Effects of Spectrum in Graph Neural Networks

Many improvements on GNNs can be deemed as operations on the spectrum of the underlying graph matrix, which motivates us to directly study the characteristics of the spectrum and their effects on GNN performance. By generalizing most existing GNN architectures, we show that the correlation issue caused by the $unsmooth$ spectrum becomes the obstacle to leveraging more powerful graph filters as well as developing deep architectures, which therefore restricts GNNs' performance. Inspired by this, we propose the correlation-free architecture which naturally removes the correlation issue among different channels, making it possible to utilize more sophisticated filters within each channel. The final correlation-free architecture with more powerful filters consistently boosts the performance of learning graph representations. Code is available at https://github.com/qslim/gnn-spectrum.

cs.LG↗

arXiv2022

HousE: Knowledge Graph Embedding with Householder Parameterization

The effectiveness of knowledge graph embedding (KGE) largely depends on the ability to model intrinsic relation patterns and mapping properties. However, existing approaches can only capture some of them with insufficient modeling capacity. In this work, we propose a more powerful KGE framework named HousE, which involves a novel parameterization based on two kinds of Householder transformations: (1) Householder rotations to achieve superior capacity of modeling relation patterns; (2) Householder projections to handle sophisticated relation mapping properties. Theoretically, HousE is capable of modeling crucial relation patterns and mapping properties simultaneously. Besides, HousE is a generalization of existing rotation-based models while extending the rotations to high-dimensional spaces. Empirically, HousE achieves new state-of-the-art performance on five benchmark datasets. Our code is available at https://github.com/anrep/HousE.

cs.AI↗

arXiv2022

A Sahlqvist-style Correspondence Theorem for Linear-time Temporal Logic

The language of modal logic is capable of expressing first-order conditions on Kripke frames. The classic result by Henrik Sahlqvist identifies a significant class of modal formulas for which first-order conditions -- or Sahlqvist correspondents -- can be find in an effective, algorithmic way. Recent works have successfully extended this classic result to more complex modal languages. In this paper, we pursue a similar line and develop a Sahlqvist-style correspondence theorem for Linear-time Temporal Logic (LTL), which is one of the most widely used formal languages for temporal specification. LTL extends the syntax of basic modal logic with dedicated temporal operators Next X and Until U . As a result, the complexity of the class of formulas that have first-order correspondents also increases accordingly. In this paper, we identify a significant class of LTL Sahlqvist formulas built by using modal operators F , G, X, and U . The main result of this paper is to prove the correspondence of LTL Sahlqvist formulas to frame conditions that are definable in first-order language.

cs.LO↗

arXiv2022

Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Images

Semantic segmentation from very fine resolution (VFR) urban scene images plays a significant role in several application scenarios including autonomous driving, land cover classification, and urban planning, etc. However, the tremendous details contained in the VFR image, especially the considerable variations in scale and appearance of objects, severely limit the potential of the existing deep learning approaches. Addressing such issues represents a promising research field in the remote sensing community, which paves the way for scene-level landscape pattern analysis and decision making. In this paper, we propose a Bilateral Awareness Network which contains a dependency path and a texture path to fully capture the long-range relationships and fine-grained details in VFR images. Specifically, the dependency path is conducted based on the ResT, a novel Transformer backbone with memory-efficient multi-head self-attention, while the texture path is built on the stacked convolution operation. Besides, using the linear attention mechanism, a feature aggregation module is designed to effectively fuse the dependency features and texture features. Extensive experiments conducted on the three large-scale urban scene image segmentation datasets, i.e., ISPRS Vaihingen dataset, ISPRS Potsdam dataset, and UAVid dataset, demonstrate the effectiveness of our BANet. Specifically, a 64.6% mIoU is achieved on the UAVid dataset. Code is available at https://github.com/WangLibo1995/GeoSeg.

cs.CV↗

arXiv2022

A Novel Transformer Based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Images

The fully convolutional network (FCN) with an encoder-decoder architecture has been the standard paradigm for semantic segmentation. The encoder-decoder architecture utilizes an encoder to capture multilevel feature maps, which are incorporated into the final prediction by a decoder. As the context is crucial for precise segmentation, tremendous effort has been made to extract such information in an intelligent fashion, including employing dilated/atrous convolutions or inserting attention modules. However, these endeavors are all based on the FCN architecture with ResNet or other backbones, which cannot fully exploit the context from the theoretical concept. By contrast, we introduce the Swin Transformer as the backbone to extract the context information and design a novel decoder of densely connected feature aggregation module (DCFAM) to restore the resolution and produce the segmentation map. The experimental results on two remotely sensed semantic segmentation datasets demonstrate the effectiveness of the proposed scheme.Code is available at https://github.com/WangLibo1995/GeoSeg

cs.CV↗

arXiv2022

A Look at Improving Robustness in Visual-inertial SLAM by Moment Matching

The fusion of camera sensor and inertial data is a leading method for ego-motion tracking in autonomous and smart devices. State estimation techniques that rely on non-linear filtering are a strong paradigm for solving the associated information fusion task. The de facto inference method in this space is the celebrated extended Kalman filter (EKF), which relies on first-order linearizations of both the dynamical and measurement model. This paper takes a critical look at the practical implications and limitations posed by the EKF, especially under faulty visual feature associations and the presence of strong confounding noise. As an alternative, we revisit the assumed density formulation of Bayesian filtering and employ a moment matching (unscented Kalman filtering) approach to both visual-inertial odometry and visual SLAM. Our results highlight important aspects in robustness both in dynamics propagation and visual measurement updates, and we show state-of-the-art results on EuRoC MAV drone data benchmark.

cs.RO↗

arXiv2022

Low-energy subband wave-functions and effective $g$-factor of one-dimensional hole gas

One-dimensional (1D) hole gas confined in a cylindrical Ge nanowire has potential applications in quantum information technologies. Here, we analytically study the low-energy properties of this 1D hole gas. The subbands of the hole gas are two-fold degenerate. The low-energy subband wave-functions are obtained exactly, and the degenerate pairs are related to each other via a combination of the time-reversal and the spin-rotation transformations. In evaluating the effective $g$-factor of these low-energy subbands, the orbital effects of the magnetic field are shown to contribute as strongly as the Zeeman term. Also, near the center of the $k_{z}$ space, there is a sharp dip or a sharp peak in the effective $g$-factor. At the site $k_{z}=0$, the longitudinal $g$-factor $g_{l}$ is much less than the transverse $g$-factor $g_{t}$ for the lowest subband, while away from the site $k_{z}=0$, $g_{l}$ can be comparable to $g_{t}$.

cond-mat.mes-hall↗

arXiv2022

Searching strong `spin'-orbit coupled one-dimensional hole gas in strong magnetic fields

We show that a strong `spin'-orbit coupled one-dimensional (1D) hole gas is achievable via applying a strong magnetic field to the original two-fold degenerate (spin degeneracy) hole gas confined in a cylindrical Ge nanowire. Both strong longitudinal and strong transverse magnetic fields are feasible to achieve this goal. Based on quasi-degenerate perturbation calculations, we show the induced low-energy subband dispersion of the hole gas can be written as $E=\hbar^{2}k^{2}_{z}/(2m^{*}_{h})+ασ^{z}k_{z}+g^{*}_{h}μ_{B}Bσ^{x}/2$, a form exactly the same as that of the electron gas in the conduction band. Here the Pauli matrices $σ^{z,x}$ represent a pseudo spin (or `spin' ), because the real spin degree of freedom has been split off from the subband dispersions by the strong magnetic field. Also, for a moderate nanowire radius $R=10$ nm, the induced effective hole mass $m^{*}_{h}$ ($0.065\sim0.08~m_{e}$) and the `spin'-orbit coupling $α$ ($0.35\sim0.8$ eV~Å) have a small magnetic field dependence in the studied magnetic field interval $1<B<15$ T, while the effective $g$-factor $g^{*}_{h}$ of the hole `spin' only has a small magnetic field dependence in the large field region.

cond-mat.mes-hall↗

arXiv2022

MACU-Net for Semantic Segmentation of Fine-Resolution Remotely Sensed Images

Semantic segmentation of remotely sensed images plays an important role in land resource management, yield estimation, and economic assessment. U-Net, a deep encoder-decoder architecture, has been used frequently for image segmentation with high accuracy. In this Letter, we incorporate multi-scale features generated by different layers of U-Net and design a multi-scale skip connected and asymmetric-convolution-based U-Net (MACU-Net), for segmentation using fine-resolution remotely sensed images. Our design has the following advantages: (1) The multi-scale skip connections combine and realign semantic features contained in both low-level and high-level feature maps; (2) the asymmetric convolution block strengthens the feature representation and feature extraction capability of a standard convolution layer. Experiments conducted on two remotely sensed datasets captured by different satellite sensors demonstrate that the proposed MACU-Net transcends the U-Net, U-NetPPL, U-Net 3+, amongst other benchmark approaches. Code is available at https://github.com/lironui/MACU-Net.

eess.IV↗

arXiv2022

Unsupervised Multi-Modal Medical Image Registration via Discriminator-Free Image-to-Image Translation

In clinical practice, well-aligned multi-modal images, such as Magnetic Resonance (MR) and Computed Tomography (CT), together can provide complementary information for image-guided therapies. Multi-modal image registration is essential for the accurate alignment of these multi-modal images. However, it remains a very challenging task due to complicated and unknown spatial correspondence between different modalities. In this paper, we propose a novel translation-based unsupervised deformable image registration approach to convert the multi-modal registration problem to a mono-modal one. Specifically, our approach incorporates a discriminator-free translation network to facilitate the training of the registration network and a patchwise contrastive loss to encourage the translation network to preserve object shapes. Furthermore, we propose to replace an adversarial loss, that is widely used in previous multi-modal image registration methods, with a pixel loss in order to integrate the output of translation into the target modality. This leads to an unsupervised method requiring no ground-truth deformation or pairs of aligned images for training. We evaluate four variants of our approach on the public Learn2Reg 2021 datasets \cite{hering2021learn2reg}. The experimental results demonstrate that the proposed architecture achieves state-of-the-art performance. Our code is available at https://github.com/heyblackC/DFMIR.

cs.CV↗

arXiv2022

HASA: Hybrid Architecture Search with Aggregation Strategy for Echinococcosis Classification and Ovary Segmentation in Ultrasound Images

Different from handcrafted features, deep neural networks can automatically learn task-specific features from data. Due to this data-driven nature, they have achieved remarkable success in various areas. However, manual design and selection of suitable network architectures are time-consuming and require substantial effort of human experts. To address this problem, researchers have proposed neural architecture search (NAS) algorithms which can automatically generate network architectures but suffer from heavy computational cost and instability if searching from scratch. In this paper, we propose a hybrid NAS framework for ultrasound (US) image classification and segmentation. The hybrid framework consists of a pre-trained backbone and several searched cells (i.e., network building blocks), which takes advantage of the strengths of both NAS and the expert knowledge from existing convolutional neural networks. Specifically, two effective and lightweight operations, a mixed depth-wise convolution operator and a squeeze-and-excitation block, are introduced into the candidate operations to enhance the variety and capacity of the searched cells. These two operations not only decrease model parameters but also boost network performance. Moreover, we propose a re-aggregation strategy for the searched cells, aiming to further improve the performance for different vision tasks. We tested our method on two large US image datasets, including a 9-class echinococcosis dataset containing 9566 images for classification and an ovary dataset containing 3204 images for segmentation. Ablation experiments and comparison with other handcrafted or automatically searched architectures demonstrate that our method can generate more powerful and lightweight models for the above US image classification and segmentation tasks.

cs.CV↗

arXiv2022

Galaxy Spectra neural Networks (GaSNets). I. Searching for strong lens candidates in eBOSS spectra using Deep Learning

With the advent of new spectroscopic surveys from ground and space, observing up to hundreds of millions of galaxies, spectra classification will become overwhelming for standard analysis techniques. To prepare for this challenge, we introduce a family of deep learning tools to classify features in one-dimensional spectra. As the first application of these Galaxy Spectra neural Networks (GaSNets), we focus on tools specialized at identifying emission lines from strongly lensed star-forming galaxies in the eBOSS spectra. We first discuss the training and testing of these networks and define a threshold probability, PL, of 95% for the high quality event detection. Then, using a previous set of spectroscopically selected strong lenses from eBOSS, confirmed with HST, we estimate a completeness of ~80% as the fraction of lenses recovered above the adopted PL. We finally apply the GaSNets to ~1.3M spectra to collect a first list of ~430 new high quality candidates identified with deep learning applied to spectroscopy and visually graded as highly probable real events. A preliminary check against ground-based observations tentatively shows that this sample has a confirmation rate of 38%, in line with previous samples selected with standard (no deep learning) classification tools and follow-up by Hubble Space Telescope. This first test shows that machine learning can be efficiently extended to feature recognition in the wavelength space, which will be crucial for future surveys like 4MOST, DESI, Euclid, and the Chinese Space Station Telescope (CSST).

astro-ph.GA↗

arXiv2022

Building extraction with vision transformer

As an important carrier of human productive activities, the extraction of buildings is not only essential for urban dynamic monitoring but also necessary for suburban construction inspection. Nowadays, accurate building extraction from remote sensing images remains a challenge due to the complex background and diverse appearances of buildings. The convolutional neural network (CNN) based building extraction methods, although increased the accuracy significantly, are criticized for their inability for modelling global dependencies. Thus, this paper applies the Vision Transformer for building extraction. However, the actual utilization of the Vision Transformer often comes with two limitations. First, the Vision Transformer requires more GPU memory and computational costs compared to CNNs. This limitation is further magnified when encountering large-sized inputs like fine-resolution remote sensing images. Second, spatial details are not sufficiently preserved during the feature extraction of the Vision Transformer, resulting in the inability for fine-grained building segmentation. To handle these issues, we propose a novel Vision Transformer (BuildFormer), with a dual-path structure. Specifically, we design a spatial-detailed context path to encode rich spatial details and a global context path to capture global dependencies. Besides, we develop a window-based linear multi-head self-attention to make the complexity of the multi-head self-attention linear with the window size, which strengthens the global context extraction by using large windows and greatly improves the potential of the Vision Transformer in processing large-sized remote sensing images. The proposed method yields state-of-the-art performance (75.74% IoU) on the Massachusetts building dataset. Code will be available.

cs.CV↗

arXiv2022

A Family of Lanthanide Noncentrosymmetric Superconductors La$_4$$TX$ ($T$ = Ru, Rh, Ir; $X$ = Al, In)

We report the discovery of superconductivity in a series of noncentrosymmetric compounds La$_4$$TX$ ($T$ = Ru, Rh, Ir; $X$ = Al, In), which have a cubic crystal structure with space group $F\bar{4}3m$. La$_4$RuAl, La$_4$RhAl, La$_4$IrAl, La$_4$RuIn and La$_4$IrIn exhibit bulk superconducting transitions with critical temperatures $T_c$ of 1.77 K, 3.05 K, 1.54 K, 0.58 K and 0.93 K, respectively. The specific heat of the La$_4$$T$Al compounds are consistent with an $s$-wave model with a fully open superconducting gap. In all cases, the upper critical fields are well described by the Werthamer-Helfand-Hohenberg model, and the values are well below the Pauli limit, indicating that orbital limiting is the dominant pair-breaking mechanism. Density functional theory (DFT) calculations reveal that the degree of band splitting by the antisymmetric spin-orbit coupling (ASOC) shows considerable variation between the different compounds. This indicates that the strength of the ASOC is highly tunable across this series of superconductors, suggesting that these are good candidates for examining the relationship between the ASOC and superconducting properties in noncentrosymmetric superconductors.

cond-mat.supr-con↗