arXiv subjects

Xiaoming Zhang

Publications and source records attributed to Xiaoming Zhang.

At least 55 records · Page 3Linked to original sources

arXiv2025

MAT: Multi-Range Attention Transformer for Efficient Image Super-Resolution

Image super-resolution (SR) has significantly advanced through the adoption of Transformer architectures. However, conventional techniques aimed at enlarging the self-attention window to capture broader contexts come with inherent drawbacks, especially the significantly increased computational demands. Moreover, the feature perception within a fixed-size window of existing models restricts the effective receptive field (ERF) and the intermediate feature diversity. We demonstrate that a flexible integration of attention across diverse spatial extents can yield significant performance enhancements. In line with this insight, we introduce Multi-Range Attention Transformer (MAT) for SR tasks. MAT leverages the computational advantages inherent in dilation operation, in conjunction with self-attention mechanism, to facilitate both multi-range attention (MA) and sparse multi-range attention (SMA), enabling efficient capture of both regional and sparse global features. Combined with local feature extraction, MAT adeptly capture dependencies across various spatial ranges, improving the diversity and efficacy of its feature representations. We also introduce the MSConvStar module, which augments the model's ability for multi-range representation learning. Comprehensive experiments show that our MAT exhibits superior performance to existing state-of-the-art SR models with remarkable efficiency (~3.3 faster than SRFormer-light).

cs.CV↗

arXiv2025

Transformer-based Approach for Accurate Asteroid Spectra taxonomy and albedo estimation

China plans to launch a probe (Tianwen-2) around 2025, mainly for exploring the near-Earth asteroid 2016 HO3 . The mission involves close-range exploration, landing, and mining operations that require three-dimensional modeling of the asteroid, which requires prior knowledge of its material composition and uniformity. This information is crucial in progressive or ground exploration processes. Our research focuses on high-precision intelligent inversion of complex physical properties of asteroids based on spectral data, providing support for further analysis of aster oid materials, density, and structure. We have developed a platform for asteroid spectral classification, albedo estimation, and composition analysis, which includes three types of neural networks based on Transformer attention mechanism: One for spectral classification, achieving a four-class classification accuracy of 97.28% and an eleven-class classification accuracy of 95.69%; second one for albedo estimation, with an average absolute error of 0.0308 in S-type asteroid albedo estimation, and the third one for composition analysis, with a predicted spectral angular distance of only 0.0340 and a root mean square error of 0.1759 for the abundance of end members. These results indicate that our network can provide high-precision asteroid spectral classification, albedo estimation, and composition analysis results. In addition, we utilized the platform to analyze and provide results for six asteroids.

astro-ph.EP↗

arXiv2025

Ultra-Stable Ferrimagnetic Second-Order Topological Insulator in 2D Metal-Organic Framework

Two-dimensional (2D) magnetic second-order topological insulators (SOTIs) exhibit distinct topological phases characterized by spin-polarized zero-dimensional (0D) corner states, which have garnered significant interest. However, 2D ferrimagnetic (FiM) SOTIs, particularly those that simultaneously exhibit ultra-stable corner states, are still lacking. Here, based on first-principles calculations and theoretical analysis, we reveal such SOTI state in a 2D metal-organic framework (MOF) material, Cr(pyz)2 (pyz = pyrazine). This material exhibits FiM ground state with an easy axis aligned along [001] direction. It hosts a nontrivial real Chern number in the spin-up channel, enabled by PT symmetry, with 0D corner states observable in disk. In contrast, the spin-down channel exhibits a trivial gapped bulk state. Notably, the topological corner states in monolayer Cr(pyz)2 show high robustness, even if the symmetries are broken by introducing defects, the corner states persist. We also considered other external perturbations, including uniaxial/biaxial strain, ligand rotation, and electric fields, the corner states still remain stable. Even more, the energy positions of the corner states are also nearly unchanged. This work is the first to identify ultra-stable FiM SOTI state in the MOF system, and provide an ideal platform for future experimental investigations and applications in spintronic devices.

cond-mat.mtrl-sci↗

arXiv2025

Fault-tolerant quantum algorithms for quantum molecular systems: A survey

Solving quantum molecular systems presents a significant challenge for classical computation. The advent of early fault-tolerant quantum computing (EFTQC) devices offers a promising avenue to address these challenges, leveraging advanced quantum algorithms with reduced hardware requirements. This review surveys the latest developments in EFTQC and fully fault-tolerant quantum computing (FFTQC) algorithms for quantum molecular systems, covering encoding schemes, advanced Hamiltonian simulation techniques, and ground-state energy estimation methods. We highlight recent progress in overcoming practical barriers, such as reducing circuit depth and minimizing the use of ancillary qubits. Special attention is given to the potential quantum advantages achievable through these algorithms, as well as the limitations imposed by dequantization and classical simulation techniques. The review concludes with a discussion of future directions, emphasizing the need for optimized algorithms and experimental validation to bridge the gap between theoretical developments and practical implementation in EFTQC and FFTQC for quantum molecular systems.

quant-ph↗

arXiv2024

Diff-Shadow: Global-guided Diffusion Model for Shadow Removal

We propose Diff-Shadow, a global-guided diffusion model for shadow removal. Previous transformer-based approaches can utilize global information to relate shadow and non-shadow regions but are limited in their synthesis ability and recover images with obvious boundaries. In contrast, diffusion-based methods can generate better content but they are not exempt from issues related to inconsistent illumination. In this work, we combine the advantages of diffusion models and global guidance to achieve shadow-free restoration. Specifically, we propose a parallel UNets architecture: 1) the local branch performs the patch-based noise estimation in the diffusion process, and 2) the global branch recovers the low-resolution shadow-free images. A Reweight Cross Attention (RCA) module is designed to integrate global contextual information of non-shadow regions into the local branch. We further design a Global-guided Sampling Strategy (GSS) that mitigates patch boundary issues and ensures consistent illumination across shaded and unshaded regions in the recovered image. Comprehensive experiments on datasets ISTD, ISTD+, and SRD have demonstrated the effectiveness of Diff-Shadow. Compared to state-of-the-art methods, our method achieves a significant improvement in terms of PSNR, increasing from 32.33dB to 33.69dB on the ISTD dataset.

cs.CV↗

arXiv2024

FineFake: A Knowledge-Enriched Dataset for Fine-Grained Multi-Domain Fake News Detection

Existing benchmarks for fake news detection have significantly contributed to the advancement of models in assessing the authenticity of news content. However, these benchmarks typically focus solely on news pertaining to a single semantic topic or originating from a single platform, thereby failing to capture the diversity of multi-domain news in real scenarios. In order to understand fake news across various domains, the external knowledge and fine-grained annotations are indispensable to provide precise evidence and uncover the diverse underlying strategies for fabrication, which are also ignored by existing benchmarks. To address this gap, we introduce a novel multi-domain knowledge-enhanced benchmark with fine-grained annotations, named \textbf{FineFake}. FineFake encompasses 16,909 data samples spanning six semantic topics and eight platforms. Each news item is enriched with multi-modal content, potential social context, semi-manually verified common knowledge, and fine-grained annotations that surpass conventional binary labels. Furthermore, we formulate three challenging tasks based on FineFake and propose a knowledge-enhanced domain adaptation network. Extensive experiments are conducted on FineFake under various scenarios, providing accurate and reliable benchmarks for future endeavors. The entire FineFake project is publicly accessible as an open-source repository at \url{https://github.com/Accuser907/FineFake}.

cs.CL↗

arXiv2024

Minstrel: Structural Prompt Generation with Multi-Agents Coordination for Non-AI Experts

LLMs have demonstrated commendable performance across diverse domains. Nevertheless, formulating high-quality prompts to assist them in their work poses a challenge for non-AI experts. Existing research in prompt engineering suggests somewhat scattered optimization principles and designs empirically dependent prompt optimizers. Unfortunately, these endeavors lack a structural design, incurring high learning costs and it is not conducive to the iterative updating of prompts, especially for non-AI experts. Inspired by structured reusable programming languages, we propose LangGPT, a structural prompt design framework. Furthermore, we introduce Minstrel, a multi-generative agent system with reflection to automate the generation of structural prompts. Experiments and the case study illustrate that structural prompts generated by Minstrel or written manually significantly enhance the performance of LLMs. Furthermore, we analyze the ease of use of structural prompts through a user survey in our online community.

cs.CL↗

arXiv2024

Quasi-one-dimensional spin transport in altermagnetic $Z^3$ nodal net metals

In three dimensions, quasi-one-dimensional (Q1D) transport has traditionally been associated with systems featuring a Q1D chain structure. Here, based on first-principle calculations, we go beyond this understanding to show that the Q1D transport can also be realized in certain three-dimensional (3D) altermagnetic (AM) metals with a topological nodal net in momentum space but lacking Q1D chain structure in real space, including the existing compounds $β$-Fe$_2$(PO$_4$)O, Co$_2$(PO$_4$)O, and LiTi$_2$O$_4$. These materials exhibit an AM ground state and feature an ideal crossed $Z^3$ Weyl nodal line in each spin channel around Fermi level, formed by three straight and flat nodal lines traversing the entire Brillouin zone. These nodal lines eventually lead to an AM $Z^3$ nodal net. Surprisingly, the electronic conductivity $σ_{xx}$ in these topological nodal net metals is dozens of times larger than $σ_{yy}$ and $σ_{zz}$ in the up-spin channel, while $σ_{yy}$ dominates transport in the down-spin channel. This suggests a distinctive Q1D transport signature in each spin channel, and the principal moving directions for the two spin channels are orthogonal, resulting in Q1D direction-dependent spin transport. This novel phenomenon cannot be found in both conventional 3D bulk materials and Q1D chain materials. In particular, the Q1D spin transport gradually disappears as the Fermi energy moves away from the nodal net, further confirming its topological origin. Our work not only enhances the comprehension of topological physics in altermagnets but also opens a new direction for the exploration of topological spintronics.

cond-mat.mtrl-sci↗

arXiv2024

Rapid Automatic Multiple Moving Objects Detection Method Based on Feature Extraction from Images with Non-sidereal Tracking

Optically observing and monitoring moving objects, both natural and artificial, is important to human space security. Non-sidereal tracking can improve the system's limiting magnitude for moving objects, which benefits the surveillance. However, images with non-sidereal tracking include complex background, as well as objects with different brightness and moving mode, posing a significant challenge for accurate multi-object detection in such images, especially in wide field of view (WFOV) telescope images. To achieve a higher detection precision in a higher speed, we proposed a novel object detection method, which combines the source feature extraction and the neural network. First, our method extracts object features from optical images such as centroid, shape, and flux. Then it conducts a naive labeling based on those features to distinguish moving objects from stars. After balancing the labeled data, we employ it to train a neural network aimed at creating a classification model for point-like and streak-like objects. Ultimately, based on the neural network model's classification outcomes, moving objects whose motion modes consistent with the tracked objects are detected via track association, while objects with different motion modes are detected using morphological statistics. The validation, based on the space objects images captured in target tracking mode with the 1-meter telescope at Nanshan, Xinjiang Astronomical Observatory, demonstrates that our method achieves 94.72% detection accuracy with merely 5.02% false alarm rate, and a processing time of 0.66s per frame. Consequently, our method can rapidly and accurately detect objects with different motion modes from wide-field images with non-sidereal tracking.

astro-ph.IM↗

arXiv2024

Hierarchical Retrieval-Augmented Generation Model with Rethink for Multi-hop Question Answering

Multi-hop Question Answering (QA) necessitates complex reasoning by integrating multiple pieces of information to resolve intricate questions. However, existing QA systems encounter challenges such as outdated information, context window length limitations, and an accuracy-quantity trade-off. To address these issues, we propose a novel framework, the Hierarchical Retrieval-Augmented Generation Model with Rethink (HiRAG), comprising Decomposer, Definer, Retriever, Filter, and Summarizer five key modules. We introduce a new hierarchical retrieval strategy that incorporates both sparse retrieval at the document level and dense retrieval at the chunk level, effectively integrating their strengths. Additionally, we propose a single-candidate retrieval method to mitigate the limitations of multi-candidate retrieval. We also construct two new corpora, Indexed Wikicorpus and Profile Wikicorpus, to address the issues of outdated and insufficient knowledge. Our experimental results on four datasets demonstrate that HiRAG outperforms state-of-the-art models across most metrics, and our Indexed Wikicorpus is effective. The code for HiRAG is available at https://github.com/2282588541a/HiRAG

cs.CL↗

arXiv2024

Hi-ResNet: Edge Detail Enhancement for High-Resolution Remote Sensing Segmentation

High-resolution remote sensing (HRS) semantic segmentation extracts key objects from high-resolution coverage areas. However, objects of the same category within HRS images generally show significant differences in scale and shape across diverse geographical environments, making it difficult to fit the data distribution. Additionally, a complex background environment causes similar appearances of objects of different categories, which precipitates a substantial number of objects into misclassification as background. These issues make existing learning algorithms sub-optimal. In this work, we solve the above-mentioned problems by proposing a High-resolution remote sensing network (Hi-ResNet) with efficient network structure designs, which consists of a funnel module, a multi-branch module with stacks of information aggregation (IA) blocks, and a feature refinement module, sequentially, and Class-agnostic Edge Aware (CEA) loss. Specifically, we propose a funnel module to downsample, which reduces the computational cost, and extract high-resolution semantic information from the initial input image. Secondly, we downsample the processed feature images into multi-resolution branches incrementally to capture image features at different scales and apply IA blocks, which capture key latent information by leveraging attention mechanisms, for effective feature aggregation, distinguishing image features of the same class with variant scales and shapes. Finally, our feature refinement module integrate the CEA loss function, which disambiguates inter-class objects with similar shapes and increases the data distribution distance for correct predictions. With effective pre-training strategies, we demonstrated the superiority of Hi-ResNet over state-of-the-art methods on three HRS segmentation benchmarks.

cs.CV↗

arXiv2024

Efficient Single Image Super-Resolution with Entropy Attention and Receptive Field Augmentation

Transformer-based deep models for single image super-resolution (SISR) have greatly improved the performance of lightweight SISR tasks in recent years. However, they often suffer from heavy computational burden and slow inference due to the complex calculation of multi-head self-attention (MSA), seriously hindering their practical application and deployment. In this work, we present an efficient SR model to mitigate the dilemma between model efficiency and SR performance, which is dubbed Entropy Attention and Receptive Field Augmentation network (EARFA), and composed of a novel entropy attention (EA) and a shifting large kernel attention (SLKA). From the perspective of information theory, EA increases the entropy of intermediate features conditioned on a Gaussian distribution, providing more informative input for subsequent reasoning. On the other hand, SLKA extends the receptive field of SR models with the assistance of channel shifting, which also favors to boost the diversity of hierarchical features. Since the implementation of EA and SLKA does not involve complex computations (such as extensive matrix multiplications), the proposed method can achieve faster nonlinear inference than Transformer-based SR models while maintaining better SR performance. Extensive experiments show that the proposed model can significantly reduce the delay of model inference while achieving the SR performance comparable with other advanced models.

eess.IV↗

arXiv2024

Large Kernel Distillation Network for Efficient Single Image Super-Resolution

Efficient and lightweight single-image super-resolution (SISR) has achieved remarkable performance in recent years. One effective approach is the use of large kernel designs, which have been shown to improve the performance of SISR models while reducing their computational requirements. However, current state-of-the-art (SOTA) models still face problems such as high computational costs. To address these issues, we propose the Large Kernel Distillation Network (LKDN) in this paper. Our approach simplifies the model structure and introduces more efficient attention modules to reduce computational costs while also improving performance. Specifically, we employ the reparameterization technique to enhance model performance without adding extra cost. We also introduce a new optimizer from other tasks to SISR, which improves training speed and performance. Our experimental results demonstrate that LKDN outperforms existing lightweight SR methods and achieves SOTA performance.

eess.IV↗

arXiv2024

Improved Esophageal Varices Assessment from Non-Contrast CT Scans

Esophageal varices (EV), a serious health concern resulting from portal hypertension, are traditionally diagnosed through invasive endoscopic procedures. Despite non-contrast computed tomography (NC-CT) imaging being a less expensive and non-invasive imaging modality, it has yet to gain full acceptance as a primary clinical diagnostic tool for EV evaluation. To overcome existing diagnostic challenges, we present the Multi-Organ-cOhesion-Network (MOON), a novel framework enhancing the analysis of critical organ features in NC-CT scans for effective assessment of EV. Drawing inspiration from the thorough assessment practices of radiologists, MOON establishes a cohesive multiorgan analysis model that unifies the imaging features of the related organs of EV, namely esophagus, liver, and spleen. This integration significantly increases the diagnostic accuracy for EV. We have compiled an extensive NC-CT dataset of 1,255 patients diagnosed with EV, spanning three grades of severity. Each case is corroborated by endoscopic diagnostic results. The efficacy of MOON has been substantiated through a validation process involving multi-fold cross-validation on 1,010 cases and an independent test on 245 cases, exhibiting superior diagnostic performance compared to methods focusing solely on the esophagus (for classifying severe grade: AUC of 0.864 versus 0.803, and for moderate to severe grades: AUC of 0.832 versus 0.793). To our knowledge, MOON is the first work to incorporate a synchronized multi-organ NC-CT analysis for EV assessment, providing a more acceptable and minimally invasive alternative for patients compared to traditional endoscopy.

eess.IV↗

arXiv2024

LIDIA: Precise Liver Tumor Diagnosis on Multi-Phase Contrast-Enhanced CT via Iterative Fusion and Asymmetric Contrastive Learning

The early detection and precise diagnosis of liver tumors are tasks of critical clinical value, yet they pose significant challenges due to the high heterogeneity and variability of liver tumors. In this work, a precise LIver tumor DIAgnosis network on multi-phase contrast-enhance CT, named LIDIA, is proposed for real-world scenario. To fully utilize all available phases in contrast-enhanced CT, LIDIA first employs the iterative fusion module to aggregate variable numbers of image phases, thereby capturing the features of lesions at different phases for better tumor diagnosis. To effectively mitigate the high heterogeneity problem of liver tumors, LIDIA incorporates asymmetric contrastive learning to enhance the discriminability between different classes. To evaluate our method, we constructed a large-scale dataset comprising 1,921 patients and 8,138 lesions. LIDIA has achieved an average AUC of 93.6% across eight different types of lesions, demonstrating its effectiveness. Besides, LIDIA also demonstrated strong generalizability with an average AUC of 89.3% when tested on an external cohort of 828 patients.

cs.CV↗

arXiv2024

LangGPT: Rethinking Structured Reusable Prompt Design Framework for LLMs from the Programming Language

LLMs have demonstrated commendable performance across diverse domains. Nevertheless, formulating high-quality prompts to instruct LLMs proficiently poses a challenge for non-AI experts. Existing research in prompt engineering suggests somewhat scattered optimization principles and designs empirically dependent prompt optimizers. Unfortunately, these endeavors lack a structured design template, incurring high learning costs and resulting in low reusability. In addition, it is not conducive to the iterative updating of prompts. Inspired by structured reusable programming languages, we propose LangGPT, a dual-layer prompt design framework as the programming language for LLMs. LangGPT has an easy-to-learn normative structure and provides an extended structure for migration and reuse. Experiments illustrate that LangGPT significantly enhances the performance of LLMs. Moreover, the case study shows that LangGPT leads LLMs to generate higher-quality responses. Furthermore, we analyzed the ease of use and reusability of LangGPT through a user survey in our online community.

cs.SE↗

arXiv2024

Cobalt-based Co$_3$Mo3N/Co$_4$N/Co Metallic Heterostructure as a Highly Active Electrocatalyst for Alkaline Overall Water Splitting

Alkaline water electrolysis is considered a commercially viable option for large-scale hydrogen production. However, this process still faces challenges due to the high voltage (>1.65 V at 10 mA cm$^{-2}$) and its limited stability at higher current densities due to the inefficient electron transport kinetics. Herein, a novel cobalt based metallic heterostructure (Co$_3$Mo3N/Co$_4$N/Co/Co) is designed for application for water electrolysis. Operando Raman experiments reveal that the formation of Co$_3$Mo3N/Co$_4$N/Co heterointerface boosts the free water adsorption and dissociation, resulting in a surplus of protons available for subsequent hydrogen production. Furthermore, the altered electronic structure of Co$_3$Mo3N/Co$_4$N/Co heterointerface optimizes the ΔGH of nitrogen atoms at the interface. This synergistic effect between interfacial nitrogen atoms and metal phase cobalt creates highly efficient hydrogen evolution reaction (HER) active sites, thereby enhancing the overall performance. Additionally, the heterostructure exhibits a rapid OH- adsorption rate, coupled with a strong adsorption strength, leading to improved oxygen evolution reaction (OER) performance. Crucially, the metallic heterojunction facilitates fast electron transport, expediting the aforementioned reaction steps and ultimately improving the overall efficiency of water splitting. The water electrolyzer with Co$_3$Mo3N/Co$_4$N/Co/Co as a catalyst exhibits outstanding performance, requiring an impressively low cell voltage of 1.58 V at 10 mA cm$^{-2}$ and maintaining approximately 100% retention over a remarkable 100 h duration at 200 mA cm$^{-2}$. This performance significantly exceeds that of the commercial Pt/C || RuO2 electrolyzer.

physics.app-ph↗

arXiv2024

Spiral Scanning and Self-Supervised Image Reconstruction Enable Ultra-Sparse Sampling Multispectral Photoacoustic Tomography

Multispectral photoacoustic tomography (PAT) is an imaging modality that utilizes the photoacoustic effect to achieve non-invasive and high-contrast imaging of internal tissues. However, the hardware cost and computational demand of a multispectral PAT system consisting of up to thousands of detectors are huge. To address this challenge, we propose an ultra-sparse spiral sampling strategy for multispectral PAT, which we named U3S-PAT. Our strategy employs a sparse ring-shaped transducer that, when switching excitation wavelengths, simultaneously rotates and translates. This creates a spiral scanning pattern with multispectral angle-interlaced sampling. To solve the highly ill-conditioned image reconstruction problem, we propose a self-supervised learning method that is able to introduce structural information shared during spiral scanning. We simulate the proposed U3S-PAT method on a commercial PAT system and conduct in vivo animal experiments to verify its performance. The results show that even with a sparse sampling rate as low as 1/30, our U3S-PAT strategy achieves similar reconstruction and spectral unmixing accuracy as non-spiral dense sampling. Given its ability to dramatically reduce the time required for three-dimensional multispectral scanning, our U3S-PAT strategy has the potential to perform volumetric molecular imaging of dynamic biological activities.

eess.IV↗