Searcharxiv⌕ Search

arXiv subjects

Hao Zheng

Publications and source records attributed to Hao Zheng.

At least 91 records · Page 5Linked to original sources

Stacking-orientation and twist-angle control on integer and fractional Chern insulators in moiré rhombohedral graphene

Rhombohedral-stacked multilayer graphene aligned with hexagonal boron nitride has emerged as an excellent platform for investigating exotic quantum phenomena arising from the interplay between electron correlations and nontrivial topology. However, the microscopic mechanism governing the emergence of both the integer and fractional Chern insulator states in this system remains an open question. In this work, we systematically investigate the electrical transport properties of RMG/hBN moiré devices with controlled alignment orientations and twist angles. We demonstrate that alignment orientation strongly modulates correlated phenomena in the moiré-proximal regime, while having negligible influence on the formation of integer and fractional Chern insulators in the moiré-distant regime. Instead, the moiré periodicity, tuned by the twist angle, serves as the key parameter controlling the stability of these correlated topological states in the moiré-distant regime. Furthermore, in the moiré-proximal regime of one specific alignment, we observe anomalous Hall effect and a variety of competing phases near ν = 1, including integer Chern insulator states, extended Chern insulator states, and trivial insulators, whose stability is highly sensitive to both the applied displacement electric field and magnetic field. Our results underscore the critical role of stacking-alignment and twist-angle engineering in exploring novel quantum states based on rhombohedral-stacked multilayer graphene moiré systems.

cond-mat.mes-hall↗

X-LeBench: A Benchmark for Extremely Long Egocentric Video Understanding

Long-form egocentric video understanding provides rich contextual information and unique insights into long-term human behaviors, holding significant potential for applications in embodied intelligence, long-term activity analysis, and personalized assistive technologies. However, existing benchmark datasets primarily focus on single, short (\eg, minutes to tens of minutes) to moderately long videos, leaving a substantial gap in evaluating extensive, ultra-long egocentric video recordings. To address this, we introduce X-LeBench, a novel benchmark dataset meticulously designed to fill this gap by focusing on tasks requiring a comprehensive understanding of extremely long egocentric video recordings. Our X-LeBench develops a life-logging simulation pipeline that produces realistic, coherent daily plans aligned with real-world video data. This approach enables the flexible integration of synthetic daily plans with real-world footage from Ego4D-a massive-scale egocentric video dataset covers a wide range of daily life scenarios-resulting in 432 simulated video life logs spanning from 23 minutes to 16.4 hours. The evaluations of several baseline systems and multimodal large language models (MLLMs) reveal their poor performance across the board, highlighting the inherent challenges of long-form egocentric video understanding, such as temporal localization and reasoning, context aggregation, and memory retention, and underscoring the need for more advanced models.

cs.CV↗

Generalized Witt and Morita equivalences

In this work, we introduce a family of new equivalence relations among fusion categories that are less refined than the usual Morita equivalence. We obtain abelian groups by quotienting these new equivalence relations from the commutative monoids of the equivalence classes of all fusion categories. Moreover, we upgrade them to equivalence relations among nondegenerate braided fusion categories that are more refined than the usual Witt equivalence. As a consequence, we obtain new abelian groups that are more refined than the usual Witt group. These new groups allow us to access the internal structures within Witt classes. We expect that they are useful in the classification program of (braided) fusion (higher) categories and in the study of gapless edges of 2+1D topological orders.

math.QA↗

A Hybrid Framework Bridging CNN and ViT based on Theory of Evidence for Diabetic Retinopathy Grading

Diabetic retinopathy (DR) is a leading cause of vision loss among middle-aged and elderly people, which significantly impacts their daily lives and mental health. To improve the efficiency of clinical screening and enable the early detection of DR, a variety of automated DR diagnosis systems have been recently established based on convolutional neural network (CNN) or vision Transformer (ViT). However, due to the own shortages of CNN / ViT, the performance of existing methods using single-type backbone has reached a bottleneck. One potential way for the further improvements is integrating different kinds of backbones, which can fully leverage the respective strengths of them (\emph{i.e.,} the local feature extraction capability of CNN and the global feature capturing ability of ViT). To this end, we propose a novel paradigm to effectively fuse the features extracted by different backbones based on the theory of evidence. Specifically, the proposed evidential fusion paradigm transforms the features from different backbones into supporting evidences via a set of deep evidential networks. With the supporting evidences, the aggregated opinion can be accordingly formed, which can be used to adaptively tune the fusion pattern between different backbones and accordingly boost the performance of our hybrid model. We evaluated our method on two publicly available DR grading datasets. The experimental results demonstrate that our hybrid model not only improves the accuracy of DR grading, compared to the state-of-the-art frameworks, but also provides the excellent interpretability for feature fusion and decision-making.

cs.CV↗

Label Smoothing Improves Gradient Ascent in LLM Unlearning

LLM unlearning has emerged as a promising approach, aiming to enable models to forget hazardous/undesired knowledge at low cost while preserving as much model utility as possible. Among existing techniques, the most straightforward method is performing Gradient Ascent (GA) w.r.t. the forget data, thereby forcing the model to unlearn the forget dataset. However, GA suffers from severe instability, as it drives updates in a divergent direction, often resulting in drastically degraded model utility. To address this issue, we propose Smoothed Gradient Ascent (SGA). SGA combines the forget data with multiple constructed normal data through a tunable smoothing rate. Intuitively, this extends GA from learning solely on the forget data to jointly learning across both forget and normal data, enabling more stable unlearning while better preserving model utility. Theoretically, we provide the theoretical guidance on the selection of the optimal smoothing rate. Empirically, we evaluate SGA on three benchmarks: TOFU, Harry Potter, and MUSE-NEWS. Experimental results demonstrate that SGA consistently outperforms the original Gradient Ascent (GA) method across all metrics and achieves top-2 performance among all baseline methods on several key metrics.

cs.LG↗

AeroDiT: Diffusion Transformers for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flows

Real-time and accurate prediction of aerodynamic flow fields around airfoils is crucial for flow control and aerodynamic optimization. However, achieving this remains challenging due to the high computational costs and the non-linear nature of flow physics. Traditional Computational Fluid Dynamics (CFD) methods face limitations in balancing computational efficiency and accuracy, hindering their application in real-time scenarios. To address these challenges, this study presents AeroDiT, a novel surrogate model that integrates scalable diffusion models with transformer architectures to address these challenges. Trained on Reynolds-Averaged Navier-Stokes (RANS) simulation data for high Reynolds-number airfoil flows, AeroDiT accurately captures complex flow patterns while enabling real-time predictions. The model demonstrates impressive performance, with mean relative $L_2$ errors of 0.1, 0.025, and 0.050 for pressure $p$ and velocity components $u_x, u_y$, confirming its reliability. To further enhance physical consistency, we incorporate explicit physics-informed losses based on RANS residuals, including mass and momentum conservation constraints. The transformer-based structure allows for real-time predictions within seconds, enabling efficient aerodynamic simulations. This work underscores the potential of generative machine learning techniques to advance computational fluid dynamics, offering potential solutions to challenges in simulating high-fidelity aerodynamic flows.

physics.flu-dyn↗

Cell Instance Segmentation: The Devil Is in the Boundaries

State-of-the-art (SOTA) methods for cell instance segmentation are based on deep learning (DL) semantic segmentation approaches, focusing on distinguishing foreground pixels from background pixels. In order to identify cell instances from foreground pixels (e.g., pixel clustering), most methods decompose instance information into pixel-wise objectives, such as distances to foreground-background boundaries (distance maps), heat gradients with the center point as heat source (heat diffusion maps), and distances from the center point to foreground-background boundaries with fixed angles (star-shaped polygons). However, pixel-wise objectives may lose significant geometric properties of the cell instances, such as shape, curvature, and convexity, which require a collection of pixels to represent. To address this challenge, we present a novel pixel clustering method, called Ceb (for Cell boundaries), to leverage cell boundary features and labels to divide foreground pixels into cell instances. Starting with probability maps generated from semantic segmentation, Ceb first extracts potential foreground-foreground boundaries with a revised Watershed algorithm. For each boundary candidate, a boundary feature representation (called boundary signature) is constructed by sampling pixels from the current foreground-foreground boundary as well as the neighboring background-foreground boundaries. Next, a boundary classifier is used to predict its binary boundary label based on the corresponding boundary signature. Finally, cell instances are obtained by dividing or merging neighboring regions based on the predicted boundary labels. Extensive experiments on six datasets demonstrate that Ceb outperforms existing pixel clustering methods on semantic segmentation probability maps. Moreover, Ceb achieves highly competitive performance compared to SOTA cell instance segmentation methods.

cs.CV↗

PinPoint3D: Fine-Grained 3D Part Segmentation from a Few Clicks

Fine-grained 3D part segmentation is crucial for enabling embodied AI systems to perform complex manipulation tasks, such as interacting with specific functional components of an object. However, existing interactive segmentation methods are largely confined to coarse, instance-level targets, while non-interactive approaches struggle with sparse, real-world scans and suffer from a severe lack of annotated data. To address these limitations, we introduce PinPoint3D, a novel interactive framework for fine-grained, multi-granularity 3D segmentation, capable of generating precise part-level masks from only a few user point clicks. A key component of our work is a new 3D data synthesis pipeline that we developed to create a large-scale, scene-level dataset with dense part annotations, overcoming a critical bottleneck that has hindered progress in this field. Through comprehensive experiments and user studies, we demonstrate that our method significantly outperforms existing approaches, achieving an average IoU of around 55.8% on each object part under first-click settings and surpassing 71.3% IoU with only a few additional clicks. Compared to current state-of-the-art baselines, PinPoint3D yields up to a 16% improvement in IoU and precision, highlighting its effectiveness on challenging, sparse point clouds with high efficiency. Our work represents a significant step towards more nuanced and precise machine perception and interaction in complex 3D environments.

cs.CV↗

Higher condensation theory

We develop a unified mathematical theory of defect condensations for topological orders in all dimensions based on higher categories, higher algebras and higher representations. A k-codimensional topological defect $A$ in an n+1D (potentially anomalous) topological order $C^{n+1}$ is condensable if it is equipped with the structure of a condensable $E_k$-algebra. Condensing such a defect $A$ amounts to a k-step process. In the first step, we condense the defect $A$ along one of its transversal directions, thus obtaining a (k-1)-codimensional defect $ΣA$, which is naturally equipped with the structure of a condensable $E_{k-1}$-algebra. In the second step, we condense the defect $ΣA$ in one of the remaining transversal directions, thus obtaining a (k-2)-codimensional defect $Σ^2 A$, so on and so forth. In the k-th step, we condense the 1-codimensional defect $Σ^{k-1}A$ along the only transversal direction, thus defining a phase transition from $C^{n+1}$ to a new n+1D topological order $D^{n+1}$. We give precise mathematical descriptions of each step in above process, including the precise mathematical characterization of the condensed phase $D^{n+1}$. When $C^{n+1}$ is anomaly-free, the same phase transition can be alternatively defined by replacing the last two steps by a single step of condensing the $E_2$-algebra $Σ^{k-2}A$ directly along the remaining two transversal directions. When n=2, this modified last step is precisely a usual anyon condensation in a 2+1D topological order. We derive many new mathematical results physically along the way. We also establish the connections among various notions of "gauging" symmetries. We also briefly discuss questions, generalizations and applications that naturally arise from our theory, including higher Morita theory, a theory of integrals and the condensations of liquid-like gapless defects in topological orders.

cond-mat.str-el↗

Personalized Federated Dictionary Learning for Modeling Heterogeneity in Multi-site fMRI Data

Data privacy constraints pose significant challenges for large-scale neuroimaging analysis, especially in multi-site functional magnetic resonance imaging (fMRI) studies, where site-specific heterogeneity leads to non-independent and identically distributed (non-IID) data. These factors hinder the development of generalizable models. To address these challenges, we propose Personalized Federated Dictionary Learning (PFedDL), a novel federated learning framework that enables collaborative modeling across sites without sharing raw data. PFedDL performs independent dictionary learning at each site, decomposing each site-specific dictionary into a shared global component and a personalized local component. The global atoms are updated via federated aggregation to promote cross-site consistency, while the local atoms are refined independently to capture site-specific variability, thereby enhancing downstream analysis. Experiments on the ABIDE dataset demonstrate that PFedDL outperforms existing methods in accuracy and robustness across non-IID datasets.

cs.LG↗

Deep Learning Advances in Vision-Based Traffic Accident Anticipation: A Comprehensive Review of Methods, Datasets, and Future Directions

Traffic accident prediction and detection are critical for enhancing road safety, and vision-based traffic accident anticipation (Vision-TAA) has emerged as a promising approach in the era of deep learning. This paper reviews 147 recent studies, focusing on the application of supervised, unsupervised, and hybrid deep learning models for accident prediction, alongside the use of real-world and synthetic datasets. Current methodologies are categorized into four key approaches: image and video feature-based prediction, spatio-temporal feature-based prediction, scene understanding, and multi modal data fusion. While these methods demonstrate significant potential, challenges such as data scarcity, limited generalization to complex scenarios, and real-time performance constraints remain prevalent. This review highlights opportunities for future research, including the integration of multi modal data fusion, self-supervised learning, and Transformer-based architectures to enhance prediction accuracy and scalability. By synthesizing existing advancements and identifying critical gaps, this paper provides a foundational reference for developing robust and adaptive Vision-TAA systems, contributing to road safety and traffic management.

cs.CV↗

Fabrication and Characterization of the Moiré surface state on a topological insulator

A Moire superlattice on the topological insulator surface is predicted to exhibit many novel properties but has not been experimentally realized. Here, we developed a two-step growth method to successfully fabricate a topological insulator Sb2Te3 thin film with a Moire superlattice, which is generated by a twist of the topmost layer via molecular beam epitaxy. The established Moire topological surface state is characterized by scanning tunneling microscopy and spectroscopy. By application of a magnetic field, new features in Landau levels arise on the Moire region compared to the pristine surface of Sb2Te3, which makes the system a promising platform for pursuing next-generation electronics. Notably, the growth method, which circumvents contamination and the induced interface defects in the manual fabrication method, can be widely applied to other van der Waals materials for fabricating Moire superlattices.

cond-mat.mtrl-sci↗

Quantum-size effect induced Andreev bound states in ultrathin metallic islands proximitized by a superconductor

While Andreev bound states (ABSs) have been realized in engineered superconducting junctions, their direct observation in normal metal/superconductor heterostructures-enabled by quantum confinement-remains experimentally elusive. Here, we report the detection of ABSs in ultrathin metallic islands (Bi, Ag, and SnTe) grown on the s-wave superconductor NbN. Using high-resolution scanning tunneling microscopy and spectroscopy, we clearly reveal in-gap ABSs with energies symmetric about the Fermi level. While the energies of these states show no position dependence, their wave functions exhibit spatial oscillations, demonstrating a quantum size effect. Both the energy levels and spatial distribution of the ABSs can be reproduced by our effective model in which a metallic island is coupled to the superconducting substrate via the proximity effect. We demonstrate that the coupling strength plays a critical role in determining the ABS energies. Our work introduces a novel physical platform for implementing ABSs, which hold promise for significant device applications.

cond-mat.supr-con↗

Hierarchical Cross-modal Prompt Learning for Vision-Language Models

Pre-trained Vision-Language Models (VLMs) such as CLIP have shown excellent generalization abilities. However, adapting these large-scale models to downstream tasks while preserving their generalization capabilities remains challenging. Although prompt learning methods have shown promise, they suffer from two fundamental bottlenecks that limit generalization: (a) modality isolation, and (b) hierarchical semantic decay. To address these limitations, we propose HiCroPL, a Hierarchical Cross-modal Prompt Learning framework that establishes bidirectional knowledge flow between text and vision modalities, enabling them to refine their semantics mutually. HiCroPL routes knowledge flows by leveraging the complementary strengths of text and vision. In early layers, text prompts inject relatively clear semantics into visual prompts through a hierarchical knowledge mapper, enhancing the representation of low-level visual semantics. In later layers, visual prompts encoding specific task-relevant objects flow back to refine text prompts, enabling deeper alignment. Crucially, our hierarchical knowledge mapper allows representations at multi-scales to be fused, ensuring that deeper representations retain transferable shallow semantics thereby enhancing generalization. We further introduce a lightweight layer-specific knowledge proxy to enable efficient cross-modal interactions. Extensive evaluations across four tasks demonstrate HiCroPL's superior performance, achieving state-of-the-art results on 11 benchmarks with significant improvements. Code is available at: https://github.com/zzeoZheng/HiCroPL.

cs.CV↗

BrainSegDMlF: A Dynamic Fusion-enhanced SAM for Brain Lesion Segmentation

The segmentation of substantial brain lesions is a significant and challenging task in the field of medical image segmentation. Substantial brain lesions in brain imaging exhibit high heterogeneity, with indistinct boundaries between lesion regions and normal brain tissue. Small lesions in single slices are difficult to identify, making the accurate and reproducible segmentation of abnormal regions, as well as their feature description, highly complex. Existing methods have the following limitations: 1) They rely solely on single-modal information for learning, neglecting the multi-modal information commonly used in diagnosis. This hampers the ability to comprehensively acquire brain lesion information from multiple perspectives and prevents the effective integration and utilization of multi-modal data inputs, thereby limiting a holistic understanding of lesions. 2) They are constrained by the amount of data available, leading to low sensitivity to small lesions and difficulty in detecting subtle pathological changes. 3) Current SAM-based models rely on external prompts, which cannot achieve automatic segmentation and, to some extent, affect diagnostic efficiency.To address these issues, we have developed a large-scale fully automated segmentation model specifically designed for brain lesion segmentation, named BrainSegDMLF. This model has the following features: 1) Dynamic Modal Interactive Fusion (DMIF) module that processes and integrates multi-modal data during the encoding process, providing the SAM encoder with more comprehensive modal information. 2) Layer-by-Layer Upsampling Decoder, enabling the model to extract rich low-level and high-level features even with limited data, thereby detecting the presence of small lesions. 3) Automatic segmentation masks, allowing the model to generate lesion masks automatically without requiring manual prompts.

cs.CV↗

GL-LCM: Global-Local Latent Consistency Models for Fast High-Resolution Bone Suppression in Chest X-Ray Images

Chest X-Ray (CXR) imaging for pulmonary diagnosis raises significant challenges, primarily because bone structures can obscure critical details necessary for accurate diagnosis. Recent advances in deep learning, particularly with diffusion models, offer significant promise for effectively minimizing the visibility of bone structures in CXR images, thereby improving clarity and diagnostic accuracy. Nevertheless, existing diffusion-based methods for bone suppression in CXR imaging struggle to balance the complete suppression of bones with preserving local texture details. Additionally, their high computational demand and extended processing time hinder their practical use in clinical settings. To address these limitations, we introduce a Global-Local Latent Consistency Model (GL-LCM) architecture. This model combines lung segmentation, dual-path sampling, and global-local fusion, enabling fast high-resolution bone suppression in CXR images. To tackle potential boundary artifacts and detail blurring in local-path sampling, we further propose Local-Enhanced Guidance, which addresses these issues without additional training. Comprehensive experiments on a self-collected dataset SZCH-X-Rays, and the public dataset JSRT, reveal that our GL-LCM delivers superior bone suppression and remarkable computational efficiency, significantly outperforming several competitive methods. Our code is available at https://github.com/diaoquesang/GL-LCM.

eess.IV↗

DiSC-Med: Diffusion-based Semantic Communications for Robust Medical Image Transmission

The rapid development of artificial intelligence has driven smart health with next-generation wireless communication technologies, stimulating exciting applications in remote diagnosis and intervention. To enable a timely and effective response for remote healthcare, efficient transmission of medical data through noisy channels with limited bandwidth emerges as a critical challenge. In this work, we propose a novel diffusion-based semantic communication framework, namely DiSC-Med, for the medical image transmission, where medical-enhanced compression and denoising blocks are developed for bandwidth efficiency and robustness, respectively. Unlike conventional pixel-wise communication framework, our proposed DiSC-Med is able to capture the key semantic information and achieve superior reconstruction performance with ultra-high bandwidth efficiency against noisy channels. Extensive experiments on real-world medical datasets validate the effectiveness of our framework, demonstrating its potential for robust and efficient telehealth applications.

cs.LG↗

Large ferromagnetic-like band splitting in ultrathin ${\mathrm{SmC}}_{6}$ films

Two-dimensional (2D) magnetic materials provide a unique platform for exploring quantum phases from magnetic order in reduced dimensions. While there have been extensive studies on 2D magnetic materials based on 3$d$ electrons, experimental studies on 4$f$-electron counterparts are far fewer, particularly on their electronic structure. In this study, we report the successful synthesis of ultrathin ${\mathrm{SmC}}_{6}$ films using molecular beam epitaxy. Utilizing in situ angle-resolved photoemission spectroscopy (ARPES), we uncover a large band splitting in the valence bands, which we attribute to the ferromagnetic order driven by exchange couplings between Sm 4$f$ moments and conduction electrons. Despite the small magnetic moment of Sm, the observed splitting is comparable to those of Eu- and Gd-based systems with much larger local moments. Interestingly, the surface state also exhibits splitting with similar magnitude and can be eliminated by overannealing, while the valence bands with ferromagnetic-like splittings remain robust. Our work provides spectroscopic insight to understand the electronic origin of magnetic order in Sm-based compounds. Our study also offers a platform to study 2D magnetic materials based on 4$f$ electrons.

cond-mat.str-el↗