arXiv subjects

Zhen Chen

Publications and source records attributed to Zhen Chen.

At least 91 records · Page 5Linked to original sources

arXiv2025

SA-Person: Text-Based Person Retrieval with Scene-aware Re-ranking

Text-based person retrieval aims to identify a target individual from an image gallery using a natural language description. Existing methods primarily focus on appearance-driven cross-modal retrieval, yet face significant challenges due to the visual complexity of scenes and the inherent ambiguity of textual descriptions. The contextual information, such as landmarks and relational cues, provides complementary cues that can offer valuable complementary insights for retrieval, but remains underexploited in current approaches. Motivated by this limitation, we propose a novel paradigm: scene-aware text-based person retrieval, which explicitly integrates both individual appearance and global scene context to improve retrieval accuracy. To support this, we first introduce ScenePerson-13W, a large-scale benchmark dataset comprising over 100,000 real-world scenes with rich annotations encompassing both pedestrian attributes and scene context. Based on this dataset, we further present SA-Person, a two-stage retrieval framework. In the first stage, SA-Person performs discriminative appearance grounding by aligning textual descriptions with pedestrian-specific regions. In the second stage, it introduces SceneRanker, a training-free, scene-aware re-ranking module that refines retrieval results by jointly reasoning over pedestrian appearance and the global scene context. Extensive experiments on ScenePerson-13W and existing benchmarks demonstrate the effectiveness of our proposed SA-Person. Both the dataset and code will be publicly released to facilitate future research.

cs.CV↗

arXiv2025

CST Anti-UAV: A Thermal Infrared Benchmark for Tiny UAV Tracking in Complex Scenes

The widespread application of Unmanned Aerial Vehicles (UAVs) has raised serious public safety and privacy concerns, making UAV perception crucial for anti-UAV tasks. However, existing UAV tracking datasets predominantly feature conspicuous objects and lack diversity in scene complexity and attribute representation, limiting their applicability to real-world scenarios. To overcome these limitations, we present the CST Anti-UAV, a new thermal infrared dataset specifically designed for Single Object Tracking (SOT) in Complex Scenes with Tiny UAVs (CST). It contains 220 video sequences with over 240k high-quality bounding box annotations, highlighting two key properties: a significant number of tiny-sized UAV targets and the diverse and complex scenes. To the best of our knowledge, CST Anti-UAV is the first dataset to incorporate complete manual frame-level attribute annotations, enabling precise evaluations under varied challenges. To conduct an in-depth performance analysis for CST Anti-UAV, we evaluate 20 existing SOT methods on the proposed dataset. Experimental results demonstrate that tracking tiny UAVs in complex environments remains a challenge, as the state-of-the-art method achieves only 35.92% state accuracy, much lower than the 67.69% observed on the Anti-UAV410 dataset. These findings underscore the limitations of existing benchmarks and the need for further advancements in UAV tracking research. The CST Anti-UAV benchmark is about to be publicly released, which not only fosters the development of more robust SOT methods but also drives innovation in anti-UAV systems.

cs.CV↗

arXiv2025

UniUltra: Interactive Parameter-Efficient SAM2 for Universal Ultrasound Segmentation

The Segment Anything Model 2 (SAM2) demonstrates remarkable universal segmentation capabilities on natural images. However, its performance on ultrasound images is significantly degraded due to domain disparities. This limitation raises two critical challenges: how to efficiently adapt SAM2 to ultrasound imaging while maintaining parameter efficiency, and how to deploy the adapted model effectively in resource-constrained clinical environments. To address these issues, we propose UniUltra for universal ultrasound segmentation. Specifically, we first introduce a novel context-edge hybrid adapter (CH-Adapter) that enhances fine-grained perception across diverse ultrasound imaging modalities while achieving parameter-efficient fine-tuning. To further improve clinical applicability, we develop a deep-supervised knowledge distillation (DSKD) technique that transfers knowledge from the large image encoder of the fine-tuned SAM2 to a super lightweight encoder, substantially reducing computational requirements without compromising performance. Extensive experiments demonstrate that UniUltra outperforms state-of-the-arts with superior generalization capabilities. Notably, our framework achieves competitive performance using only 8.91% of SAM2's parameters during fine-tuning, and the final compressed model reduces the parameter count by 94.08% compared to the original SAM2, making it highly suitable for practical clinical deployment. The source code is available at https://github.com/xq141839/UniUltra.

eess.IV↗

arXiv2025

TM-UNet: Token-Memory Enhanced Sequential Modeling for Efficient Medical Image Segmentation

Medical image segmentation is essential for clinical diagnosis and treatment planning. Although transformer-based methods have achieved remarkable results, their high computational cost hinders clinical deployment. To address this issue, we propose TM-UNet, a novel lightweight framework that integrates token sequence modeling with an efficient memory mechanism for efficient medical segmentation. Specifically, we introduce a multi-scale token-memory (MSTM) block that transforms 2D spatial features into token sequences through strategic spatial scanning, leveraging matrix memory cells to selectively retain and propagate discriminative contextual information across tokens. This novel token-memory mechanism acts as a dynamic knowledge store that captures long-range dependencies with linear complexity, enabling efficient global reasoning without redundant computation. Our MSTM block further incorporates exponential gating to identify token effectiveness and multi-scale contextual extraction via parallel pooling operations, enabling hierarchical representation learning without computational overhead. Extensive experiments demonstrate that TM-UNet outperforms state-of-the-art methods across diverse medical segmentation tasks with substantially reduced computation cost. The code is available at https://github.com/xq141839/TM-UNet.

cs.CV↗

arXiv2025

Fragile by Design: On the Limits of Adversarial Defenses in Personalized Generation

Personalized AI applications such as DreamBooth enable the generation of customized content from user images, but also raise significant privacy concerns, particularly the risk of facial identity leakage. Recent defense mechanisms like Anti-DreamBooth attempt to mitigate this risk by injecting adversarial perturbations into user photos to prevent successful personalization. However, we identify two critical yet overlooked limitations of these methods. First, the adversarial examples often exhibit perceptible artifacts such as conspicuous patterns or stripes, making them easily detectable as manipulated content. Second, the perturbations are highly fragile, as even a simple, non-learned filter can effectively remove them, thereby restoring the model's ability to memorize and reproduce user identity. To investigate this vulnerability, we propose a novel evaluation framework, AntiDB_Purify, to systematically evaluate existing defenses under realistic purification threats, including both traditional image filters and adversarial purification. Results reveal that none of the current methods maintains their protective effectiveness under such threats. These findings highlight that current defenses offer a false sense of security and underscore the urgent need for more imperceptible and robust protections to safeguard user identity in personalized generation.

cs.CV↗

arXiv2025

CoMA: Complementary Masking and Hierarchical Dynamic Multi-Window Self-Attention in a Unified Pre-training Framework

Masked Autoencoders (MAE) achieve self-supervised learning of image representations by randomly removing a portion of visual tokens and reconstructing the original image as a pretext task, thereby significantly enhancing pretraining efficiency and yielding excellent adaptability across downstream tasks. However, MAE and other MAE-style paradigms that adopt random masking generally require more pre-training epochs to maintain adaptability. Meanwhile, ViT in MAE suffers from inefficient parameter use due to fixed spatial resolution across layers. To overcome these limitations, we propose the Complementary Masked Autoencoders (CoMA), which employ a complementary masking strategy to ensure uniform sampling across all pixels, thereby improving effective learning of all features and enhancing the model's adaptability. Furthermore, we introduce DyViT, a hierarchical vision transformer that employs a Dynamic Multi-Window Self-Attention (DM-MSA), significantly reducing the parameters and FLOPs while improving fine-grained feature learning. Pre-trained on ImageNet-1K with CoMA, DyViT matches the downstream performance of MAE using only 12% of the pre-training epochs, demonstrating more effective learning. It also attains a 10% reduction in pre-training time per epoch, further underscoring its superior pre-training efficiency.

cs.CV↗

arXiv2025

How Far Are Surgeons from Surgical World Models? A Pilot Study on Zero-shot Surgical Video Generation with Expert Assessment

Foundation models in video generation are demonstrating remarkable capabilities as potential world models for simulating the physical world. However, their application in high-stakes domains like surgery, which demand deep, specialized causal knowledge rather than general physical rules, remains a critical unexplored gap. To systematically address this challenge, we present SurgVeo, the first expert-curated benchmark for video generation model evaluation in surgery, and the Surgical Plausibility Pyramid (SPP), a novel, four-tiered framework tailored to assess model outputs from basic appearance to complex surgical strategy. On the basis of the SurgVeo benchmark, we task the advanced Veo-3 model with a zero-shot prediction task on surgical clips from laparoscopic and neurosurgical procedures. A panel of four board-certified surgeons evaluates the generated videos according to the SPP. Our results reveal a distinct "plausibility gap": while Veo-3 achieves exceptional Visual Perceptual Plausibility, it fails critically at higher levels of the SPP, including Instrument Operation Plausibility, Environment Feedback Plausibility, and Surgical Intent Plausibility. This work provides the first quantitative evidence of the chasm between visually convincing mimicry and causal understanding in surgical AI. Our findings from SurgVeo and the SPP establish a crucial foundation and roadmap for developing future models capable of navigating the complexities of specialized, real-world healthcare domains.

cs.CV↗

arXiv2025

Atomic-Scale Roughness of Freestanding Oxide Membranes Revealed by Electron Ptychography

Freestanding oxide films offer significant potential for integrating exotic quantum functionalities with semiconductor technologies. However, their performance is critically limited by surface roughness and interfacial imperfection caused by dangling bonds, which disrupt coherent interactions and suppress quantum phenomena at heterointerfaces. To address the challenge of structural characterization of surfaces and interfaces, we develop a metrological approach achieving atomic-scale precision in mapping the topography of both free surfaces and buried interfaces within ultrathin oxide heterostructures leveraging three-dimensional structures reconstructed from multislice electron ptychography. This method also allows for counting the number of atoms, even including light elements such as oxygen, along the electron trajectory in electron microscopy, leading to the identification of surface termination in oxide films. The planar-view of measurement geometry, allowing for large field-of-view imaging, provides remarkably rich information and high statistics about the atomic-scale structural inhomogeneities in freestanding membranes. This quantitative analysis provides unprecedented capabilities for correlating structural imperfection with quantum device performance, offering critical insights for engineering robust heterointerfaces in next-generation oxide electronics.

cond-mat.mtrl-sci↗

arXiv2025

Superconductivity in monolayer-trilayer phase of La$_3$Ni$_2$O$_7$ under high pressure

The discovery of 80 K superconductivity in pressurized bilayer Ruddlesden-Popper (RP) nickelate La$_3$Ni$_2$O$_7$ has established a new high-temperature superconductor family. The quest to understand the governing principles of RP nickelate superconductivity has become a central focus in condensed matter physics. Here, we report a critical advance by synthesizing and investigating a distinct structural polymorph of the same compound: the monolayer-trilayer (1313) hybrid phase of La$_3$Ni$_2$O$_7$. Under high pressure, synchrotron X-ray diffraction and Raman spectroscopy reveal a structural transition from the orthorhombic $Cmmm$ to the tetragonal $P4/mmm$ space group at 13~GPa. Above 19 GPa, the phase exhibits a clear superconducting transition, confirmed by a zero-resistance state, albeit at a significantly reduced temperature of 3.6 K. The stark contrast with the 80 K transition in the bilayer phase provides a uniquely clean experimental comparison. Our results demonstrate that the superconducting transition temperature is directly governed by the nature of the interlayer coupling, and the bilayer NiO$_6$ block as the essential structural motif for achieving high-$T_\text{c}$ superconductivity in the RP nickelates.

cond-mat.supr-con↗

arXiv2025

Unlocking Thickness Modeling for Codimensional Contact Simulation

In this work we analyze and address a fundamental restriction that blocks the reliable application of codimensional yarn-level and shell models with thickness, to simulate real-world woven and knit fabrics. As discretizations refine toward practical and accurate physical modeling, such models can generate non-physical contact forces with stencil-neighboring elements in the simulation mesh, leading to severe locking artifacts. While not well-documented in the literature, this restriction has so far been addressed with two alternatives with undesirable tradeoffs. One option is to restrict the mesh to coarse resolutions, however, this eliminates the possibility of accurate (and consistent) resolution simulations across real-world material variations. A second alternative instead seeks to cull contact pairs that can create such locking forces in the first place. This relaxes resolution restrictions but compromise robustness. Culling can and will generate unacceptable and unpredictable geometric intersections and tunneling that destroys weaving and knitting structures and cause unrecoverable pull-throughs. We address these challenges to simulating real-world materials with a new and practical contact-processing model for thickened codimensional simulation, that removes resolution restrictions, while guaranteeing contact-locking-free, non-intersecting simulations. We demonstrate the application of our model across a wide range of previously unavailable simulation scenarios, with real-world material yarn and fabric parameters and patterns, challenging simulation conditions and mesh resolutions, and both rod and shell models, integrated with the IPC barrier.

cs.GR↗

arXiv2025

RePainter: Empowering E-commerce Object Removal via Spatial-matting Reinforcement Learning

In web data, product images are central to boosting user engagement and advertising efficacy on e-commerce platforms, yet the intrusive elements such as watermarks and promotional text remain major obstacles to delivering clear and appealing product visuals. Although diffusion-based inpainting methods have advanced, they still face challenges in commercial settings due to unreliable object removal and limited domain-specific adaptation. To tackle these challenges, we propose Repainter, a reinforcement learning framework that integrates spatial-matting trajectory refinement with Group Relative Policy Optimization (GRPO). Our approach modulates attention mechanisms to emphasize background context, generating higher-reward samples and reducing unwanted object insertion. We also introduce a composite reward mechanism that balances global, local, and semantic constraints, effectively reducing visual artifacts and reward hacking. Additionally, we contribute EcomPaint-100K, a high-quality, large-scale e-commerce inpainting dataset, and a standardized benchmark EcomPaint-Bench for fair evaluation. Extensive experiments demonstrate that Repainter significantly outperforms state-of-the-art methods, especially in challenging scenes with intricate compositions. We will release our code and weights upon acceptance.

cs.CV↗

arXiv2025

Polyp-Gen: Realistic and Diverse Polyp Image Generation for Endoscopic Dataset Expansion

Automated diagnostic systems (ADS) have shown significant potential in the early detection of polyps during endoscopic examinations, thereby reducing the incidence of colorectal cancer. However, due to high annotation costs and strict privacy concerns, acquiring high-quality endoscopic images poses a considerable challenge in the development of ADS. Despite recent advancements in generating synthetic images for dataset expansion, existing endoscopic image generation algorithms failed to accurately generate the details of polyp boundary regions and typically required medical priors to specify plausible locations and shapes of polyps, which limited the realism and diversity of the generated images. To address these limitations, we present Polyp-Gen, the first full-automatic diffusion-based endoscopic image generation framework. Specifically, we devise a spatial-aware diffusion training scheme with a lesion-guided loss to enhance the structural context of polyp boundary regions. Moreover, to capture medical priors for the localization of potential polyp areas, we introduce a hierarchical retrieval-based sampling strategy to match similar fine-grained spatial features. In this way, our Polyp-Gen can generate realistic and diverse endoscopic images for building reliable ADS. Extensive experiments demonstrate the state-of-the-art generation quality, and the synthetic images can improve the downstream polyp detection task. Additionally, our Polyp-Gen has shown remarkable zero-shot generalizability on other datasets. The source code is available at https://github.com/CUHK-AIM-Group/Polyp-Gen.

cs.CV↗

arXiv2025

PRO-VPT: Distribution-Adaptive Visual Prompt Tuning via Prompt Relocation

Visual prompt tuning (VPT), i.e., fine-tuning some lightweight prompt tokens, provides an efficient and effective approach for adapting pre-trained models to various downstream tasks. However, most prior art indiscriminately uses a fixed prompt distribution across different tasks, neglecting the importance of each block varying depending on the task. In this paper, we introduce adaptive distribution optimization (ADO) by tackling two key questions: (1) How to appropriately and formally define ADO, and (2) How to design an adaptive distribution strategy guided by this definition? Through empirical analysis, we first confirm that properly adjusting the distribution significantly improves VPT performance, and further uncover a key insight that a nested relationship exists between ADO and VPT. Based on these findings, we propose a new VPT framework, termed PRO-VPT (iterative Prompt RelOcation-based VPT), which adaptively adjusts the distribution built upon a nested optimization formulation. Specifically, we develop a prompt relocation strategy derived from this formulation, comprising two steps: pruning idle prompts from prompt-saturated blocks, followed by allocating these prompts to the most prompt-needed blocks. By iteratively performing prompt relocation and VPT, our proposal can adaptively learn the optimal prompt distribution in a nested optimization-based manner, thereby unlocking the full potential of VPT. Extensive experiments demonstrate that our proposal significantly outperforms advanced VPT methods, e.g., PRO-VPT surpasses VPT by 1.6 pp and 2.0 pp average accuracy, leading prompt-based methods to state-of-the-art performance on VTAB-1k and FGVC benchmarks. The code is available at https://github.com/ckshang/PRO-VPT.

cs.CV↗

arXiv2025

Distinct orbital contributions to electronic and magnetic structures in La$_{4}$Ni$_{3}$O$_{10}$

High-T$_c$ superconductivity has recently been discovered in Ruddlesden-Popper phase nickelates under pressure, where the low-energy electronic structure is dominated by Ni $d_{x^2 - y^2}$ and $d_{z^2}$ orbitals. However, the respective roles of these orbitals in superconductivity remain unclear. Here, by combining X-ray absorption, electron energy loss spectroscopy, and density functional theory calculations on La$_{4}$Ni$_{3}$O$_{10}$ single crystals, we identify ligand holes in the $p_{x,y}$ orbitals of planar oxygen and the $p_z$ orbitals of apical oxygen, which hybridize with the Ni $d_{x^2-y^2}$ and $d_{z^2}$ orbitals, respectively. These ligand holes enable orbital-selective O K-edge resonant inelastic X-ray scattering (RIXS) study, which reveals that $d_{x^2-y^2}$ states dominate the low-energy charge excitations and are more itinerant. We also observe a $\sim$0.1 eV bimagnon through RIXS and Raman spectroscopy, which leads to an interlayer superexchange interaction J$_z$ of $\sim$50 meV. Our results reveal distinct contributions of Ni $d_{x^2-y^2}$ and $d_{z^2}$ orbitals to the electronic and magnetic structure and provide direct experimental insights to understand the RP-phase nickelate superconductors.

cond-mat.supr-con↗

arXiv2025

SAGE:State-Aware Guided End-to-End Policy for Multi-Stage Sequential Tasks via Hidden Markov Decision Process

Multi-stage sequential (MSS) robotic manipulation tasks are prevalent and crucial in robotics. They often involve state ambiguity, where visually similar observations correspond to different actions. We present SAGE, a state-aware guided imitation learning framework that models tasks as a Hidden Markov Decision Process (HMDP) to explicitly capture latent task stages and resolve ambiguity. We instantiate the HMDP with a state transition network that infers hidden states, and a state-aware action policy that conditions on both observations and hidden states to produce actions, thereby enabling disambiguation across task stages. To reduce manual annotation effort, we propose a semi-automatic labeling pipeline combining active learning and soft label interpolation. In real-world experiments across multiple complex MSS tasks with state ambiguity, SAGE achieved 100% task success under the standard evaluation protocol, markedly surpassing the baselines. Ablation studies further show that such performance can be maintained with manual labeling for only about 13% of the states, indicating its strong effectiveness.

cs.RO↗

arXiv2025

Three-Majorana Cotunneling Interferometer for Non-Abelian Braiding and Topological Quantum Gate Implementation

We propose a novel scheme for performing Majorana zero mode (MZM) braiding utilizing cotunneling processes in a three-MZM system incorporating reference arms. This approach relies on the interference between cotunneling paths through the MZMs and reference arms, establishing an effective, tunable coupling between the MZMs. The strength and sign of this coupling can be manipulated via the reference arms and applied magnetic flux. Notably, the introduction of a half quantum flux reverses the coupling sign, enabling an echo-like protocol to eliminate dynamic phases during braiding. Our setup, requiring only three MZMs, represents a minimal platform for demonstrating non-Abelian braiding statistics. We demonstrate that this system facilitates the implementation of Clifford gates via braiding and, significantly, permits the realization of non-Clifford gates, such as the $T$ gate, by geometric phase, thereby offering a potential pathway towards universal topological quantum computation.

cond-mat.mes-hall↗

arXiv2025

Co-Seg: Mutual Prompt-Guided Collaborative Learning for Tissue and Nuclei Segmentation

Histopathology image analysis is critical yet challenged by the demand of segmenting tissue regions and nuclei instances for tumor microenvironment and cellular morphology analysis. Existing studies focused on tissue semantic segmentation or nuclei instance segmentation separately, but ignored the inherent relationship between these two tasks, resulting in insufficient histopathology understanding. To address this issue, we propose a Co-Seg framework for collaborative tissue and nuclei segmentation. Specifically, we introduce a novel co-segmentation paradigm, allowing tissue and nuclei segmentation tasks to mutually enhance each other. To this end, we first devise a region-aware prompt encoder (RP-Encoder) to provide high-quality semantic and instance region prompts as prior constraints. Moreover, we design a mutual prompt mask decoder (MP-Decoder) that leverages cross-guidance to strengthen the contextual consistency of both tasks, collaboratively computing semantic and instance segmentation masks. Extensive experiments on the PUMA dataset demonstrate that the proposed Co-Seg surpasses state-of-the-arts in the semantic, instance and panoptic segmentation of tumor tissues and nuclei instances. The source code is available at https://github.com/xq141839/Co-Seg.

cs.CV↗

arXiv2025

SurgLLM: A Versatile Large Multimodal Model with Spatial Focus and Temporal Awareness for Surgical Video Understanding

Surgical video understanding is crucial for facilitating Computer-Assisted Surgery (CAS) systems. Despite significant progress in existing studies, two major limitations persist, including inadequate visual content perception and insufficient temporal awareness in surgical videos, and hinder the development of versatile CAS solutions. In this work, we propose the SurgLLM framework, an effective large multimodal model tailored for versatile surgical video understanding tasks with enhanced spatial focus and temporal awareness. Specifically, to empower the spatial focus of surgical videos, we first devise Surgical Context-aware Multimodal Pretraining (Surg-Pretrain) for the video encoder of SurgLLM, by performing instrument-centric Masked Video Reconstruction (MV-Recon) and subsequent multimodal alignment. To incorporate surgical temporal knowledge into SurgLLM, we further propose Temporal-aware Multimodal Tuning (TM-Tuning) to enhance temporal reasoning with interleaved multimodal embeddings. Moreover, to accommodate various understanding tasks of surgical videos without conflicts, we devise a Surgical Task Dynamic Ensemble to efficiently triage a query with optimal learnable parameters in our SurgLLM. Extensive experiments performed on diverse surgical video understanding tasks, including captioning, general VQA, and temporal VQA, demonstrate significant improvements over the state-of-the-art approaches, validating the effectiveness of our SurgLLM in versatile surgical video understanding. The source code is available at https://github.com/franciszchen/SurgLLM.

cs.CV↗