arXiv subjects

Wenhe Jia

Publications and source records attributed to Wenhe Jia.

10 recordsLinked to original sources

arXiv2026

TAO-Force: Unifying Force-Aware Perception and Fast-Slow Control for Contact-Rich Manipulation

Vision-Language-Action (VLA) models have demonstrated strong performance across diverse robotic manipulation tasks, yet their predominantly vision-centric perception and position-controlled execution remain insufficient for contact-rich manipulation. Visual observations alone often provide limited evidence of contact onset and interaction magnitude, while position-control policies cannot respond compliantly to rapidly changing contact dynamics. To bridge both the perception and control gaps, we propose TAO-Force, a force-conditioned VLA framework that combines force-aware policy learning with contact-regulated execution. For force-aware perception, TAO-Force introduces Force-conditioned Feature-wise Linear Modulation (F-FiLM) to inject encoded force feedback into the representations of a frozen pretrained visual-language backbone while preserving its semantic priors. For responsive control, it employs a contact-gated fast-slow architecture, with a slow position-control branch tracking nominal trajectories during non-contact phases and a fast admittance-control branch regulating physical interaction during contact phases. Detailed analyses on a force-perception task and real-world evaluations across four contact-rich manipulation tasks validate the effectiveness and robustness of TAO-Force.

cs.RO↗

arXiv2026

Spin-canting-induced Giant Nonlinear Optical Magnetochirality in a 2D Ferrotoroid

Achieving magnetically switchable chiral light emission is an important goal for 2D opto-spintronics. However, conventional strategies face a fundamental trade-off between dynamic tunability and polarization contrast. Nonlinear optics, particularly the emerging mechanism of chiral second-harmonic generation (SHG), offers a distinct strategy to bypass this restriction, yet its experimental realization remains elusive due to stringent symmetry requirements. Here, we report giant nonlinear optical magnetochirality in a centrosymmetric 2D ferrotoroid, bilayer (2L) CrSBr. We reveal that a field-induced spin-canting state breaks the parity-time (PT) symmetry of the unperturbed antiferromagnetic (AFM) ground state, activating a spin-chirality-driven i-type susceptibility. The coherent interference between this emergent i-type and intrinsic c-type SHG susceptibilities generates a macroscopic circularly polarized SHG signal whose helicity is magnetically switchable. Leveraging this sensitive mechanism, we uncover remanent magnetic states after field saturation that evade conventional linear probes. By exploiting the non-volatility of these states, we demonstrate magneto-optical memory and logic operations. Our work establishes a general symmetry-driven strategy for tailoring nonlinear magnetochirality, while providing a sensitive optical probe for subtle spin textures in the 2D limit.

physics.optics↗

arXiv2025

Tunable polarization-entangled near-infrared photons from orthogonal GaAs nanowires

Quantum entanglement is a fundamental resource for emerging quantum technologies, enabling secure communication and enhanced sensing. For decades, generating polarization entangled states has been mainly achieved using bulk crystals with spontaneous parametric down conversion (SPDC), preventing scalability and on-chip integration. Miniaturizing the quantum source provides access to more versatility and tunability while enabling an easier integration to other devices, notably necessary for satellite-based quantum communication, and eventually reducing fabrication costs. This challenging task can be achieved with Zinc Blende GaAs nanowires. They already have shown an efficient photon pairs generation via SPDC at 1550 nm. Here we demonstrate that a pair of orthogonal GaAs nanowires constitutes a new nanoscale platform to control the quantum state at telecommunication wavelength, enabling a transition from polarization entangled to separable states as a function of the pump polarization, with fidelities reaching 90%

physics.optics↗

arXiv2025

Scalable multilayer diffractive neural network with all-optical nonlinear activation

All-optical diffractive neural networks (DNNs) offer a promising alternative to electronics-based neural network processing due to their low latency, high throughput, and inherent spatial parallelism. However, the lack of reconfigurability and nonlinearity limits existing all-optical DNNs to handling only simple tasks. In this study, we present a folded optical system that enables a multilayer reconfigurable DNN using a single spatial light modulator. This platform not only enables dynamic weight reconfiguration for diverse classification challenges but crucially integrates a mirror-coated silicon substrate exhibiting instantaneous \c{hi}(3) nonlinearity. The incorporation of all-optical nonlinear activation yields substantial accuracy improvements across benchmark tasks, with performance gains becoming increasingly significant as both network depth and task complexity escalate. Our system represents a critical advancement toward realizing scalable all-optical neural networks with complex architectures, potentially achieving computational capabilities that rival their electronic counterparts while maintaining photonic advantages.

physics.optics↗

arXiv2024

Polarization-entangled photon pair generation from an epsilon-near-zero metasurface

Polarization-entangled photon pair sources are essential for diverse quantum technologies, such as quantum communication, computation, and imaging. However, the generation of complex polarization-entangled quantum states has long been constrained by the available nonlinear susceptibility tensor of natural nonlinear crystals, necessitating a cumbersome and intricate setup for additional coherent superposition or post-selection. In this study, we introduce and experimentally demonstrate a nanoscale polarization-entangled photon pair source utilizing an artificially-engineered metamaterial platform. This platform is based on a plasmonic metasurface that is strongly coupled to an epsilon-near-zero (ENZ) material. By precisely engineering resonances at both pump and signal/idler wavelengths, and leveraging the field enhancement provided by the ENZ effect, the photon pair generation efficiency of the 68-nm-thick metasurface is significantly boosted. More notably, the ENZ metasurface platform facilitates versatile manipulation of the system's anisotropic second-order nonlinear susceptibility tensor, enabling direct control over the polarization states of the photon pairs, which leads to the generation of a polarization-entangled Bell state without the need for additional components. Our approach opens a new avenue for the simultaneous photon pair generation and quantum state engineering in a compact platform.

physics.optics↗

arXiv2024

Deep Learning Technique for Human Parsing: A Survey and Outlook

Human parsing aims to partition humans in image or video into multiple pixel-level semantic parts. In the last decade, it has gained significantly increased interest in the computer vision community and has been utilized in a broad range of practical applications, from security monitoring, to social media, to visual special effects, just to name a few. Although deep learning-based human parsing solutions have made remarkable achievements, many important concepts, existing challenges, and potential research directions are still confusing. In this survey, we comprehensively review three core sub-tasks: single human parsing, multiple human parsing, and video human parsing, by introducing their respective task settings, background concepts, relevant problems and applications, representative literature, and datasets. We also present quantitative performance comparisons of the reviewed methods on benchmark datasets. Additionally, to promote sustainable development of the community, we put forward a transformer-based human parsing framework, providing a high-performance baseline for follow-up research through universal, concise, and extensible solutions. Finally, we point out a set of under-investigated open issues in this field and suggest new directions for future study. We also provide a regularly updated project page, to continuously track recent developments in this fast-advancing field: https://github.com/soeaver/awesome-human-parsing.

cs.CV↗

arXiv2023

Quality-Aware Network for Face Parsing

This is a very short technical report, which introduces the solution of the Team BUPT-CASIA for Short-video Face Parsing Track of The 3rd Person in Context (PIC) Workshop and Challenge at CVPR 2021. Face parsing has recently attracted increasing interest due to its numerous application potentials. Generally speaking, it has a lot in common with human parsing, such as task setting, data characteristics, number of categories and so on. Therefore, this work applies state-of-the-art human parsing method to face parsing task to explore the similarities and differences between them. Our submission achieves 86.84% score and wins the 2nd place in the challenge.

cs.CV↗

arXiv2022

UV R-CNN: Stable and Efficient Dense Human Pose Estimation

Dense pose estimation is a dense 3D prediction task for instance-level human analysis, aiming to map human pixels from an RGB image to a 3D surface of the human body. Due to a large amount of surface point regression, the training process appears to be easy to collapse compared to other region-based human instance analyzing tasks. By analyzing the loss formulation of the existing dense pose estimation model, we introduce a novel point regression loss function, named Dense Points} loss to stable the training progress, and a new balanced loss weighting strategy to handle the multi-task losses. With the above novelties, we propose a brand new architecture, named UV R-CNN. Without auxiliary supervision and external knowledge from other tasks, UV R-CNN can handle many complicated issues in dense pose model training progress, achieving 65.0% $AP_{gps}$ and 66.1% $AP_{gpsm}$ on the DensePose-COCO validation subset with ResNet-50-FPN feature extractor, competitive among the state-of-the-art dense human pose estimation methods.

cs.CV↗

arXiv2022

TIVE: A Toolbox for Identifying Video Instance Segmentation Errors

Since first proposed, Video Instance Segmentation(VIS) task has attracted vast researchers' focus on architecture modeling to boost performance. Though great advances achieved in online and offline paradigms, there are still insufficient means to identify model errors and distinguish discrepancies between methods, as well approaches that correctly reflect models' performance in recognizing object instances of various temporal lengths remain barely available. More importantly, as the fundamental model abilities demanded by the task, spatial segmentation and temporal association are still understudied in both evaluation and interaction mechanisms. In this paper, we introduce TIVE, a Toolbox for Identifying Video instance segmentation Errors. By directly operating output prediction files, TIVE defines isolated error types and weights each type's damage to mAP, for the purpose of distinguishing model characters. By decomposing localization quality in spatial-temporal dimensions, model's potential drawbacks on spatial segmentation and temporal association can be revealed. TIVE can also report mAP over instance temporal length for real applications. We conduct extensive experiments by the toolbox to further illustrate how spatial segmentation and temporal association affect each other. We expect the analysis of TIVE can give the researchers more insights, guiding the community to promote more meaningful explorations for video instance segmentation. The proposed toolbox is available at https://github.com/wenhe-jia/TIVE.

cs.CV↗

arXiv2020

Renovating Parsing R-CNN for Accurate Multiple Human Parsing

Multiple human parsing aims to segment various human parts and associate each part with the corresponding instance simultaneously. This is a very challenging task due to the diverse human appearance, semantic ambiguity of different body parts, and complex background. Through analysis of multiple human parsing task, we observe that human-centric global perception and accurate instance-level parsing scoring are crucial for obtaining high-quality results. But the most state-of-the-art methods have not paid enough attention to these issues. To reverse this phenomenon, we present Renovating Parsing R-CNN (RP R-CNN), which introduces a global semantic enhanced feature pyramid network and a parsing re-scoring network into the existing high-performance pipeline. The proposed RP R-CNN adopts global semantic representation to enhance multi-scale features for generating human parsing maps, and regresses a confidence score to represent its quality. Extensive experiments show that RP R-CNN performs favorably against state-of-the-art methods on CIHP and MHP-v2 datasets. Code and models are available at https://github.com/soeaver/RP-R-CNN.

cs.CV↗