Searcharxiv⌕ Search

arXiv subjects

Yu Yao

Publications and source records attributed to Yu Yao.

At least 55 records · Page 3Linked to original sources

A Polarimetry-based Field-deployable Non-interruptive Mirror Soiling Detection Method

The soiling level of heliostat mirrors in Concentrated Solar Power (CSP) fields is one of the key factors that significantly influences optical efficiency. State-of-the-art methods of monitoring heliostats soiling levels still face various challenges, including slow speed, labor-intensive operations, resolution and accuracy constraints or interruptions to solar field operations. We present a rapid, cost-effective, and non-intrusive method for mirror soiling detection based on polarimetric imaging, referred to as Polarimetric Imaging-based Mirror Soiling (PIMS). The compact PIMS device is designed for integration with unmanned aerial vehicles (UAVs), enabling rapid, large-area assessments of heliostat mirrors for efficient soiling detection. Our method utilizes the correlation between the Degree of Linear Polarization (DoLP) and surface soiling level based on Mie scattering theory and Monte Carlo simulations. Field deployment of the PIMS method requires minimal device installation, and its UAV-based operation allows for soiling detection without interrupting plant activities. The PIMS method holds the potential for mirror soiling detection across various concentrated solar power (CSP) plants and can be further adapted for other types of solar fields, such as parabolic trough systems.

physics.app-ph↗

Heliostat Optical Error Inspection with Polarimetric Imaging Drone

On a Concentrated Solar Power (CSP) field, optical errors have significant impacts on the collection efficiency of heliostats. Fast, cost-effective, labor-efficient, and non-intrusive autonomous field inspection remains a challenge. Approaches using imaging drone, i.e., Unmanned Aerial Vehicle (UAV) system integrated with high resolution visible imaging sensors, have been developed to address these challenges; however, these approaches are often limited by insufficient imaging contrast. Here we report a polarimetry-based method with a polarization imaging system integrated on UAV to enhance imaging contrast for in-situ detection of heliostat mirrors without interrupting field operation. We developed an optical model for skylight polarization pattern to simulate the polarization images of heliostat mirrors and obtained optimized waypoints for polarimetric imaging drone flight path to capture images with enhanced contrast. The polarimetric imaging-based method improved the success rate of edge detections in scenarios which were challenging for mirror edge detection with conventional imaging sensors. We have performed field tests to achieve significantly enhanced heliostat edge detection success rate and investigate the feasibility of integrating polarimetric imaging method with existing imaging-based heliostat inspection methods, i.e., Polarimetric Imaging Heliostat Inspection Method (PIHIM). Our preliminary field test results suggest that the PIHIM hold the promise to enable sufficient imaging contrast for real-time autonomous imaging and detection of heliostat field, thus suitable for non-interruptive fast CSP field inspection during its operation.

physics.app-ph↗

Learning Semantic Directions for Feature Augmentation in Domain-Generalized Medical Segmentation

Medical image segmentation plays a crucial role in clinical workflows, but domain shift often leads to performance degradation when models are applied to unseen clinical domains. This challenge arises due to variations in imaging conditions, scanner types, and acquisition protocols, limiting the practical deployment of segmentation models. Unlike natural images, medical images typically exhibit consistent anatomical structures across patients, with domain-specific variations mainly caused by imaging conditions. This unique characteristic makes medical image segmentation particularly challenging. To address this challenge, we propose a domain generalization framework tailored for medical image segmentation. Our approach improves robustness to domain-specific variations by introducing implicit feature perturbations guided by domain statistics. Specifically, we employ a learnable semantic direction selector and a covariance-based semantic intensity sampler to modulate domain-variant features while preserving task-relevant anatomical consistency. Furthermore, we design an adaptive consistency constraint that is selectively applied only when feature adjustment leads to degraded segmentation performance. This constraint encourages the adjusted features to align with the original predictions, thereby stabilizing feature selection and improving the reliability of the segmentation. Extensive experiments on two public multi-center benchmarks show that our framework consistently outperforms existing domain generalization approaches, achieving robust and generalizable segmentation performance across diverse clinical domains.

cs.CV↗

AGENTS-LLM: Augmentative GENeration of Challenging Traffic Scenarios with an Agentic LLM Framework

Rare, yet critical, scenarios pose a significant challenge in testing and evaluating autonomous driving planners. Relying solely on real-world driving scenes requires collecting massive datasets to capture these scenarios. While automatic generation of traffic scenarios appears promising, data-driven models require extensive training data and often lack fine-grained control over the output. Moreover, generating novel scenarios from scratch can introduce a distributional shift from the original training scenes which undermines the validity of evaluations especially for learning-based planners. To sidestep this, recent work proposes to generate challenging scenarios by augmenting original scenarios from the test set. However, this involves the manual augmentation of scenarios by domain experts. An approach that is unable to meet the demands for scale in the evaluation of self-driving systems. Therefore, this paper introduces a novel LLM-agent based framework for augmenting real-world traffic scenarios using natural language descriptions, addressing the limitations of existing methods. A key innovation is the use of an agentic design, enabling fine-grained control over the output and maintaining high performance even with smaller, cost-effective LLMs. Extensive human expert evaluation demonstrates our framework's ability to accurately adhere to user intent, generating high quality augmented scenarios comparable to those created manually.

cs.RO↗

Room-temperature mid-infrared detection using metasurface-absorber-integrated phononic crystal oscillator

Mid-infrared (MIR) detectors find extensive applications in chemical sensing, spectroscopy, communications, biomedical diagnosis and space explorations. Alternative to semiconductor MIR photodiodes and bolometers, mechanical-resonator-based MIR detectors show advantages in higher sensitivity and lower noise at room temperature, especially towards longer wavelength infrared. Here, we demonstrate uncooled room-temperature MIR detectors based on lithium niobate surface acoustic wave phononic crystal (PnC) resonators integrated with wavelength-and-polarization-selective metasurface absorber arrays. The detection is based on the resonant frequency shift induced by the local temperature change due to MIR absorptions. The PnC resonator is configured in an oscillating mode, enabling active readout and low frequency noise. Compared with detectors based on tethered thin-film mechanical resonators, our non-suspended, fully supported PnC resonators offer lower noise, faster thermal response, and robustness in both fabrication and practical applications. Our 1-GHz oscillator-based MIR detector shows a relative frequency deviation of $5.24 \times 10^{-10}$ Hz$^{-1/2}$ at an integration time of 50 $μ$s, leading to an incident noise equivalent power of 197 pW/$\sqrt{\mathrm{Hz}}$ when input 6-$μ$m MIR light is modulated at 1.8 kHz, and a large dynamic range of 107 in incident MIR power. Our device architecture is compatible with the scalable manufacturing process and can be readily extended to a broader spectral range by tailoring the absorbing wavelengths of metasurface absorbers.

physics.optics↗

Enhanced channel estimation for near-field IRS-aided multi-user MIMO system via a large deep residual network

In this paper, the channel estimation (CE) of intelligent reflecting surface-aided near-field (NF) multi-user communication is investigated. Initially, the least square (LS) estimator and minimum mean square error (MMSE) estimator for the estimated channel are designed, their mean square errors (MSEs) are derived, and the Cramer-Rao lower bound (CRLB) is derived to serve as a benchmark for performance evaluation. Subsequently, in view of the fact that the NF channel model is more sensitive to distance variations compared to the far-field model, this leads to pronounced discrepancies in the user channel characteristics in different regions. To effectively capture and utilize these diverse channel features, users are initially divided into distinct regions predicated on pivotal parameters, such as channel angle and distance. Correspondingly, a user region classifier based on convolutional neural networks is designed. Then, to fully harness the potential of deep residual networks (DRNs) in denoising, the aforementioned CE problem is reconceptualized as a denoising task, and a DRN-driven single region NF CE network, named SR-DRN-NFCE, is proposed. In addition, by integrating SR-DRN-NFCE networks corresponding to different regions and conducting joint training in a federated learning (FL) manner, a new network is obtained, named FL-DRN-NFCE. Simulation results demonstrate that the proposed FL-DRN-NFCE network outperforms LS, MMSE, and no residual connections in terms of MSE, and the proposed FL-DRN-NFCE method has higher CE accuracy than the SR-DRN-NFCE method.

eess.SP↗

A Sample Efficient Conditional Independence Test in the Presence of Discretization

In many real-world scenarios, interested variables are often represented as discretized values due to measurement limitations. Applying Conditional Independence (CI) tests directly to such discretized data, however, can lead to incorrect conclusions. To address this, recent advancements have sought to infer the correct CI relationship between the latent variables through binarizing observed data. However, this process inevitably results in a loss of information, which degrades the test's performance. Motivated by this, this paper introduces a sample-efficient CI test that does not rely on the binarization process. We find that the independence relationships of latent continuous variables can be established by addressing an over-identifying restriction problem with Generalized Method of Moments (GMM). Based on this insight, we derive an appropriate test statistic and establish its asymptotic distribution correctly reflecting CI by leveraging nodewise regression. Theoretical findings and Empirical results across various datasets demonstrate that the superiority and effectiveness of our proposed test. Our code implementation is provided in https://github.com/boyangaaaaa/DCT

cs.AI↗

SafeAuto: Knowledge-Enhanced Safe Autonomous Driving with Multimodal Foundation Models

Traditional autonomous driving systems often struggle to connect high-level reasoning with low-level control, leading to suboptimal and sometimes unsafe behaviors. Recent advances in multimodal large language models (MLLMs), which process both visual and textual data, offer an opportunity to unify perception and reasoning. However, effectively embedding precise safety knowledge into MLLMs for autonomous driving remains a significant challenge. To address this, we propose SafeAuto, a framework that enhances MLLM-based autonomous driving by incorporating both unstructured and structured knowledge. First, we introduce a Position-Dependent Cross-Entropy (PDCE) loss to improve low-level control signal predictions when values are represented as text. Second, to explicitly integrate safety knowledge, we develop a reasoning component that translates traffic rules into first-order logic (e.g., "red light $\implies$ stop") and embeds them into a probabilistic graphical model (e.g., Markov Logic Network) to verify predicted actions using recognized environmental attributes. Additionally, our Multimodal Retrieval-Augmented Generation (RAG) model leverages video, control signals, and environmental attributes to learn from past driving experiences. Integrating PDCE, MLN, and Multimodal RAG, SafeAuto outperforms existing baselines across multiple datasets, enabling more accurate, reliable, and safer autonomous driving. The code is available at https://github.com/AI-secure/SafeAuto.

cs.RO↗

Beyond Optimal Transport: Model-Aligned Coupling for Flow Matching

Flow Matching (FM) is an effective framework for training a model to learn a vector field that transports samples from a source distribution to a target distribution. To train the model, early FM methods use random couplings, which often result in crossing paths and lead the model to learn non-straight trajectories that require many integration steps to generate high-quality samples. To address this, recent methods adopt Optimal Transport (OT) to construct couplings by minimizing geometric distances, which helps reduce path crossings. However, we observe that such geometry-based couplings do not necessarily align with the model's preferred trajectories, making it difficult to learn the vector field induced by these couplings, which prevents the model from learning straight trajectories. Motivated by this, we propose Model-Aligned Coupling (MAC), an effective method that matches training couplings based not only on geometric distance but also on alignment with the model's preferred transport directions based on its prediction error. To avoid the time-costly match process, MAC proposes to select the top-$k$ fraction of couplings with the lowest error for training. Extensive experiments show that MAC significantly improves generation quality and efficiency in few-step settings compared to existing methods. Project page: https://yexionglin.github.io/mac

cs.CV↗

SP2RINT: Spatially-Decoupled Physics-Inspired Progressive Inverse Optimization for Scalable, PDE-Constrained Meta-Optical Neural Network Training

DONNs leverage light propagation for efficient analog AI and signal processing. Advances in nanophotonic fabrication and metasurface-based wavefront engineering have opened new pathways to realize high-capacity DONNs across various spectral regimes. Training such DONN systems to determine the metasurface structures remains challenging. Heuristic methods are fast but oversimplify metasurfaces modulation, often resulting in physically unrealizable designs and significant performance degradation. Simulation-in-the-loop optimizes implementable metasurfaces via adjoint methods, but is computationally prohibitive and unscalable. To address these limitations, we propose SP2RINT, a spatially decoupled, progressive training framework that formulates DONN training as a PDE-constrained learning problem. Metasurface responses are first relaxed into freely trainable transfer matrices with a banded structure. We then progressively enforce physical constraints by alternating between transfer matrix training and adjoint-based inverse design, avoiding per-iteration PDE solves while ensuring final physical realizability. To further reduce runtime, we introduce a physics-inspired, spatially decoupled inverse design strategy based on the natural locality of field interactions. This approach partitions the metasurface into independently solvable patches, enabling scalable and parallel inverse design with system-level calibration. Evaluated across diverse DONN training tasks, SP2RINT achieves digital-comparable accuracy while being 1825 times faster than simulation-in-the-loop approaches. By bridging the gap between abstract DONN models and implementable photonic hardware, SP2RINT enables scalable, high-performance training of physically realizable meta-optical neural systems. Our code is available at https://github.com/ScopeX-ASU/SP2RINT

physics.optics↗

Hybrid RIS-Enhanced ISAC Secure Systems: Joint Optimization in the Presence of an Extended Target

Unlike the conventional fully-passive and fully-active reconfigurable intelligent surfaces (RISs), a hybrid RIS consisting of active and passive reflection units has recently been concerned, which can exploit their integrated advantages to alleviate the RIS-induced path loss. In this paper, we investigate a novel security strategy where the multiple hybrid RIS-aided integrated sensing and communication (ISAC) system communicates with downlink users and senses an extended target synchronously. Assuming imperfectly known target location (TL), we consider the joint design of the transmit signal and receive filter bank of the base station (BS), the receive beamformers of all users and the weights of the hybrid RIS. An optimization problem is formulated for maximizing the worst-case sensing signal-to-interference-plus-noise-ratio (SINR) subject to secure communication and system power budget constraints. To address this non-convex problem, we leverage generalized fractional programming (GFP) and penalty-dual-decomposition (PDD), and propose a security solution that efficiently optimizes all variables by employing convex optimization approaches. Simulation results show that by incorporating the multiple hybrid RIS into the optimization design, the extended target detection and secure transmission performance of ISAC systems are improved over the state-of-the-art RIS-aided ISAC approaches.

physics.ins-det↗

A Conditional Independence Test in the Presence of Discretization

Testing conditional independence has many applications, such as in Bayesian network learning and causal discovery. Different test methods have been proposed. However, existing methods generally can not work when only discretized observations are available. Specifically, consider $X_1$, $\tilde{X}_2$ and $X_3$ are observed variables, where $\tilde{X}_2$ is a discretization of latent variables $X_2$. Applying existing test methods to the observations of $X_1$, $\tilde{X}_2$ and $X_3$ can lead to a false conclusion about the underlying conditional independence of variables $X_1$, $X_2$ and $X_3$. Motivated by this, we propose a conditional independence test specifically designed to accommodate the presence of such discretization. To achieve this, we design the bridge equations to recover the parameter reflecting the statistical information of the underlying latent continuous variables. An appropriate test statistic and its asymptotic distribution under the null hypothesis of conditional independence have also been derived. Both theoretical results and empirical validation have been provided, demonstrating the effectiveness of our test methods.

stat.ML↗

Mamba-VA: A Mamba-based Approach for Continuous Emotion Recognition in Valence-Arousal Space

Continuous Emotion Recognition (CER) plays a crucial role in intelligent human-computer interaction, mental health monitoring, and autonomous driving. Emotion modeling based on the Valence-Arousal (VA) space enables a more nuanced representation of emotional states. However, existing methods still face challenges in handling long-term dependencies and capturing complex temporal dynamics. To address these issues, this paper proposes a novel emotion recognition model, Mamba-VA, which leverages the Mamba architecture to efficiently model sequential emotional variations in video frames. First, the model employs a Masked Autoencoder (MAE) to extract deep visual features from video frames, enhancing the robustness of temporal information. Then, a Temporal Convolutional Network (TCN) is utilized for temporal modeling to capture local temporal dependencies. Subsequently, Mamba is applied for long-sequence modeling, enabling the learning of global emotional trends. Finally, a fully connected (FC) layer performs regression analysis to predict continuous valence and arousal values. Experimental results on the Valence-Arousal (VA) Estimation task of the 8th competition on Affective Behavior Analysis in-the-wild (ABAW) demonstrate that the proposed model achieves valence and arousal scores of 0.5362 (0.5036) and 0.4310 (0.4119) on the validation (test) set, respectively, outperforming the baseline. The source code is available on GitHub:https://github.com/FreedomPuppy77/Charon.

cs.CV↗

Flow: Modularized Agentic Workflow Automation

Multi-agent frameworks powered by large language models (LLMs) have demonstrated great success in automated planning and task execution. However, the effective adjustment of agentic workflows during execution has not been well studied. An effective workflow adjustment is crucial in real-world scenarios, as the initial plan must adjust to unforeseen challenges and changing conditions in real time to ensure the efficient execution of complex tasks. In this paper, we define workflows as an activity-on-vertex (AOV) graph, which allows continuous workflow refinement by LLM agents through dynamic subtask allocation adjustment based on historical performance and previous AOVs. To further enhance framework performance, we emphasize modularity in workflow design based on evaluating parallelism and dependency complexity. With this design, our proposed multi-agent framework achieves efficient concurrent execution of subtasks, effective goal achievement, and enhanced error tolerance. Empirical results across various practical tasks demonstrate significant improvements in the efficiency of multi-agent frameworks through dynamic workflow refinement and modularization. The code is available at: https://github.com/tmllab/2025_ICLR_FLOW.

cs.AI↗

Low-phase-noise surface-acoustic-wave oscillator using an edge mode of a phononic band gap

Low-phase-noise microwave-frequency integrated oscillators provide compact solutions for various applications in signal processing, communications, and sensing. Surface acoustic waves (SAW), featuring orders-of-magnitude shorter wavelength than electromagnetic waves at the same frequency, enable integrated microwave-frequency systems with much smaller footprint on chip. SAW devices also allow higher quality (Q) factors than electronic components at room temperature. Here, we demonstrate a low-phase-noise gigahertz-frequency SAW oscillator on 128°Y-cut lithium niobate, where the SAW resonator occupies a footprint of 0.05 mm$^2$. Leveraging phononic crystal bandgap-edge modes to balance between Q factors and insertion losses, our 1-GHz SAW oscillator features a low phase noise of -132.5 dBc/Hz at a 10 kHz offset frequency and an overlapping Hadamard deviation of $6.5\times10^{-10}$ at an analysis time of 64 ms. The SAW resonator-based oscillator holds high potential in developing low-noise sensors and acousto-optic integrated circuits.

physics.app-ph↗

Graphene-like nanoribbons connected by four-/five- membered rings on pentacene/picene precursors, Au(110) surface

The rapid development of fabrication of functional high-quality graphene-like nanoribbons has increasingly reliant on integration of diverse nanofabrication platforms. The demand for innovative techniques to enable the exploration and precise manipulation of graphene-like nanoribbons. Herein, we present an on-surface synthesis approach for graphene-like nanoribbons, achieved through the self-assembly and annealing of pentacene/picene monomers on an one-dimensional(1D) Au(110) substrate. Scanning tunneling microscope(STM) analysis reveals that the formation of four- and eight- membered rings between adjacent molecules. Furthermore, we demonstrate a technique for manipulating pentacene dimer without breaking structural integrity by STM tip manipulation. Our results exhibit a potential platform for the development of next-generation graphene-based quantum computing architectures, as well as a technique for fabricating functional graphene-like nanoribbons with exceptional precision.

cond-mat.mes-hall↗

MD-Dose: A diffusion model based on the Mamba for radiation dose prediction

Radiation therapy is crucial in cancer treatment. Experienced experts typically iteratively generate high-quality dose distribution maps, forming the basis for excellent radiation therapy plans. Therefore, automated prediction of dose distribution maps is significant in expediting the treatment process and providing a better starting point for developing radiation therapy plans. With the remarkable results of diffusion models in predicting high-frequency regions of dose distribution maps, dose prediction methods based on diffusion models have been extensively studied. However, existing methods mainly utilize CNNs or Transformers as denoising networks. CNNs lack the capture of global receptive fields, resulting in suboptimal prediction performance. Transformers excel in global modeling but face quadratic complexity with image size, resulting in significant computational overhead. To tackle these challenges, we introduce a novel diffusion model, MD-Dose, based on the Mamba architecture for predicting radiation therapy dose distribution in thoracic cancer patients. In the forward process, MD-Dose adds Gaussian noise to dose distribution maps to obtain pure noise images. In the backward process, MD-Dose utilizes a noise predictor based on the Mamba to predict the noise, ultimately outputting the dose distribution maps. Furthermore, We develop a Mamba encoder to extract structural information and integrate it into the noise predictor for localizing dose regions in the planning target volume (PTV) and organs at risk (OARs). Through extensive experiments on a dataset of 300 thoracic tumor patients, we showcase the superiority of MD-Dose in various metrics and time consumption.

eess.IV↗

Multi-Dimensional Reconfigurable, Physically Composable Hybrid Diffractive Optical Neural Network

Diffractive optical neural networks (DONNs), leveraging free-space light wave propagation for ultra-parallel, high-efficiency computing, have emerged as promising artificial intelligence (AI) accelerators. However, their inherent lack of reconfigurability due to fixed optical structures post-fabrication hinders practical deployment in the face of dynamic AI workloads and evolving applications. To overcome this challenge, we introduce, for the first time, a multi-dimensional reconfigurable hybrid diffractive ONN system (MDR-HDONN), a physically composable architecture that unlocks a new degree of freedom and unprecedented versatility in DONNs. By leveraging full-system learnability, MDR-HDONN repurposes fixed fabricated optical hardware, achieving exponentially expanded functionality and superior task adaptability through the differentiable learning of system variables. Furthermore, MDR-HDONN adopts a hybrid optical/photonic design, combining the reconfigurability of integrated photonics with the ultra-parallelism of free-space diffractive systems. Extensive evaluations demonstrate that MDR-HDONN has digital-comparable accuracy on various task adaptations with 74x faster speed and 194x lower energy. Compared to prior DONNs, MDR-HDONN shows exponentially larger functional space with 5x faster training speed, paving the way for a new paradigm of versatile, composable, hybrid optical/photonic AI computing. We will open-source our codes.

physics.optics↗