arXiv subjects

Yanwei Wang

Publications and source records attributed to Yanwei Wang.

17 recordsLinked to original sources

arXiv2026

Probing optical and acoustic phonons in heated nano-Si/epoxy composites

Understanding the thermal response of optical and acoustic phonons is crucial for designing functional polymer nanocomposites. We study silicon nanoparticle (Si NP)-epoxy composites using combined Raman and Brillouin spectroscopy under local(laser-induced) and global(stage-controlled) heating. Raman spectra reveal THz longitudinal optical(LO) phonon softening and spectral broadening under local heating, indicating nanoscale hot-spots and interfacial scattering. Brillouin data track GHz longitudinal acoustic(LA) phonons, showing temperature- and concentration-dependent evolution of elasticity and damping. Contrasting heating methods unravels Si loading thresholds for isolated thermal absorbers, thermal percolation, acoustic attenuation and elastic homogenization. Local heating induces greater phonon softening and damping than global heating, with this disparity amplified at higher loadings by thermal gradients and interfacial dissipation. Global heating correlates with viscoelastic relaxation, showing intensified acoustic attenuation near the glass transition. Raman thermometry coupled with finite-element opto-thermal modeling allows evaluation of thermal conductivity of the composites characterized by increase from 0.09 to 0.46 W/(mK) for 0.07 up to 2 wt% of Si NPs, respectively, outperforming SiC nanowires at 2 wt% [D. Shen et al, Sci. Rep. 7, 2606 (2017)] despite bulk conductivity of Si being more than 3 times smaller than that of SiC. However, effective heat conductivity of our nanocomposites remain far below bulk Si, confirming that interfacial thermal resistance, not filler conductivity, governs heat transport.

physics.app-ph↗

arXiv2026

Motion Blur Robust Wheat Pest Damage Detection with Dynamic Fuzzy Feature Fusion

Motion blur caused by camera shake produces ghosting artifacts that substantially degrade edge side object detection. Existing approaches either suppress blur as noise and lose discriminative structure, or apply full image restoration that increases latency and limits deployment on resource constrained devices. We propose DFRCP, a Dynamic Fuzzy Robust Convolutional Pyramid, as a plug in upgrade to YOLOv11 for blur robust detection. DFRCP enhances the YOLOv11 feature pyramid by combining large scale and medium scale features while preserving native representations, and by introducing Dynamic Robust Switch units that adaptively inject fuzzy features to strengthen global perception under jitter. Fuzzy features are synthesized by rotating and nonlinearly interpolating multiscale features, then merged through a transparency convolution that learns a content adaptive trade off between original and fuzzy cues. We further develop a CUDA parallel rotation and interpolation kernel that avoids boundary overflow and delivers more than 400 times speedup, making the design practical for edge deployment. We train with paired supervision on a private wheat pest damage dataset of about 3,500 images, augmented threefold using two blur regimes, uniform image wide motion blur and bounding box confined rotational blur. On blurred test sets, YOLOv11 with DFRCP achieves about 10.4 percent higher accuracy than the YOLOv11 baseline with only a modest training time overhead, reducing the need for manual filtering after data collection.

cs.CV↗

arXiv2025

A Roadmap for Climate-Relevant Robotics Research

Climate change is one of the defining challenges of the 21st century, and many in the robotics community are looking for ways to contribute. This paper presents a roadmap for climate-relevant robotics research, identifying high-impact opportunities for collaboration between roboticists and experts across climate domains such as energy, the built environment, transportation, industry, land use, and Earth sciences. These applications include problems such as energy systems optimization, construction, precision agriculture, building envelope retrofits, autonomous trucking, and large-scale environmental monitoring. Critically, we include opportunities to apply not only physical robots but also the broader robotics toolkit - including planning, perception, control, and estimation algorithms - to climate-relevant problems. A central goal of this roadmap is to inspire new research directions and collaboration by highlighting specific, actionable problems at the intersection of robotics and climate. This work represents a collaboration between robotics researchers and domain experts in various climate disciplines, and it serves as an invitation to the robotics community to bring their expertise to bear on urgent climate priorities.

cs.RO↗

arXiv2025

Steering Robots with Inference-Time Interactions

Imitation learning has driven the development of generalist policies capable of autonomously solving multiple tasks. However, when a pretrained policy makes errors during deployment, there are limited mechanisms for users to correct its behavior. While collecting additional data for finetuning can address such issues, doing so for each downstream use case is inefficient at deployment. My research proposes an alternative: keeping pretrained policies frozen as a fixed skill repertoire while allowing user interactions to guide behavior generation toward user preferences at inference time. By making pretrained policies steerable, users can help correct policy errors when the model struggles to generalize-without needing to finetune the policy. Specifically, I propose (1) inference-time steering, which leverages user interactions to switch between discrete skills, and (2) task and motion imitation, which enables user interactions to edit continuous motions while satisfying task constraints defined by discrete symbolic plans. These frameworks correct misaligned policy predictions without requiring additional training, maximizing the utility of pretrained models while achieving inference-time user objectives.

cs.RO↗

arXiv2025

Partner Modelling Emerges in Recurrent Agents (But Only When It Matters)

Humans are remarkably adept at collaboration, able to infer the strengths and weaknesses of new partners in order to work successfully towards shared goals. To build AI systems with this capability, we must first understand its building blocks: does such flexibility require explicit, dedicated mechanisms for modelling others -- or can it emerge spontaneously from the pressures of open-ended cooperative interaction? To investigate this question, we train simple model-free RNN agents to collaborate with a population of diverse partners. Using the `Overcooked-AI' environment, we collect data from thousands of collaborative teams, and analyse agents' internal hidden states. Despite a lack of additional architectural features, inductive biases, or auxiliary objectives, the agents nevertheless develop structured internal representations of their partners' task abilities, enabling rapid adaptation and generalisation to novel collaborators. We investigated these internal models through probing techniques, and large-scale behavioural analysis. Notably, we find that structured partner modelling emerges when agents can influence partner behaviour by controlling task allocation. Our results show that partner modelling can arise spontaneously in model-free agents -- but only under environmental conditions that impose the right kind of social pressure.

cs.AI↗

arXiv2025

Deep Learning-Driven Protein Structure Prediction and Design: Key Model Developments by Nobel Laureates and Multi-Domain Applications

This systematic review outlines pivotal advancements in deep learning-driven protein structure prediction and design, focusing on four core models-AlphaFold, RoseTTAFold, RFDiffusion, and ProteinMPNN-developed by 2024 Nobel Laureates in Chemistry: David Baker, Demis Hassabis, and John Jumper. We analyze their technological iterations and collaborative design paradigms, emphasizing breakthroughs in atomic-level structural accuracy, functional protein engineering, and multi-component biomolecular interaction modeling. Key innovations include AlphaFold3's diffusion-based framework for unified biomolecular prediction, RoseTTAFold's three-track architecture integrating sequence and spatial constraints, RFDiffusion's denoising diffusion for de novo protein generation, and ProteinMPNN's inverse folding for sequence-structure co-optimization. Despite transformative progress in applications such as binder design, nanomaterials, and enzyme engineering, challenges persist in dynamic conformational sampling, multimodal data integration, and generalization to non-canonical targets. We propose future directions, including hybrid physics-AI frameworks and multimodal learning, to bridge gaps between computational design and functional validation in cellular environments.

physics.bio-ph↗

arXiv2025

Sub-Image Recapture for Multi-View 3D Reconstruction

3D reconstruction of high-resolution target remains a challenge task due to the large memory required from the large input image size. Recently developed learning based algorithms provide promising reconstruction performance than traditional ones, however, they generally require more memory than the traditional algorithms and facing scalability issue. In this paper, we developed a generic approach, sub-image recapture (SIR), to split large image into smaller sub-images and process them individually. As a result of this framework, the existing 3D reconstruction algorithms can be implemented based on sub-image recapture with significantly reduced memory and substantially improved scalability

cs.CV↗

arXiv2024

Inference-Time Policy Steering through Human Interactions

Generative policies trained with human demonstrations can autonomously accomplish multimodal, long-horizon tasks. However, during inference, humans are often removed from the policy execution loop, limiting the ability to guide a pre-trained policy towards a specific sub-goal or trajectory shape among multiple predictions. Naive human intervention may inadvertently exacerbate distribution shift, leading to constraint violations or execution failures. To better align policy output with human intent without inducing out-of-distribution errors, we propose an Inference-Time Policy Steering (ITPS) framework that leverages human interactions to bias the generative sampling process, rather than fine-tuning the policy on interaction data. We evaluate ITPS across three simulated and real-world benchmarks, testing three forms of human interaction and associated alignment distance metrics. Among six sampling strategies, our proposed stochastic sampling with diffusion policy achieves the best trade-off between alignment and distribution shift. Videos are available at https://yanweiw.github.io/itps/.

cs.RO↗

arXiv2024

First Place Solution to the ECCV 2024 ROAD++ Challenge @ ROAD++ Atomic Activity Recognition 2024

This report presents our team's technical solution for participating in Track 3 of the 2024 ECCV ROAD++ Challenge. The task of Track 3 is atomic activity recognition, which aims to identify 64 types of atomic activities in road scenes based on video content. Our approach primarily addresses the challenges of small objects, discriminating between single object and a group of objects, as well as model overfitting in this task. Firstly, we construct a multi-branch activity recognition framework that not only separates different object categories but also the tasks of single object and object group recognition, thereby enhancing recognition accuracy. Subsequently, we develop various model ensembling strategies, including integrations of multiple frame sampling sequences, different frame sampling sequence lengths, multiple training epochs, and different backbone networks. Furthermore, we propose an atomic activity recognition data augmentation method, which greatly expands the sample space by flipping video frames and road topology, effectively mitigating model overfitting. Our methods rank first in the test set of Track 3 for the ROAD++ Challenge 2024, and achieve 69% mAP.

cs.CV↗

arXiv2024

Versatile Demonstration Interface: Toward More Flexible Robot Demonstration Collection

Previous methods for Learning from Demonstration leverage several approaches for a human to teach motions to a robot, including teleoperation, kinesthetic teaching, and natural demonstrations. However, little previous work has explored more general interfaces that allow for multiple demonstration types. Given the varied preferences of human demonstrators and task characteristics, a flexible tool that enables multiple demonstration types could be crucial for broader robot skill training. In this work, we propose Versatile Demonstration Interface (VDI), an attachment for collaborative robots that simplifies the collection of three common types of demonstrations. Designed for flexible deployment in industrial settings, our tool requires no additional instrumentation of the environment. Our prototype interface captures human demonstrations through a combination of vision, force sensing, and state tracking (e.g., through the robot proprioception or AprilTag tracking). Through a user study where we deployed our prototype VDI at a local manufacturing innovation center with manufacturing experts, we demonstrated VDI in representative industrial tasks. Interactions from our study highlight the practical value of VDI's varied demonstration types, expose a range of industrial use cases for VDI, and provide insights for future tool design.

cs.RO↗

arXiv2024

Grounding Language Plans in Demonstrations Through Counterfactual Perturbations

Grounding the common-sense reasoning of Large Language Models (LLMs) in physical domains remains a pivotal yet unsolved problem for embodied AI. Whereas prior works have focused on leveraging LLMs directly for planning in symbolic spaces, this work uses LLMs to guide the search of task structures and constraints implicit in multi-step demonstrations. Specifically, we borrow from manipulation planning literature the concept of mode families, which group robot configurations by specific motion constraints, to serve as an abstraction layer between the high-level language representations of an LLM and the low-level physical trajectories of a robot. By replaying a few human demonstrations with synthetic perturbations, we generate coverage over the demonstrations' state space with additional successful executions as well as counterfactuals that fail the task. Our explanation-based learning framework trains an end-to-end differentiable neural network to predict successful trajectories from failures and as a by-product learns classifiers that ground low-level states and images in mode families without dense labeling. The learned grounding classifiers can further be used to translate language plans into reactive policies in the physical domain in an interpretable manner. We show our approach improves the interpretability and reactivity of imitation learning through 2D navigation and simulated and real robot manipulation tasks. Website: https://yanweiw.github.io/glide

cs.RO↗

arXiv2023

Human-Machine Cooperative Multimodal Learning Method for Cross-subject Olfactory Preference Recognition

Odor sensory evaluation has a broad application in food, clothing, cosmetics, and other fields. Traditional artificial sensory evaluation has poor repeatability, and the machine olfaction represented by the electronic nose (E-nose) is difficult to reflect human feelings. Olfactory electroencephalogram (EEG) contains odor and individual features associated with human olfactory preference, which has unique advantages in odor sensory evaluation. However, the difficulty of cross-subject olfactory EEG recognition greatly limits its application. It is worth noting that E-nose and olfactory EEG are more advantageous in representing odor information and individual emotions, respectively. In this paper, an E-nose and olfactory EEG multimodal learning method is proposed for cross-subject olfactory preference recognition. Firstly, the olfactory EEG and E-nose multimodal data acquisition and preprocessing paradigms are established. Secondly, a complementary multimodal data mining strategy is proposed to effectively mine the common features of multimodal data representing odor information and the individual features in olfactory EEG representing individual emotional information. Finally, the cross-subject olfactory preference recognition is achieved in 24 subjects by fusing the extracted common and individual features, and the recognition effect is superior to the state-of-the-art recognition methods. Furthermore, the advantages of the proposed method in cross-subject olfactory preference recognition indicate its potential for practical odor evaluation applications.

cs.AI↗

arXiv2023

Improving Small Language Models on PubMedQA via Generative Data Augmentation

Large Language Models (LLMs) have made remarkable advancements in the field of natural language processing. However, their increasing size poses challenges in terms of computational cost. On the other hand, Small Language Models (SLMs) are known for their efficiency, but they often struggle with limited capacity and training data, especially in specific domains. In this paper, we introduce a novel method aimed at improving SLMs in the medical domain using LLM-based generative data augmentation. The objective of our approach is to develop more efficient and capable models that are specifically tailored for specialized applications. Through experiments conducted on the PubMedQA dataset, we demonstrate the effectiveness of LLMs in refining and diversifying existing question-answer pairs. This refinement process leads to improved performance in a significantly smaller model after fine-tuning. Notably, our best SLM, with under 1.6 billion parameters, outperforms the few-shot GPT-4 on the PubMedQA dataset. Our code and generated data are publicly available to facilitate further explorations.

cs.CL↗

arXiv2022

Visual Pre-training for Navigation: What Can We Learn from Noise?

One powerful paradigm in visual navigation is to predict actions from observations directly. Training such an end-to-end system allows representations useful for downstream tasks to emerge automatically. However, the lack of inductive bias makes this system data inefficient. We hypothesize a sufficient representation of the current view and the goal view for a navigation policy can be learned by predicting the location and size of a crop of the current view that corresponds to the goal. We further show that training such random crop prediction in a self-supervised fashion purely on synthetic noise images transfers well to natural home images. The learned representation can then be bootstrapped to learn a navigation policy efficiently with little interaction data. The code is available at https://yanweiw.github.io/noise2ptz

cs.CV↗

arXiv2022

Temporal Logic Imitation: Learning Plan-Satisficing Motion Policies from Demonstrations

Learning from demonstration (LfD) has succeeded in tasks featuring a long time horizon. However, when the problem complexity also includes human-in-the-loop perturbations, state-of-the-art approaches do not guarantee the successful reproduction of a task. In this work, we identify the roots of this challenge as the failure of a learned continuous policy to satisfy the discrete plan implicit in the demonstration. By utilizing modes (rather than subgoals) as the discrete abstraction and motion policies with both mode invariance and goal reachability properties, we prove our learned continuous policy can simulate any discrete plan specified by a linear temporal logic (LTL) formula. Consequently, an imitator is robust to both task- and motion-level perturbations and guaranteed to achieve task success. Project page: https://yanweiw.github.io/tli/

cs.RO↗

arXiv2020

Deep learning for magnitude prediction in earthquake early warning

Fast and accurate magnitude prediction is the key to the success of earthquake early warning. We have proposed a new approach based on deep learning for P-wave magnitude prediction (EEWNet), which takes time series data as input instead of feature parameters. The architecture of EEWNet is adaptively adjusted according to the length of the input, thus eliminates the need of complicated tuning of hyperparameters for deep learning. Only the unfiltered accelerograms of vertical components are used. EEWNet is trained on a moderate number of data set (10,000s of records), but it achieves excellent results in magnitude prediction compared with approaches using parameters τlog, τc and Pd.

physics.geo-ph↗

arXiv2018

Modeling of a charged dielectric interface: Comparison of the continuum and discrete lattice representations of surface charges

Two main approaches in particle-based simulations for modeling a charged surface are using explicit, discrete charges and continuum, uniform charges. It is well-known that these two approaches could lead to substantially distinct ionic distributions, whereas a systematic exploration of the origin is still absent. In this short communication, we calculate the electrostatic force of a single point charge above a planar substrate characterized by a surface charge density and dielectric mismatch and compare the differences in the electrostatic forces produced by discrete and continuum representations of surface charges. We demonstrate that while the model of uniform surface charges gives a rather simple picture, the model of discrete surface charges can exhibit different scenarios, depending on the respective values of ion-surface distance versus lattice spacing and a self-image interaction parameter.

cond-mat.soft↗