arXiv subjects

Mingjia Chen

Publications and source records attributed to Mingjia Chen.

3 recordsLinked to original sources

arXiv2025

PFEA: An LLM-based High-Level Natural Language Planning and Feedback Embodied Agent for Human-Centered AI

The rapid advancement of Large Language Models (LLMs) has marked a significant breakthrough in Artificial Intelligence (AI), ushering in a new era of Human-centered Artificial Intelligence (HAI). HAI aims to better serve human welfare and needs, thereby placing higher demands on the intelligence level of robots, particularly in aspects such as natural language interaction, complex task planning, and execution. Intelligent agents powered by LLMs have opened up new pathways for realizing HAI. However, existing LLM-based embodied agents often lack the ability to plan and execute complex natural language control tasks online. This paper explores the implementation of intelligent robotic manipulating agents based on Vision-Language Models (VLMs) in the physical world. We propose a novel embodied agent framework for robots, which comprises a human-robot voice interaction module, a vision-language agent module and an action execution module. The vision-language agent itself includes a vision-based task planner, a natural language instruction converter, and a task performance feedback evaluator. Experimental results demonstrate that our agent achieves a 28\% higher average task success rate in both simulated and real environments compared to approaches relying solely on LLM+CLIP, significantly improving the execution success rate of high-level natural language instruction tasks.

cs.RO↗

arXiv2025

MDCPP: Multi-Robot Dynamic Coverage Path Planning for Workload Adaptation

Multi-robot coverage path planning commonly balances geometric area or path length under a constantspeed assumption. This assumption is inadequate when sensing or interaction tasks cause spatially varying traversal speeds, because equal areas can induce markedly different completion times. We propose Multi-Robot Dynamic Coverage Path Planning (MDCPP), which learns a Gaussian-mixture workload field from partial observations, predicts cell-wise service times, and repeatedly repartitions the uncovered cells through a distributed capacity-constrained assignment. We establish finite termination and pairwise local optimality of each synchronized assignment round, bound the service-time makespan degradation due to estimation error, and state sufficient conditions for complete coverage. A 600-run benchmark against sweeping, LS-MCPP, reactive reassignment, and an oracle shows that prediction is most valuable under strong heterogeneity and improves aggregate paired makespan over the nonpredictive alternatives. A three-UGV experiment further validates route execution and spatial speed adaptation under localization, drivetrain, and wireless-control effects.

cs.RO↗

arXiv2022

DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Reconstruction and Rendering

We introduce DoubleField, a novel framework combining the merits of both surface field and radiance field for high-fidelity human reconstruction and rendering. Within DoubleField, the surface field and radiance field are associated together by a shared feature embedding and a surface-guided sampling strategy. Moreover, a view-to-view transformer is introduced to fuse multi-view features and learn view-dependent features directly from high-resolution inputs. With the modeling power of DoubleField and the view-to-view transformer, our method significantly improves the reconstruction quality of both geometry and appearance, while supporting direct inference, scene-specific high-resolution finetuning, and fast rendering. The efficacy of DoubleField is validated by the quantitative evaluations on several datasets and the qualitative results in a real-world sparse multi-view system, showing its superior capability for high-quality human model reconstruction and photo-realistic free-viewpoint human rendering. Data and source code will be made public for the research purpose. Please refer to our project page: http://www.liuyebin.com/dbfield/dbfield.html.

cs.CV↗