arXiv subjects

Zhian Ruan

Publications and source records attributed to Zhian Ruan.

3 recordsLinked to original sources

arXiv2026

SENTINEL: A Multi-Level Formal Framework for Safety Evaluation of Foundation Model-based Embodied Agents

We present SENTINEL, a framework for formally evaluating the physical safety of foundation model (FM)-based embodied agents. SENTINEL is the first to provide multi-level safety evaluation across semantic interpretation, plan generation, and physical execution within a unified formal framework. Unlike prior methods that rely on heuristic rules or subjective FM judgments, SENTINEL grounds practical safety requirements in formal temporal logic (TL) semantics that can precisely specify state invariants, temporal dependencies, and timing constraints. It employs a multi-level verification pipeline where (i) at the semantic level, intuitive natural language safety requirements are formalized into TL formulas and the agent's understanding of these requirements is probed for alignment with the TL formulas; (ii) at the plan level, high-level action plans and subgoals generated by the agent are verified against the TL formulas to detect unsafe plans before execution; and (iii) at the trajectory level, multiple execution trajectories are merged into a computation tree and efficiently verified against physically-detailed TL specifications for a final safety check. We apply SENTINEL in VirtualHome and AI2-THOR, and formally evaluate multiple FM-based embodied agents against diverse safety requirements. Our experiments show that by grounding physical safety in temporal logic and applying verification methods across multiple levels, SENTINEL provides a rigorous foundation for systematically evaluating the safety of FM-based embodied agents in simulation-based physical environments, and can effectively expose potential safety violations in interpreting, planning, and executing the tasks.

cs.AI↗

arXiv2024

Inverse Delayed Reinforcement Learning

Inverse Reinforcement Learning (IRL) has demonstrated effectiveness in a variety of imitation tasks. In this paper, we introduce an IRL framework designed to extract rewarding features from expert trajectories affected by delayed disturbances. Instead of relying on direct observations, our approach employs an efficient off-policy adversarial training framework to derive expert features and recover optimal policies from augmented delayed observations. Empirical evaluations in the MuJoCo environment under diverse delay settings validate the effectiveness of our method. Furthermore, we provide a theoretical analysis showing that recovering expert policies from augmented delayed observations outperforms using direct delayed observations.

cs.LG↗

arXiv2024

Distributed Invariant Unscented Kalman Filter based on Inverse Covariance Intersection with Intermittent Measurements

This paper studies the problem of distributed state estimation (DSE) over sensor networks on matrix Lie groups, which is crucial for applications where system states evolve on Lie groups rather than vector spaces. We propose a diffusion-based distributed invariant Unscented Kalman Filter using the inverse covariance intersection (DIUKF-ICI) method to address target tracking in 3D environments. Unlike existing distributed UKFs confined to vector spaces, our approach extends the distributed UKF framework to Lie groups, enabling local estimates to be fused with intermediate information from neighboring agents on Lie groups. To handle the unknown correlations across local estimates, we extend the ICI fusion strategy to matrix Lie groups for the first time and integrate it into the diffusion algorithm. We demonstrate that the estimation error of the proposed method is bounded. Additionally, the algorithm is fully distributed, robust against intermittent measurements, and adaptable to time-varying communication topologies. The effectiveness of the proposed method is validated through extensive Monte-Carlo simulations.

eess.SY↗