SearcharxivSearch

arXiv subjects

Thomas Zhao

Publications and source records attributed to Thomas Zhao.

2 recordsLinked to original sources

Information-Guided Safe Reinforcement Learning for Autonomous Gas Source Localization using sUAS

The autonomous localization of fugitive gas emissions using small Unmanned Aircraft Systems (sUAS) constitutes a fundamentally ill-posed inverse problem. In turbulent atmospheric boundary layers, highly intermittent scalar concentration fields violate the assumptions of classical gradient-based navigation, causing data-driven estimators to suffer from severe noise and spurious local minima. To address these challenges, we introduce an Information-Guided Safe Reinforcement Learning framework evaluated within a custom, GPU-accelerated 3D simulation environment coupling an Eulerian wind solver with a Lagrangian puff dispersion model. We identify a critical vulnerability in deterministic information-seeking planners - a Gramian bias where agents act greedily upon flawed early estimates, starving the estimator of spatial diversity. To systematically break this degeneracy, our architecture integrates a classical empirical observability Gramian (EMGR) planner with a learned Soft Actor-Critic (SAC) exploratory policy. A deterministic meta-supervisor actively monitors estimator reliability via Kullback-Leibler (KL) divergence, dynamically blending deterministic exploitation with learned exploration to steer the sUAS into high-information zones. Trained via a progressive curriculum and safeguarded by a strictly enforced Robust Control Barrier Function (RCBF), our RL framework achieves nearly 80% localization success on complex, mobile sources - drastically outperforming classical baselines (~30%) - while ensuring zero safety violations.

cs.RO

A Dynamical Systems Perspective Reveals Coordination in Russian Twitter Operations

We study Twitter data from a dynamical systems perspective. In particular, we focus on the large set of data released by Twitter Inc. and asserted to represent a Russian influence operation. We propose a mathematical model to describe the per-day tweet production that can be extracted using spectral analysis. We show that this mathematical model allows us to construct families (clusters) of users with common harmonics. We define a labeling scheme describing user strategy in an information operation and show that the resulting strategies correspond to the behavioral clusters identified from their harmonics. We then compare these user clusters to the ones derived from text data using a graph-based topic analysis method. We show that spectral properties of the user clusters are related to the number of user-topic groups represented in a spectral cluster. Bulk data analysis also provides new insights into the data set in the context of prior work.

cs.SI