arXiv subjects

Xiaowen Bi

Publications and source records attributed to Xiaowen Bi.

3 recordsLinked to original sources

arXiv2026

From Observation to Intervention: Mastering Bus Holding Control from Historical Uncontrolled Trajectories with Offline Reinforcement Learning

Bus operations are inherently unstable---buses initially dispatched at equal headways will inevitably end up bunching up. This issue exacerbates passenger waiting times, creates load imbalances between buses, and undermines service reliability. Reinforcement learning (RL) has proven highly effective for mitigating bus bunching and outperforms traditional model-based approaches. However, existing RL approaches require agents to continuously interact with the environment, which potentially disrupts the bus system before effective policies are learned. This paper proposes an Offline Graph-based Multi-agent Actor-Critic (Offline-GMAC) method that trains bus holding policies using only readily available logged GPS data collected during normal uncontrolled operations, thereby eliminating the need for disruptive online interaction or exploration. The method employs general graph neural networks for multi-agent credit assignment. A key innovation of our method is a data augmentation scheme that synthesizes unperformed holding actions from historical uncontrolled bus trajectories. The scheme exploits the equivalence between stochastic link travel time delays and deliberate holding interventions. Under mild assumptions, we prove that the 1-Wasserstein distance between synthesized and target state transition distributions is bounded above by a term that scales linearly with the standard deviation of link travel times plus a tunable synthesis-dependent term. Evaluations using real-world bus data demonstrate that the proposed offline method achieves performance comparable to, and in some cases, even better than its online counterpart.

econ.GN↗

arXiv2026

Future-Aware Flow Planning for Safe UAV Target Following

UAV target following in cluttered environments requires anticipating target motion. Followers that use only the current target state can lag behind turns or choose blocked corridors. They may also trade safe near-horizon motion for lower tracking error. We propose a future-aware flow planning framework for state-informed UAV target following. Predicted target futures guide clean UAV trajectory generation through residual signals aligned with the planning horizon. Risk-scored repair of the executable prefix is embedded in the sampling loop. On fixed in-distribution (ID) and out-of-distribution (OOD) receding-horizon benchmarks, the planner improves the safety--tracking trade-off. It matches zero measured ID collision rate and achieves the highest ID safe-tracking time fraction. It also gives the lowest OOD macro-average collision rate and final tracking error among the compared methods. It does not dominate every metric: Future-MPC remains smoother and stronger on some threshold-based OOD success metrics under its hand-designed objective. Controlled comparisons show that future conditioning with the adapter improves candidate generation before safety repair. Simulator-facing tests examine interface perturbations, sensing, and controller execution. These results support horizon-aligned future guidance and embedded prefix repair as complementary components for safe UAV target following under the tested simulation conditions.

cs.RO↗

arXiv2026

Reciprocity Separates Gradient Flow from Rotation in Conservative Physical Learning

Physical learning lets a trainable material or network use its own physical response to carry error signals, reducing the need for a separately programmed backward computation. We ask what determines whether such a system follows conventional gradient descent or evolves along a genuinely different learning trajectory. Our canonical model is a directed layered transport network in which every node redistributes a fixed amount of flow, so learning preserves positivity and total mass. In this model, conservation constrains only the allowable learning directions. Within the matched response class studied here, adjoint matching gives the physical output response a symmetric form. Non-negative mode-wise feedback then produces a reciprocal closed-loop response and a reweighted gradient flow. Adding an antisymmetric boundary component makes the closed-loop response rotational: the learning path can turn while the error driving that update still decreases at that moment. Turning is not automatically beneficial. Its finite-step effect is set by local curvature, and its accumulated effect also depends on step selection and on the new states visited along the path. Numerical consistency checks reproduce the exact response structure, predict the sign of the local effect across new network families, and show how trajectory drift can negate a local advantage. These results separate the roles of conservation, reciprocity, and nonreciprocity in physical learning.

cs.LG↗