Searcharxiv⌕ Search

arXiv subjects

Wei Xiao

Publications and source records attributed to Wei Xiao.

At least 19 recordsLinked to original sources

$TF^2$-Steering: Action Refinement with Tactile Forecasts and Feedback via Velocity-Field Steering

Tactile sensing plays a crucial role in everyday human interaction. Consider inserting a plug into a tight socket, vision alone provides limited guidance during the final insertion stage, and we instead rely on both anticipated contact and realized tactile feedback to ajust the insertion motion. The same capability is equally important for robots, particularly in dexterous manipulation tasks. Yet many contemporary robot policies remain vision-dominant. This visual bias, compounded by limited tactile data and sparse contact events, can cause directly incorporated tactile signals to be ignored or even compromise the policy's pretrained capabilities, yielding degrading performance as observed in our experiments. We present $TF^2$-Steering, which refines actions via learned residual steering of the flow-matching action expert's velocity field, using a tactile mixture-of-experts architecture to integrate both tactile forecasts and real-time tactile feedback. Together with specific designed three stages training recipe, $TF^2$-Steering enables tactile signals to correct and, when necessary, redirect the flow-matching action-generation process, while building on the strong action-generation capacity of the vision-based foundation policy. Extensive experiments across six simulated and six real-world manipulation tasks demonstrate the effectiveness of $TF^2$-Steering. It outperforms the strongest evaluated baselines by 10.7 percentage points in average simulation success rate and 9.1 percentage points in average real-world progress success rate. Project page: https://yiming-cc.github.io/tf2-steering/.

cs.RO↗

Robust Taylor-Lagrange Control for Safety-Critical Systems with Guaranteed Feasibility

The Control Barrier Function (CBF) method has been widely adopted in solving safety-critical control problems. However, the existence of a CBF is only a sufficient condition for system safety. The recently proposed Taylor-Lagrange Control (TLC) method addresses this limitation by providing a necessary and sufficient condition, but it is still vulnerable to the feasibility preservation problem (e.g., due to the inter-sampling effect when time is discretized). In this paper, we propose a robust TLC (rTLC) method to address the feasibility preservation problem and show how to use it to solve optimal control problems. Specifically, the rTLC method expands the safety function to an order higher than its relative degree using Taylor's expansion with Lagrange remainder, which allows the control to explicitly show up at the current time instead of a future time in the original TLC method. This implies that the safety constraint remains satisfied over the entire discretization time interval that follows. Moreover, the rTLC method naturally addresses the feasibility preservation problem with only a single hyper-parameter (the discretization time interval size during implementation), compared to significantly more parameters for its counterparts. Finally, we illustrate the effectiveness of the proposed rTLC method through an adaptive cruise control problem, and compare it with existing safety-critical control methods.

eess.SY↗

Competition and cancellation in a tilted Rice--Mele chain: exact Wannier--Stark offset and spectral readout

In a tilted Rice--Mele chain, the Wannier--Stark (WS) ladder becomes staggered, \(E_n=n\Fo+(-1)^{n+1}A\). The offset \(A\) reflects the competition between the staggered onsite energy \(Δ\) and the dimerized hopping \(\dt\), and its cancellation restores spectral equidistance. We determine \(A\) through a systematic strong-field series in the WS basis and a nonperturbative two-band Floquet expression. An exact matrix element reduces the strong-field expansion to Bessel algebra; at the representative working point, truncation at seventh order locates the cancellation point with a theory-internal truncation error of \(0.010\)~Hz, against \(27.3\)~Hz at first order. The Floquet propagator gives the closed form \(A=(\Fo/π)\arcsin(-i\,\mathrm{Tr}\,U/2)\), exact within the two-band model, implying the kinematic bound \(|A|\le\Fo/2\) and identifying cancellation with maximum spectral uniformity. The same analytic structure yields a family of real zeros and complex exceptional points that set the convergence radius of the strong-field series without touching the real axis. On odd-length chains, the hidden-symmetry defect produces a pairing plateau of height \(2|A|\) that persists numerically beyond first order in the modulations, allowing the offset to be read from the static spectrum without Floquet propagation or time evolution. In the bulk, cancellation appears as the merging of two sidebands into a single line at \(\Fo\), a null measurement that requires no calibrated sideband amplitudes, although the tilt and line frequency still need calibration. These signatures provide complementary spectral tests of the staggered WS ladder and a calibration-aware route to precision force sensing.

quant-ph↗

Curvature of left-invariant complex Finsler metric on Lie groups

Let $G$ be an even-dimensional connected real Lie group admitting a left-invariant complex structure $J$. Let $\mathfrak g$ be the Lie algebra of $G$, and $\mathfrak g^{1,0}$ the $(1,0)$-part of the complexification $\mathfrak g^{\mathbb{C}}$ of $\mathfrak g$. We derive explicit formulas for the holomorphic sectional curvature and holomorphic bisectional curvature of any left-invariant strongly pseudoconvex complex Finsler metric $F$ on $G$, expressed in terms of the complex Lie algebra $\mathfrak g^{1,0}$. We also obtain a necessary and sufficient condition for $F$ to be a Kähler-Finsler metric (resp. weakly Kähler-Finsler metric). As an application, we prove a rigidity result: if $G$ is a complex Lie group and $F$ is a left-invariant strongly pseudoconvex complex Finsler metric on $G$, then $F$ must be a complex Berwald metric with vanishing holomorphic bisectional curvature; moreover, $F$ is a Kähler-Berwald metric if and only if $G$ is an abelian complex Lie group.

math.DG↗

DIAL: Steerable Language Models with Distilled Instruction-Adherence Levels

When a user says "Keep it short", how short should the LLM's response be? More generally, users and applications require different levels of instruction adherence, but prompting does not reliably provide fine-grained control over them. We therefore study "steerable language models" that provide fine-grained numerical control over the degree to which models follow general instructions specified in text. However, existing approaches do not jointly offer fine-grained control, efficiency, and scalability across diverse instructions. To address this gap, we introduce DIAL (Distilled Instruction-Adherence Levels) to achieve all three properties. For fine-grained control, we perform classifier-free guidance (CFG) with a frozen LLM to provide training signals for on-policy distillation of instruction adherence at different levels. For efficiency, we design a lightweight steering adapter that uses a classifier over the LLM's hidden states to compute a closed-form steering edit. The classifier adaptively sets the steering magnitude at each token based on the target adherence level, while accounting for the geometry of the LLM's hidden states to preserve response coherence. For scalability, the classifier is text-conditioned, allowing a shared adapter to support new instructions without per-instruction fitting, and training requires only instruction and request text. Evaluation across multiple LLM families shows that DIAL achieves a competitive balance between concept expression and response fluency, with concept scores increasing monotonically across adherence levels. We introduce SteerIF, an instruction-only dataset of 98, 625 concept, persona, verifiable, and descriptive instructions. When trained on SteerIF, DIAL provides fine-grained control over personas and, when combined with prompting, improves verifiable instruction following.

cs.AI↗

Safety-Critical Quadrotor Navigation Using Fourth-Order Control Barrier Functions with Full Nonlinear Quadrotor Dynamics

Safety-critical quadrotor navigation in cluttered environments typically relies on hierarchical architectures in which a high-level safety filter modifies position references that are then tracked by a separate attitude controller. However, this separation can create a mismatch between translational safety objectives and attitude evolution. To address this gap, we propose a safety controller based on fourth-order control barrier functions (CBFs) that explicitly incorporates the full nonlinear quadrotor dynamics, including attitude dynamics and torque-level actuation. Furthermore, we apply the integral high-order CBF technique to resolve the mixed-relative degree issue in the derived constraint formulation. The resulting formulation enforces obstacle-avoidance constraints while optimizing control torques, granting the safety layer direct authority over attitude behavior and eliminating the hierarchical disconnect inherent in reference-tracking safety filters. We validate the approaches in both high-fidelity simulation and real-world flight experiments, demonstrating reliable constraint satisfaction and successful obstacle avoidance. These results suggest that torque-level high-order CBFs provide a practical pathway to provably safer quadrotor navigation under full rigid-body dynamics.

cs.RO↗

Monaural Continuous-Radius Regional Speech Extraction with Cross-Radius Consistency Learning

Source-to-microphone distance enables speaker-independent speech extraction without prior enrollment. We propose a monaural continuous-radius regional speech extraction method that directly models the cumulative speech target within a queried radius. To realize continuous region control, the query radius is encoded as a continuous scalar and injected into a time-frequency extraction network, allowing a single model to operate over arbitrary radii within the trained range. Exploiting the nested structure of target-speaker sets across query radii, we introduce cross-radius consistency learning to stabilize predictions for adjacent radii sharing the same nonempty target-speaker set. Experiments on measured RIRs show that continuous-radius conditioning improves selective extraction over discrete conditioning. The proposed method achieves 29.25~dB SI-SDR, 4.40~dB SI-SDRi, 62.01~dB attenuation, and 0.46\% RCE, outperforming fixed-threshold and local-range baselines. It also remains effective with more speakers and additive noise.

eess.AS↗

GJK-CBF: Control Barrier Functions for Convex Rigid Body Collision Avoidance on SE(3)

Collision avoidance among convex bodies is a fundamental problem in robotics. Control Barrier Functions (CBFs) provide a practical framework for real-time safety filtering due to their computational efficiency. For general convex bodies, exact separation measures, such as distance or scaling factor, are typically computed through optimization. Existing CBF formulations often obtain the required gradient via differentiable optimization (diffOpt), adding computational overhead. In contrast, we leverage the Gilbert-Johnson-Keerthi (GJK) algorithm to obtain the current witness pair---the pair of points realizing the minimum distance or penetration depth---and formulate a CBF, termed GJK-CBF, whose gradient is constructed directly from the relative rigid-body motion of the witness pair, without resorting to diffOpt. This formulation applies to both 2D and 3D environments across a broad class of convex body pairs, provided that at least one in each one-to-one interaction is strictly convex. The proposed GJK-CBF is validated in various scenarios, including multi-robot position swapping in both 2D and 3D, navigation through a vertical slit in 3D, and its applicability to manipulators. The results demonstrate collision-free motion across all scenarios while reducing the conservativeness introduced by geometric approximations, particularly in narrow environments.

cs.RO↗

Event-Triggered Adaptive Taylor-Lagrange Control for Safety-Critical Systems

This paper studies safety-critical control for nonlinear systems under sampled-data implementations of the controller. The recently proposed Taylor--Lagrange Control (TLC) method provides safety guarantees but relies on a fixed discretization-related parameter, which can lead to infeasibility or unsafety in the presence of input constraints and inter-sampling effects. To address these limitations, we propose an adaptive Taylor--Lagrange Control (aTLC) framework with an event-triggered implementation, where the key parameter defines the discretization time interval and is selected online as state-dependent rather than fixed. This enables the controller to dynamically balance feasibility and safety by adjusting the effective time interval of the Taylor expansion. The resulting controller is implemented as a sequence of Quadratic Programs (QPs) with input constraints. We further introduce a selection rule to choose the largest feasible discretization time interval from a finite candidate set while preserving safety. Simulation results on an adaptive cruise control (ACC) problem demonstrate that the proposed approach improves feasibility, guarantees safety, achieves smoother control actions, and reduces triggering events compared to TLC while avoiding the class $\mathcal K$ function tuning required by Control Barrier Function (CBF)-based methods.

eess.SY↗

Model Predictive Control for Safety-Critical Systems Using Taylor's Theorem with Lagrange Remainder

Safety-critical Model Predictive Control (MPC) formulations based on Control Barrier Functions (CBFs) often require multiple tuning parameters and may become conservative or difficult to keep feasible, particularly for high-relative-degree constraints. To address these limitations, in this paper we draw inspiration from the recently introduced Taylor-Lagrange Control (TLC) method, and propose an MPC formulation based on a Taylor expansion with Lagrange remainder (MPC-TLR). To enable digital implementation, we develop a numerical approximation of the Lagrange remainder under zero-order-hold control. The resulting safety constraint includes a tunable margin to account for approximation errors and balance safety, feasibility, and conservativeness. Comparisons with MPC using high-order CBFs (MPC-HOCBF), discrete-time high-order CBFs (MPC-DHOCBF), and direct safety constraints (MPC-DC) on a unicycle obstacle-avoidance problem show that MPC-TLR yields safer trajectories than MPC-DHOCBF and MPC-DC, while requiring fewer tuning parameters and being less conservative than MPC-HOCBF. Its broader control-input coverage under the adopted discretization can improve feasibility and control performance for short prediction horizons.

eess.SY↗

ROVE: Unlocking Human Interventions for Humanoid Manipulation via Reinforcement Learning

Human interventions provide crucial corrective signals for post-training Vision-Language-Action (VLA) models. However, enabling seamless humanoid interventions is a formidable systems challenge due to complex whole-body kinematics and dexterous-hand control. Consequently, the collected intervention trajectories are often suboptimal, and methods that rely on human interventions as expert supervision can absorb hesitant, inefficient, or even erroneous behaviors. To address both the system and algorithmic challenges, we propose ROVE, a reinforcement learning framework for humanoid VLA post-training with imperfect human interventions. First, ROVE introduces a human-in-the-loop pipeline capable of collecting deployment and intervention data for humanoid manipulation. Second, it utilizes Optimistic Value Estimation (OVE) to prioritize high-value behaviors from mixed-quality trajectories. To further robustify value estimation, we incorporate cross-embodiment human experience videos to provide rich supervision for long-tailed failure and recovery modes. The resulting critic yields informative advantage signals, steering the VLA actor to focus on high-value behaviors rather than indiscriminately imitating all actions. On challenging real-world contact-rich and fine-grained humanoid manipulation tasks, ROVE outperforms experience-learning baselines and consistently improves across multiple rollout-intervention iterations.

cs.RO↗

Safety Control of a Hyper-redundant Robot via Adaptive Weighted Control Barrier Functions

Hyper-redundant robots are well suited for confined-space manipulation due to their high dexterity, but safe operation in cluttered environments remains challenging. In addition, their slender structures often lead to uneven load distributions and nonuniform tracking errors along the body. To address these issues, this work proposes a weighted control barrier functions (W-CBFs) framework that enforces safety constraints while reducing tracking errors caused by uneven loading. The proposed controller was first evaluated on a circular path-following task under different obstacle configurations. With fixed weights, compared to the non-weighted method, the maximum reduction in root-mean-square (RMS) tracking error was 59.6\% in simulation and 87.7\% in physical experiments. An adaptive weighting strategy was then investigated based on the discrepancy between simulated and experimental performance under different mapping functions. The RMS errors were further reduced by 21.9\% and 8.5\%, respectively, although the error increases when obstacles were located close to the robot body. Finally, the robot was evaluated in a cleaning task requiring coverage of a rectangular area and compared with manual teleoperation. Although the controller was not explicitly optimized for area coverage, the autonomous strategy achieved comparable or better coverage performance while avoiding collisions with the surrounding frame, whereas collisions occurred during manual operation.

cs.RO↗

DR-MPC: Fast and Feasible Dynamics-Relaxed Model-Predictive Control for Legged Locomotion

This paper presents dynamics-relaxed model predictive control (DR-MPC), a novel MPC formulation for legged locomotion, and a tailored interior-point method (IPM) solver. The formulation combines online optimization feasibility by construction with a contact-aware input parameterization. DR-MPC moves the dynamics equality and affine input constraints into quadratic penalties and retains only nonempty box constraints. The resulting box-constrained quadratic program (QP) has a block-arrow Hessian that enables the state and affine-output directions to be eliminated through a Schur complement. The solver factors only the reduced control system after swing-force elimination and contact-aligned move blocking. For the evaluated implementations using the same DR-MPC formulation, our method achieves median end-to-end MPC speedups of $16.0\times$ over HPIPM and $4.4\times$ over OSQP, with comparable locomotion performance in simulation. DR-MPC achieves a median onboard MPC end-to-end time of $4.4$ ms and is validated on a Unitree Go1 quadruped. Open-source code will be made available after publication.

cs.RO↗

Complex Problem Solving in Large Language Models: A Statistical Control Survey and Diagnostic Framework

Complex problem solving (CPS) with large language models (LLMs) is often framed as a matter of stronger reasoning or longer generation. Yet early-step error amplification, prompt brittleness, and failures to revise incorrect commitments are difficult to explain by missing knowledge or expressive capacity alone. This survey interprets CPS as a sequential estimation-and-decision problem over a latent solution state. A controller maintains a belief about an unobserved solution trajectory, updates it as noisy intermediate evidence arrives, and decides whether to commit, verify, branch, roll back, or abstain to minimize expected loss. Reasoning supplies candidate transitions and interpretations, whereas process control shapes and evaluates those proposals and regulates subsequent transitions and observations. Within this framework, we organize existing methods around five components: explicit state representation, transition structuring, validation and constraint enforcement, search and rollback, and uncertainty management. We also interpret evaluation metrics according to the statistical quantities they estimate. The framework further yields a diagnostic hypothesis: interventions should be most effective when they target the error or uncertainty component implicated by an observed failure. We distinguish systematic, stochastic, and irreducible error together with epistemic and aleatoric uncertainty, and call this alignment problem-control fit and its failure control mismatch. For example, additional sampling may reduce sampling variability while leaving a shared systematic error unchanged. This perspective clarifies what current methods estimate and control, what remains uncontrolled, and why reliable validation, targeted recovery, calibrated uncertainty, and matched-budget evaluation are central open problems.

stat.ML↗

Data-Driven Spiking Control for Distributed $\varepsilon$-Nash Equilibrium Seeking

This paper studies how a feedback law synthesized directly from data can be realized by spiking control while retaining a game-theoretic performance guarantee. We consider distributed $\varepsilon$-Nash equilibrium (NE) seeking in network games played by linear dynamical agents with unknown models and exogenous disturbances. The pseudo-gradient of the game is treated as a regulated error, and local internal models account for signals generated by known exosystems. Robust linear matrix inequalities are then used to compute stabilizing analogue feedback gains directly from noisy local input-state data, without identifying the agent dynamics. To implement these gains using only fixed-weight spikes, we develop two spiking realizations. The first realization uses non-interacting leaky integrate-and-fire units, while the second permits reset coupling among the neuronal units. In both cases, a continuous auxiliary coordinate exposes the impulsive closed loop as the stable analogue system driven by a bounded implementation error. This representation yields forward completeness, Zeno-freeness, and an ultimate bound on the pseudo-gradient, subject to explicit event-processing conditions for the connected architecture. The bound implies that, after a finite transient, the agents' outputs constitute an $\varepsilon$-NE for every $\varepsilon$ above a finite threshold. A spacecraft formation reconfiguration example illustrates the data-driven synthesis, the two spiking realizations, and their practical equilibrium behavior.

eess.SY↗

Exact Signed-Distance Control Barrier Functions via Minkowski Operations for Safe Navigation among Polytopes

Safely navigating polytopic environments while respecting the dynamics, control, and exact geometry of the underlying system is a challenge in robotics. Control barrier functions (CBFs) synthesize safe control policies by rendering the safe set forward invariant, but many existing CBF-based methods approximate polytopes using conservative smooth shapes, such as spheres or ellipsoids, to obtain explicit differentiable distance functions. In this article, we propose an exact Signed Distance Function (SDF) formulation for a {\it polytopic} robot and {\it polytopic} obstacles and integrate it with nonsmooth CBFs. Leveraging Minkowski operations, the proposed method computes the exact SDF via companion convex programs in both the collision-free (positive-sign) and in-collision (negative-sign) cases. Furthermore, by exploiting the convenient geometric properties of 2D Minkowski operations and the optimality conditions of the two companion convex programs, we derive a unified analytical expression for the gradient of the exact SDF via sensitivity analysis. The exact rotational gradient further reveals a previously masked class of local minima induced by the coupling between geometry and nonholonomic kinematics. We demonstrate the effectiveness of the proposed framework through a pure-translation case and three scenarios with unicycle models involving recovery from an unsafe initialization and single- and multiple-obstacle avoidance. Comparisons with baseline methods highlight how the proposed framework enables non-conservative maneuvers and safety recovery.

cs.RO↗

FlowPilot: Real-Time World-Action Modeling for Agile UAV Navigation

We present FlowPilot, a compact world-action model for real-time onboard UAV navigation from depth. Unlike map-then-optimize pipelines that require local reconstruction or end-to-end policies that lack explicit scene prediction, FlowPilot jointly denoises future depth observations and executable trajectories with flow matching. A dual-stream mixture-of-transformers couples video and action experts through shared attention, allowing future-scene prediction and trajectory generation to inform each other. At deployment, the model runs action-centrically and outputs only a trajectory. To ensure trackability, actions are parameterized as degree-7 Bernstein polynomials: the current state constrains the initial control points, and the network predicts five free control points, yielding C^2-continuous references with closed-form velocity, acceleration and jerk. FlowPilot is trained on a three-level depth pyramid spanning high-throughput simulation, photorealistic simulation, and real onboard data. In closed-loop simulation, it outperforms learning- and optimization-based baselines under increasing clutter and commanded speeds up to 8m/s. On a physical quadrotor, the full perception-to-action pipeline runs in under 18ms on a Jetson Orin NX and reaches 5.5m/s in cluttered indoor and forest environments using only onboard sensing and computation.

cs.RO↗

Distributed Motion Planning with Safety Guarantees for Self-Reconfiguring Robotic Boats

Aquatic self-reconfigurable robots must assemble into desired shapes while ensuring safe interactions among multiple agents. This paper proposes a hybrid framework that combines distributed Model Predictive Control (MPC) with Control Barrier Functions (CBFs) for multi-agent shape formation and reconfiguration. Given a desired shape and target assignment, a distributed MPC scheme, solved via the Alternating Direction Method of Multipliers (ADMM), computes coordinated trajectories through local optimization and information exchange. To ensure safety in real time, distributed CBF-based filters are applied to enforce inter-agent collision avoidance. The proposed approach leverages the predictive capabilities of MPC to mitigate local minima, while CBFs provide formal safety guarantees despite the nonconvexity of the underlying optimization problem. Simulation results with up to 25 agents and experimental validation with four physical robots demonstrate the effectiveness and scalability of the framework.

cs.RO↗