Searcharxiv⌕ Search

arXiv subjects

Zhihui Peng

Publications and source records attributed to Zhihui Peng.

At least 19 recordsLinked to original sources

XBot-Omni: An Omni-Modal Model for Embodied Understanding and Interaction

Embodied interaction requires an agent to integrate multimodal perception with verbal and nonverbal behaviors to effectively communicate its intentions, including speech, body motion, and facial expressions. We present XBot-Omni, a Thinker--Talker--Actor architecture that extends the Omni paradigm to robotic modalities, including body motion and facial expressions, with ``X'' representing the extensibility to robotic-specific modalities. The Thinker processes text, images, audio, and video to formulate contextually appropriate responses, which are then realized by the Talker and Actor through speech and coordinated bodily expressions, respectively. In this report, we innovatively introduce the concept of ``Actor'' as a dedicated component for embodied agents: a coordinated, streaming module that leverages the native representations of the Thinker and Talker within an end-to-end pipeline, introducing only modest latency overhead. This unified architecture enables multimodal generation conditioned on omni-modal inputs directly to prevent information loss in staged designs. We comprehensively evaluate XBot-Omni across seven benchmarks, demonstrating strong multimodal understanding capabilities on both general-domain and robot-centric videos, as well as high-quality, natural, and well-coordinated motion generation. Furthermore, our results validate its capability to generate embodied multimodal responses directly from omni inputs, meeting the diverse requirements of embodied interaction. XBot-Omni enables robots not only to perceive the omni world but also to express themselves through speech and bodily behaviors, extending Omni models from conversational interaction to embodied communication in physical environments.

cs.RO↗

X-Nav Technical Report: Real-World Long-Horizon Indoor-to-Outdoor Navigation on a Humanoid Robot

Long-horizon navigation from indoors to outdoors remains an open problem for humanoid robots: one instruction covers rooms, doors and roads, and the camera moves with the gait. Worken, AGIBOT's measure of productive robot work, depends on robots that reach their workplaces autonomously. We present X-Nav, to our knowledge the first system to take a bipedal humanoid through a language-instructed long-horizon mission from indoors to outdoors. X-Nav covers a pipeline from data to deployment. Its data engine collects navigation data in open-source scenes, in digital twins of deployment sites and on real robots. Its navigation model, MELIOR, takes only RGB images from the robot's built-in camera and comes in two versions: MELIOR-A predicts actions, and MELIOR-N predicts a navigation goal. Its agentic workflow, X-Navarch, turns a brief human instruction into sub-tasks and deploys MELIOR on the robot with explicit target navigation and obstacle avoidance. On the Lingxi X2, X-Nav completes a mission of about a hundred metres from an office lobby to a store in a neighbouring building; LiDAR and odometry are used for target approach and low-level control. The mission is completed with both versions of MELIOR: the robot follows a change of destination and walks through a door from the lobby to the road, and with X-Navarch it also passes static and dynamic obstacles on the route. During deployment, MELIOR is adapted with data collected in a digital twin of the site; the adaptation raises its closed-loop success rate in the twin, and the adapted model is then deployed on the robot at the real site. In addition, MELIOR achieves competitive results on the R2R-CE and RxR-CE benchmarks.

cs.RO↗

X2-N: A Transformable Wheel-legged Humanoid Robot with Dual-mode Locomotion and Manipulation

Wheel-legged robots combine the efficiency of wheeled locomotion with the versatility of legged systems, enabling rapid traversal over both continuous and discrete terrains. However, conventional designs typically employ fixed wheels as feet and limited degrees of freedom (DoFs) at the hips, resulting in reduced stability and mobility during legged locomotion compared to humanoids with flat feet. In addition, most existing platforms lack a full upper body with arms, which limits their ability to perform dexterous manipulation tasks. In this letter, we present X2-N, a high-DoF transformable robot with dual-mode locomotion and manipulation. X2-N can operate in both humanoid and wheel-legged forms and transform seamlessly between them through joint reconfiguration. We further propose a reinforcement learning (RL)-based whole-body control framework tailored to this morphology, enabling control across hybrid locomotion, transformation, and manipulation. We validate X2-N in a range of challenging locomotion and manipulation tasks, including dynamic skating-like motion, stair climbing, and package delivery. Results demonstrate high

cs.RO↗

WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Control

Humanoid robots require precise locomotion and dexterous manipulation to perform challenging loco-manipulation tasks. Yet existing approaches, modular or end-to-end, are deficient in manipulation-aware locomotion. This confines the robot to a limited workspace, preventing it from performing large-space loco-manipulation. We attribute this to: (1) the challenge of acquiring loco-manipulation knowledge due to the scarcity of humanoid teleoperation data, and (2) the difficulty of faithfully and reliably executing locomotion commands, stemming from the limited precision and stability of existing RL controllers. To acquire richer loco-manipulation knowledge, we propose a unified latent learning framework that enables Vision-Language-Action (VLA) system to learn from low-cost action-free egocentric videos. Moreover, an efficient human data collection pipeline is devised to augment the dataset and scale the benefits. To execute the desired locomotion commands more precisely, we present a loco-manipulation-oriented (LMO) RL policy specifically tailored for accurate and stable core loco-manipulation movements, such as advancing, turning, and squatting. Building on these components, we introduce WholeBodyVLA, a unified framework for humanoid loco-manipulation. To the best of our knowledge, WholeBodyVLA is one of its kind enabling large-space humanoid loco-manipulation. It is verified via comprehensive experiments on the AgiBot X2 humanoid, outperforming prior baseline by 21.3%. It also demonstrates strong generalization and high extensibility across a broad range of tasks.

cs.RO↗

On-Demand Microwave Single-Photon Source Based on Tantalum Thin Film

Single-photon sources are crucial for quantum information technologies. Here, we demonstrate a microwave single-photon source fabricated using a tantalum-based thin film, whose favorable material properties enable high-quality and stable photon emission. The antibunching behavior of the emitted radiation is revealed by second-order correlation measurements. Furthermore, traveling-wave parametric amplifiers are used as the pre-amplifier in the detection chains, we substantially improve the signal-to-noise ratio and thereby greatly reduce the acquisition time required for second-order correlation measurements. These results demonstrate the viability of tantalum-based superconducting devices as reliable platforms for microwave quantum photonics.

quant-ph↗

Efficient Convex Optimization for Bosonic State Tomography

Quantum states encoded in electromagnetic fields, also known as bosonic states, have been widely applied in quantum sensing, quantum communication, and quantum error correction. Accurate characterization is therefore essential yet difficult when states cannot be reconstructed with sparse Pauli measurements. Tomography must work with dense measurement bases, high-dimensional Hilbert spaces, and often sample-based data. However, existing convex optimization-based techniques are not efficient enough and scale poorly when extended to large and multi-mode systems. In this work, we explore convex optimization as an effective framework to address problems in bosonic state tomography, introducing three techniques to enhance efficiency and scalability: efficient displacement operator computation, Hilbert space truncation, and stochastic convex optimization, which mitigate common limitations of existing approaches. Then we propose a sample-based, convex maximum-likelihood estimation (MLE) method specifically designed for flying mode tomography. Numerical simulations of flying four-mode and nine-mode problems demonstrate the accuracy and practicality of our methods. This method provides practical tools for reliable bosonic mode quantum state reconstruction in high-dimensional and multi-mode systems.

quant-ph↗

Quantum Acoustics with Superconducting Qubits in the Multimode Transition-Coupling Regime

Hybrid mechanical-superconducting systems for quantum information processing have attracted significant attention due to their potential applications. In such systems, the weak coupling regime, dominated by dissipation, has been extensively studied. The strong coupling regime, where coherent energy exchange exceeds losses, has also been widely explored. However, the transition-coupling regime, which lies between the above two and exhibits rich, unique physics, remains underexplored. In this study, we fabricate a tunable coupling device to investigate the coupling of a superconducting transmon qubit to a seven-mode surface acoustic wave resonator (SAWR), with a particular focus on the transition-coupling regime. Through a series of phonon oscillation experiments and studies in the dispersive regime, we systematically characterize the performance of the SAWR. We then explore the complex dynamics of energy exchange between the qubit and the mechanical modes, highlighting the interplay between dissipation and coherence. Finally, we propose a protocol for qubit readout and fast reset with a multimode mechanical cavity using one mode for readout and another mode for reset. We have demonstrated in simulation that the qubit achieves both fast reset and high coherence performance when the qubit is coupled to the reset mode in the transition-coupling regime.

quant-ph↗

Robust Quantum Control using Reinforcement Learning from Demonstration

Quantum control requires high-precision and robust control pulses to ensure optimal system performance. However, control sequences generated with a system model may suffer from model bias, leading to low fidelity. While model-free reinforcement learning (RL) methods have been developed to avoid such biases, training an RL agent from scratch can be time-consuming, often taking hours to gather enough samples for convergence. This challenge has hindered the broad application of RL techniques to larger and more complex quantum control issues, limiting their adaptability. In this work, we use Reinforcement Learning from Demonstration (RLfD) to leverage the control sequences generated with system models and further optimize them with RL to avoid model bias. By avoiding learning from scratch and starting with reasonable control pulse shapes, this approach can increase sample efficiency by reducing the number of samples, which can significantly reduce the training time. Thus, this method can effectively handle pulse shapes that are discretized into more than 1000 pieces without compromising final fidelity. We have simulated the preparation of several high-fidelity non-classical states using the RLfD method. We also find that the training process is more stable when using RLfD. In addition, this method is suitable for fast gate calibration using reinforcement learning.

quant-ph↗

Interference trapping of populations in a semi-infinite coupled-resonator waveguide

We study the energy structure and dynamics of a two-level emitter (2LE) locally coupled to a semi-infinite one-dimensional (1D) coupled-resonator array (CRA). The energy spectrum in the single-excitation subspace features a continuous band with scattering states, discrete levels with bound states, and a quantum phase transition characterized by the change of the number of bound states. The number of bound states is revealed by the behavior of the excited-state population at long times with quantum beat, residual oscillation, a constant with either non-zero or zero.

quant-ph↗

Hybrid quantum surface acoustic wave with skyrmion qubit for quantum information processing

Surface acoustic wave (SAW) devices are key components of classical communication systems and recently studied for quantum information processing. We here propose and study a hybrid quantum system composed of skyrmion qubit and a SAW cavity, which supports a number of long-lived phononic modes. The results show that the system allows for strong coupling between skyrmion qubit and single phonon of different modes. By manipulating the qubit(s) through a static magnetic field and a time-dependent modulation magnetic field, we further study the interaction between skyrmion qubit and individual phononic modes, phonon-phonon interaction, and qubit-qubit interaction, which operates in strong-coupling regime. The controllability of nanoscale skyrmion qubit and the dense phononic modes of single SAW cavity would make our system have promising applications in large-scale quantum communication and computing.

quant-ph↗

Quantum Optimal Control Theory for the Shaping of Flying Qubits

The control of flying qubits carried by itinerant photons is ubiquitous in quantum networks. Beside their logical states, the shape of flying qubits must also be tailored for high-efficiency information transmission. In this paper, we introduce quantum optimal control theory to the shaping of flying qubits. Building on the flying-qubit control model established in our previous work, we design objective functionals for the generation of shaped flying qubits under practical constraints on the emitters and couplers. Numerical simulations employing gradient-descent algorithms demonstrate that the optimized control can effectively mitigate unwanted level and photon leakage caused by these non-idealities. Notably, while coherent control offers limited shaping capacity with a fixed coupler, it can significantly enhance the shaping performance when combined with a tunable coupler that has restricted tunability. The proposed optimal control framework provides a systematic approach to achieving high-quality control of flying qubits using realistic quantum devices.

quant-ph↗

Quantum dual-path interferometry scheme for axion dark matter searches

Exploring the mysterious dark matter is a key quest in modern physics. Currently, detecting axions, a hypothetical particle proposed as a primary component of dark matter, remains a significant challenge due to their weakly interacting nature. Here we show at quantum level that in a cavity permeated by a magnetic field, the single axion-photon conversion rate is enhanced by the cavity quality factor and is quantitatively larger than the classical result by $π/2$. The axion cavity can be considered a quantum device emitting single photons with temporal separations. This differs from the classical picture and reveals a possibility for the axion cavity experiment to handle the signal sensitivity at the quantum level, e.g., a dual path quantum interferometry with cross-power and second-order correlation measurements. This scheme would greatly reduce the signal scanning time and improve the sensitivity of the axion-photon coupling, potentially leading to the direct observation of axions.

hep-ph↗

Dark photon constraints from a 7.139 GHz cavity haloscope experiment

The dark photon is a promising candidate for the dark matter which comprises most of the matter in our visible Universe. Via kinetic mixing with the Standard Model it can also be resonantly converted to photons in an electromagnetic cavity, offering novel experimental possibilities for the discovery and study of dark matter. We report the results of a pathfinder dark photon dark matter cavity search experiment performed at Hunan Normal University and the Institute of Physics, Chinese Academy of Sciences, representing the first stage of the APEX (Axion and dark Photon EXperiment) program. Finding no statistically significant excess, we place an upper limit on the kinetic mixing parameter $|χ|<3.7\times 10^{-13}$ around $m_A\simeq 29.5$ $μ$eV at 90% confidence level. This result exceeds other constraints on dark photon dark matter in this frequency range by roughly an order of magnitude.

hep-ex↗

Tunable coupling of a quantum phononic resonator to a transmon qubit with flip-chip architecture

A hybrid system with tunable coupling between phonons and qubits shows great potential for advancing quantum information processing. In this work, we demonstrate strong and tunable coupling between a surface acoustic wave (SAW) resonator and a transmon qubit based on galvanic-contact flip-chip technique. The coupling strength varies from $2π\times$7.0 MHz to -$2π\times$20.6 MHz, which is extracted from different vacuum Rabi oscillation frequencies. The phonon-induced ac Stark shift of the qubit at different coupling strengths is also shown. Our approach offers a good experimental platform for exploring quantum acoustics and hybrid systems.

quant-ph↗

Calibration of the Cryogenic Measurement System of a Resonant Haloscope Cavity

Possible light bosonic dark matter interactions with the Standard Model photon have been searched by microwave resonant cavities. In this paper, we demonstrate the cryogenic readout system calibration of a 7.138 GHz copper cavity with a loaded quality factor $Q_l=10^4$, operated at 22 mK temperature based on a dilution refrigerator. Our readout system consists of High Electron Mobility Transistors as cryogenic amplifiers at 4 K, plus room-temperature amplifiers and a spectrum analyzer for signal power detection. We test the system with a superconducting two-level system as a single-photon source in the microwave frequency regime and report an overall 95.6 dB system gain and -71.4 dB attenuation in the cavity's input channel. The effective noise temperature of the measurement system is 7.5 K.

hep-ex↗

Open-sourced Data Ecosystem in Autonomous Driving: the Present and Future

With the continuous maturation and application of autonomous driving technology, a systematic examination of open-source autonomous driving datasets becomes instrumental in fostering the robust evolution of the industry ecosystem. Current autonomous driving datasets can broadly be categorized into two generations. The first-generation autonomous driving datasets are characterized by relatively simpler sensor modalities, smaller data scale, and is limited to perception-level tasks. KITTI, introduced in 2012, serves as a prominent representative of this initial wave. In contrast, the second-generation datasets exhibit heightened complexity in sensor modalities, greater data scale and diversity, and an expansion of tasks from perception to encompass prediction and control. Leading examples of the second generation include nuScenes and Waymo, introduced around 2019. This comprehensive review, conducted in collaboration with esteemed colleagues from both academia and industry, systematically assesses over seventy open-source autonomous driving datasets from domestic and international sources. It offers insights into various aspects, such as the principles underlying the creation of high-quality datasets, the pivotal role of data engine systems, and the utilization of generative foundation models to facilitate scalable data generation. Furthermore, this review undertakes an exhaustive analysis and discourse regarding the characteristics and data scales that future third-generation autonomous driving datasets should possess. It also delves into the scientific and technical challenges that warrant resolution. These endeavors are pivotal in advancing autonomous innovation and fostering technological enhancement in critical domains. For further details, please refer to https://github.com/OpenDriveLab/DriveAGI.

cs.CV↗

Dynamics and Resonance Fluorescence from a Superconducting Artificial Atom Doubly Driven by Quantized and Classical Fields

We report an experimental demonstration of resonance fluorescence in a two-level superconducting artificial atom under two driving fields coupled to a detuned cavity. One of the fields is classical and the other is varied from quantum (vacuum fluctuations) to classical one by controlling the photon number inside the cavity. The device consists of a transmon qubit strongly coupled to a one-dimensional transmission line and a coplanar waveguide resonator. We observe a sideband anti-crossing and asymmetry in the emission spectra of the system through a one-dimensional transmission line, which is fundamentally different from the weak coupling case. By changing the photon number inside the cavity, the emission spectrum of our doubly driven system approaches to the case when the atom is driven by two classical bichromatic fields. We also measure the dynamical evolution of the system through the transmission line and study the properties of the first-order correlation function, Rabi oscillations and energy relaxation in the system. The study of resonance fluorescence from an atom driven by two fields promotes understanding decoherence in superconducting quantum circuits and may find applications in superconducting quantum computing and quantum networks.

quant-ph↗

Randomised benchmarking for characterizing and forecasting correlated processes

The development of fault-tolerant quantum processors relies on the ability to control noise. A particularly insidious form of noise is temporally correlated or non-Markovian noise. By combining randomized benchmarking with supervised machine learning algorithms, we develop a method to learn the details of temporally correlated noise. In particular, we can learn the time-independent evolution operator of system plus bath and this leads to (i) the ability to characterize the degree of non-Markovianity of the dynamics and (ii) the ability to predict the dynamics of the system even beyond the times we have used to train our model. We exemplify this by implementing our method on a superconducting quantum processor. Our experimental results show a drastic change between the Markovian and non-Markovian regimes for the learning accuracies.

quant-ph↗