SearcharxivSearch

arXiv subjects

Zhibo Hou

Publications and source records attributed to Zhibo Hou.

At least 19 recordsLinked to original sources

From Memorization to Absorption: Mixed-Policy RL for Continual Knowledge Injection

Continual knowledge injection is essential for keeping large language models up-to-date in a fast-evolving world. Existing methods rely on supervised fine-tuning (SFT), which memorizes injected facts in their training format but fails to generalize across paraphrasing, document combinations, and reasoning. To address this, we propose Golden-GRPO Injection (GRIN), a three-stage self-learning framework for continual knowledge injection. Golden-GRPO is a mixed-policy reinforcement learning algorithm designed specifically for knowledge injection, which injects a golden answer to provide learning signal even when on-policy rollouts fail on novel facts. We further introduce Blank and Counter, two document-level benchmarks targeting novel acquisition and counterfactual overwrite respectively, each evaluating single-fact recall, multi-source retrieval, and inferential reasoning. Our experiments establish a clear empirical claim: mixed-policy reinforcement learning enables knowledge absorption beyond what supervised fine-tuning can achieve. GRIN substantially outperforms SFT and mixed-policy RL baselines on the harder question types while matching them on basic fact recall.

cs.CL

Estimation of a sparse multi-qubit Hamiltonian via compressed sensing

Hamiltonian estimation is an effective approach in studying the structure and dynamical evolution of quantum systems. The difficulty in estimating the Hamiltonian is that an $N$-qubit Hamiltonian has $4^N-1$ unknown parameters, requiring exponentially many equations for information extraction. In this paper we develop a method based on compressed sensing to estimate the Hamiltonian of a multi-qubit system. We identify a problem where as $N$ increases, the common sufficient condition (Restricted Isometry Property) for compressed sensing often fails, obstructing the application of compressed sensing in ($N\geq 3$)-qubit Hamiltonian estimation. To solve this problem, we propose a ``scale transformation" technique to restore RIP and ensure a compressive estimation of a $k$-sparse Hamiltonian using only $O(k\log(4^N/k))$ equations. In the numerical examples, we estimate the Hamiltonians of two 6- and 30-qubit systems, demonstrating the effectiveness of the method.

quant-ph

Beating three-parameter precision trade-offs with entangling collective measurements

Quantum-mechanical incompatibility, which precludes the simultaneous precise measurement of non-commuting observables, imposes fundamental limits on the rate at which classical information can be extracted. While the potential to surpass these limits using entangling collective measurements has been explored for two parameters, the regime of three or more parameters remains largely unexplored despite its fundamental and technological importance. Here, we investigate the three-parameter trade-off relations for estimating the Bloch vector components of a qubit, comparing conventional individual measurements with entangling collective measurements. We theoretically derive and experimentally implement optimal collective measurements on two identically prepared qubits using a programmable photonic circuit. Our experimental results demonstrate a clear violation of the entanglement-free trade-off relation -- by an average of 16 standard deviations -- achieving a tomography precision beyond the reach of any individual measurement scheme. This work directly confirms that optimal collective measurements can surpass the fundamental quantum limits of individual schemes in a three-parameter setting -- thereby deepening our understanding of quantum uncertainty relations beyond the two-parameter regime and providing a clear strategy to overcome the precision trade-offs imposed by quantum incompatibility.

quant-ph

A single programmable photonic circuit for universal quantum measurements

Programmable photonic quantum processors face a critical challenge: despite significant advances in quantum state preparation and manipulation, measurements remain limited to projective techniques. Here, we demonstrate a programmable measurement processor that overcomes this limitation by enabling arbitrary quantum measurements within a scalable circuit framework. Our large-scale integrated photonic architecture achieves precise coherent control of ancillary quantum systems, realizing a universal four-dimensional quantum measurement device. We benchmark the processor by performing measurement tomography on 100 randomly selected measurements, achieving an average fidelity of 97.7%. The processor's performance exceeds the theoretical limits of projective measurements in three key quantum information tasks: state discrimination (with 23 times lower error), state estimation (with 10.6% higher fidelity), and randomness generation (with 37% more randomness yield), demonstrating its high operational quality. This work establishes a fully programmable quantum measurement processor, advancing the development of universal quantum operations for photonic quantum information processing by providing the key missing component.

quant-ph

Generalized collective quantum tomography: algorithm design, optimization, and validation

Quantum tomography is a fundamental technique for characterizing, benchmarking, and verifying quantum states and devices. It plays a crucial role in advancing quantum technologies and deepening our understanding of quantum mechanics. Collective quantum state tomography, which estimates an unknown state \r{ho} through joint measurements on multiple copies $\rho\otimes\cdots\otimes\rho$ of the unknown state, offers superior information extraction efficiency. Here we extend this framework to a generalized setting where the target becomes $S_1\otimes\cdots\otimes S_n$, with each $S_i$ representing identical or distinct quantum states, detectors, or processes from the same category. We formulate these tasks as optimization problems and develop three algorithms for collective quantum state, detector and process tomography, respectively, each accompanied by an analytical characterization of the computational complexity and mean squared error (MSE) scaling. Furthermore, we develop optimal solutions of these optimization problems using sum of squares (SOS) techniques with semi-algebraic constraints. The effectiveness of our proposed methods is demonstrated through numerical examples. Additionally, we experimentally demonstrate the algorithms using two-copy collective measurements, where entangled measurements directly provide information about the state purity. Compared to existing methods, our algorithms achieve lower MSEs and approach the collective MSE bound by effectively leveraging purity information.

quant-ph

Beyond Noisy-TVs: Noise-Robust Exploration Via Learning Progress Monitoring

When there exists an unlearnable source of randomness (noisy-TV) in the environment, a naively intrinsic reward driven exploring agent gets stuck at that source of randomness and fails at exploration. Intrinsic reward based on uncertainty estimation or distribution similarity, while eventually escapes noisy-TVs as time unfolds, suffers from poor sample efficiency and high computational cost. Inspired by recent findings from neuroscience that humans monitor their improvements during exploration, we propose a novel method for intrinsically-motivated exploration, named Learning Progress Monitoring (LPM). During exploration, LPM rewards model improvements instead of prediction error or novelty, effectively rewards the agent for observing learnable transitions rather than the unlearnable transitions. We introduce a dual-network design that uses an error model to predict the expected prediction error of the dynamics model in its previous iteration, and use the difference between the model errors of the current iteration and previous iteration to guide exploration. We theoretically show that the intrinsic reward of LPM is zero-equivariant and a monotone indicator of Information Gain (IG), and that the error model is necessary to achieve monotonicity correspondence with IG. We empirically compared LPM against state-of-the-art baselines in noisy environments based on MNIST, 3D maze with 160x120 RGB inputs, and Atari. Results show that LPM's intrinsic reward converges faster, explores more states in the maze experiment, and achieves higher extrinsic reward in Atari. This conceptually simple approach marks a shift-of-paradigm of noise-robust exploration. For code to reproduce our experiments, see https://github.com/Akuna23Matata/LPM_exploration

cs.LG

Unified formalism and adaptive algorithms for optimal quantum state, detector and process tomography

Quantum tomography is a standard technique for characterizing, benchmarking and verifying quantum systems/devices and plays a vital role in advancing quantum technology and understanding the foundations of quantum mechanics. Achieving the highest possible tomography accuracy remains a central challenge. Here we unify the infidelity metrics for quantum state, detector and process tomography in a single index $1-F(\hat S,S)$, where $S$ represents the true density matrix, POVM element, or process matrix, and $\hat S$ is its estimator. We establish a sufficient and necessary condition for any tomography protocol to attain the optimal scaling $1-F= O(1/N) $ where $N$ is the number of state copies consumed, in contrast to the $O(1/\sqrt{N})$ worst-case scaling of static methods. Guided by this result, we propose adaptive algorithms with provably optimal infidelity scalings for state, detector, and process tomography. Numerical simulations and quantum optical experiments validate the proposed methods, with our experiments reaching, for the first time, the optimal infidelity scaling in ancilla-assisted process tomography.

quant-ph

Stability and bifurcation of Navier-Stokes equations in an annular domain with mixed boundary conditions

We study the existence and stability of non-trivial steady-state solutions to the two-dimensional incompressible Navier-Stokes equations in an annular domain $\Omega = B(0,b) \setminus \overline{B(0,a)}$ with radii $b>a>0$.The outer boundary $\partial B(0, b)$ is subject to the free condition, while the inner boundary $\partial B(0, a)$ obeys a Navier-slip condition with effective slip length $\alpha > 0$. Our main results are fourfold. First, we establish global-in-time strong solutions and derive a sharp energy estimate that underpins the subsequent nonlinear instability analysis. Second, for $\alpha > 0$, we compute an explicit critical viscosity $\mu_c:=\mu_c(\alpha, a,b,\mu)$ that separates qualitatively different dynamical behaviours. Third, we precisely characterize the stability properties of the trivial solution in three distinct regimes. The zero solution is globally asymptotically stable in $H^2$ if $\mu > \mu_c$. If $\mu = \mu_c$, we prove an alternative theorem that completely describes the local dynamics near the trivial state. If $\mu < \mu_c$, the trivial solution is nonlinearly unstable in every $L^p (p \geq 1)$.Finally, we demonstrate that for $\mu < \mu_c$, the system undergoes a pitchfork bifurcation that generates an infinite family of non-trivial steady states. For generic choices of $(\alpha,b)$, this bifurcation is supercritical; a measurable subset of parameter space yields subcritical transitions. Notably, all bifurcating solutions share the same topological pattern-a single row of counter-rotating vortices-despite their mathematical non-uniqueness.

math.AP

Disentangling Uncertainties by Learning Compressed Data Representation

We study aleatoric and epistemic uncertainty estimation in a learned regressive system dynamics model. Disentangling aleatoric uncertainty (the inherent randomness of the system) from epistemic uncertainty (the lack of data) is crucial for downstream tasks such as risk-aware control and reinforcement learning, efficient exploration, and robust policy transfer. While existing approaches like Gaussian Processes, Bayesian networks, and model ensembles are widely adopted, they suffer from either high computational complexity or inaccurate uncertainty estimation. To address these limitations, we propose the Compressed Data Representation Model (CDRM), a framework that learns a neural network encoding of the data distribution and enables direct sampling from the output distribution. Our approach incorporates a novel inference procedure based on Langevin dynamics sampling, allowing CDRM to predict arbitrary output distributions rather than being constrained to a Gaussian prior. Theoretical analysis provides the conditions where CDRM achieves better memory and computational complexity compared to bin-based compression methods. Empirical evaluations show that CDRM demonstrates a superior capability to identify aleatoric and epistemic uncertainties separately, achieving AUROCs of 0.8876 and 0.9981 on a single test set containing a mixture of both uncertainties. Qualitative results further show that CDRM's capability extends to datasets with multimodal output distributions, a challenging scenario where existing methods consistently fail. Code and supplementary materials are available at https://github.com/ryeii/CDRM.

cs.LG

Optimal estimation of three parallel spins with genuine and restricted collective measurements

Collective measurements on identical and independent quantum systems can offer advantages in information extraction compared with individual measurements. However, little is known about the distinction between restricted collective measurements and genuine collective measurements in the multipartite setting. In this work we establish a rigorous performance gap based on a simple and old estimation problem, the estimation of a random spin state given three parallel spins. Notably, we derive an analytical formula for the maximum estimation fidelity of biseparable measurements and clarify its fidelity gap from genuine collective measurements. Moreover, we clarify the structure of optimal biseparable measurements. It turns out that the maximum estimation fidelity can be achieved by two- and one-copy measurements assisted by one-way communication in one direction, but not the other way. Our work reveals a rich landscape of multipartite nonclassicality in quantum measurements instead of quantum states and is expected to trigger further studies.

quant-ph

Universal device for two-qubit entangled measurements via photonic quantum walks

Sophisticated quantum measurements are fundamental to obtain a quantum advantage in many informational problems. Here, we consider the task of guessing a direction encoded in a two-qubit pure state. We experimentally demonstrate that abstention can be used to recover optimal direction guessing (measured in terms of the fidelity and maximum likelihood scores) even from non ideal states. Our protocol uses nine-step photonic quantum walks to implement the optimal five-output two-qubit collective measurements with fidelities above 0.9850. Thanks to abstention, we obtain more than a 10-fold improvement of the direction guessing scores (in terms of deviation to the optimal guessing scores). Our work demonstrates the versatility of photonic quantum walks for implementing many-qubit sophisticated measurements.

quant-ph

Experimental Realization of Genuine Three-copy Collective Measurements for Optimal Information Extraction

Nonclassical phenomena tied to entangled states are the focus of foundational studies and powerful resources in many applications. By contrast, the counterparts in quantum measurements are still poorly understood. Notably, genuine multipartite nonclassicality is barely discussed, let alone its experimental realization. Here we experimentally demonstrate the power of genuine tripartite nonclassicality in quantum measurements based on a simple estimation problem. To this end we realize an optimal genuine three-copy collective measurement via a nine-step two-dimensional photonic quantum walk with 30 elaborately designed coin operators. Then we realize an optimal estimation protocol and achieve an unprecedented high estimation fidelity, which can beat all strategies based on restricted collective measurements by more than 11 standard deviations. These results clearly demonstrate that genuine collective measurements can extract more information than local measurements and restricted collective measurements. Our work opens the door for exploring genuine multipartite nonclassical measurements and their power in quantum information processing.

quant-ph

Experimental Demonstration of Inequivalent Mutually Unbiased Bases

Quantum measurements based on mutually unbiased bases (MUB) play crucial roles in foundational studies and quantum information processing. It is known that there exist inequivalent MUB, but little is known about their operational distinctions, not to say experimental demonstration. In this work, by virtue of a simple estimation problem we experimentally demonstrate the operational distinctions between inequivalent triples of MUB in dimension 4 based on high-precision photonic systems. The experimental estimation fidelities coincide well with the theoretical predictions with only 0.16$\%$ average deviation, which is 25 times less than the difference (4.1$\%$) between the maximum estimation fidelity and the minimum estimation fidelity. Our experiments clearly demonstrate that inequivalent MUB have different information extraction capabilities and different merits for quantum information processing.

quant-ph

Minimum-consumption discrimination of quantum states via globally optimal adaptive measurements

Reducing the average resource consumption is the central quest in discriminating non-orthogonal quantum states for a fixed admissible error rate $\varepsilon$. The globally optimal fixed local projective measurement (GOFL) for this task is found to be different from that for previous minimum-error discrimination tasks [PRL 118, 030502 (2017)]. To achieve the ultimate minimum average consumption, here we develop a general globally optimal adaptive strategy (GOA) by subtly using the updated posterior probability, which works under any error rate requirement and any one-way measurement restrictions, and can be solved by a convergent iterative relation. First, under the local measurement restrictions, our GOA is solved to serve as the local bound, which saves 16.6 copies (24%) compared with the previously best GOFL. When the more powerful two-copy collective measurements are allowed, our GOA is experimentally demonstrated to beat the local bound by 3.9 copies (6.0%). By exploiting both adaptivity and collective measurements, our work marks an important step towards minimum-consumption quantum state discrimination.

quant-ph

Higher-dimensional symmetric informationally complete measurement via programmable photonic integrated optics

Symmetric informationally complete measurements are both important building blocks in many quantum information protocols and the seminal example of a generalised, non-orthogonal, quantum measurement. In higher-dimensional systems, these measurements become both increasingly interesting and increasingly complex to implement. Here, we demonstrate an integrated quantum photonic platform to realize such a measurement on three-level quantum systems. The device operates at the high fidelities necessary for verifying a genuine many-outcome quantum measurement, performing near-optimal quantum state discrimination, and beating the projective limit in quantum random number generation. Moreover, it is programmable and can readily implement other quantum measurements at similarly high quality. Our work paves the way for the implementation of sophisticated higher-dimensional quantum measurements that go beyond the traditional orthogonal projections.

quant-ph

Experimental study of quantum uncertainty from lack of information

Quantum uncertainty is a well-known property of quantum mechanics that states the impossibility of predicting measurement outcomes of multiple incompatible observables simultaneously. In contrast, the uncertainty in the classical domain comes from the lack of information about the exact state of the system. One may naturally ask, whether the quantum uncertainty is indeed a fully intrinsic property of the quantum theory, or whether similarly to the classical domain lack of knowledge about specific parts of the physical system might be the source of this uncertainty. This question has been addressed in the previous literature where the authors argue that in the entropic formulation of the uncertainty principle that can be illustrated using the, so-called, guessing games, indeed such lack of information has a significant contribution to the arising quantum uncertainty. Here we investigate this issue experimentally by implementing the corresponding two-dimensional and three-dimensional guessing games. Our results confirm that within the guessing-game framework, the quantum uncertainty to a large extent relies on the fact that quantum information determining the key properties of the game is stored in the degrees of freedom that remain inaccessible to the guessing party. Moreover, we offer an experimentally compact method to construct the high-dimensional Fourier gate which is a major building block for various tasks in quantum computation, quantum communication, and quantum metrology.

quant-ph

Experimental Masking of Real Quantum States

Masking of quantum information is a way of hiding information in correlations such that no information is accessible to any local observer. Although the set of all quantum states as a whole cannot be masked into bipartite correlations according to the no-masking theorem, the set of real states is maskable and is a maximal maskable set. In this work, we experimentally realize a masking protocol of the real ququart by virtue of a photonic quantum walk. Our experiment clearly demonstrates that quantum information of the real ququart can be completely hidden in bipartite correlations of two-qubit hybrid entangled states, which are encoded in two different degrees of freedom of a single photon. The hidden information is not accessible from each qubit alone, but can be faithfully retrieved with a fidelity of about 99% from correlation measurements. By contrast, any superset of the set of real density matrices cannot be masked.

quant-ph

Efficient Experimental Verification of Quantum Gates with Local Operations

Verifying the correct functioning of quantum gates is a crucial step towards reliable quantum information processing, but it becomes an overwhelming challenge as the system size grows due to the dimensionality curse. Recent theoretical breakthroughs show that it is possible to verify various important quantum gates with the optimal sample complexity of $O(1/ε)$ using local operations only, where $ε$ is the estimation precision. In this work, we propose a variant of quantum gate verification (QGV) which is robust to practical gate imperfections, and experimentally realize efficient QGV on a two-qubit controlled-not gate and a three-qubit Toffoli gate using only local state preparations and measurements. The experimental results show that, by using only 1600 and 2600 measurements on average, we can verify with 95% confidence level that the implemented controlled-not gate and Toffoli gate have fidelities at least 99% and 97%, respectively. Demonstrating the superior low sample complexity and experimental feasibility of QGV, our work promises a solution to the dimensionality curse in verifying large quantum devices in the quantum era.

quant-ph