Searcharxiv⌕ Search

arXiv · 2611.19182

Advancing Quantum Reinforcement Learning with Differentiable Quantum Architecture Search and Adaptive Non-local Observables

Abstract

Quantum Reinforcement Learning (QRL) using variational quantum circuits (VQCs) is constrained by fixed measurement protocols and hand-designed circuit ansätze. Adaptive Non-local Observables (ANO) and Differentiable Quantum Architecture Search (DiffQAS) address these issues independently, but to our knowledge have not been combined or compared in a single QRL framework. We present an ablation of ANO and DiffQAS within the Quantum Time-series Transformer (QTSTransformer), evaluated on a 2 x 2 factorial design across six environments--two classic-control tasks and four Atari 2600 games. Three findings emerge. First, the quantum agent outperforms a matched classical transformer baseline on five of six environments, with absolute scores ranging from 360.0 vs 304.0 (MarioBros) to 17.2 vs 2.5 (Breakout), while using approximately 12.5x fewer transformer parameters on the four Atari environments (more modestly so on the two classic-control tasks). Second, ANO and DiffQAS provide complementary benefits: ANO yields the largest gain on continuous-state CartPole (347.7 vs 223.2), while DiffQAS yields the largest absolute Atari gains (Breakout 17.2 vs 3.0; DonkeyKong 70.0 vs 37.0). Third, combining both innovations exhibits an asymmetric interaction: ANO-dominant tasks tolerate DiffQAS, whereas DiffQAS-dominant tasks degrade when ANO is added. These results provide design guidance for QRL agents: select between ANO and DiffQAS according to whether the bottleneck is the measurement basis or the gate topology, rather than applying both indiscriminately.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Junghoon Justin Park, Kyumin Lee, Anna Jung, Samuel Yen-Chi Chen, Huan-Hsin Tseng, Shinjae Yoo, Jiook Cha. 2026-11-14. Advancing Quantum Reinforcement Learning with Differentiable Quantum Architecture Search and Adaptive Non-local Observables. https://searcharxiv.com/abs/2611.19182

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related papers

A Diamond Quantum Oscilloscope

Quantum-enhanced metrology has achieved remarkable precision in parameter estimation, but extending these advantages to continuous time-dependent fields (waveform sensing) remains a formidable challenge due to the infinite-dimensional nature of the signal. Here, we report the first experimental realization of a room-temperature solid-state quantum oscilloscope based on a sequential quantum difference amplification strategy. Within a zero-order-hold reconstruction framework, our method completely bypasses the need for massive entanglement. Crucially, we demonstrate that the overall waveform reconstruction error unequivocally follows the theoretically predicted Heisenberg scaling of \(O(N^{-1/2})\), decisively surpassing the classical \(O(N^{-1/3})\) limit. This transformative precision requires approximately 30-fold fewer quantum resources than conventional methods to achieve the same waveform error. Furthermore, we demonstrate the reconstruction of a multicomponent waveform and distinctly resolve weak high-frequency components that are entirely drowned in the shot noise of classical sampling. These results transition quantum metrology from parameter estimation into a practical instrument, establishing a genuine quantum advantage in continuous waveform reconstruction and paving the way for critical applications such as nanoscale nuclear magnetic resonance imaging, where detecting extremely weak signals is crucial for resolving molecular structures.

quant-ph↗

Entanglement preservation and Clauser-Horne nonlocality in electromagnetically induced transparency quantum memories

Understanding how decoherence-induced loss affects entanglement and nonlocal correlations in quantum memories is important for quantum information science. Here we develop a quantitative description of photonic quantum states retrieved from electromagnetically induced transparency (EIT) memories in a ground-state-decoherence-limited regime. Using the dark-state-polariton formalism, we derive the attenuation factor of the retrieved probe mode from the EIT dynamics. This attenuation depends on the coupling field and ground-state coherence decay and is not introduced as an independent phenomenological loss parameter. Within a specified quantum-limited pure-loss model, we use this attenuation to obtain the reduced photonic density operator. We show that, in the symmetric case, the complete retrieved state of an initially path-entangled single photon remains entangled for any nonzero storage efficiency, despite acquiring a vacuum component. In contrast, violation of the unconditional Clauser-Horne inequality under displaced on/off detection without post-selection requires an intrinsic efficiency above 89.7%. We further derive the retrieved N-qubit photonic density operator for multiple independently operating EIT memories. These results establish a quantitative connection between EIT memory dynamics, retrieved quantum states, and operational nonlocality benchmarks under explicit channel assumptions.

quant-ph↗

Geometric encoding of turbulence for end-to-end quantum simulation

Simulating multiscale turbulence in engineering remains challenging. Any quantum advantage for such simulations requires efficient initial-state preparation. Yet exact loading of an arbitrary classical snapshot requires exponential quantum resources. We introduce "turbuloscope", a physics-informed geometric method that generates statistically representative turbulent initial states in a gate-based register from a parameterized Pauli-spinor multiscale distribution. Scale invariance renders conditional rotations approximately affine in Gray-code space, enabling linear-depth, ancilla-free preparation. The generalized Madelung transform and Hopf fibration map the encoded Pauli spinor to fluid observables and vortex tubes. The qubit count scales logarithmically with the Reynolds number, yielding an exponential reduction in preparation overhead relative to full-grid classical spectral synthesis. We classically emulate a 30-qubit preparation circuit and generate a turbulent field over one billion grid points at a scale-inferred Reynolds number of 35,000, exhibiting Kolmogorov's five-thirds energy spectrum, tangled vortex tubes, and intermittency. This method provides scalable initial states for quantum simulation of turbulence and multiscale systems.

quant-ph↗