Searcharxiv⌕ Search

arXiv subjects

Florian Marquardt

Publications and source records attributed to Florian Marquardt.

At least 19 recordsLinked to original sources

feedback-grape: A JAX-based Python Package for GPU-Accelerated GRAPE with Feedback

Modern quantum technology applications require accurate control of quantum systems, including a feedback loop in the control process. While open-loop control can be performed using well established gradient methods like GRadient Ascent Pulse Engineering (GRAPE), it was until recently unclear how to combine these with feedback from measurements, which are inherently non-differentiable. Recent work has successfully demonstrated how feedback can be incorporated into GRAPE using machine learning, resolving this issue. Following this progress, we have developed an efficient Python package implementing the method of ``feedback GRAPE''. In this hands-on tutorial, we discuss the package in detail based on concrete examples. Built on the GPU-accelerated JAX platform, our package offers a user-friendly interface inspired by the widely-used QuTiP library, including simplified treatment of multi-component systems.

quant-ph↗

On the Dynamics of Local Hidden-Variable Models

Bell nonlocality is an intriguing property of quantum mechanics with far-reaching consequences for information processing, philosophy, and our fundamental understanding of nature. However, standard Bell nonlocality is a statement about correlations at a fixed point in time only. It does not take into account dynamics, i.e., time evolution of those correlations. Consider a dynamic situation where the correlations remain local for all times. Then, at each moment in time, there exists a local hidden-variable (LHV) model reproducing the momentary correlations. Can the time evolution of the correlations then be captured by evolving the hidden variables? We make this question precise by defining dynamical LHV models and motivating additional physical attributes such as locality and continuity of the dynamics. We then establish a series of complementary go and no-go theorems that together map out which combinations of these properties LHV dynamics can and cannot have. In particular, noninteracting quantum dynamics can be represented on the hidden-variable level in a local way, but LHV dynamics can fail to exist for interacting systems: Even though the observed correlations are local at all times, their time evolution may nevertheless be incompatible with local hidden-variable dynamics.

quant-ph↗

Agentic AI for Discovering Fault-Tolerant Quantum Circuits

Scaling quantum computing toward practical quantum advantage is currently limited by the efficiency of circuits that operate on information encoded by quantum error-correcting codes. The full stack of quantum computing encompasses several tasks: preparation of logical code states, implementation of logical gates, logical routines on encoded qubits, etc. Yet, these circuits are largely designed by hand for individual cases, with some recent works incorporating machine learning for certain aspects. We formulate this problem as agentic evolutionary program synthesis, wherein a large language model, leveraging its pretraining knowledge and tool-use proficiency, and guided by a circuit verifier, evolves a program that defines a Clifford circuit for a wide range of curated tasks such as logical state preparation, logical gate design, and logical routines such as code-switching, code growth, etc. Our approach consistently finds fault-tolerant circuits for all of these tasks, each verified by an exhaustive check over faults.

quant-ph↗

Large-Language-Model Discovery of Quantum LDPC Codes through Structured Concept Evolution

Quantum low-density parity-check codes promise low-overhead error correction, but high-performing constructions remain hard to find. Here we introduce structured concept evolution, in which a large language model (LLM) evolves construction programs and their internal search strategies by modifying the finite group, protograph shapes or entry-assignment rule. We search for codes with fewer than $600$ data qubits and check weight at most $12$, optimizing $kd^2/n$ or the circuit-level logical error rate. Our method improves on published lifted-product benchmarks in selected parameter regimes, with exactly certified distances for the leading results. Circuit-level optimization typically yields lower logical error rates than $kd^2/n$ optimization, often despite smaller code distances. With the same evolution framework and step budget, the best LLM outperforms all random-mutation and hill-climbing runs on both objectives. Our results point to LLM-driven program search as an approach to designing general quantum LDPC codes.

quant-ph↗

Agentic Exploration of Physics Models

The process of scientific discovery relies on an interplay of observations, analysis, and hypothesis generation. Machine learning is increasingly being adopted to address individual aspects of this process. However, it remains an open challenge to fully automate the heuristic, iterative loop required to discover the laws of an unknown system by exploring it through experiments and analysis, without tailoring the approach to the specifics of a given task. Here, we introduce SciExplorer, an agent that leverages large language model tool-use capabilities to enable exploration of systems without any domain-specific blueprints, and apply it to physical systems that are initially unknown to the agent. We test SciExplorer on a broad set of models spanning mechanical dynamical systems, wave evolution, and quantum many-body physics. Despite using a minimal set of tools, primarily based on code execution, we observe impressive performance on tasks such as recovering equations of motion from observed dynamics and inferring Hamiltonians from expectation values. The demonstrated effectiveness of this setup opens the door toward similar scientific exploration in other domains, without the need for fine-tuning or task-specific instructions.

cs.AI↗

Uncovering Latent Structures in Robust Pulse Sequences: A Model-Based Reinforcement Learning Approach for Adaptable Quantum Control

Real-time adaptive control of quantum systems requires rapid generation of robust, high-fidelity pulses across a continuous range of operating conditions. Standard optimization algorithms such as gradient-ascent pulse engineering (GRAPE) solve each instance independently, discarding information between runs and requiring costly reinitialization when parameters change. We present an approach to robust optimal quantum control based on model-based reinforcement learning, in which a single neural network -- embedding the Hamiltonian directly into the training pipeline -- generates robust gates across an entire family of gate configurations, without pre-computed training data. Demonstrated on a single-spin (two-level) system, the trained networks produce pulses for arbitrary rotation angles over a range of pulse durations, detunings, and field inhomogeneities in milliseconds, at fidelities comparable to multi-seed GRAPE. The framework is inherently adaptable: any parameter entering the Hamiltonian can serve as a network input, extending the approach to different systems and control settings. Beyond speed, the network reveals structure in the control landscape: it discovers the same structured phase profiles that appear in GRAPE solutions -- made identifiable through fidelity-invariant symmetry transformations -- but more consistently than independent optimization. This consistency enables smooth interpolation across the entire trained parameter space.

quant-ph↗

Comment on "A General Framework for Constructing Local Hidden-state Models to Determine the Steerability"

We point out that the method presented in a recent arXiv article by Jia et al. (arXiv:2512.21848) for constructing local hidden-state models closely follows the framework we developed in N. von Selzam & F. Marquardt (PRX Quantum, 2025) for constructing local hidden-variable models. While Jia et al. cite our work, the extent of the methodological overlap and the degree of textual similarity are not adequately reflected by the attribution given. We document this overlap in detail.

quant-ph↗

Neuromorphic computing with optomechanical oscillators

The increasing resource demands of artificial neural networks have prompted the exploration of novel platforms better suited for machine learning. In this context, phase oscillators represent a promising candidate due to their intrinsic nonlinearity and their ability to exhibit collective synchronization when coupled together. In the present work, we investigate one such implementation: a network of optomechanical oscillators pumped in the blue-detuned regime to achieve self-sustained oscillations. We propose a theoretical framework to describe their dynamics and demonstrate how such systems can be employed for neuromorphic computing. We discuss how they can be trained and analyze a platform, based on drum resonators, that could enable their physical implementation. Ultimately, the theoretical results obtained from modelling an XOR gate using 5 nodes in an all-to-all configuration are discussed.

cond-mat.mes-hall↗

Quantum feedback control with a transformer neural network architecture

Attention-based neural networks such as transformers have revolutionized various fields such as natural language processing, genomics, and vision. Here, we demonstrate the use of transformers for quantum feedback control through both a supervised and reinforcement learning approach. In particular, due to the transformer's ability to capture long-range temporal correlations and training efficiency, we show that it can surpass some of the limitations of previous control approaches, e.g.~those based on recurrent neural networks trained using a similar approach or policy based reinforcement learning. We numerically show, for the example of state stabilization of a two-level system, that our bespoke transformer architecture can achieve near unit fidelity to a target state in a short time even in the presence of inefficient measurement and Hamiltonian perturbations that were not included in the training set as well as the control of non-Markovian systems. We also demonstrate that our transformer can perform energy minimization of non-integrable many-body quantum systems when trained for reinforcement learning tasks. Our approach can be used for quantum error correction, fast control of quantum states in the presence of colored noise, as well as real-time tuning, and characterization of quantum devices.

quant-ph↗

Deep learning of spatial densities in inhomogeneous correlated quantum systems

Machine learning has made important headway in helping to improve the treatment of quantum many-body systems. A domain of particular relevance are correlated inhomogeneous systems. What has been missing so far is a general, scalable deep-learning approach that would enable the rapid prediction of spatial densities for strongly correlated systems in arbitrary potentials. In this work, we present a straightforward scheme, where we learn to predict densities using convolutional neural networks trained on random potentials. While we demonstrate this approach in 1D and 2D lattice models using data from numerical techniques like Quantum Monte Carlo, it is directly applicable as well to training data obtained from experimental quantum simulators. We train networks that can predict the densities of multiple observables simultaneously and that can predict for a whole class of many-body lattice models, for arbitrary system sizes. We show that our approach can handle well the interplay of interference and interactions and the behaviour of models with phase transitions in inhomogeneous situations, and we also illustrate the ability to solve inverse problems, finding a potential for a desired density.

quant-ph↗

Dependence of Equilibrium Propagation Training Success on Network Architecture

The rapid rise of artificial intelligence has led to an unsustainable growth in energy consumption. This has motivated progress in neuromorphic computing and physics-based training of learning machines as alternatives to digital neural networks. Many theoretical studies focus on simple architectures like all-to-all or densely connected layered networks. However, these may be challenging to realize experimentally, e.g. due to connectivity constraints. In this work, we investigate the performance of the widespread physics-based training method of equilibrium propagation for more realistic architectural choices, specifically, locally connected lattices. We train an XY model and explore the influence of architecture on various benchmark tasks, tracking the evolution of spatially distributed responses and couplings during training. Our results show that sparse networks with only local connections can achieve performance comparable to dense networks. Our findings provide guidelines for further scaling up architectures based on equilibrium propagation in realistic settings.

cs.LG↗

Reinforcement Learning for Quantum Technology

Many challenges arising in Quantum Technology can be successfully addressed using a set of machine learning algorithms collectively known as reinforcement learning (RL), based on adaptive decision-making through interaction with the quantum device. After a concise and intuitive introduction to RL aimed at a broad physics readership, we discuss the key ideas and core concepts in reinforcement learning with a particular focus on quantum systems. We then survey recent progress in RL in all relevant areas. We discuss state preparation in few- and many-body quantum systems, the design and optimization of high-fidelity quantum gates, and the automated construction of quantum circuits, including applications to variational quantum eigensolvers and architecture search. We further highlight the interactive capabilities of RL agents, emphasizing recent progress in quantum feedback control and quantum error correction, and briefly discuss quantum reinforcement learning as well as applications to quantum metrology. The review concludes with a discussion of open challenges -- such as scalability, interpretability, and integration with experimental platforms -- and outlines promising directions for future research. Throughout, we highlight experimental implementations that exemplify the increasing role of reinforcement learning in shaping the development of quantum technologies.

quant-ph↗

Unitary fault-tolerant encoding of Pauli states in surface codes

In fault-tolerant quantum computation, the preparation of logical states is a ubiquitous subroutine, yet significant challenges persist even for the simplest states required. In the present work, we present a unitary, scalable, distance-preserving encoding scheme for preparing Pauli eigenstates in surface codes. Unlike previous unitary approaches whose fault-distance remains constant with increasing code distance, our scheme ensures that the protection offered by the code is preserved during state preparation. Building on strategies discovered by reinforcement learning for the surface-17 code, we generalize the construction to arbitrary code distances and both rotated and unrotated surface codes. The proposed encoding relies only on geometrically local gates, and is therefore fully compatible with planar 2D qubit connectivity, and it achieves circuit depth scaling as $\mathcal{O}(d)$, consistent with fundamental entanglement-generation bounds. We design explicit stabilizer-expanding circuits with and without ancilla-mediated connectivity and analyze their error-propagation behavior. Numerical simulations under depolarizing noise show that our unitary encoding without ancillas outperforms standard stabilizer-measurement-based schemes, reducing logical error rates by up to an order of magnitude. These results make the scheme particularly relevant for platforms such as trapped ions and neutral atoms, where measurements are costly relative to gates and idling noise is considerably weaker than gate noise. Our work bridges the gap between measurement-based and unitary encodings of surface-code states and opens new directions for distance-preserving state preparation in fault-tolerant quantum computation.

quant-ph↗

Reusability Report: Optimizing T-count in General Quantum Circuits with AlphaTensor-Quantum

Quantum computing has the potential to solve problems that are intractable for classical computers, with possible applications in areas such as drug discovery and high-energy physics. However, the practical implementation of quantum computation is hindered by the complexity of executing quantum circuits on hardware. In particular, minimizing the number of T-gates is crucial for implementing efficient quantum algorithms. AlphaTensor-Quantum is a reinforcement learning-based method designed to optimize the T-count of quantum circuits by formulating the problem as a tensor decomposition task. While it has demonstrated superior performance over existing methods on benchmark quantum arithmetic circuits, its applicability has so far been restricted to specific circuit families, requiring separate, time-intensive training for each new application. This report reproduces some of the key results of the original work and extends AlphaTensor-Quantum's capabilities to simplify random quantum circuits with varying qubit counts, eliminating the need for retraining on new circuits. Our experiments show that a general agent trained on 5- to 8-qubit circuits achieves greater T-count reduction than previous methods for a large fraction of quantum circuits. Furthermore, we demonstrate that a general agent trained on circuits with varying qubit numbers outperforms agents trained on fixed qubit numbers, highlighting the method's generalizability and its potential for broader quantum circuit optimization tasks.

quant-ph↗

Artificial discovery of lattice models for wave transport

Wave transport devices, such as amplifiers, frequency converters, and nonreciprocal devices, are essential for modern communication, signal processing, and sensing applications. Of particular interest are traveling wave setups, which offer excellent gain and bandwidth properties. So far, the conceptual design of those devices has relied on human ingenuity. This makes it difficult and time-consuming to explore the full design space under a variety of constraints and target functionalities. In our work, we present a method which automates this challenge. By optimizing the discrete and continuous parameters of periodic coupled-mode lattices, our approach identifies the simplest lattices that achieve the target transport functionality, and we apply it to discover new schemes for directional amplifiers, isolators, and frequency demultiplexers. Leveraging automated symbolic regression tools, we find closed analytical expressions that facilitate the discovery of generalizable construction rules. Moreover, we utilize important conceptual connections between the device transport properties and non-Hermitian topology. The resulting structures can be implemented on a variety of platforms, including microwave, optical, and optomechanical systems. Our approach opens the door to extensions like the artificial discovery of lattice models with desired properties in higher dimensions or with nonlinear interactions.

physics.optics↗

Automated Discovery of Gadgets in Quantum Circuits for Efficient Reinforcement Learning

Reinforcement learning (RL) has proven itself as a powerful tool for the discovery of quantum circuits and quantum protocols. We have recently shown that including composite quantum gates -- referred to as ``gadgets'' -- in the action space of RL agents substantially enhances the RL performance in the context of quantum error correction. However, up to now the gadgets themselves had to be constructed manually. In this paper, we suggest an algorithm for the automated discovery of new gadgets and families of related gadgets. The algorithm is based on the representation of quantum circuits as directed graphs and an automated search for repeated subgraphs. The latter are identified as gadgets. We demonstrate the efficiency of the algorithm, which allows us to find two new gadget families suitable for RL. We compare the performance of 4-qubit gadgets taken from a previously known and a newly discovered family and discuss their advantages and disadvantages.

quant-ph↗

Training nonlinear optical neural networks with Scattering Backpropagation

As deep learning applications continue to deploy increasingly large artificial neural networks, the associated high energy demands are creating a need for alternative neuromorphic approaches. Optics and photonics are particularly compelling platforms as they offer high speeds and energy efficiency. Neuromorphic systems based on nonlinear optics promise high expressivity with a minimal number of parameters. However, so far, there is no efficient and generic physics-based training method allowing us to extract gradients for the most general class of nonlinear optical systems. In this work, we present Scattering Backpropagation, an efficient method for experimentally measuring approximated gradients for nonlinear optical neural networks. Remarkably, our approach does not require a mathematical model of the physical nonlinearity, and only involves two scattering experiments to extract all gradient approximations. The estimation precision depends on the deviation from reciprocity. We successfully apply our method to well-known benchmarks such as XOR and MNIST. Scattering Backpropagation is widely applicable to existing state-of-the-art, scalable platforms, such as optics, microwave, and also extends to other physical platforms such as electrical circuits.

physics.optics↗

Quantum computing and artificial intelligence: status and perspectives

This white paper discusses and explores the various points of intersection between quantum computing and artificial intelligence (AI). It describes how quantum computing could support the development of innovative AI solutions. It also examines use cases of classical AI that can empower research and development in quantum technologies, with a focus on quantum computing and quantum sensing. The purpose of this white paper is to provide a long-term research agenda aimed at addressing foundational questions about how AI and quantum computing interact and benefit one another. It concludes with a set of recommendations and challenges, including how to orchestrate the proposed theoretical work, align quantum AI developments with quantum hardware roadmaps, estimate both classical and quantum resources - especially with the goal of mitigating and optimizing energy consumption - advance this emerging hybrid software engineering discipline, and enhance European industrial competitiveness while considering societal implications.

quant-ph↗