arXiv subjects

Lorenzo Buffoni

Publications and source records attributed to Lorenzo Buffoni.

49 records · Page 3Linked to original sources

arXiv2021

Quantum Reinforcement Learning: the Maze problem

Quantum Machine Learning (QML) is a young but rapidly growing field where quantum information meets machine learning. Here, we will introduce a new QML model generalizing the classical concept of Reinforcement Learning to the quantum domain, i.e. Quantum Reinforcement Learning (QRL). In particular we apply this idea to the maze problem, where an agent has to learn the optimal set of actions in order to escape from a maze with the highest success probability. To perform the strategy optimization, we consider an hybrid protocol where QRL is combined with classical deep neural networks. In particular, we find that the agent learns the optimal strategy in both the classical and quantum regimes, and we also investigate its behaviour in a noisy environment. It turns out that the quantum speedup does robustly allow the agent to exploit useful actions also at very short time scales, with key roles played by the quantum coherence and the external noise. This new framework has the high potential to be applied to perform different tasks (e.g. high transmission/processing rates and quantum error correction) in the new-generation Noisy Intermediate-Scale Quantum (NISQ) devices whose topology engineering is starting to become a new and crucial control knob for practical applications in real-world problems. This work is dedicated to the memory of Peter Wittek.

quant-ph↗

arXiv2021

Improved bound on entropy production in a quantum annealer

For a system described by a multivariate probability density function obeying the fluctuation theorem, the average dissipation is lower-bounded by the degree of asymmetry of the marginal distributions (namely the relative entropy between the marginal and its mirror image). We formally prove that such lower bound is tighter than the recently reported bound expressed in terms of the precision of the marginal (i.e., the thermodynamic uncertainty relation) and is saturable. We illustrate the result with examples and we apply it to achieve the most accurate experimental estimation of dissipation associated to quantum annealing to date.

cond-mat.stat-mech↗

arXiv2021

Experimental Quantum Embedding for Machine Learning

The classification of big data usually requires a mapping onto new data clusters which can then be processed by machine learning algorithms by means of more efficient and feasible linear separators. Recently, Lloyd et al. have advanced the proposal to embed classical data into quantum ones: these live in the more complex Hilbert space where they can get split into linearly separable clusters. Here, we implement these ideas by engineering two different experimental platforms, based on quantum optics and ultra-cold atoms respectively, where we adapt and numerically optimize the quantum embedding protocol by deep learning methods, and test it for some trial classical data. We perform also a similar analysis on the Rigetti superconducting quantum computer. Therefore, we find that the quantum embedding approach successfully works also at the experimental level and, in particular, we show how different platforms could work in a complementary fashion to achieve this task. These studies might pave the way for future investigations on quantum machine learning techniques especially based on hybrid quantum technologies.

quant-ph↗

arXiv2021

On the training of sparse and dense deep neural networks: less parameters, same performance

Deep neural networks can be trained in reciprocal space, by acting on the eigenvalues and eigenvectors of suitable transfer operators in direct space. Adjusting the eigenvalues, while freezing the eigenvectors, yields a substantial compression of the parameter space. This latter scales by definition with the number of computing neurons. The classification scores, as measured by the displayed accuracy, are however inferior to those attained when the learning is carried in direct space, for an identical architecture and by employing the full set of trainable parameters (with a quadratic dependence on the size of neighbor layers). In this Letter, we propose a variant of the spectral learning method as appeared in Giambagli et al {Nat. Comm.} 2021, which leverages on two sets of eigenvalues, for each mapping between adjacent layers. The eigenvalues act as veritable knobs which can be freely tuned so as to (i) enhance, or alternatively silence, the contribution of the input nodes, (ii) modulate the excitability of the receiving nodes with a mechanism which we interpret as the artificial analogue of the homeostatic plasticity. The number of trainable parameters is still a linear function of the network size, but the performances of the trained device gets much closer to those obtained via conventional algorithms, these latter requiring however a considerably heavier computational cost. The residual gap between conventional and spectral trainings can be eventually filled by employing a suitable decomposition for the non trivial block of the eigenvectors matrix. Each spectral parameter reflects back on the whole set of inter-nodes weights, an attribute which we shall effectively exploit to yield sparse networks with stunning classification abilities, as compared to their homologues trained with conventional means.

cs.LG↗

arXiv2021

Experimental characterization of the energetics of quantum logic gates

We characterize the energetic footprint of a two-qubit quantum gate from the perspective of non-equilibrium quantum thermodynamics. We experimentally reconstruct the statistics of energy and entropy fluctuations following the implementation of a controlled-unitary gate, linking them to the performance of the gate itself and the phenomenology of Landauer principle at the single-quantum level. Our work thus addresses the energetic cost of operating quantum circuits, a problem that is crucial for the grounding of the upcoming quantum technologies.

quant-ph↗

arXiv2021

Mobility-based prediction of SARS-CoV-2 spreading

The rapid spreading of SARS-CoV-2 and its dramatic consequences, are forcing policymakers to take strict measures in order to keep the population safe. At the same time, societal and economical interactions are to be safeguarded. A wide spectrum of containment measures have been hence devised and implemented, in different countries and at different stages of the pandemic evolution. Mobility towards workplace or retails, public transit usage and permanence in residential areas constitute reliable tools to indirectly photograph the actual grade of the imposed containment protocols. In this paper, taking Italy as an example, we will develop and test a deep learning model which can forecast various spreading scenarios based on different mobility indices, at a regional level. We will show that containment measures contribute to "flatten the curve" and quantify the minimum time frame necessary for the imposed restrictions to result in a perceptible impact, depending on their associated grade.

cond-mat.dis-nn↗

arXiv2020

Machine learning in spectral domain

Deep neural networks are usually trained in the space of the nodes, by adjusting the weights of existing links via suitable optimization protocols. We here propose a radically new approach which anchors the learning process to reciprocal space. Specifically, the training acts on the spectral domain and seeks to modify the eigenvalues and eigenvectors of transfer operators in direct space. The proposed method is ductile and can be tailored to return either linear or non-linear classifiers. Adjusting the eigenvalues, when freezing the eigenvectors entries, yields performances which are superior to those attained with standard methods {\it restricted} to a operate with an identical number of free parameters. Tuning the eigenvalues correspond in fact to performing a global training of the neural network, a procedure which promotes (resp. inhibits) collective modes on which an effective information processing relies. This is at variance with the usual approach to learning which implements instead a local modulation of the weights associated to pairwise links. Interestingly, spectral learning limited to the eigenvalues returns a distribution of the predicted weights which is close to that obtained when training the neural network in direct space, with no restrictions on the parameters to be tuned. Based on the above, it is surmised that spectral learning bound to the eigenvalues could be also employed for pre-training of deep neural networks, in conjunction with conventional machine-learning schemes. Changing the eigenvectors to a different non-orthogonal basis alters the topology of the network in direct space and thus allows to export the spectral learning strategy to other frameworks, as e.g. reservoir computing.

cs.LG↗

arXiv2020

Thermodynamics of a Quantum Annealer

The D-wave processor is a partially controllable open quantum system which exchanges energy with its surrounding environment (in the form of heat) and with the external time dependent control fields (in the form of work). Despite being rarely thought as such, it is a thermodynamic machine. Here we investigate the properties of the D-Wave quantum annealers from a thermodynamical perspective. We performed a number of reverse-annealing experiments on the D-Wave 2000Q via the open access cloud server Leap, with the aim of understanding what type of thermal operation the machine performs, and quantifying the degree of dissipation that accompanies it, as well as the amount of heat and work that it exchanges. The latter is a challenging task in view of the fact that one can experimentally access only the overall energy change occurring in the processor, (which is the sum of heat and work it receives). However, recent results of non-equilibrium thermodynamics(namely, the fluctuation theorem and the thermodynamic uncertainty relations), allow to calculate lower bounds on the average entropy production (which quantifies the degree of dissipation) as well as the average heat and work exchanges. The analysis of the collected experimental data shows that 1) in a reverse annealing process the D-Wave processor works as a thermal accelerator and 2) its evolution involves an increasing amount of dissipation with increasing transverse field.

quant-ph↗

arXiv2019

A Path Towards Quantum Advantage in Training Deep Generative Models with Quantum Annealers

The development of quantum-classical hybrid (QCH) algorithms is critical to achieve state-of-the-art computational models. A QCH variational autoencoder (QVAE) was introduced in Ref. [1] by some of the authors of this paper. QVAE consists of a classical auto-encoding structure realized by traditional deep neural networks to perform inference to, and generation from, a discrete latent space. The latent generative process is formalized as thermal sampling from either a quantum or classical Boltzmann machine (QBM or BM). This setup allows quantum-assisted training of deep generative models by physically simulating the generative process with quantum annealers. In this paper, we have successfully employed D-Wave quantum annealers as Boltzmann samplers to perform quantum-assisted, end-to-end training of QVAE. The hybrid structure of QVAE allows us to deploy current-generation quantum annealers in QCH generative models to achieve competitive performance on datasets such as MNIST. The results presented in this paper suggest that commercially available quantum annealers can be deployed, in conjunction with well-crafted classical deep neutral networks, to achieve competitive results in unsupervised and semisupervised tasks on large-scale datasets. We also provide evidence that our setup is able to exploit large latent-space (Q)BMs, which develop slowly mixing modes. This expressive latent space results in slow and inefficient classical sampling, and paves the way to achieve quantum advantage with quantum annealing in realistic sampling applications.

quant-ph↗

arXiv2019

Maximal energy extraction via quantum measurement

We study the maximal amount of energy that can be extracted from a finite quantum system by means of projective measurements. For this quantity we coin the expression "metrotropy" $\mathcal{M}$, in analogy with "ergotropy" $\mathcal{W}$, which is the maximal amount of energy that can be extracted by means of unitary operations. The study is restricted to the case when the system is initially in a stationary state, and therefore the ergotropy is achieved by means of a permutation of the energy eigenstates. We show that i) the metrotropy is achieved by means of an even combination of the identity and an involution permutation; ii) it is $\mathcal{M}\leq\mathcal{W}/2$, with the bound being saturated when the permutation that achieves the ergotropy is an involution.

quant-ph↗

arXiv2019

PixelVAE++: Improved PixelVAE with Discrete Prior

Constructing powerful generative models for natural images is a challenging task. PixelCNN models capture details and local information in images very well but have limited receptive field. Variational autoencoders with a factorial decoder can capture global information easily, but they often fail to reconstruct details faithfully. PixelVAE combines the best features of the two models and constructs a generative model that is able to learn local and global structures. Here we introduce PixelVAE++, a VAE with three types of latent variables and a PixelCNN++ for the decoder. We introduce a novel architecture that reuses a part of the decoder as an encoder. We achieve the state of the art performance on binary data sets such as MNIST and Omniglot and achieve the state of the art performance on CIFAR-10 among latent variable models while keeping the latent variables informative.

cs.CV↗

arXiv2019

Quantum Measurement Cooling

Invasiveness of quantum measurements is a genuinely quantum mechanical feature that is not necessarily detrimental: Here we show how quantum measurements can be used to fuel a cooling engine. We illustrate quantum measurement cooling (QMC) by means of a prototypical two-stroke two-qubit engine which interacts with a measurement apparatus and two heat reservoirs at different temperatures. We show that feedback control is not necessary for operation while entanglement must be present in the measurement projectors. We quantify the probability that QMC occurs when the measurement basis is chosen randomly, and find that it can be very large as compared to the probability of extracting energy (heat engine operation), while remaining always smaller than the most useless operation, namely dumping heat in both baths. These results show that QMC can be very robust to experimental noise. A possible low-temperature solid-state implementation that integrates circuit QED technology with circuit quantum thermodynamics technology is presented.

cond-mat.stat-mech↗

arXiv2018

Non-equilibrium quantum-heat statistics under stochastic projective measurements

In this paper we aim at characterizing the effect of stochastic fluctuations on the distribution of the energy exchanged by a quantum system with an external environment under sequences of quantum measurements performed at random times. Both quenched and annealed averages are considered. The information about fluctuations is encoded in the quantum-heat probability density function, or equivalently in its characteristic function, whose general expression for a quantum system with arbitrary Hamiltonian is derived. We prove that, when a stochastic protocol of measurements is applied, the quantum Jarzynski equality is obeyed. Therefore, the fluctuation relation is robust against the presence of randomness in the times intervals between measurements. Then, for the paradigmatic case of a two-level system, we analytically characterize the quantum-heat transfer. Particular attention is devoted to the limit of large number of measurements and to the effects caused by the stochastic fluctuations. The relation with the stochastic Zeno regime is also discussed.

quant-ph↗