arXiv subjects

Roger G. Melko

Publications and source records attributed to Roger G. Melko.

At least 55 records · Page 3Linked to original sources

arXiv2021

Miniaturizing neural networks for charge state autotuning in quantum dots

A key challenge in scaling quantum computers is the calibration and control of multiple qubits. In solid-state quantum dots, the gate voltages required to stabilize quantized charges are unique for each individual qubit, resulting in a high-dimensional control parameter space that must be tuned automatically. Machine learning techniques are capable of processing high-dimensional data - provided that an appropriate training set is available - and have been successfully used for autotuning in the past. In this paper, we develop extremely small feed-forward neural networks that can be used to detect charge-state transitions in quantum dot stability diagrams. We demonstrate that these neural networks can be trained on synthetic data produced by computer simulations, and robustly transferred to the task of tuning an experimental device into a desired charge state. The neural networks required for this task are sufficiently small as to enable an implementation in existing memristor crossbar arrays in the near future. This opens up the possibility of miniaturizing powerful control elements on low-power hardware, a significant step towards on-chip autotuning in future quantum dot computers.

cond-mat.mes-hall↗

arXiv2021

Pruning a restricted Boltzmann machine for quantum state reconstruction

Restricted Boltzmann machines (RBMs) have proven to be a powerful tool for learning quantum wavefunction representations from qubit projective measurement data. Since the number of classical parameters needed to encode a quantum wavefunction scales rapidly with the number of qubits, the ability to learn efficient representations is of critical importance. In this paper we study magnitude-based pruning as a way to compress the wavefunction representation in an RBM, focusing on RBMs trained on data from the transverse-field Ising model in one dimension. We find that pruning can reduce the total number of RBM weights, but the threshold at which the reconstruction accuracy starts to degrade varies significantly depending on the phase of the model. In a gapped region of the phase diagram, the RBM admits pruning over half of the weights while still accurately reproducing relevant physical observables. At the quantum critical point however, even a small amount of pruning can lead to significant loss of accuracy in the physical properties of the reconstructed quantum state. Our results highlight the importance of tracking all relevant observables as their sensitivity varies strongly with pruning. Finally, we find that sparse RBMs are trainable and discuss how a successful sparsity pattern can be created without pruning.

quant-ph↗

arXiv2021

Twin Neural Network Regression is a Semi-Supervised Regression Algorithm

Twin neural network regression (TNNR) is a semi-supervised regression algorithm, it can be trained on unlabelled data points as long as other, labelled anchor data points, are present. TNNR is trained to predict differences between the target values of two different data points rather than the targets themselves. By ensembling predicted differences between the targets of an unseen data point and all training data points, it is possible to obtain a very accurate prediction for the original regression problem. Since any loop of predicted differences should sum to zero, loops can be supplied to the training data, even if the data points themselves within loops are unlabelled. Semi-supervised training improves TNNR performance, which is already state of the art, significantly.

cs.LG↗

arXiv2021

Variational Neural Annealing

Many important challenges in science and technology can be cast as optimization problems. When viewed in a statistical physics framework, these can be tackled by simulated annealing, where a gradual cooling procedure helps search for groundstate solutions of a target Hamiltonian. While powerful, simulated annealing is known to have prohibitively slow sampling dynamics when the optimization landscape is rough or glassy. Here we show that by generalizing the target distribution with a parameterized model, an analogous annealing framework based on the variational principle can be used to search for groundstate solutions. Modern autoregressive models such as recurrent neural networks provide ideal parameterizations since they can be exactly sampled without slow dynamics even when the model encodes a rough landscape. We implement this procedure in the classical and quantum settings on several prototypical spin glass Hamiltonians, and find that it significantly outperforms traditional simulated annealing in the asymptotic limit, illustrating the potential power of this yet unexplored route to optimization.

cond-mat.dis-nn↗

arXiv2020

Twin Neural Network Regression

We introduce twin neural network (TNN) regression. This method predicts differences between the target values of two different data points rather than the targets themselves. The solution of a traditional regression problem is then obtained by averaging over an ensemble of all predicted differences between the targets of an unseen data point and all training data points. Whereas ensembles are normally costly to produce, TNN regression intrinsically creates an ensemble of predictions of twice the size of the training set while only training a single neural network. Since ensembles have been shown to be more accurate than single models this property naturally transfers to TNN regression. We show that TNNs are able to compete or yield more accurate predictions for different data sets, compared to other state-of-the-art methods. Furthermore, TNN regression is constrained by self-consistency conditions. We find that the violation of these conditions provides an estimate for the prediction uncertainty.

cs.LG↗

arXiv2020

U(1) symmetric recurrent neural networks for quantum state reconstruction

Generative models are a promising technology for the enhancement of quantum simulators. These machine learning methods are capable of reconstructing a quantum state from experimental measurements, and can aid in the calculation of physical observables. In this paper, we employ a recurrent neural network (RNN) to reconstruct the ground state of the spin-1/2 XY model, a prototypical Hamiltonian explored in trapped ion simulators. We explore its performance after enforcing a U(1) symmetry, which was recently shown by Hibat-Allah et al. [Phys. Rev. Research 2, 023358 (2020)] to preserve the autoregressive nature of the RNN. By studying the reconstruction of the XY model ground state from projective measurement data, we show that imposing U(1) symmetry on the RNN significantly increases the efficiency of learning, particularly in the early epoch regime. We argue that this performance increase may result from the tendency of the enforced symmetry to alleviate vanishing and exploding gradients, which helps stabilize the training process. Thus, symmetry-enforced RNNs may be particularly useful for applications of quantum simulators where a rapid feedback between optimization and circuit preparation is necessary, such as in hybrid classical-quantum algorithms.

quant-ph↗

arXiv2020

Discovering Symmetry Invariants and Conserved Quantities by Interpreting Siamese Neural Networks

In this paper, we introduce interpretable Siamese Neural Networks (SNN) for similarity detection to the field of theoretical physics. More precisely, we apply SNNs to events in special relativity, the transformation of electromagnetic fields, and the motion of particles in a central potential. In these examples, the SNNs learn to identify datapoints belonging to the same events, field configurations, or trajectory of motion. It turns out that in the process of learning which datapoints belong to the same event or field configuration, these SNNs also learn the relevant symmetry invariants and conserved quantities. These SNNs are highly interpretable, which enables us to reveal the symmetry invariants and conserved quantities without prior knowledge.

physics.comp-ph↗

arXiv2020

Reconstructing quantum molecular rotor ground states

Nanomolecular assemblies of C$_{60}$ can be synthesized to enclose dipolar molecules. The low-temperature states of such endofullerenes are described by quantum mechanical rotors, which are candidates for quantum information devices with higher-dimensional local Hilbert spaces. The experimental exploration of endofullerene arrays comes at a time when machine learning techniques are rapidly being adopted to characterize, verify, and reconstruct quantum states from measurement data. In this paper, we develop a strategy for reconstructing the ground state of chains of dipolar rotors using restricted Boltzmann machines (RBMs) adapted to train on data from higher-dimensional Hilbert spaces. We demonstrate accurate generation of energy expectation values from an RBM trained on data in the free-rotor eigenstate basis, and explore the learning resources required for various chain lengths and dipolar interaction strengths. Finally, we show evidence for fundamental limitations in the accuracy achievable by RBMs due to the difficulty in imposing symmetries in the sampling procedure. We discuss possible avenues to overcome this limitation in the future, including the further development of autoregressive models such as recurrent neural networks for the purposes of quantum state reconstruction.

quant-ph↗

arXiv2020

Recurrent Neural Network Wave Functions

A core technology that has emerged from the artificial intelligence revolution is the recurrent neural network (RNN). Its unique sequence-based architecture provides a tractable likelihood estimate with stable training paradigms, a combination that has precipitated many spectacular advances in natural language processing and neural machine translation. This architecture also makes a good candidate for a variational wave function, where the RNN parameters are tuned to learn the approximate ground state of a quantum Hamiltonian. In this paper, we demonstrate the ability of RNNs to represent several many-body wave functions, optimizing the variational parameters using a stochastic approach. Among other attractive features of these variational wave functions, their autoregressive nature allows for the efficient calculation of physical estimators by providing independent samples. We demonstrate the effectiveness of RNN wave functions by calculating ground state energies, correlation functions, and entanglement entropies for several quantum spin models of interest to condensed matter physicists in one and two spatial dimensions.

cond-mat.dis-nn↗

arXiv2020

Wavefunction positivization via automatic differentiation

We introduce a procedure to systematically search for a local unitary transformation that maps a wavefunction with a non-trivial sign structure into a positive-real form. The transformation is parametrized as a quantum circuit compiled into a set of one and two qubit gates. We design a cost function that maximizes the average sign of the output state and removes its complex phases. The optimization of the gates is performed through automatic differentiation algorithms, widely used in the machine learning community. We provide numerical evidence for significant improvements in the average sign for a two-leg triangular Heisenberg ladder with next-to-nearest neighbour and ring-exchange interactions. This model exhibits phases where the sign structure can be removed by simple local one-qubit unitaries, but also an exotic Bose-metal phase whose sign structure induces "Bose surfaces" with a fermionic character and a higher entanglement that requires deeper circuits.

quant-ph↗

arXiv2019

Machine learning design of a trapped-ion quantum spin simulator

Trapped ions have emerged as one of the highest quality platforms for the quantum simulation of interacting spin models of interest to various fields of physics. In such simulators, two effective spins can be made to interact with arbitrary strengths by coupling to the collective vibrational or phonon states of ions, controlled by precisely tuned laser beams. However, the task of determining laser control parameters required for a given spin-spin interaction graph is a type of inverse problem, which can be highly mathematically complex. In this paper, we adapt a modern machine learning technique developed for similar inverse problems to the task of finding the laser control parameters for a number of interaction graphs. We demonstrate that typical graphs, forming regular lattices of interest to physicists, can easily be produced for up to 50 ions using a single GPU workstation. The scaling of the machine learning method suggests that this can be expanded to hundreds of ions with moderate additional computational effort.

quant-ph↗

arXiv2019

Integrating Neural Networks with a Quantum Simulator for State Reconstruction

We demonstrate quantum many-body state reconstruction from experimental data generated by a programmable quantum simulator, by means of a neural network model incorporating known experimental errors. Specifically, we extract restricted Boltzmann machine (RBM) wavefunctions from data produced by a Rydberg quantum simulator with eight and nine atoms in a single measurement basis, and apply a novel regularization technique to mitigate the effects of measurement errors in the training data. Reconstructions of modest complexity are able to capture one- and two-body observables not accessible to experimentalists, as well as more sophisticated observables such as the Rényi mutual information. Our results open the door to integration of machine learning architectures with intermediate-scale quantum hardware.

quant-ph↗

arXiv2019

The learnability scaling of quantum states: restricted Boltzmann machines

Generative modeling with machine learning has provided a new perspective on the data-driven task of reconstructing quantum states from a set of qubit measurements. As increasingly large experimental quantum devices are built in laboratories, the question of how these machine learning techniques scale with the number of qubits is becoming crucial. We empirically study the scaling of restricted Boltzmann machines (RBMs) applied to reconstruct ground-state wavefunctions of the one-dimensional transverse-field Ising model from projective measurement data. We define a learning criterion via a threshold on the relative error in the energy estimator of the machine. With this criterion, we observe that the number of RBM weight parameters required for accurate representation of the ground state in the worst case - near criticality - scales quadratically with the number of qubits. By pruning small parameters of the trained model, we find that the number of weights can be significantly reduced while still retaining an accurate reconstruction. This provides evidence that over-parametrization of the RBM is required to facilitate the learning process.

quant-ph↗

arXiv2019

Making Trotters Sprint: A Variational Imaginary Time Ansatz for Quantum Many-body Systems

We introduce a variational wavefunction for many-body ground states that involves imaginary time evolution with two different Hamiltonians in an alternating fashion with variable time intervals. We successfully apply the ansatz on the one- and two-dimensional transverse-field Ising model and systematically study its scaling for the one-dimensional model at criticality. We find the total imaginary time required scales logarithmically with system size, in contrast to the linear scaling in conventional Quantum Monte Carlo. We suggest this is due to unique dynamics permitted by alternating imaginary time evolution, including the exponential growth of bipartite entanglement. For generic models, the superior scaling of our ansatz potentially mitigates the negative sign problem at the expense of having to optimize variational parameters.

cond-mat.str-el↗

arXiv2019

Reconstructing quantum states with generative models

A major bottleneck in the quest for scalable many-body quantum technologies is the difficulty in benchmarking their preparations, which suffer from an exponential `curse of dimensionality' inherent to their quantum states. We present an experimentally friendly method for density matrix reconstruction based on deep neural-network generative models. The learning procedure comes with a built-in approximate certificate of the reconstruction and makes no assumptions on the state under scrutiny, making it both reliable and unconditional. It can efficiently handle a broad class of complex systems including prototypical states in quantum information, as well as ground states of local spin models common to condensed matter physics. The key insight is to reduce the state tomography task to an unsupervised learning problem of the statistics of an informationally complete set of quantum measurements. This constitutes a modern machine learning approach to the validation of large quantum devices, which may prove relevant as a neural-network ansatz over mixed states suitable for variational optimization.

quant-ph↗

arXiv2019

QuCumber: wavefunction reconstruction with neural networks

As we enter a new era of quantum technology, it is increasingly important to develop methods to aid in the accurate preparation of quantum states for a variety of materials, matter, and devices. Computational techniques can be used to reconstruct a state from data, however the growing number of qubits demands ongoing algorithmic advances in order to keep pace with experiments. In this paper, we present an open-source software package called QuCumber that uses machine learning to reconstruct a quantum state consistent with a set of projective measurements. QuCumber uses a restricted Boltzmann machine to efficiently represent the quantum wavefunction for a large number of qubits. New measurements can be generated from the machine to obtain physical observables not easily accessible from the original data.

quant-ph↗

arXiv2019

Machine learning quantum states in the NISQ era

We review the development of generative modeling techniques in machine learning for the purpose of reconstructing real, noisy, many-qubit quantum states. Motivated by its interpretability and utility, we discuss in detail the theory of the restricted Boltzmann machine. We demonstrate its practical use for state reconstruction, starting from a classical thermal distribution of Ising spins, then moving systematically through increasingly complex pure and mixed quantum states. Intended for use on experimental noisy intermediate-scale quantum (NISQ) devices, we review recent efforts in reconstruction of a cold atom wavefunction. Finally, we discuss the outlook for future experimental state reconstruction using machine learning, in the NISQ era and beyond.

quant-ph↗

arXiv2019

Universal divergence of the Renyi entropy of a thinly sliced torus at the Ising fixed point

The entanglement entropy of a quantum critical system can provide new universal numbers that depend on the geometry of the entangling bipartition. We calculate a universal number called $κ$, which arises when a quantum critical system is embedded on a two-dimensional torus and bipartitioned into two cylinders. In the limit when one of the cylinders is a thin slice through the torus, $κ$ parameterizes a divergence that occurs in the entanglement entropy sub-leading to the area law. Using large-scale Monte Carlo simulations of an Ising model in 2+1 dimensions, we access the second Renyi entropy, and determine that, at the Wilson-Fisher (WF) fixed point, $κ_{2,\text{WF}} = 0.0174(5)$. This result is significantly different from its value for the Gaussian fixed point, known to be $κ_{2,\text{Gaussian}} \approx 0.0227998$.

cond-mat.str-el↗