Searcharxiv⌕ Search

arXiv subjects

Danijela Marković

Publications and source records attributed to Danijela Marković.

17 recordsLinked to original sources

Training the parametric interactions in an analog bosonic quantum neural network with Fock basis measurement

Quantum neural networks promise to extend the power of machine learning into the quantum domain, with potential applications ranging from automatic recognition of quantum states to the control of quantum devices. However, their physical implementation and training remain challenging. In particular, the backpropagation algorithm that underpins the efficiency of classical neural networks cannot generally be applied to large quantum systems, as nonlinear quantum dynamics are not efficiently simulable. Instead, variational quantum circuits typically rely on parameter-shift rules or sampling-based gradient estimation. Here we propose a bosonic quantum neural network based on parametrically coupled Gaussian modes. Although the underlying quantum dynamics are linear, nonlinear output features are generated through Fock-basis measurements. Because Gaussian evolution can be efficiently simulated in the Heisenberg representation, the system admits gradient-based optimization by differentiating a classical model of the dynamics, while the forward evolution itself could be implemented on quantum hardware. This hybrid approach enables end-to-end training of physically meaningful parameters without requiring gradient extraction from the experimental device. Such architectures are naturally compatible with circuit quantum electrodynamics platforms featuring tunable parametric couplers, as well as integrated photonic systems with engineered $χ$(2) or $χ$(3) nonlinearities. Our results demonstrate that linear bosonic networks combined with nonlinear measurement provide a scalable and trainable route toward experimentally realizable quantum neural networks.

quant-ph↗

Experimental quantum reservoir computing with a circuit quantum electrodynamics system

Quantum reservoir computing is a machine learning framework that offers ease of training compared to other quantum neural networks, as it does not rely on gradient-based optimization. Learning is performed in a single step on the output features measured from the quantum system. Various implementations of quantum reservoir computing have been explored in simulations, with different measured features. Although simulations have shown that quantum reservoirs present advantages in performance compared to classical reservoirs, experimental implementations have remained scarce. This is due to the challenge of obtaining a large number of output features that are nonlinear transformations of the input data. In this work, we show that even with a circuit quantum electrodynamics system as simple as a single transmon coupled to a readout resonator, we can implement a proof-of-concept realization of quantum reservoir computing. We obtain a large number of nonlinear features from a single physical system by encoding the input data in the amplitude of a coherent drive and measuring the cavity state in the Fock basis. We demonstrate classification of two classical tasks with significantly smaller hardware resources and fewer measured features compared to classical neural networks. Our experimental results are supported by numerical simulations that show additional Kerr nonlinearity is beneficial to reservoir performance. Our work demonstrates a hardware-efficient quantum neural network implementation that can be further scaled up and generalized to other quantum machine learning models.

quant-ph↗

Training of Physical Neural Networks

Physical neural networks (PNNs) are a class of neural-like networks that leverage the properties of physical systems to perform computation. While PNNs are so far a niche research area with small-scale laboratory demonstrations, they are arguably one of the most underappreciated important opportunities in modern AI. Could we train AI models 1000x larger than current ones? Could we do this and also have them perform inference locally and privately on edge devices, such as smartphones or sensors? Research over the past few years has shown that the answer to all these questions is likely "yes, with enough research": PNNs could one day radically change what is possible and practical for AI systems. To do this will however require rethinking both how AI models work, and how they are trained - primarily by considering the problems through the constraints of the underlying hardware physics. To train PNNs at large scale, many methods including backpropagation-based and backpropagation-free approaches are now being explored. These methods have various trade-offs, and so far no method has been shown to scale to the same scale and performance as the backpropagation algorithm widely used in deep learning today. However, this is rapidly changing, and a diverse ecosystem of training techniques provides clues for how PNNs may one day be utilized to create both more efficient realizations of current-scale AI models, and to enable unprecedented-scale models.

physics.app-ph↗

Quantum reservoir neural network implementation on coherently coupled quantum oscillators

Quantum reservoir computing is a promising approach for quantum neural networks, capable of solving hard learning tasks on both classical and quantum input data. However, current approaches with qubits suffer from limited connectivity. We propose an implementation for quantum reservoir that obtains a large number of densely connected neurons by using parametrically coupled quantum oscillators instead of physically coupled qubits. We analyse a specific hardware implementation based on superconducting circuits: with just two coupled quantum oscillators, we create a quantum reservoir comprising up to 81 neurons. We obtain state-of-the-art accuracy of 99 % on benchmark tasks that otherwise require at least 24 classical oscillators to be solved. Our results give the coupling and dissipation requirements in the system and show how they affect the performance of the quantum reservoir. Beyond quantum reservoir computing, the use of parametrically coupled bosonic modes holds promise for realizing large quantum neural network architectures, with billions of neurons implemented with only 10 coupled quantum oscillators.

quant-ph↗

Classification of multi-frequency RF signals by extreme learning, using magnetic tunnel junctions as neurons and synapses

Extracting information from radiofrequency (RF) signals using artificial neural networks at low energy cost is a critical need for a wide range of applications from radars to health. These RF inputs are composed of multiples frequencies. Here we show that magnetic tunnel junctions can process analogue RF inputs with multiple frequencies in parallel and perform synaptic operations. Using a backpropagation-free method called extreme learning, we classify noisy images encoded by RF signals, using experimental data from magnetic tunnel junctions functioning as both synapses and neurons. We achieve the same accuracy as an equivalent software neural network. These results are a key step for embedded radiofrequency artificial intelligence.

cond-mat.mes-hall↗

Compensation of anisotropy in spin-Hall devices for neuromorphic applications

Spintronic nano-oscillators with reduced non-linearity could offer key benefits for realizing neuromorphic applications such as spike-based neurons and frequency multiplexing in neural networks. Here, we experimentally demonstrate the reduction in non-linearity of a spin-Hall nano-oscillator (SHNO) by compensation of its effective magnetic anisotropy. The study involves optimization of Co/Ni multilayer growth to achieve the compensation, followed by spin diode measurements on patterned microstrips to quantify their anisotropy. The relation between the second ($H_{k2}$ = 0.47 mT) and the first order ($H_{k1}^{eff}$ = $-$0.8 mT) anisotropy fields reveals the existence of an easy cone, thereby validating the presence of compensation. Furthermore, we demonstrate a synapse based on the compensated spin diode which has a fixed frequency when the input power is varied. We then study the current-induced auto-oscillation properties of SHNOs on compensated films by patterning nano-constrictions of widths 200 and 100 nm. The invariance of the resonance frequency and linewidth of the compensated SHNO with applied dc current indicates the absence of non-linearity. This independence is maintained irrespective of the applied external fields and its orientations. The compensated SHNO obtained has a linewidth of 1.1 MHz and a peak output power of up to 1 pW/MHz emulating a nano-neuron with a low linewidth and a fixed frequency.

cond-mat.mtrl-sci↗

Multilayer spintronic neural networks with radio-frequency connections

Spintronic nano-synapses and nano-neurons perform complex cognitive computations with high accuracy thanks to their rich, reproducible and controllable magnetization dynamics. These dynamical nanodevices could transform artificial intelligence hardware, provided that they implement state-of-the art deep neural networks. However, there is today no scalable way to connect them in multilayers. Here we show that the flagship nano-components of spintronics, magnetic tunnel junctions, can be connected into multilayer neural networks where they implement both synapses and neurons thanks to their magnetization dynamics, and communicate by processing, transmitting and receiving radio frequency (RF) signals. We build a hardware spintronic neural network composed of nine magnetic tunnel junctions connected in two layers, and show that it natively classifies nonlinearly-separable RF inputs with an accuracy of 97.7%. Using physical simulations, we demonstrate that a large network of nanoscale junctions can achieve state-of the-art identification of drones from their RF transmissions, without digitization, and consuming only a few milliwatts, which is a gain of more than four orders of magnitude in power consumption compared to currently used techniques. This study lays the foundation for deep, dynamical, spintronic neural networks.

cs.ET↗

Coherently coupled quantum oscillators for quantum reservoir computing

We analyze the properties of a quantum system composed of two coherently coupled quantum oscillators and show through simulations that it fulfills the two properties required for reservoir computing: non-linearity and fading memory. We first show that the basis states of this system apply a set of nonlinear transformations on the input signals and thus can implement neurons. We then show that the system exhibits a fading memory that can be controlled by its dissipation rates. Finally we show that a strong coupling between the oscillators is important in order to ensure complex dynamics and to populate a number of basis state neurons that is exponential in the number of physical devices.

quant-ph↗

2022 Roadmap on Neuromorphic Computing and Engineering

Modern computation based on the von Neumann architecture is today a mature cutting-edge science. In the Von Neumann architecture, processing and memory units are implemented as separate blocks interchanging data intensively and continuously. This data transfer is responsible for a large part of the power consumption. The next generation computer technology is expected to solve problems at the exascale with 1018 calculations each second. Even though these future computers will be incredibly powerful, if they are based on von Neumann type architectures, they will consume between 20 and 30 megawatts of power and will not have intrinsic physically built-in capabilities to learn or deal with complex data as our brain does. These needs can be addressed by neuromorphic computing systems which are inspired by the biological concepts of the human brain. This new generation of computers has the potential to be used for the storage and processing of large amounts of digital information with much lower power consumption than conventional processors. Among their potential future applications, an important niche is moving the control from data centers to edge devices. The aim of this Roadmap is to present a snapshot of the present state of neuromorphic technology and provide an opinion on the challenges and opportunities that the future holds in the major areas of neuromorphic technology, namely materials, devices, neuromorphic circuits, neuromorphic algorithms, applications, and ethics. The Roadmap is a collection of perspectives where leading researchers in the neuromorphic community provide their own view about the current state and the future challenges. We hope that this Roadmap will be a useful resource to readers outside this field, for those who are just entering the field, and for those who are well established in the neuromorphic community. https://doi.org/10.1088/2634-4386/ac4a83

cs.ET↗

Convolutional Neural Networks with Radio-Frequency Spintronic Nano-Devices

Convolutional neural networks are state-of-the-art and ubiquitous in modern signal processing and machine vision. Nowadays, hardware solutions based on emerging nanodevices are designed to reduce the power consumption of these networks. Spintronics devices are promising for information processing because of the various neural and synaptic functionalities they offer. However, due to their low OFF/ON ratio, performing all the multiplications required for convolutions in a single step with a crossbar array of spintronic memories would cause sneak-path currents. Here we present an architecture where synaptic communications have a frequency selectivity that prevents crosstalk caused by sneak-path currents. We first demonstrate how a chain of spintronic resonators can function as synapses and make convolutions by sequentially rectifying radio-frequency signals encoding consecutive sets of inputs. We show that a parallel implementation is possible with multiple chains of spintronic resonators to avoid storing intermediate computational steps in memory. We propose two different spatial arrangements for these chains. For each of them, we explain how to tune many artificial synapses simultaneously, exploiting the synaptic weight sharing specific to convolutions. We show how information can be transmitted between convolutional layers by using spintronic oscillators as artificial microwave neurons. Finally, we simulate a network of these radio-frequency resonators and spintronic oscillators to solve the MNIST handwritten digits dataset, and obtain results comparable to software convolutional neural networks. Since it can run convolutional neural networks fully in parallel in a single step with nano devices, the architecture proposed in this paper is promising for embedded applications requiring machine vision, such as autonomous driving.

cs.ET↗

Easy-plane spin Hall nano-oscillators as spiking neurons for neuromorphic computing

We show analytically using a macrospin approximation that easy-plane spin Hall nano-oscillators excited by a spin-current polarized perpendicularly to the easy-plane have phase dynamics analogous to that of Josephson junctions. Similarly to Josephson junctions, they can reproduce the spiking behavior of biological neurons that is appropriate for neuromorphic computing. We perform micromagnetic simulations of such oscillators realized in the nano-constriction geometry and show that the easy-plane spiking dynamics is preserved in an experimentally feasible architecture. Finally we simulate two elementary neural network blocks that implement operations essential for neuromorphic computing. First, we show that output spikes energies from two neurons can be summed and injected into a following layer neuron and second, we demonstrate that outputs can be multiplied by synaptic weights implemented by locally modifying the anisotropy.

cond-mat.dis-nn↗

Quantum neuromorphic computing

Quantum neuromorphic computing physically implements neural networks in brain-inspired quantum hardware to speed up their computation. In this perspective article, we show that this emerging paradigm could make the best use of the existing and near future intermediate size quantum computers. Some approaches are based on parametrized quantum circuits, and use neural network-inspired algorithms to train them. Other approaches, closer to classical neuromorphic computing, take advantage of the physical properties of quantum oscillator assemblies to mimic neurons and compute. We discuss the different implementations of quantum neuromorphic networks with digital and analog circuits, highlight their respective advantages, and review exciting recent experimental results.

quant-ph↗

Sequential dispersive measurement of a superconducting qubit

We present a superconducting device that realizes the sequential measurement of a transmon qubit. The device disables common limitations of dispersive readout such as Purcell effect or transients in the cavity mode by turning on and off the coupling to the measurement channel on demand. The qubit measurement begins by loading a readout resonator that is coupled to the qubit. After an optimal interaction time with negligible loss, a microwave pump releases the content of the readout mode by upconversion into a measurement line in a characteristic time as low as 10~ns, which is 400 times shorter than the lifetime of the readout resonator. A direct measurement of the released field quadratures demonstrates a readout fidelity of $97.5~\%$ in a total measurement time of $220~\mathrm{ns}$. The Wigner tomography of the readout mode allows us to characterize the non-Gaussian nature of the readout mode and its dynamics.

quant-ph↗

Wireless communication between two magnetic tunnel junctions acting as oscillator and diode

Magnetic tunnel junctions are nanoscale spintronic devices with microwave generation and detection capabilities. Here we use the rectification effect called "spin-diode" in a magnetic tunnel junction to wirelessly detect the microwave emission of another junction in the auto-oscillatory regime. We show that the rectified spin-diode voltage measured at the receiving junction end can be reconstructed from the independently measured auto-oscillation and spin diode spectra in each junction. Finally we adapt the auto-oscillator model to the case of spin-torque oscillator and spin-torque diode and we show that accurately reproduces the experimentally observed features. These results will be useful to design circuits and chips based on spintronic nanodevices communicating through microwaves.

cond-mat.mes-hall↗

Injection locking and parametric locking in a superconducting circuit

When a signal is injected in a parametric oscillator close enough to its resonance, the oscillator frequency and phase get locked to those of the injected signal. Here, we demonstrate two frequency locking schemes using a Josephson mixer in the parametric down-conversion regime, pumped beyond the parametric oscillation threshold. The circuit then emits radiation out of two spectraly and spatially separated resonators at frequencies determined by the locking schemes that we choose. When we inject the signal close to a resonance, it locks the oscillator emission to the signal frequency by injection locking. When we inject the signal close to the difference of resonances, it locks the oscillator emission by parametric locking. We compare both schemes and investigate the dependence of the parametric locking range on the pump and the injection signal power. Our results can be interpreted using Adler's theory for lasers, which makes a new link between laser physics and superconducting circuits that could enable better understanding of pumped circuits for quantum information applications such as error correction, circulators and photon number detectors.

cond-mat.mes-hall↗

Reservoir computing with the frequency, phase and amplitude of spin-torque nano-oscillators

Spin-torque nano-oscillators can emulate neurons at the nanoscale. Recent works show that the non-linearity of their oscillation amplitude can be leveraged to achieve waveform classification for an input signal encoded in the amplitude of the input voltage. Here we show that the frequency and the phase of the oscillator can also be used to recognize waveforms. For this purpose, we phase-lock the oscillator to the input waveform, which carries information in its modulated frequency. In this way we considerably decrease amplitude, phase and frequency noise. We show that this method allows classifying sine and square waveforms with an accuracy above 99% when decoding the output from the oscillator amplitude, phase or frequency. We find that recognition rates are directly related to the noise and non-linearity of each variable. These results prove that spin-torque nano-oscillators offer an interesting platform to implement different computing schemes leveraging their rich dynamical features.

physics.app-ph↗

Demonstration of an effective ultrastrong coupling between two oscillators

When the coupling rate between two quantum systems becomes as large as their characteristic frequencies, it induces dramatic effects on their dynamics and even on the nature of their ground state. The case of a qubit coupled to a harmonic oscillator in this ultrastrong coupling regime has been investigated theoretically and experimentally. Here, we explore the case of two harmonic oscillators in the ultrastrong coupling regime. Specifically, we realize an analog quantum simulation of this coupled system by dual frequency pumping a nonlinear superconducting circuit. The pump amplitudes directly tune the effective coupling rate. We observe spectroscopic signature of a mode hybridization that is characteristic of the ultrastrong coupling. Further we experimentally demon- strate a key property of the ground state of this simulated ultrastrong coupling between modes by observing simultaneous single-mode and two-mode squeezing of the radiated field below vacuum fluctuations.

quant-ph↗