SearcharxivSearch

arXiv subjects

Sumito Tsunegi

Publications and source records attributed to Sumito Tsunegi.

At least 19 recordsLinked to original sources

Ensemble Reservoir Computing for Physical Systems

Physical computing exploits unconventional physical substrates to overcome limitations such as the high energy consumption inherent in digital computation. However, intrinsic noise and temporal fluctuations (e.g., oscillations) generally deteriorate computational performance. Here, we propose ensemble reservoir computing (ERC), a novel framework that employs ensemble averaging of spatially multiplexed systems to achieve robust information processing despite noise and temporal fluctuations. First, we prove that ensemble averaging in ERC eliminates temporal fluctuations and noise from dynamical states under certain conditions, thereby restoring computational performance to its noise-free level. Next, we show that ERC not only removes the noise and fluctuations but also actively exploits the computational capabilities that conventional reservoir computing (RC) leaves unutilized. This computational enhancement is demonstrated across diverse dynamical systems (e.g., periodic, chaotic, and strange-nonchaotic systems), in which ERC outperforms conventional RC. Finally, using energy-efficient spin-torque oscillators (STOs), we demonstrate that ERC maintains high performance even under realistic conditions, in which noise and temporal fluctuations coexist: STOs with ERC achieved 99\% accuracy on an error detection test, where conventional STO reservoir with linear regression only shows a chance level performance, highlighting ERC's robustness and performance gains for physical systems.

math.DS

Reservoir Computing Generalized

A physical neural network (PNN) has both the strong potential to solve machine learning tasks and intrinsic physical properties, such as high-speed computation and energy efficiency. Reservoir computing (RC) is an excellent framework for implementing an information processing system with a dynamical system by attaching a trained readout, thus accelerating the wide use of unconventional materials for a PNN. However, RC requires the dynamics to reproducibly respond to input sequence, which limits the type of substance available for building information processors. Here we propose a novel framework called generalized reservoir computing (GRC) by turning this requirement on its head, making conventional RC a special case. Using substances that do not respond the same to identical inputs (e.g., a real spin-torque oscillator), we propose mechanisms aimed at obtaining a reliable output and show that processed inputs in the unconventional substance are retrievable. Finally, we demonstrate that, based on our framework, spatiotemporal chaos, which is thought to be unusable as a computational resource, can be used to emulate complex nonlinear dynamics, including large scale spatiotemporal chaos. Overall, our framework removes the limitation to building an information processing device and opens a path to constructing a computational system using a wider variety of physical dynamics.

nlin.CD

Spintronic reservoir computing without driving current or magnetic field

Recent studies have shown that nonlinear magnetization dynamics excited in nanostructured ferromagnets are applicable to brain-inspired computing such as physical reservoir computing. The previous works have utilized the magnetization dynamics driven by electric current and/or magnetic field. This work proposes a method to apply the magnetization dynamics driven by voltage control of magnetic anisotropy to physical reservoir computing, which will be preferable from the viewpoint of low-power consumption. The computational capabilities of benchmark tasks in single MTJ are evaluated by numerical simulation of the magnetization dynamics and found to be comparable to those of echo-state networks with more than 10 nodes.

cond-mat.mes-hall

Input-driven chaotic dynamics in vortex spin-torque oscillator

A new research topic in spintronics relating to the operation principles of brain-inspired computing is input-driven magnetization dynamics in nanomagnet. In this paper, the magnetization dynamics in a vortex spin-torque oscillator (STO) driven by a series of random magnetic field are studied through a numerical simulation of the Thiele equation. It is found that input-driven synchronization occurs in the weak perturbation limit, as found recently. As well, chaotic behavior is newly found to occur in the vortex core dynamics for a wide range of parameters, where synchronized behavior is disrupted by an intermittency. Ordered and chaotic dynamical phases are examined by evaluating the Lyapunov exponent. The relation between the dynamical phase and the computational capability of physical reservoir computing is also studied.

cond-mat.mes-hall

Towards mutual synchronization of serially connected Spin Torque Oscillators based on magnetic tunnel junctions

Multiple neuromorphic applications require the tuning of two or more devices to a common signal. Various types of neuromorphic computation can be realized using spintronic oscillators, where the DC current induces magnetization precession, which turns into an AC voltage generator. However, in spintronics, synchronization of two oscillators using a DC signal is still a challenging problem because it requires a certain degree of similarity between devices that are to be synchronized, which may be difficult to achieve due to device parameter distribution during the fabrication process. In this work, we present experimental results on the mechanisms of synchronization of spin-torque oscillators. Devices are based on magnetic tunnel junction with a perpendicularly magnetized free layer and take advantage of a uniform magnetization precision in the presence of the magnetic field and a DC bias. By using an external microwave source, we show the optimal condition for the synchronization of the magnetic tunnel junctions. Finally, we present results on the in-series connection of two junctions and discuss the possible path towards improving oscillation power and linewidth. In addition, using numerical simulations of the coupled oscillators model, we aim to reproduce the conditions of the experiments and determine the tolerance for achieving synchronization.

physics.app-ph

Computational capability for physical reservoir computing using a spin-torque oscillator with two free layers

A numerical analysis on the computational capability of physical reservoir computing utilizing a spin-torque oscillator with two free layers is reported. Conventional spintronics devices usually consist of two ferromagnets, where the direction of magnetization in one layer, called the free layer, can move while that of the other, the reference layer, is fixed. Recently, however, devices with two free layers, where the reference layer is replaced by another free layer, have been developed for various practical applications. Adding another free layer drastically changes the dynamical response of the device through the couplings via the spin-transfer effect and the dipole magnetic field. A numerical simulation of the Landau-Lifshitz-Gilbert equation and a statistical analyses of the Lyapunov exponent and the synchronization index reveal the appearance of an amplitude-modulated oscillation and chaos in the oscillators with two free layers. Such complex dynamics qualitatively change the computational capability of physical reservoir computing because the computational resource is dynamics of the physical system. An evaluation of the short-term memory capacity clarifies that oscillators with two free layers have a larger capacity than those of conventional oscillators. An enhancement in capacity near the edge of echo state property, i.e., the boundary between zero and finite synchronization index, is also found.

cond-mat.mes-hall

Spin-torque Dynamics for Noise Reduction in Vortex-based Sensors

Performance of magnetoresistive sensors is today mainly limited by their 1/f low-frequency noise. Here, we study this noise component in vortex-based TMR sensors. We compare the noise level in different magnetization configurations of the device, i.e vortex state or uniform parallel or antiparallel states. We find that the vortex state is at least an order of magnitude noisier than the uniform states. Nevertheless, by activating the spin-transfer induced dynamics of the vortex configuration, we observe a reduction of the 1/f noise, close to the values measured in the AP state, as the vortex core has a lower probability of pinning into defect sites. Additionally, by driving the dynamics of the vortex core by a non-resonant rf field or current we demonstrate that the 1/f noise can be further decreased. The ability to reduce the 1/f low-frequency noise in vortex-based devices by leveraging their spin-transfer dynamics thus enhances their applicability in the magnetic sensors' landscape.

cond-mat.mes-hall

Step-like dependence of memory function on pulse width in spintronics reservoir computing

Physical reservoir computing is a type of recurrent neural network that applies the dynamical response from physical systems to information processing. However, the relation between computation performance and physical parameters/phenomena still remains unclear. This study reports our progress regarding the role of current-dependent magnetic damping in the computational performance of reservoir computing. The current-dependent relaxation dynamics of a magnetic vortex core results in an asymmetric memory function with respect to binary inputs. A fast relaxation caused by a large input leads to a fast fading of the input memory, whereas a slow relaxation by a small input enables the reservoir to keep the input memory for a relatively long time. As a result, a step-like dependence is found for the short-term memory and parity-check capacities on the pulse width of input data, where the capacities remain at 1.5 for a certain range of the pulse width, and drop to 1.0 for a long pulse-width limit. Both analytical and numerical analyses clarify that the step-like behavior can be attributed to the current-dependent relaxation time of the vortex core to a limit-cycle state. }

cond-mat.mes-hall

Periodic structure of memory function in spintronics reservoir with feedback current

The role of the feedback effect on physical reservoir computing is studied theoretically by solving the vortex-core dynamics in a nanostructured ferromagnet. Although the spin-transfer torque due to the feedback current makes the vortex dynamics complex, it is clarified that the feedback effect does not always contribute to the enhancement of the memory function in a physical reservoir. The memory function, characterized by the correlation coefficient between the input data and the dynamical response of the vortex core, becomes large when the delay time of the feedback current is not an integral multiple of the pulse width. On the other hand, the memory function remains small when the delay time is an integral multiple of the pulse width. As a result, a periodic behavior for the short-term memory capacity is observed with respect to the delay time, the phenomenon of which can be attributed to correlations between the virtual neurons via the feedback current.

cond-mat.mes-hall

Influence of flicker noise and nonlinearity on the frequency spectrum of spin torque nano-oscillators

The correlation of phase fluctuations in any type of oscillator fundamentally defines its spectral shape. However, in nonlinear oscillators, such as spin torque nano oscillators, the frequency spectrum can become particularly complex. This is specifically true when not only considering thermal but also colored $1/f$ flicker noise processes, which are crucial in the context of the oscillator's long term stability. In this study, we address the frequency spectrum of spin torque oscillators in the regime of large-amplitude steady oscillations experimentally and as well theoretically. We particularly take both thermal and flicker noise into account. We perform a series of measurements of the phase noise and the spectrum on spin torque vortex oscillators, notably varying the measurement time duration. Furthermore, we develop the modelling of thermal and flicker noise in Thiele equation based simulations. We also derive the complete phase variance in the framework of the nonlinear auto-oscillator theory and deduce the actual frequency spectrum. We investigate its dependence on the measurement time duration and compare with the experimental results. Long term stability is important in several of the recent applicative developments of spin torque oscillators. This study brings some insights on how to better address this issue.

cond-mat.mes-hall

Phase estimation of spin-torque oscillator by nonlinear spin-torque diode effect

A theoretical analysis is developed on spin-torque diode effect in nonlinear region. An analytical solution of the diode voltage generated from spin-torque oscillator by the rectification of an alternating current is derived. The diode voltage is revealed to depend nonlinearly on the phase difference between the oscillator and the alternating current. The validity of the analytical prediction is confirmed by numerical simulation of the Landau-Lifshitz-Gilbert equation. The results indicate that the spin-torque diode effect is useful to evaluate the phase of a spin-torque oscillator in forced synchronization state.

cond-mat.mes-hall

Binding events through the mutual synchronization of spintronic nano-neurons

The brain naturally binds events from different sources in unique concepts. It is hypothesized that this process occurs through the transient mutual synchronization of neurons located in different regions of the brain when the stimulus is presented. This mechanism of binding through synchronization can be directly implemented in neural networks composed of coupled oscillators. To do so, the oscillators must be able to mutually synchronize for the range of inputs corresponding to a single class, and otherwise remain desynchronized. Here we show that the outstanding ability of spintronic nano-oscillators to mutually synchronize and the possibility to precisely control the occurrence of mutual synchronization by tuning the oscillator frequencies over wide ranges allows pattern recognition. We demonstrate experimentally on a simple task that three spintronic nano-oscillators can bind consecutive events and thus recognize and distinguish temporal sequences. This work is a step forward in the construction of neural networks that exploit the non-linear dynamic properties of their components to perform brain-inspired computations.

physics.app-ph

Synchronization and chaos in a spin-torque oscillator with a perpendicularly magnetized free layer

Synchronization and chaos caused by alternating current and microwave field in a spin torque oscillator consisting of a perpendicularly magnetized free layer and an in-plane magnetized reference layer is comprehensively studied theoretically. A forced synchronization by the alternating current is observed in numerical simulation over wide ranges of its amplitude and frequency. An analytical theory clarifies that the nonlinear frequency shift, as well as the spin-transfer torque asymmetry, plays a key role in determining locking range and phase difference between the oscillator and current. Chaos caused by the alternating current is identified for a region of large alternating current by evaluating the Lyapunov exponent. Similar results are also obtained for microwave field, although the parameter regions causing chaos are narrower than those by the alternating current.

cond-mat.mes-hall

Role of non-linear data processing on speech recognition task in the framework of reservoir computing

The reservoir computing neural network architecture is widely used to test hardware systems for neuromorphic computing. One of the preferred tasks for bench-marking such devices is automatic speech recognition. However, this task requires acoustic transformations from sound waveforms with varying amplitudes to frequency domain maps that can be seen as feature extraction techniques. Depending on the conversion method, these may obscure the contribution of the neuromorphic hardware to the overall speech recognition performance. Here, we quantify and separate the contributions of the acoustic transformations and the neuromorphic hardware to the speech recognition success rate. We show that the non-linearity in the acoustic transformation plays a critical role in feature extraction. We compute the gain in word success rate provided by a reservoir computing device compared to the acoustic transformation only, and show that it is an appropriate benchmark for comparing different hardware. Finally, we experimentally and numerically quantify the impact of the different acoustic transformations for neuromorphic hardware based on magnetic nano-oscillators.

eess.AS

Low offset frequency $1/f$ flicker noise in spin torque vortex oscillators

Low frequency noise close to the carrier remains little explored in spin torque nano oscillators. However, it is crucial to investigate as it limits the oscillator's frequency stability. This work addresses the low offset frequency flicker noise of a TMR-based spin-torque vortex oscillator in the regime of large amplitude steady oscillations. We first phenomenologically expand the nonlinear auto-oscillator theory aiming to reveal the properties of this noise. We then present a thorough experimental study of the oscillator's $1/f$ flicker noise and discuss the results based on the theoretical predictions. Hereby, we connect the oscillator's nonlinear dynamics with the concept of flicker noise and furthermore refer to the influence of a standard $1/f$ noise description based on the Hooge formula, taking into account the non-constant magnetic oscillation volume, which contributes to the magnetoresistance.

cond-mat.mes-hall

Vowel recognition with four coupled spin-torque nano-oscillators

Substantial evidence indicates that the brain uses principles of non-linear dynamics in neural processes, providing inspiration for computing with nanoelectronic devices. However, training neural networks composed of dynamical nanodevices requires finely controlling and tuning their coupled oscillations. In this work, we show that the outstanding tunability of spintronic nano-oscillators can solve this challenge. We successfully train a hardware network of four spin-torque nano-oscillators to recognize spoken vowels by tuning their frequencies according to an automatic real-time learning rule. We show that the high experimental recognition rates stem from the high frequency tunability of the oscillators and their mutual coupling. Our results demonstrate that non-trivial pattern classification tasks can be achieved with small hardware neural networks by endowing them with non-linear dynamical features: here, oscillations and synchronization. This demonstration is a milestone for spintronics-based neuromorphic computing.

q-bio.NC

Macromagnetic simulation for reservoir computing utilizing spin dynamics in magnetic tunnel junctions

The figures-of-merit for reservoir computing (RC), using spintronics devices called magnetic tunnel junctions (MTJs), are evaluated. RC is a type of recurrent neural network. The input information is stored in certain parts of the reservoir, and computation can be performed by optimizing a linear transform matrix for the output. While all the network characteristics should be controlled in a general recurrent neural network, such optimization is not necessary for RC. The reservoir only has to possess a non-linear response with memory effect. In this paper, macromagnetic simulation is conducted for the spin-dynamics in MTJs, for reservoir computing. It is determined that the MTJ-system possesses the memory effect and non-linearity required for RC. With RC using 5-7 MTJs, high performance can be obtained, similar to an echo-state network with 20-30 nodes, even if there are no magnetic and/or electrical interactions between the magnetizations.

cond-mat.mtrl-sci

Mutual synchronization of spin-torque oscillators consisting of perpendicularly magnetized free layers and in-plane magnetized pinned layers

A mutual synchronization of spin-torque oscillators coupled through current injection is studied theoretically. Models of electrical coupling in parallel and series circuits are proposed. Solving the Landau-Lifshitz-Gilbert equation, excitation of in-phase or antiphase synchronization, depending on the ways the oscillators are connected, is found. It is also found from both analytical and numerical calculations that the current-frequency relations for both parallel and series circuits are the same as that for a single spin-torque oscillator.

cond-mat.mes-hall