arXiv subjects

Kazutaka Kanno

Publications and source records attributed to Kazutaka Kanno.

16 recordsLinked to original sources

arXiv2026

Approximate reservoir computing with a semiconductor laser for reducing energy consumption

Photonic reservoir computing is a promising physical machine-learning technique for predicting time-series data. The quantization of the response signal from the reservoir is required for the implementation of photonic reservoir computing, and the number of quantization bits and sampling frequency need to be optimized to achieve high performance and low energy consumption. However, few studies have been reported to investigate the effect of bit quantization and sampling frequency. In this study, we introduce a concept of approximate reservoir computing with a semiconductor laser by quantizing the amplitude of node states in the reservoir and output weights. We evaluate the performance of a chaotic time-series prediction task and energy consumption per sample. We achieve significant reduction of energy consumption by optimizing the number of quantization bits, the sampling frequency, and the injection current of the semiconductor laser, while maintaining the prediction performance.

physics.optics↗

arXiv2025

Photonic decision making using optical frequency difference detection in mutually-coupled semiconductor lasers

As electronic computing approaches its performance limits, photonic accelerators have emerged as promising alternatives. Photonic accelerators exploiting semiconductor-laser synchronization have been studied for decision-making. While conventional cross-correlation methods are computationally intensive and memory demanding, we propose a frequency-based approach using optical frequency differences. Simulations and experiments confirm that this method achieves decision making with reduced cost and memory requirements.

physics.optics↗

arXiv2025

Attention-Enhanced Reservoir Computing as a Multiple Dynamical System Approximator

Reservoir computing has proven effective for tasks such as time-series prediction, particularly in the context of chaotic systems. However, conventional reservoir computing frameworks often face challenges in achieving high prediction accuracy and adapting to diverse dynamical problems due to their reliance on fixed weight structures. A concept of an attention-enhanced reservoir computer has been proposed, which integrates an attention mechanism into the output layer of the reservoir computing model. This addition enables the system to prioritize distinct features dynamically, enhancing adaptability and prediction performance. In this study, we demonstrate the capability of the attention-enhanced reservoir computer to learn and predict multiple chaotic attractors simultaneously with a single set of weights, thus enabling transitions between attractors without explicit retraining. The method is validated using benchmark tasks, including the Lorenz system, Rössler system, Henon map, Duffing oscillator, and Mackey-Glass delay-differential equation. Our results indicate that the attention-enhanced reservoir computer achieves superior prediction accuracy, valid prediction times, and improved representation of spectral and histogram characteristics compared to traditional reservoir computing methods, establishing it as a robust tool for modeling complex dynamical systems.

nlin.CD↗

arXiv2025

Blending Optimal Control and Biologically Plausible Learning for Noise-Robust Physical Neural Networks

The rapidly increasing computational demands for artificial intelligence (AI) have spurred the exploration of computing principles beyond conventional digital computers. Physical neural networks (PNNs) offer efficient neuromorphic information processing by harnessing the innate computational power of physical processes; however, training their weight parameters is computationally expensive. We propose a training approach for substantially reducing this training cost. Our training approach merges an optimal control method for continuous-time dynamical systems with a biologically plausible training method--direct feedback alignment. In addition to the reduction of training time, this approach achieves robust processing even under measurement errors and noise without requiring detailed system information. The effectiveness was numerically and experimentally verified in an optoelectronic delay system. Our approach significantly extends the range of physical systems practically usable as PNNs.

physics.app-ph↗

arXiv2024

Attention-Enhanced Reservoir Computing

Photonic reservoir computing has been successfully utilized in time-series prediction as the need for hardware implementations has increased. Prediction of chaotic time series remains a significant challenge, an area where the conventional reservoir computing framework encounters limitations of prediction accuracy. We introduce an attention mechanism to the reservoir computing model in the output stage. This attention layer is designed to prioritize distinct features and temporal sequences, thereby substantially enhancing the prediction accuracy. Our results show that a photonic reservoir computer enhanced with the attention mechanism exhibits improved prediction capabilities for smaller reservoirs. These advancements highlight the transformative possibilities of reservoir computing for practical applications where accurate prediction of chaotic time series is crucial.

cs.ET↗

arXiv2023

Experimental control of mode-competition dynamics in a chaotic multimode semiconductor laser for decision making

Photonic computing has been widely used to accelerate the computational performance in machine learning. Photonic decision-making is a promising approach that uses photonic computing technologies to solve the multi-armed bandit problem based on reinforcement learning. Photonic decision making using chaotic mode competition dynamics has been proposed. However, the experimental conditions for achieving superior decision-making performance have not yet been established. In this study, we experimentally investigate the mode competition dynamics in a chaotic multimode semiconductor laser in the presence of optical feedback and injection. We control chaotic mode-competition dynamics via optical injection, and we found that positive wavelength detuning results in an efficient mode concentration to one of the longitudinal modes with a small optical injection power. We experimentally investigate two-dimensional bifurcation map of the laser dynamics of the total intensity. Complex mixed dynamics are observed in the presence of optical feedback and injection. We experimentally conduct decision making to solve the bandit problem using chaotic mode-competition dynamics. A fast mode concentration property is observed at positive wavelength detuning, which resulted in a fast convergence of the correct decision rate. Our findings could be useful in accelerating the decision-making performance in adaptive optical networks using reinforcement learning.

physics.optics↗

arXiv2023

Analysis of temporal structure of laser chaos by Allan variance

Allan variance has been widely utilized in evaluating the stability of the time series generated by atomic clocks and lasers, in time regimes ranging from short to extremely long. This multi-scale examination capability of the Allan variance may also be beneficial in evaluating the chaotic oscillating dynamics of semiconductor lasers, not just for conventional phase stability analysis purposes. Here we demonstrate Allan variance analysis of the complex time series generated by a semiconductor laser with delayed feedback, including low-frequency fluctuations (LFFs), which exhibit both fast and slow dynamics. Whereas the detection of LFFs is not easy with the conventional power spectrum analysis method in the low-frequency regime, we show that the Allan variance approach clearly captured the appearance of multiple time-scale dynamics, like LFFs. This study demonstrates that Allan variance can help in understanding and characterizing versatile laser dynamics, including LFFs, which involve dynamics spanning a wide range of time scales.

physics.optics↗

arXiv2022

Chaotic mode-competition dynamics in a multimode semiconductor laser with optical feedback and injection

Photonic computing is attracting increasing interest to accelerate information processing in machine learning applications. The mode-competition dynamics of multimode semiconductor lasers is useful for solving the multi-armed bandit problem in reinforcement learning for computing applications. In this study, we numerically evaluate the chaotic mode-competition dynamics in a multimode semiconductor laser with optical feedback and injection. We observe the chaotic mode-competition dynamics among the longitudinal modes and control them by injecting an external optical signal into one of the longitudinal modes. We define the dominant mode as the mode with the maximum intensity; the dominant-mode ratio for the injected mode increases as the optical injection strength increases. We find that the characteristics of the dominant mode ratio in terms of the optical injection strength are different among the modes owing to the different optical feedback phases. We propose a control technique for the characteristics of the dominant mode ratio by precisely tuning the initial optical frequency detuning between the optical injection signal and injected mode. We also evaluate the relationship between the region for the large dominant mode ratio and injection locking range. The region for the large dominant mode ratio does not correspond to the injection-locking range. This discrepancy results from the complex mode-competition dynamics in multimode semiconductor lasers with both optical feedback and injection. This control technique of chaotic mode-competition dynamics in multimode lasers is promising for applications in reinforcement learning and reservoir computing as photonic artificial intelligence.

physics.optics↗

arXiv2022

Parallel photonic accelerator for decision making using optical spatiotemporal chaos

Photonic accelerators have attracted increasing attention in artificial intelligence applications. The multi-armed bandit problem is a fundamental problem of decision making using reinforcement learning. However, the scalability of photonic decision making has not yet been demonstrated in experiments, owing to technical difficulties in physical realization. We propose a parallel photonic decision-making system for solving large-scale multi-armed bandit problems using optical spatiotemporal chaos. We solve a 512-armed bandit problem online, which is much larger than previous experiments by two orders of magnitude. The scaling property for correct decision making is examined as a function of the number of slot machines, evaluated as an exponent of 0.86. This exponent is smaller than that in previous work, indicating the superiority of the proposed parallel principle. This experimental demonstration facilitates photonic decision making to solve large-scale multi-armed bandit problems for future photonic accelerators.

cs.ET↗

arXiv2022

Parallel bandit architecture based on laser chaos for reinforcement learning

Accelerating artificial intelligence by photonics is an active field of study aiming to exploit the unique properties of photons. Reinforcement learning is an important branch of machine learning, and photonic decision-making principles have been demonstrated with respect to the multi-armed bandit problems. However, reinforcement learning could involve a massive number of states, unlike previously demonstrated bandit problems where the number of states is only one. Q-learning is a well-known approach in reinforcement learning that can deal with many states. The architecture of Q-learning, however, does not fit well photonic implementations due to its separation of update rule and the action selection. In this study, we organize a new architecture for multi-state reinforcement learning as a parallel array of bandit problems in order to benefit from photonic decision-makers, which we call parallel bandit architecture for reinforcement learning or PBRL in short. Taking a cart-pole balancing problem as an instance, we demonstrate that PBRL adapts to the environment in fewer time steps than Q-learning. Furthermore, PBRL yields faster adaptation when operated with a chaotic laser time series than the case with uniformly distributed pseudorandom numbers where the autocorrelation inherent in the laser chaos provides a positive effect. We also find that the variety of states that the system undergoes during the learning phase exhibits completely different properties between PBRL and Q-learning. The insights obtained through the present study are also beneficial for existing computing platforms, not just photonic realizations, in accelerating performances by the PBRL algorithms and correlated random sequences.

cs.ET↗

arXiv2022

Controlling chaotic itinerancy in laser dynamics for reinforcement learning

Photonic artificial intelligence has attracted considerable interest in accelerating machine learning; however, the unique optical properties have not been fully utilized for achieving higher-order functionalities. Chaotic itinerancy, with its spontaneous transient dynamics among multiple quasi-attractors, can be employed to realize brain-like functionalities. In this paper, we propose a method for controlling the chaotic itinerancy in a multi-mode semiconductor laser to solve a machine learning task, known as the multi-armed bandit problem, which is fundamental to reinforcement learning. The proposed method utilizes ultrafast chaotic itinerant motion in mode competition dynamics controlled via optical injection. We found that the exploration mechanism is completely different from a conventional searching algorithm and is highly scalable, outperforming the conventional approaches for large-scale bandit problems. This study paves the way to utilize chaotic itinerancy for effectively solving complex machine learning tasks as photonic hardware accelerators.

physics.optics↗

arXiv2022

Photonic reinforcement learning based on optoelectronic reservoir computing

Reinforcement learning has been intensively investigated and developed in artificial intelligence in the absence of training data, such as autonomous driving vehicles, robot control, internet advertising, and elastic optical networks. However, the computational cost of reinforcement learning with deep neural networks is extremely high and reducing the learning cost is a challenging issue. We propose a photonic on-line implementation of reinforcement learning using optoelectronic delay-based reservoir computing, both experimentally and numerically. In the proposed scheme, we accelerate reinforcement learning at a rate of several megahertz because there is no required learning process for the internal connection weights in reservoir computing. We perform two benchmark tasks, CartPole-v0 and MountanCar-v0 tasks, to evaluate the proposed scheme. Our results represent the first hardware implementation of reinforcement learning based on photonic reservoir computing and pave the way for fast and efficient reinforcement learning as a novel photonic accelerator.

cs.ET↗

arXiv2021

Using multidimensional speckle dynamics for high-speed, large-scale, parallel photonic computing

The recent rapid increase in demand for data processing has resulted in the need for novel machine learning concepts and hardware. Physical reservoir computing and an extreme learning machine are novel computing paradigms based on physical systems themselves, where the high dimensionality and nonlinearity play a crucial role in the information processing. Herein, we propose the use of multidimensional speckle dynamics in multimode fibers for information processing, where input information is mapped into the space, frequency, and time domains by an optical phase modulation technique. The speckle-based mapping of the input information is high-dimensional and nonlinear and can be realized at the speed of light; thus, nonlinear time-dependent information processing can successfully be achieved at fast rates when applying a reservoir-computing-like-approach. As a proof-of-concept, we experimentally demonstrate chaotic time-series prediction at input rates of 12.5 Gigasamples per second. Moreover, we show that owing to the passivity of multimode fibers, multiple tasks can be simultaneously processed within a single system, i.e., multitasking. These results offer a novel approach toward realizing parallel, high-speed, and large-scale photonic computing.

physics.optics↗

arXiv2020

Adaptive model selection in photonic reservoir computing by reinforcement learning

Photonic reservoir computing is an emergent technology toward beyond-Neumann computing. Although photonic reservoir computing provides superior performance in environments whose characteristics are coincident with the training datasets for the reservoir, the performance is significantly degraded if these characteristics deviate from the original knowledge used in the training phase. Here, we propose a scheme of adaptive model selection in photonic reservoir computing using reinforcement learning. In this scheme, a temporal waveform is generated by different dynamic source models that change over time. The system autonomously identifies the best source model for the task of time series prediction using photonic reservoir computing and reinforcement learning. We prepare two types of output weights for the source models, and the system adaptively selected the correct model using reinforcement learning, where the prediction errors are associated with rewards. We succeed in adaptive model selection when the source signal is temporally mixed, having originally been generated by two different dynamic system models, as well as when the signal is a mixture from the same model but with different parameter values. This study paves the way for autonomous behavior in photonic artificial intelligence and could lead to new applications in load forecasting and multi-objective control, where frequent environment changes are expected.

cs.ET↗

arXiv2020

Dynamic channel selection in wireless communications via a multi-armed bandit algorithm using laser chaos time series

Dynamic channel selection is among the most important wireless communication elements in dynamically changing electromagnetic environments wherein a user can experience improved communication quality by choosing a better channel. Multi-armed bandit (MAB) algorithms are a promising approach by which the difficult tradeoff between exploration to search for better a channel and exploitation to experience enhanced communication quality is resolved. Ultrafast solution of MAB problems has been demonstrated by utilizing chaotically oscillating time series generated by semiconductor lasers. In this study, we experimentally demonstrate a MAB algorithm incorporating laser chaos time series in a wireless local area network (WLAN). Autonomous and adaptive dynamic channel selection is successfully demonstrated in an IEEE802.11a-based, four-channel WLAN. Although the laser chaos time series is arranged prior to the WLAN experiments, the results confirm the usefulness of ultrafast chaotic sequences for real wireless applications. In addition, we numerically examine the underlining adaptation mechanism of the significantly simplified MAB algorithm implemented in the present study compared with the previously reported chaos-based decision makers. This study provides a first step toward the application of ultrafast chaotic lasers for future high-performance wireless communication networks.

eess.SP↗

arXiv2019

Generative adversarial network based on chaotic time series

Generative adversarial network (GAN) is gaining increased importance in artificially constructing natural images and related functionalities wherein two networks called generator and discriminator are evolving through adversarial mechanisms. Using deep convolutional neural networks and related techniques, high-resolution, highly realistic scenes, human faces, among others have been generated. While GAN in general needs a large amount of genuine training data sets, it is noteworthy that vast amounts of pseudorandom numbers are required. Here we utilize chaotic time series generated experimentally by semiconductor lasers for the latent variables of GAN whereby the inherent nature of chaos can be reflected or transformed into the generated output data. We show that the similarity in proximity, which is a degree of robustness of the generated images with respects to a minute change in the input latent variables, is enhanced while the versatility as a whole is not severely degraded. Furthermore, we demonstrate that the surrogate chaos time series eliminates the signature of generated images that is originally observed corresponding to the negative autocorrelation inherent in the chaos sequence. We also discuss the impact of utilizing chaotic time series in retrieving images from the trained generator.

cs.LG↗