Searcharxiv⌕ Search

arXiv subjects

Kazuyuki Aihara

Publications and source records attributed to Kazuyuki Aihara.

At least 55 records · Page 3Linked to original sources

Time-domain digital-to-analog converter for spiking neural network hardware

We propose a new digital-to-analog converter (DAC) for realizing a synapse circuit of mixed-signal spiking neural networks. We named this circuit "time-domain DAC (TDAC)". This produces weights for converting a digital input code into voltage using one current waveform. Therefore, a TDAC is more compact than a conventional DAC that comprises many current sources and resistors. Moreover, a TDAC with leak resistance reproduces biological plausible synaptic responses that are expressed as alpha functions or dual exponential equations. We will show numerical analysis results of a TDAC and circuit simulation results of a circuit designed by the TSMC 40 nm CMOS process.

eess.SP↗

Fully Neural Network based Model for General Temporal Point Processes

A temporal point process is a mathematical model for a time series of discrete events, which covers various applications. Recently, recurrent neural network (RNN) based models have been developed for point processes and have been found effective. RNN based models usually assume a specific functional form for the time course of the intensity function of a point process (e.g., exponentially decreasing or increasing with the time since the most recent event). However, such an assumption can restrict the expressive power of the model. We herein propose a novel RNN based model in which the time course of the intensity function is represented in a general manner. In our approach, we first model the integral of the intensity function using a feedforward neural network and then obtain the intensity function as its derivative. This approach enables us to both obtain a flexible model of the intensity function and exactly evaluate the log-likelihood function, which contains the integral of the intensity function, without any numerical approximations. Our model achieves competitive or superior performances compared to the previous state-of-the-art methods for both synthetic and real datasets.

cs.LG↗

A Supervised Learning Algorithm for Multilayer Spiking Neural Networks Based on Temporal Coding Toward Energy-Efficient VLSI Processor Design

Spiking neural networks (SNNs) are brain-inspired mathematical models with the ability to process information in the form of spikes. SNNs are expected to provide not only new machine-learning algorithms, but also energy-efficient computational models when implemented in VLSI circuits. In this paper, we propose a novel supervised learning algorithm for SNNs based on temporal coding. A spiking neuron in this algorithm is designed to facilitate analog VLSI implementations with analog resistive memory, by which ultra-high energy efficiency can be achieved. We also propose several techniques to improve the performance on a recognition task, and show that the classification accuracy of the proposed algorithm is as high as that of the state-of-the-art temporal coding SNN algorithms on the MNIST dataset. Finally, we discuss the robustness of the proposed SNNs against variations that arise from the device manufacturing process and are unavoidable in analog VLSI implementation. We also propose a technique to suppress the effects of variations in the manufacturing process on the recognition performance.

cs.NE↗

Practical data-driven flood forecasting based on dynamical systems theory: Case studies from Japan

Data-driven flood forecasting methods are useful, especially for the rivers that lack hydrological information to build physical models. Although these former methods can forecast river stages using only past water levels and rainfall data, they cannot handle previously unexperienced water levels easily, and require a large amount of data to build accurate models. Here, we focus on phase-space reconstruction approaches, and develop a practical data-driven forecasting method to overcome the existing problems. The proposed method can handle the unexperienced water levels and provide forecasts using only a small number of water rise events. We apply the method to data from actual rivers, and it achieved the best forecast performance among existing methods, including a physical runoff model, a data-driven multi-layer perceptron, and a conventional method based on phase-space reconstruction. In addition, the proposed method also forecasted the exceedance of the evacuation warning level 6 h earlier for steep rivers. Given its performance and maintainability, the proposed method can be applied to many actual rivers for early evacuation.

physics.geo-ph↗

Quantum Expectation-Maximization Algorithm

Clustering algorithms are a cornerstone of machine learning applications. Recently, a quantum algorithm for clustering based on the k-means algorithm has been proposed by Kerenidis, Landman, Luongo and Prakash. Based on their work, we propose a quantum expectation-maximization (EM) algorithm for Gaussian mixture models (GMMs). The robustness and quantum speedup of the algorithm is demonstrated. We also show numerically the advantage of GMM over k-means for non-trivial cluster data.

quant-ph↗

Forecasting high-dimensional dynamics exploiting suboptimal embeddings

Delay embedding---a method for reconstructing dynamical systems by delay coordinates---is widely used to forecast nonlinear time series as a model-free approach. When multivariate time series are observed, several existing frameworks can be applied to yield a single forecast combining multiple forecasts derived from various embeddings. However, the performance of these frameworks is not always satisfactory because they randomly select embeddings or use brute force and do not consider the diversity of the embeddings to combine. Herein, we develop a forecasting framework that overcomes these existing problems. The framework exploits various "suboptimal embeddings" obtained by minimizing the in-sample error via combinatorial optimization. The framework achieves the best results among existing frameworks for sample toy datasets and a real-world flood dataset. We show that the framework is applicable to a wide range of data lengths and dimensions. Therefore, the framework can be applied to various fields such as neuroscience, ecology, finance, fluid dynamics, weather, and disaster prevention.

stat.ML↗

Destabilization of local minima in analog spin systems by correction of amplitude heterogeneity

The relaxation of binary spins to analog values has been the subject of much debate in the field of statistical physics, neural networks, and more recently quantum computing, notably because the benefits of using an analog state for finding lower energy spin configurations are usually offset by the negative impact of the improper mapping of the energy function that results from the relaxation. We show that it is possible to destabilize trapping sets of analog states that correspond to local minima of the binary spin Hamiltonian by extending the phase space to include error signals that correct amplitude inhomogeneity of the analog spin states and controlling the divergence of their velocity. Performance of the proposed analog spin system in finding lower energy states is competitive against state-of-the-art heuristics.

nlin.CD↗

Work relations with measurement and feedback control on nonuniform temperature systems

The relation between the work performed to a system and the change of its free energy during a certain process is important in nonequilibrium statistical mechanics. In particular, the work relation with measurement and feedback control has attracted much attention, because it resolved the paradox concerning Maxwell's demon. Most studies, however, assume that their target systems are isolated or isothermal. In this paper, by considering a nonisothermal system, we generalize the Sagawa-Ueda-Jarzynski relation, which involves measurement and feedback control, and apply it to a realistic model. Furthermore, when the temperature profile is quadratic, we see that the system is governed by Tsallis statistical mechanics. In addition, we show that our formulation provides the generalized version of the second law of information thermodynamics and a set of work relations for isothermal systems.

cond-mat.stat-mech↗

Non-Gaussian power grid frequency fluctuations characterized by Lévy-stable laws and superstatistics

Multiple types of fluctuations impact the collective dynamics of power grids and thus challenge their robust operation. Fluctuations result from processes as different as dynamically changing demands, energy trading, and an increasing share of renewable power feed-in. Here we analyze principles underlying the dynamics and statistics of power grid frequency fluctuations. Considering frequency time series for a range of power grids, including grids in North America, Japan and Europe, we find a substantial deviation from Gaussianity best described as Lévy-stable and q-Gaussian distributions. We present a coarse framework to analytically characterize the impact of arbitrary noise distributions as well as a superstatistical approach which systematically interprets heavy tails and skewed distributions. We identify energy trading as a substantial contribution to today's frequency fluctuations and effective damping of the grid as a controlling factor enabling reduction of fluctuation risks, with enhanced effects for small power grids.

physics.data-an↗

A Quantum Model for Coherent Ising Machine: Stochastic Differential Equations with Replicator Dynamics

The quantum theory of coherent Ising machines, based on degenerate optical parametric oscillators and measurement-feedback circuits, is developed using the positive $P(α,β)$ representation of the density operator and the master equation. The theory is composed of the c-number stochastic differential equations for describing open dissipative quantum dynamics and the replicator dynamics equations for handling measurement-induced collapse of the density operator. We apply the present theory to simulate two simple Ising spin models and elucidate the unique features of this computing machine.

quant-ph↗

A Quantum Model for Coherent Ising Machines: Discrete-time Measurement Feedback Formulation

Recently, the coherent Ising machine (CIM) as a degenerate optical parametric oscillator (DOPO) network has been researched to solve Ising combinatorial optimization problems. We formulate a theoretical model for the CIM with discrete-time measurement feedback processes, and perform numerical simulations for the simplest network, composed of two degenerate optical parametric oscillator pulses with the anti-ferromagnetic mutual coupling. We evaluate the extent to which quantum coherence exists during the optimization process.

quant-ph↗

Hawkes process model with a time-dependent background rate and its application to high-frequency financial data

A Hawkes process model with a time-varying background rate is developed for analyzing the high-frequency financial data. In our model, the logarithm of the background rate is modeled by a linear model with a relatively large number of variable-width basis functions, and the parameters are estimated by a Bayesian method. Our model can capture not only the slow time-variation, such as in the intraday seasonality, but also the rapid one, which follows a macroeconomic news announcement. By analyzing the tick data of the Nikkei 225 mini, we find that (i) our model is better fitted to the data than the Hawkes models with a constant background rate or a slowly varying background rate, which have been commonly used in the field of quantitative finance; (ii) the improvement in the goodness-of-fit to the data by our model is significant especially for sessions where considerable fluctuation of the background rate is present; and (iii) our model is statistically consistent with the data. The branching ratio, which quantifies the level of the endogeneity of markets, estimated by our model is 0.41, suggesting the relative importance of exogenous factors in the market dynamics. We also demonstrate that it is critically important to appropriately model the time-dependent background rate for the branching ratio estimation.

q-fin.ST↗

Performance evaluation of coherent Ising machines against classical neural networks

The coherent Ising machine is expected to find a near-optimal solution in various combinatorial optimization problems, which has been experimentally confirmed with optical parametric oscillators (OPOs) and a field programmable gate array (FPGA) circuit. The similar mathematical models were proposed three decades ago by J. J. Hopfield, et al. in the context of classical neural networks. In this article, we compare the computational performance of both models.

quant-ph↗

Partially unstable attractors in networks of forced integrate-and-fire oscillators

The asymptotic attractors of a nonlinear dynamical system play a key role in the long-term physically observable behaviors of the system. The study of attractors and the search for distinct types of attractor have been a central task in nonlinear dynamics. In smooth dynamical systems, an attractor is often enclosed completely in its basin of attraction with a finite distance from the basin boundary. Recent works have uncovered that, in neuronal networks, unstable attractors with a remote basin can arise, where almost every point on the attractor is locally transversely repelling. Herewith we report our discovery of a class of attractors: partially unstable attractors, in pulse-coupled integrate-and-fire networks subject to a periodic forcing. The defining feature of such an attractor is that it can simultaneously possess locally stable and unstable sets, both of positive measure. Exploiting the structure of the key dynamical events in the network, we develop a symbolic analysis that can fully explain the emergence of the partially unstable attractors. To our knowledge, such exotic attractors have not been reported previously, and we expect them to arise commonly in biological networks whose dynamics are governed by pulse (or spike) generation.

nlin.CD↗

Balancing specificity, sensitivity and speed of ligand discrimination by zero-order ultraspecificity

Specific interactions between receptors and their target ligands in the presence of non-target ligands are crucial for biological processes such as T cell ligand discrimination. To discriminate between the target and non-target ligands, cells have to increase specificity by amplifying the small differences in affinity among ligands. In addition, sensitivity to ligand concentration and quick discrimination are also important to detect low amounts of target ligands and facilitate fast cellular decision making after ligand recognition. In this work, we find that ultraspecificity is naturally derived from a well-known mechanism for zero-order ultrasensitivity to concentration. We also show that this mechanism can produce an optimal balance of specificity, sensitivity, and quick discrimination. Furthermore, we show that a model for insensitivity to large number of non-terget ligands can be naturally derived from the ultraspecificity model. Zero-order ultraspecificity may provide alternative way to understand ligand discrimination from the viewpoint of the nonlinear properties of biochemical reactions.

q-bio.MN↗

Contribution of hidden modes to nonlinear epidemic dynamics in urban human proximity networks

Recently developed techniques to acquire high-quality human mobility data allow large-scale simulations of the spread of infectious diseases with high spatial and temporal resolution.Analysis of such data has revealed the oversimplification of existing theoretical frameworks to infer the final epidemic size or influential nodes from the network topology. Here we propose a spectral decomposition-based framework for the quantitative analysis of epidemic processes on realistic networks of human proximity derived from urban mobility data. Common wisdom suggests that modes with larger eigenvalues contribute more to the epidemic dynamics. However, we show that hidden dominant structures, namely modes with smaller eigenvalues but a greater contribution to the epidemic dynamics, exist in the proximity network. This framework provides a basic understanding of the relationship between urban human motion and epidemic dynamics, and will contribute to strategic mitigation policy decisions.

physics.soc-ph↗

Smoothing effect for spatially distributed renewable resources and its impact on power grid robustness

In this paper, we show that spatial correlation of renewable energy outputs greatly influences the robustness of power grids. First, we propose a new index for the spatial correlation among renewable energy outputs. We find that the spatial correlation of renewable energy outputs in a short time-scale is as weak as that caused by independent random variables and that in a long time-scale is as strong as that under perfect synchronization. Then, by employing the topology of the power grid in eastern Japan, we analyze the robustness of the power grid with spatial correlation of renewable energy outputs. The analysis is performed by using a realistic differential-algebraic equations model and the result shows that the spatial correlation of the energy resources strongly degrades the robustness of the power grid. Our result suggests that the spatial correlation of the renewable energy outputs should be taken into account when estimating the stability of power grids.

physics.soc-ph↗

Bifurcations and strange nonchaotic attractors in a phase oscillator model of glacial-interglacial cycles

Glacial-interglacial cycles are large variations in continental ice mass and greenhouse gases, which have dominated climate variability over the Quaternary. The dominant periodicity of the cycles is $\sim $40 kyr before the so-called middle Pleistocene transition between $\sim$1.2 and $\sim$0.7 Myr ago, and it is $\sim $100 kyr after the transition. In this paper, the dynamics of glacial-interglacial cycles are investigated using a phase oscillator model forced by the time-varying incoming solar radiation (insolation). We analyze the bifurcations of the system and show that strange nonchaotic attractors appear through nonsmooth saddle-node bifurcations of tori. The bifurcation analysis indicates that mode-locking is likely to occur for the 41 kyr glacial cycles but not likely for the 100 kyr glacial cycles. The sequence of mode-locked 41 kyr cycles is robust to small parameter changes. However, the sequence of 100 kyr glacial cycles can be sensitive to parameter changes when the system has a strange nonchaotic attractor.

nlin.CD↗