SearcharxivSearch

arXiv subjects

Takashi Tsuchiya

Publications and source records attributed to Takashi Tsuchiya.

At least 19 recordsLinked to original sources

Spoken Digit Recognition and Speaker Classification by Nonlinear Interfered Spin Wave-Based Physical Reservoir Computing

Recently, artificial-intelligence (AI) technologies have been increasingly utilized in a wide range of real-world applications. Speech recognition is one of these practical AI tasks and is regarded as a key application for edge AI systems. Consequently, speech recognition has been widely employed as a representative benchmark task for assessing the performance of physical reservoir computing (PRC). Although many PRCs have performed this task, the majority of them rely on the frequency-extraction preprocessing method, such as a cochleagram and mel-frequency cepstrum. Especially about the cochleagram, this method enables high-accuracy recognition; however, it requires a substantial computational cost for preprocessing and is unsuitable for edge computing, due to the limited resources. In this study, we employed a nonlinear interfered spin wave-based PRC, which demonstrated superior computational performance in mathematical tasks. Using this PRC, we evaluated the performance for two types of speech recognition, spoken digit recognition and speaker classification under four configurations: cochleagram-alone, interfered spin wave-based PRC with cochleagram, baseline without PRC, and interfered spin wave-based PRC alone to quantify the contributions of the cochleagram and of the interfered spin wave-based PRC for each task. As a result, although the cochleagram alone yielded accuracies around 90 % for both tasks, the accuracy reached 85.8 % for speaker classification when only the interfered spin wave-based PRC was used. These results indicate the potential of the proposed PRC to handle speech recognition tasks without cochleagram preprocessing.

physics.app-ph

Spectral dynamics reservoir computing for high-speed hardware-efficient neuromorphic processing

Physical reservoir computing (PRC) is a promising brain-inspired computing architecture for overcoming the von Neumann bottleneck by utilizing the intrinsic dynamics of physical systems. However, a major obstacle to its real-world implementation lies in the tension between extracting sufficient information for high computational performance and maintaining a hardware-feasible, high-speed architecture. Here, we report spectral dynamics reservoir computing (SDRC), a broadly applicable framework based on analogue filtering and envelope detection that bridges this gap. SDRC effectively exploits the fast spectral dynamics embedded in short-time, coarse spectra of material responses to attain strong computational capability while maintaining high-speed processing and minimal hardware overhead. This approach circumvents the need for implementation-intensive, precision-sensitive integrated circuits required in high-speed time-multiplexing measurements, while enabling real-time use of the material's spectral manifold as a high-dimensional computational resource. We implement and experimentally demonstrate SDRC applied to spin waves that achieves state-of-the-art-level performance with only 56 nodes on benchmark tasks of parity-check and second-order nonlinear autoregressive moving average, as well as high accuracy of 98.0% on a real-world problem of speech recognition.

cs.ET

Computational Dating for the Nuzi Cuneiform Archive: The Least Squares Constrained by Family Trees and Synchronisms

We introduce a computational method of dating for an archive in ancient Mesopotamia. We use the name index Nuzi Personal Names (NPN) published in 1943. We made an electronic version of NPN and added the kinships of the two powerful families to NPN to reflect the Nuzi studies after 1943. Nuzi is a town from the 15th - 14th century B.C.E.for a period of some five generations in Arrapha. The cuneiform tablets listed in NPN are for contracts on land transactions, marriage, loans, slavery, etc. In NPN, the kinships and cuneiform tablets (contracts, documents, texts) involved are listed for each person. We reconstruct family trees from the added NPN to formulate the least squares problem with the constraints: a person's father is at least 22.5 years older than the person, contractors were living at the time of the contract, etc. Our results agree with the Assyriological results of M. P. Maidman on the seniority among siblings of a powerful family. Our method could be applied to the other clay tablet archives once we have the name index in the format of NPN.

cs.DL

Multi-time scale and high performance in-material reservoir computing using graphene-based ion-gating reservoir

The rising energy demands of conventional AI systems underscore the need for efficient computing technologies like brain-inspired computing. Physical reservoir computing (PRC), leveraging the nonlinear dynamics of physical systems for information processing, has emerged as a promising approach for neuromorphic computing. However, current PRC systems are constrained by narrow operating timescales and limited performance. To address these challenges, an ion-gel/graphene electric double layer transistor-based ion-gating reservoir (IGR) was developed, offering adaptability across multi-time scales with an exceptionally wide operating range from 1 MHz to 20 Hz and high information processing capacity. The IGR achieved deep learning (DL)-level accuracy in chaotic time series prediction tasks while reducing computational resource requirements to 1/100 of those needed by DL. Principal component analysis reveals the IGR's superior performance stems from its high-dimensionality, driven by the ambipolar behavior of graphene and multiple relaxation processes. The proposed IGR represents a significant step forward in providing low-power, high-performance computing solutions, particularly for resource-constrained edge environments.

physics.app-ph

Enhancing Top Efficiency by Minimizing Second-Best Scores: A Novel Perspective on Super Efficiency Models in DEA

In this paper, we reveal a new characterization of the super-efficiency model for Data Envelopment Analysis (DEA). In DEA, the efficiency of each decision making unit (DMU) is measured by the ratio the weighted sum of outputs divided by the weighted sum of inputs. In order to measure efficiency of a DMU, ${\rm DMU}_j$, say, in CCR model, the weights of inputs and outputs are determined so that the effiency of ${\rm DMU}_j$ is maximized under the constraint that the efficiency of each DMU is less than or equal to one. ${\rm DMU}_j$ is called CCR-efficient if its efficiency score is equal to one. It often happens that weights making ${\rm DMU}_j$ CCR-efficient are not unique but form continuous set. This can be problematic because the weights representing CCR-efficiencty of ${\rm DMU}_j$ play an important role in making decisions on its management strategy. In order to resolve this problem, we propose to choose weights which minimize the efficency of the second best DMU enhancing the strength of ${\rm DMU}_j$, and demonstrate that this problem is reduced to a linear programming problem identical to the renowned super-efficiency model. We conduct numerical experiments using data of Japanese commercial banks to demonstrate the advantage of the supper-efficiency model.

math.OC

A high-performance deep reservoir computing experimentally demonstrated with ion-gating reservoirs

While physical reservoir computing (PRC) is a promising way to achieve low power consumption neuromorphic computing, its computational performance is still insufficient at a practical level. One promising approach to improving PRC performance is deep reservoir computing (deep-RC), in which the component reservoirs are multi-layered. However, all of the deep-RC schemes reported so far have been effective only for simulation reservoirs and limited PRCs, and there have been no reports of nanodevice implementations. Here, as the first nanodevice implementation of Deep-RC, we report a demonstration of deep physical reservoir computing using an ion gating reservoir (IGR), which is a small and high-performance physical reservoir. While previously reported Deep-RC scheme did not improve the performance of IGR, our Deep-IGR achieved a normalized mean squared error of 0.0092 on a second-order nonlinear autoregressive moving average task, with is the best performance of any physical reservoir so far reported. More importantly, the device outperformed full simulation reservoir computing. The dramatic performance improvement of the IGR with our deep-RC architecture paves the way for high-performance, large-scale, physical neural network devices.

physics.app-ph

Few-molecule reservoir computing experimentally demonstrated with surface enhanced Raman scattering and ion-gating stimulation

Reservoir computing (RC) is a promising solution for achieving low power consumption neuromorphic computing, although the large volume of the physical reservoirs reported to date has been a serious drawback in their practical application. Here, we report the development of a few-molecule RC that employs the molecular vibration dynamics in the para-mercaptobenzoic acid (pMBA) detected by surface enhanced Raman scattering (SERS) with tungsten oxide nanorod/silver nanoparticles (WOx@Ag-NPs). The Raman signals of the pMBA molecules, adsorbed at the SERS active site of WOx@Ag-NPs, were reversibly perturbated by the application of voltage-induced local pH changes in the vicinity of the molecules, and then used to perform RC of pattern recognition and prediction tasks. In spite of the small number of molecules employed, our system achieved good performance, including 95.1% to 97.7% accuracy in various nonlinear waveform transformations and 94.3% accuracy in solving a second-order nonlinear dynamic equation task. Our work provides a new concept of molecular computing with practical computation capabilities.

physics.app-ph

Closing Duality Gaps of SDPs through Perturbation

Let $({\bf P},{\bf D})$ be a primal-dual pair of SDPs with a nonzero finite duality gap. Under such circumstances, ${\bf P}$ and ${\bf D}$ are weakly feasible and if we perturb the problem data to recover strong feasibility, the (common) optimal value function $v$ as a function of the perturbation is not well-defined at zero (unperturbed data) since there are ``two different optimal values'' $v({\bf P})$ and $v({\bf D})$, where $v({\bf P})$ and $v({\bf D})$ are the optimal values of ${\bf P}$ and ${\bf D}$ respectively. Thus, continuity of $v$ is lost at zero though $v$ is continuous elsewhere. Nevertheless, we show that a limiting version ${v_a}$ of $v$ is a well-defined monotone decreasing continuous bijective function connecting $v({\bf P})$ and $v({\bf D})$ with domain $[0, π/2]$ under the assumption that both ${\bf P}$ and ${\bf D}$ have singularity degree one. The domain $[0,π/2]$ corresponds to directions of perturbation defined in a certain manner. Thus, ${v_a}$ ``completely fills'' the nonzero duality gap under a mild regularity condition. Our result is tight in that there exists an instance with singularity degree two for which ${v_a}$ is not continuous.

math.OC

A Limiting Analysis on Regularization of Singular SDP and its Implication to Infeasible Interior-point Algorithms

We consider primal-dual pairs of semidefinite programs and assume that they are ill-posed, i.e., both primal and dual are either weakly feasible or weakly infeasible. Under such circumstances, strong duality may break down and the primal and dual might have a nonzero duality gap. Nevertheless, there are arbitrary small perturbations to the problem data which makes the perturbed primal-dual pair strongly feasible thus zeroing the duality gap. In this paper, we conduct an asymptotic analysis of the optimal value as the perturbation is driven to zero. Specifically, we fix two positive definite matrices (typically the identity matrices), and shift the associated affine spaces of the primal and dual slightly in the direction of the two positive definite matrices possibly in a different proportion so that the perturbed problems have interior feasible solutions, and analyze the behavior of the optimal value of the perturbed problem when the perturbation is reduced to zero keeping the proportion. A key feature of our analysis is that no further assumptions such as compactness or constraint qualifications are ever made. It will be shown that the optimal value of the perturbed problem converges to a value between the primal and dual optimal values of the original problem. Finally, the analysis leads us to the relatively surprising consequence that the infeasible interior-point algorithms for SDP generates a sequence converging to a number between the primal and dual optimal values, even in the presence of a nonzero duality gap. We expect that this property might be particularly useful in solving mixed integer SDPs with infeasible interior-point methods.

math.OC

A Redox-based Ion-Gating Reservoir, Utilizing Double Reservoir States in Drain and Gate Nonlinear Responses

We have demonstrated physical reservoir computing with a redox-based ion-gating reservoir (redox-IGR) comprising LixWO3 thin film and lithium ion conducting glass ceramic (LICGC). The subject redox-IGR successfully solved a second-order nonlinear dynamic equation by utilizing voltage pulse driven ion-gating in a LixWO3 channel to enable reservoir computing. Under the normal conditions, in which only the drain current (ID) is used for the reservoir states, the lowest prediction error is 7.39x10-4. Performance was enhanced by the addition of IG to the reservoir states, resulting in a significant lowering of the prediction error to 5.06x10-4, which is noticeably lower than other types of physical reservoirs reported to date. A second-order nonlinear autoregressive moving average (NARMA2) task, a typical benchmark of reservoir computing, was also performed with the IGR and good performance was achieved, with an NMSE of 0.163. A short-term memory task was performed to investigate an enhancement mechanism resulting from the IG addition. An increase in memory capacity, from 1.87 without IG to 2.73 with IG, was observed in the forgetting curves, indicating that enhancement of both high dimensionality and memory capacity are attributed to the origin of the performance improvement.

cond-mat.mtrl-sci

Experimental Demonstration of High-Performance Physical Reservoir Computing with Nonlinear Interfered Spin Wave Multi-Detection

Physical reservoir computing, which is a promising method for the implementation of highly efficient artificial intelligence devices, requires a physical system with nonlinearity, fading memory, and the ability to map in high dimensions. Although it is expected that spin wave interference can perform as highly efficient reservoir computing in some micromagnetic simulations, there has been no experimental verification to date. Herein, we demonstrate reservoir computing that utilizes multidetected nonlinear spin wave interference in an yttrium iron garnet single crystal. The subject computing system achieved excellent performance when used for hand-written digit recognition, second-order nonlinear dynamical tasks, and nonlinear autoregressive moving average (NARMA). It is of particular note that normalized mean square errors (NMSEs) for NARMA2 and second-order nonlinear dynamical tasks were 1.81x10-2 and 8.37x10-5, respectively, which are the lowest figures for any experimental physical reservoir so far reported. Said high performance was achieved with higher nonlinearity and the large memory capacity of interfered spin wave multi-detection.

cs.ET

Edge-Of-Chaos Learning Achieved by Ion-Electron Coupled Dynamics in an Ion-Gating Reservoir

Physical reservoir computing has recently been attracting attention for its ability to significantly reduce the computational resources required to process time-series data. However, the physical reservoirs that have been reported to date have had insufficient expression power, and most of them have a large volume, which makes their practical application difficult. Herein we describe the development of a Li+-electrolyte based ion-gating reservoir (IGR), with ion-electron coupled dynamics, for use in high performance physical reservoir computing. A variety of synaptic responses were obtained in response to past experience, which responses were stored as transient charge density patterns in an electric double layer, at the Li+-electrolyte/diamond interface. Performance, which was tested using a nonlinear autoregressive moving-average (NARMA) task, was found to be excellent, with a NMSE of 0.023 for NARMA2, which is the highest for any physical reservoir reported to date. The maximum Lyapunov exponent of the IGR was 0.0083: the edge of chaos state enabling the best computational capacity. The IGR described herein opens the way for high-performance and integrated neural network devices.

cs.ET

Solving SDP Completely with an Interior Point Oracle

We suppose the existence of an oracle which solves any semidefinite programming (SDP) problem satisfying Slater's condition simultaneously at its primal and dual sides. We note that such an oracle might not be able to directly solve general SDPs even after certain regularization schemes are applied. In this work we fill this gap and show how to use such an oracle to "completely solve" an arbitrary SDP. Completely solving an SDP, includes, for example, distinguishing between weak/strong feasibility/infeasibility and detecting when the optimal value is attained or not. We will employ several tools, including a variant of facial reduction where all auxiliary problems are ensured to satisfy Slater's condition at all sides. Our main technical innovation, however, is an analysis of double facial reduction, which is the process of applying facial reduction twice: first to the original problem and then once more to the dual of the regularized problem obtained during the first run. Although our discussion is focused on semidefinite programming, the majority of the results are proved for general convex cones

math.OC

Implementation of Interior-point Methods for LP based on Krylov Subspace Iterative Solvers with Inner-iteration Preconditioning

We apply novel inner-iteration preconditioned Krylov subspace methods to the interior-point algorithm for linear programming (LP). Inner-iteration preconditioners recently proposed by Morikuni and Hayami enable us to overcome the severe ill-conditioning of linear equations solved in the final phase of interior-point iterations. The Krylov subspace methods do not suffer from rank-deficiency and therefore no preprocessing is necessary even if rows of the constraint matrix are not linearly independent. By means of these methods, a new interior-point recurrence is proposed in order to omit one matrix-vector product at each step. Extensive numerical experiments are conducted over diverse instances of 138 LP problems including the Netlib, QAPLIB, Mittelmann and Atomizer Basis Pursuit collections. The largest problem has 434,580 unknowns. It turns out that our implementation is more robust than the standard public domain solvers SeDuMi (Self-Dual Minimization), SDPT3 (Semidefinite Programming Toh-Todd-Tütüncü) and the LSMR iterative solver in PDCO (Primal-Dual Barrier Method for Convex Objectives) without increasing CPU time. The proposed interior-point method based on iterative solvers succeeds in solving a fairly large number of LP instances from benchmark libraries under the standard stopping criteria. The work also presents a fairly extensive benchmark test for several renowned solvers including direct and iterative solvers.

math.OC

An oracle-based projection and rescaling algorithm for linear semi-infinite feasibility problems and its application to SDP and SOCP

We point out that Chubanov's oracle-based algorithm for linear programming [5] can be applied almost as it is to linear semi-infinite programming (LSIP). In this note, we describe the details and prove the polynomial complexity of the algorithm based on the real computation model proposed by Blum, Shub and Smale (the BSS model) which is more suitable for floating point computation in modern computers. The adoption of the BBS model makes our description and analysis much simpler than the original one by Chubanov [5]. Then we reformulate semidefinite programming (SDP) and second-order cone programming (SOCP) into LSIP, and apply our algorithm to obtain new complexity results for computing interior feasible solutions of homogeneous SDP and SOCP.

math.OC

Facial Reduction and Partial Polyhedrality

We present FRA-Poly, a facial reduction algorithm (FRA) for conic linear programs that is sensitive to the presence of polyhedral faces in the cone. The main goals of FRA and FRA-Poly are the same, i.e., finding the minimal face containing the feasible region and detecting infeasibility, but FRA-Poly treats polyhedral constraints separately. This idea enables us to reduce the number of iterations drastically when there are many linear inequality constraints. The worst case number of iterations for FRA-poly is written in the terms of a "distance to polyhedrality" quantity and provides better bounds than FRA under mild conditions. In particular, in the case of the doubly nonnegative cone, FRA-Poly gives a worst case bound of $n$ whereas the classical FRA is $\mathcal{O}(n^2)$. Of possible independent interest, we prove a variant of Gordan-Stiemke's Theorem and a proper separation theorem that takes into account partial polyhedrality. We provide a discussion on the optimal facial reduction strategy and an instance that forces FRAs to perform many steps. We also present a few applications. In particular, we will use FRA-poly to improve the bounds recently obtained by Liu and Pataki on the dimension of certain affine subspaces which appear in weakly infeasible problems.

math.OC

An extension of Chubanov's algorithm to symmetric cones

In this work we present an extension of Chubanov's algorithm to the case of homogeneous feasibility problems over a symmetric cone K. As in Chubanov's method for linear feasibility problems, the algorithm consists of a basic procedure and a step where the solutions are confined to the intersection of a half-space and K. Following an earlier work by Kitahara and Tsuchiya on second order cone feasibility problems, progress is measured through the volumes of those intersections: when they become sufficiently small, we know it is time to stop. We never have to explicitly compute the volumes, it is only necessary to keep track of the reductions between iterations. We show this is enough to obtain concrete upper bounds to the minimum eigenvalues of a scaled version of the original feasibility problem. Another distinguishing feature of our approach is the usage of a spectral norm that takes into account the way that K is decomposed as simple cones. In several key cases, including semidefinite programming and second order cone programming, these norms make it possible to obtain better complexity bounds for the basic procedure when compared to a recent approach by Peña and Soheili. Finally, in the appendix, we present a translation of the algorithm to the homogeneous feasibility problem in semidefinite programming.

math.OC