Searcharxiv⌕ Search

arXiv subjects

Masayuki Ohzeki

Publications and source records attributed to Masayuki Ohzeki.

At least 73 records · Page 4Linked to original sources

Existence of long-range order in random-field Ising model on Dyson hierarchical lattice

We study the random-field Ising model on a Dyson hierarchical lattice, where the interactions decay in a power-law-like form, $J(r)\sim r^{-α}$, with respect to the distance. Without a random field, the Ising model on the Dyson hierarchical lattice has a long-range order at finite low temperatures when $1<α<2$. In this study, for $1<α<3/2$, we rigorously prove that there is a long-range order in the random-field Ising model on the Dyson hierarchical lattice at finite low temperatures, including zero temperature, when the strength of the random field is sufficiently small but nonzero. Our proof is based on Dyson's method for the case without a random field, and the concentration inequalities in probability theory enable us to evaluate the effect of a random field.

math-ph↗

Relaxation-assisted reverse annealing on nonnegative/binary matrix factorization

Quantum annealing has garnered significant attention as meta-heuristics inspired by quantum physics for combinatorial optimization problems. Among its many applications, nonnegative/binary matrix factorization stands out for its complexity and relevance in unsupervised machine learning. The use of reverse annealing, a derivative procedure of quantum annealing to prioritize the search in a vicinity under a given initial state, helps improve its optimization performance in matrix factorization. This study proposes an improved strategy that integrates reverse annealing with a linear programming relaxation technique. Using relaxed solutions as the initial configuration for reverse annealing, we demonstrate improvements in optimization performance comparable to the exact optimization methods. Our experiments on facial image datasets show that our method provides better convergence than known reverse annealing methods. Furthermore, we investigate the effectiveness of relaxation-based initialization methods on randomized datasets, demonstrating a relationship between the relaxed solution and the optimal solution. This research underscores the potential of combining reverse annealing and classical optimization strategies to enhance optimization performance.

quant-ph↗

Schödinger Bridge Type Diffusion Models as an Extension of Variational Autoencoders

Generative diffusion models use time-forward and backward stochastic differential equations to connect the data and prior distributions. While conventional diffusion models (e.g., score-based models) only learn the backward process, more flexible frameworks have been proposed to also learn the forward process by employing the Schrödinger bridge (SB). However, due to the complexity of the mathematical structure behind SB-type models, we can not easily give an intuitive understanding of their objective function. In this work, we propose a unified framework to construct diffusion models by reinterpreting the SB-type models as an extension of variational autoencoders. In this context, the data processing inequality plays a crucial role. As a result, we find that the objective function consists of the prior loss and drift matching parts.

cs.LG↗

Quadratic Unconstrained Binary Formulation for Traffic Signal Optimization on Real-World Maps

The D-Wave quantum annealing machine can quickly find the optimal solution for quadratic unconstrained binary optimization (QUBO). One of the applications where the use of quantum annealing is desired is in problems requiring rapid calculations. One such application is the traffic signal optimization. Several studies have used quantum annealing; however, they are formulated in relatively unrealistic settings, such as only crossroads on a map. We propose a different formulation of QUBO that can also deal with T-junctions and multi-forked roads. The simulation of urban mobility (SUMO) was used to validate the efficiency of our approach and verify the feasibility of real-time control using geographical information data that were very similar to the real world. Our model could reduce the waiting time at red lights for vehicles. In addition, we compared our results with those of the Gurobi Optimizer to confirm whether the D-Wave machine could find the ground state. Unfortunately, our results show that the D-Wave machine could not find the optimal solution and was slower than the Gurobi Optimizer in computation time.

quant-ph↗

Comparing the effects of Boltzmann machines as associative memory in Generative Adversarial Networks between classical and quantum sampling

We investigate the quantum effect on machine learning (ML) models exemplified by the Generative Adversarial Network (GAN), which is a promising deep learning framework. In the general GAN framework the generator maps uniform noise to a fake image. In this study, we utilize the Associative Adversarial Network (AAN), which consists of a standard GAN and an associative memory. Further, we set a Boltzmann Machine (BM), which is an undirected graphical model that learns low-dimensional features extracted from a discriminator, as the memory. Owing to difficulty calculating the BM's log-likelihood gradient, it is necessary to approximate it by using the sample mean obtained from the BM, which has tentative parameters. To calculate the sample mean, a Markov Chain Monte Carlo (MCMC) is often used. In a previous study, this was performed using a quantum annealer device, and the performance of the "Quantum" AAN was compared to that of the standard GAN. However, its better performance than the standard GAN is not well understood. In this study, we introduce two methods to draw samples: classical sampling via MCMC and quantum sampling via quantum Monte Carlo (QMC) simulation, which is quantum simulation on the classical computer. Then, we compare these methods to investigate whether quantum sampling is advantageous. Specifically, calculating the discriminator loss, the generator loss, inception score and Fréchet inception distance, we discuss the possibility of AAN. We show that the AANs trained by both MCMC and QMC are more stable during training and produce more varied images than the standard GANs. However, the results indicate no difference in sampling by QMC simulation compared to that by MCMC.

cond-mat.dis-nn↗

Solution space and storage capacity of fully connected two-layer neural networks with generic activation functions

The storage capacity of a binary classification model is the maximum number of random input-output pairs per parameter that the model can learn. It is one of the indicators of the expressive power of machine learning models and is important for comparing the performance of various models. In this study, we analyze the structure of the solution space and the storage capacity of fully connected two-layer neural networks with general activation functions using the replica method from statistical physics. Our results demonstrate that the storage capacity per parameter remains finite even with infinite width and that the weights of the network exhibit negative correlations, leading to a 'division of labor'. In addition, we find that increasing the dataset size triggers a phase transition at a certain transition point where the permutation symmetry of weights is broken, resulting in the solution space splitting into disjoint regions. We identify the dependence of this transition point and the storage capacity on the choice of activation function. These findings contribute to understanding the influence of activation functions and the number of parameters on the structure of the solution space, potentially offering insights for selecting appropriate architectures based on specific objectives.

cond-mat.dis-nn↗

Replica bound for Ising spin glass models in one dimension

The interpolation method is a powerful tool for rigorous analysis of mean-field spin glass models, both with and without dilution. In this study, we show that the interpolation method can be applied to Ising spin glass models in one dimension, such as a one-dimensional chain and a two-leg ladder. In one dimension, the replica symmetric (RS) cavity method is naturally expected to be rigorous for Ising spin glass models. Using the interpolation method, we rigorously prove that the RS cavity method provides lower bounds on the quenched free energies of Ising spin glass models in one dimension at any finite temperature in the thermodynamic limit.

cond-mat.dis-nn↗

Routing and Scheduling Optimization for Urban Air Mobility Fleet Management using Quantum Annealing

The growing integration of urban air mobility (UAM) for urban transportation and delivery has accelerated due to increasing traffic congestion and its environmental and economic repercussions. Efficiently managing the anticipated high-density air traffic in cities is critical to ensure safe and effective operations. In this study, we propose a routing and scheduling framework to address the needs of a large fleet of UAM vehicles operating in urban areas. Using mathematical optimization techniques, we plan efficient and deconflicted routes for a fleet of vehicles. Formulating route planning as a maximum weighted independent set problem enables us to utilize various algorithms and specialized optimization hardware, such as quantum annealers, which has seen substantial progress in recent years. Our method is validated using a traffic management simulator tailored for the airspace in Singapore. Our approach enhances airspace utilization by distributing traffic throughout a region. This study broadens the potential applications of optimization techniques in UAM traffic management.

quant-ph↗

Toward mean-field bound for critical temperature on Nishimori line

The critical inverse temperature of the mean-field approximation establishes a lower bound of the true critical inverse temperature in a broad class of ferromagnetic spin models. This is referred to as the mean-field bound for the critical temperature. In this study, we explored the possibility of a corresponding mean-field bound for the critical temperature in Ising spin glass models with Gaussian randomness on the Nishimori line. On this line, the critical inverse temperature of the mean-field approximation is given by $β_{MF}^{NL}=\sqrt{1/z}$, where $z$ is the coordination number. Using the Griffiths inequalities on the Nishimori line, we proved that there is zero spontaneous magnetization in the high-temperature region $β< β_{MF}^{NL}/2$. In other words, the true critical inverse temperature $β_c^{NL}$ on the Nishimori line is always bounded by $β_c^{NL} \ge β_{MF}^{NL}/2$. Unfortunately, we have not succeeded in obtaining the corresponding mean-field bound $β_c^{NL} \ge β_{MF}^{NL}$ on the Nishimori line.

cond-mat.dis-nn↗

Phase transition in binary compressed sensing based on $L_{1}$-norm minimization

Compressed sensing is a signal processing scheme that reconstructs high-dimensional sparse signals from a limited number of observations. In recent years, various problems involving signals with a finite number of discrete values have been attracting attention in the field of compressed sensing. In particular, binary compressed sensing, which restricts signal elements to binary values $\{0, 1\}$, is the most fundamental and straightforward analysis subject in such problem settings. We evaluate the typical performance of noiseless binary compressed sensing based on $L_{1}$-norm minimization using the replica method, a statistical mechanical approach. We analyze a general setting where the elements of the observation matrix follow a Gaussian distribution, including a non-zero mean. We demonstrate that the biased observation matrix indicates more reconstruction success conditions in binary compressed sensing. Our results are consistent with the outcomes of several prior studies.

cond-mat.stat-mech↗

Duality analysis in symmetric group and its application to random tensor network model

The Ising model is the simplest to describe many-body effects in classical statistical mechanics. Duality analysis leads to a critical point under several assumptions. The Ising model itself has $Z(2)$ symmetry. The basis of the duality analysis is a nontrivial relationship between low and high-temperature expansions. However, the discrete Fourier transformation finds the hidden relationship automatically. The duality analysis can be naturally generalized into the case with the degrees of freedom with $Z(q)$ symmetry and random spin systems. We further obtain the duality in a series of permutation models in the present study by considering the symmetric group $S_q$ and its Fourier transformation. The permutation model in the symmetric group is closely related to the random quantum circuits and random tensor network model, often discussed in the context of quantum computing and the holographic principle, a property of string theories and quantum gravity. We provide a systematic way by our duality analysis to analyze the phase transition in these models.

quant-ph↗

Reconsideration of optimization for reduction of traffic congestion

One of the most impressive applications of a quantum annealer was optimizing a group of Volkswagen to reduce traffic congestion using a D-Wave system. A simple formulation of a quadratic term was proposed to reduce traffic congestion. This quadratic term was useful for determining the shortest routes among several candidates. The original formulation produced decreases in the total lengths of car tours and traffic congestion. In this study, we reformulated the cost function with the sole focus on reducing traffic congestion. We then found a unique cost function for expressing the quadratic function with a dead zone and an inequality constraint.

cond-mat.dis-nn↗

Magnetic order in nanoscale gyroid networks

Three-dimensional magnetic metamaterials feature interesting phenomena that arise from a delicate interplay of material properties, local anisotropy, curvature, and connectivity. A particularly interesting magnetic lattice that combines these aspects is that of nanoscale gyroids, with a highly-interconnected chiral network with local three-connectivity reminiscent of three-dimensional artificial spin ices. Here, we use finite-element micromagnetic simulations to elucidate the anisotropic behaviour of nanoscale nickel gyroid networks at applied fields and at remanence. We simplify the description of the micromagnetic spin states with a macrospin model to explain the anistropic global response, to quantify the extent of ice-like correlations, and to discuss qualitative features of the anisotropic magnetoresistance in the three-dimensional network. Our results demonstrate the large variability of the magnetic order in extended gyroid networks, which might enable future spintronic functionalities, including neuromorphic computing and non-reciprocal transport.

cond-mat.mes-hall↗

Statistical Mechanics Calculations Using Variational Autoregressive Networks and Quantum Annealing

In statistical mechanics, computing the partition function is generally difficult. An approximation method using a variational autoregressive network (VAN) has been proposed recently. This approach offers the advantage of directly calculating the generation probabilities while obtaining a significantly large number of samples. The present study introduces a novel approximation method that employs samples derived from quantum annealing machines in conjunction with VAN, which are empirically assumed to adhere to the Gibbs-Boltzmann distribution. When applied to the finite-size Sherrington-Kirkpatrick model, the proposed method demonstrates enhanced accuracy compared to the traditional VAN approach and other approximate methods, such as the widely utilized naive mean field.

cond-mat.dis-nn↗

Application of time-series quantum generative model to financial data

Despite proposing a quantum generative model for time series that successfully learns correlated series with multiple Brownian motions, the model has not been adapted and evaluated for financial problems. In this study, a time-series generative model was applied as a quantum generative model to actual financial data. Future data for two correlated time series were generated and compared with classical methods such as long short-term memory and vector autoregression. Furthermore, numerical experiments were performed to complete missing values. Based on the results, we evaluated the practical applications of the time-series quantum generation model. It was observed that fewer parameter values were required compared with the classical method. In addition, the quantum time-series generation model was feasible for both stationary and nonstationary data. These results suggest that several parameters can be applied to various types of time-series data.

quant-ph↗

Storage Capacity Evaluation of the Quantum Perceptron using the Replica Method

We investigate a quantum perceptron implemented on a quantum circuit using a repeat until method. We evaluate this from the perspective of capacity, one of the performance evaluation measures for perceptions. We assess a Gardner volume, defined as a volume of coefficients of the perceptron that can correctly classify given training examples using the replica method. The model is defined on the quantum circuit. Nevertheless, it is straightforward to assess the capacity using the replica method, which is a standard method in classical statistical mechanics. The reason why we can solve our model by the replica method is the repeat until method, in which we focus on the output of the measurements of the quantum circuit. We find that the capacity of a quantum perceptron is larger than that of a classical perceptron since the quantum one is simple but effectively falls into a highly nonlinear form of the activation function.

cond-mat.dis-nn↗

Spatio-temporal reconstruction of substance dynamics using compressed sensing in multi-spectral magnetic resonance spectroscopic imaging

The objective of our study is to observe dynamics of multiple substances in vivo with high temporal resolution from multi-spectral magnetic resonance spectroscopic imaging (MRSI) data. The multi-spectral MRSI can effectively separate spectral peaks of multiple substances and is useful to measure spatial distributions of substances. However it is difficult to measure time-varying substance distributions directly by ordinary full sampling because the measurement requires a significantly long time. In this study, we propose a novel method to reconstruct the spatio-temporal distributions of substances from randomly undersampled multi-spectral MRSI data on the basis of compressed sensing (CS) and the partially separable function model with base spectra of substances. In our method, we have employed spatio-temporal sparsity and temporal smoothness of the substance distributions as prior knowledge to perform CS. The effectiveness of our method has been evaluated using phantom data sets of glass tubes filled with glucose or lactate solution in increasing amounts over time and animal data sets of a tumor-bearing mouse to observe the metabolic dynamics involved in the Warburg effect in vivo. The reconstructed results are consistent with the expected behaviors, showing that our method can reconstruct the spatio-temporal distribution of substances with a temporal resolution of four seconds which is extremely short time scale compared with that of full sampling. Since this method utilizes only prior knowledge naturally assumed for the spatio-temporal distributions of substances and is independent of the number of the spectral and spatial dimensions or the acquisition sequence of MRSI, it is expected to contribute to revealing the underlying substance dynamics in MRSI data already acquired or to be acquired in the future.

eess.SP↗

Random Postprocessing for Combinatorial Bayesian Optimization

Model-based sequential approaches to discrete "black-box" optimization, including Bayesian optimization techniques, often access the same points multiple times for a given objective function in interest, resulting in many steps to find the global optimum. Here, we numerically study the effect of a postprocessing method on Bayesian optimization that strictly prohibits duplicated samples in the dataset. We find the postprocessing method significantly reduces the number of sequential steps to find the global optimum, especially when the acquisition function is of maximum a posterior estimation. Our results provide a simple but general strategy to solve the slow convergence of Bayesian optimization for high-dimensional problems.

cs.LG↗