arXiv subjects

Shu Tanaka

Publications and source records attributed to Shu Tanaka.

At least 37 records · Page 2Linked to original sources

arXiv2026

Structural Comparison of Error Mitigation Methods for Ising Machines: Penalty-Spin Model versus Stacked Model

Error-mitigation methods for Ising machines are reexamined not merely as noise-suppression techniques but as a structural design problem of replica-coupled Ising models. Using simulated annealing as a hardware-noise-free testbed, we systematically compare the penalty-spin (PS) model, which couples replicas through a centralized auxiliary layer, with the stacked model, which couples adjacent replicas directly. Numerical experiments on the quadratic assignment problem reveal that the ferromagnetically coupled stacked model stably maintains constraint satisfaction and improves solution quality over a broad parameter range, exhibiting favorable scalability with both the number of replicas and problem size. In contrast, the PS model suffers from cooperation collapse at large parallelism: many-replica averaging in the PS layer washes out sparse solution information, preventing effective inter-replica coordination. These findings demonstrate that the topology of inter-replica couplings decisively influences search robustness, and provide practical guidelines for model selection and parameter tuning in constrained optimization.

cond-mat.stat-mech↗

arXiv2025

Statistics of Min-max Normalized Eigenvalues in Random Matrices

Random matrix theory has played an important role in various areas of pure mathematics, mathematical physics, and machine learning. From a practical perspective of data science, input data are usually normalized prior to processing. Thus, this study investigates the statistical properties of min-max normalized eigenvalues in random matrices. Previously, the effective distribution for such normalized eigenvalues has been proposed. In this study, we apply it to evaluate a scaling law of the cumulative distribution. Furthermore, we derive the residual error that arises during matrix factorization of random matrices. We conducted numerical experiments to verify these theoretical predictions.

cs.LG↗

arXiv2025

Extending Sample Persistence Variable Reduction for Constrained Combinatorial Optimization Problems

Constrained combinatorial optimization problems (CCOPs) are challenging to solve due to the exponential growth of the solution space. When tackled with Ising machines, constraints are typically enforced by the penalty function method, whose coefficients must be carefully tuned to balance feasibility and objective quality. Variable-reduction techniques such as sample persistence variable reduction (SPVAR) can mitigate hardware limitations of Ising machines, yet their behavior on CCOPs remains insufficiently understood. Building on our prior proposal, we extend and comprehensively evaluate multi-penalty SPVAR (MP-SPVAR), which fixes variables using solution persistence aggregated across multiple penalty coefficients. Experiments on benchmark problems, including the quadratic assignment problem and the quadratic knapsack problem, demonstrate that MP-SPVAR attains higher feasible-solution ratios while matching or improving approximation ratios relative to the conventional SPVAR algorithm. An examination of low-energy states under small penalties clarifies when feasibility degrades and how encoding choices affect the trade-off between solution quality and feasibility. These results position MP-SPVAR as a practical variable-reduction strategy for CCOPs and lay a foundation for systematic penalty tuning, broader problem classes, and integration with quantum-inspired optimization hardware as well as quantum algorithms.

cond-mat.stat-mech↗

arXiv2025

Evaluating the Performance of Direct Higher-Order Formulations in Combinatorial Optimization Problems

Ising machines, including quantum annealing machines, are promising next-generation computers for combinatorial optimization problems. However, due to hardware limitations, most Ising-type hardware can only solve objective functions expressed in linear or quadratic terms of binary variables. Therefore, problems with higher-order terms require an order-reduction process, which increases the number of variables and constraints and may degrade solution quality. In this study, we evaluate the effectiveness of directly solving such problems without order reduction by using a high-performance simulated annealing-based optimization solver capable of handling polynomial unconstrained binary optimization (PUBO) formulations. We compare its performance against a conventional quadratic unconstrained binary optimization (QUBO) solver on the same hardware platform. As benchmarks, we use the low autocorrelation binary sequence (LABS) problem and the vehicle routing problem with distance balancing, both of which naturally include higher-order interactions. Results show that the PUBO solver consistently achieves superior solution quality and stability compared to its QUBO counterpart, while maintaining comparable computational time and requiring no order-reduction compilation indicating potential advantages of directly handling higher-order terms in practical optimization problems.

cond-mat.stat-mech↗

arXiv2025

Black-box optimization using factorization and Ising machines

Black-box optimization (BBO) is used in materials design, drug discovery, and hyperparameter tuning in machine learning. The world is experiencing several of these problems. In this review, a factorization machine with quantum annealing or with quadratic-optimization annealing (FMQA) algorithm to realize fast computations of BBO using Ising machines (IMs) is discussed. The FMQA algorithm uses a factorization machine (FM) as a surrogate model for BBO. The FM model can be directly transformed into a quadratic unconstrained binary optimization model that can be solved using IMs. This makes it possible to optimize the acquisition function in BBO, which is a difficult task using conventional methods without IMs. Consequently, it has the advantage of handling large BBO problems. To be able to perform BBO with the FMQA algorithm immediately, we introduce the FMQA algorithm along with Python packages to run it. In addition, we review examples of applications of the FMQA algorithm in various fields, including physics, chemistry, materials science, and social sciences. These successful examples include binary and integer optimization problems, as well as more general optimization problems involving graphs, networks, and strings, using a binary variational autoencoder. We believe that BBO using the FMQA algorithm will become a key technology in IMs including quantum annealers.

cond-mat.stat-mech↗

arXiv2025

Effectiveness of Hybrid Optimization Method for Quantum Annealing Machines

To enhance the performance of quantum annealing machines, several methods have been proposed to reduce the number of spins by fixing spin values through preprocessing. We proposed a hybrid optimization method that combines a simulated annealing (SA)-based non-quantum-type Ising machine with a quantum annealing machine. However, its applicability remains unclear. Therefore, we evaluated the performance of the hybrid method on large-size Ising models and analyzed its characteristics. The results indicate that the hybrid method improves upon solutions obtained by the preprocessing SA, even if the Ising models cannot be embedded in the quantum annealing machine. We analyzed the method from three perspectives: preprocessing, spin-fixed sub-Ising model generation method, and the accuracy of the quantum annealing machine. From the viewpoint of the minimum energy gap, we found that solving the sub-Ising model with a quantum annealing machine results in a higher solution accuracy than solving the original Ising model. Additionally, we demonstrated that the number of fixed spins and the accuracy of the quantum annealing machine affect the dependency of the solution accuracy on the sub-Ising model size.

cond-mat.stat-mech↗

arXiv2025

Impact of Fixing Spins in a Quantum Annealer with Energy Rescaling

Quantum annealing is a promising algorithm for solving combinatorial optimization problems. However, various hardware restrictions significantly impede its efficient performance. Size-reduction methods provide an effective approach for addressing large-scale problems but often introduce additional challenges. A notable hardware restriction is the limited number of decision variables quantum annealing can handle compared to the size of the problem. Moreover, when employing size-reduction methods, the interactions and local magnetic fields in the Ising model--used to represent the combinatorial optimization problem--can become excessively large, making them difficult to implement on hardware. Although prior studies suggest that energy rescaling impacts the performance of quantum annealing, its interplay with size-reduction methods remains unexplored. This study examines the relationship between fixing spins, a promising size-reduction method, and the effects of energy rescaling. Numerical simulations and experiments conducted on a quantum annealer demonstrate that the fixing spins method enhances quantum annealing performance while preserving the spin-chain embedding for a homogeneous, fully connected ferromagnetic Ising model.

cond-mat.stat-mech↗

arXiv2025

Quick design of feasible tensor networks for constrained combinatorial optimization

Quantum computers are expected to enable fast solving of large-scale combinatorial optimization problems. However, their limitations in fidelity and the number of qubits prevent them from handling real-world problems. Recently, a quantum-inspired solver using tensor networks has been proposed, which works on classical computers. Particularly, tensor networks have been applied to constrained combinatorial optimization problems for practical applications. By preparing a specific tensor network to sample states that satisfy constraints, feasible solutions can be searched for without the method of penalty functions. Previous studies have been based on profound physics, such as U(1) gauge schemes and high-dimensional lattice models. In this study, we devise to design feasible tensor networks using elementary mathematics without such a specific knowledge. One approach is to construct tensor networks with nilpotent-matrix manipulation. The second is to algebraically determine tensor parameters. We showed mathematically that such feasible tensor networks can be constructed to accommodate various types of constraints. For the principle verification, we numerically constructed a feasible tensor network for facility location problem, to find much faster construction than conventional methods. Then, by performing imaginary time evolution, feasible solutions were always obtained, ultimately leading to the optimal solution.

cond-mat.stat-mech↗

arXiv2025

Initialization Method for Factorization Machine Based on Low-Rank Approximation for Constructing a Corrected Approximate Ising Model

This paper presents an initialization method that can approximate a given approximate Ising model with a high degree of accuracy using a factorization machine (FM), a machine learning model. The construction of an Ising models using an FM is applied to black-box combinatorial optimization problems using factorization machine with quantum annealing (FMQA). It is anticipated that the optimization performance of FMQA will be enhanced through an implementation of the warm-start method. Nevertheless, the optimal initialization method for leveraging the warm-start approach in FMQA remains undetermined. Consequently, the present study compares initialization methods based on random initialization and low-rank approximation, and then identifies a suitable one for use with warm-start in FMQA through numerical experiments. Furthermore, the properties of the initialization method by the low-rank approximation for the FM are analyzed using random matrix theory, demonstrating that the approximation accuracy of the proposed method is not significantly influenced by the specific Ising model under consideration. The findings of this study will facilitate advancements of research in the field of black-box combinatorial optimization through the use of Ising machines.

cs.LG↗

arXiv2025

Systematic and Efficient Construction of Quadratic Unconstrained Binary Optimization Forms for High-order and Dense Interactions

Quantum Annealing (QA) can efficiently solve combinatorial optimization problems whose objective functions are represented by Quadratic Unconstrained Binary Optimization (QUBO) formulations. For broader applicability of QA, quadratization methods are used to transform higher-order problems into QUBOs. However, quadratization methods for complex problems involving Machine Learning (ML) remain largely unknown. In these problems, strong nonlinearity and dense interactions prevent conventional methods from being applied. Therefore, we model target functions by the sum of rectified linear unit bases, which not only have the ability of universal approximation, but also have an equivalent quadratic-polynomial representation. In this study, the proof of concept is verified both numerically and analytically. In addition, by combining QA with the proposed quadratization, we design a new black-box optimization scheme, in which ML surrogate regressors are inputted to QA after the quadratization process.

quant-ph↗

arXiv2025

Performance of Domain-Wall Encoding in Digital Ising Machine

To tackle combinatorial optimization problems using an Ising machine, the objective function and constraints must be mapped onto a quadratic unconstrained binary optimization (QUBO) model. While QUBO involves binary variables, combinatorial optimization problems frequently include integer variables, which require encoding by binary variables. This process, known as binary-integer encoding, includes various methods, one of which is domain-wall encoding - a recently proposed approach. Experiments on a quantum annealing machine have demonstrated that domain-wall encoding outperforms the commonly used one-hot encoding in terms of objective function value and the probability of obtaining the optimal solution. In a digital Ising machine, domain-wall encoding required less computation time to reach optimal solutions compared to one-hot encoding. However, its practical effectiveness in digital Ising machines remains unclear. To address this uncertainty, the performance of one-hot and domain-wall encoding methods was evaluated on a digital Ising machine using the quadratic knapsack problem (QKP). The comparison focused on the dependency of penalty coefficient and sensitivity to computation time. Domain-wall encoding demonstrated a higher feasible solution rate when relative penalty coefficients for the two constraint terms were adjusted, a strategy not commonly used in previous studies. Additionally, domain-wall encoding obtained higher performance practical evaluation metrics for QKPs with large knapsack capacities compared to one-hot encoding. Furthermore, it was observed to be more sensitive to computation time than one-hot encoding.

cond-mat.stat-mech↗

arXiv2025

Inductive Construction of Variational Quantum Circuit for Constrained Combinatorial Optimization

In this study, we propose a new method for constrained combinatorial optimization using variational quantum circuits. Quantum computers are considered to have the potential to solve large combinatorial optimization problems faster than classical computers. Variational quantum algorithms, such as Variational Quantum Eigensolver (VQE), have been studied extensively because they are expected to work on noisy intermediate scale devices. Unfortunately, many optimization problems have constraints, which induces infeasible solutions during VQE process. Recently, several methods for efficiently solving constrained combinatorial optimization problems have been proposed by designing a quantum circuit so as to output only the states that satisfy the constraints. However, the types of available constraints are still limited. Therefore, we have started to develop variational quantum circuits that can handle a wider range of constraints. The proposed method utilizes a forwarding operation that maps from feasible states for subproblems to those for larger subproblems. As long as appropriate forwarding operations can be defined, iteration of this process can inductively construct variational circuits outputting feasible states even in the case of multiple and complex constraints. In this paper, the proposed method was applied to facility location problem and was found to increase the probability for measuring feasible solutions or optimal solutions. In addition, the cost of the obtained circuit was comparable to that of conventional variational circuits.

quant-ph↗

arXiv2024

Advantages of fixing spins in quantum annealing

Quantum annealing can efficiently obtain solutions to combinatorial optimization problems. Size-reduction methods are used to treat large-scale combinatorial optimization problems that cannot be input directly into a quantum annealer because of its size limitation. Various size-reduction methods using fixing spins have been proposed as quantum-classical hybrid methods to obtain solutions. However, the high performance of these hybrid methods is yet to be clearly elucidated. In this study, we adopted a parameterized fixing spins method to verify the effects of fixing spins. The results revealed that setting the appropriate number of spins of the subproblem is crucial for obtaining a satisfactory solution, and the energy gap expansion is confirmed after fixing spins.

cond-mat.stat-mech↗

arXiv2024

An Ising Machine Formulation for Design Updates in Topology Optimization of Flow Channels

Topology optimization is an essential tool in computational engineering, for example, to improve the design and efficiency of flow channels. At the same time, Ising machines, including digital or quantum annealers, have been used as efficient solvers for combinatorial optimization problems. Beyond combinatorial optimization, recent works have demonstrated applicability to other engineering tasks by tailoring corresponding problem formulations. In this study, we present a novel Ising machine formulation for computing design updates during topology optimization with the goal of minimizing dissipation energy in flow channels. We explore the potential of this approach to improve the efficiency and performance of the optimization process. To this end, we conduct experiments to study the impact of various factors within the novel formulation. Additionally, we compare it to a classical method using the number of optimization steps and the final values of the objective function as indicators of the time intensity of the optimization and the performance of the resulting designs, respectively. Our findings show that the proposed update strategy can accelerate the topology optimization process while producing comparable designs. However, it tends to be less exploratory, which may lead to lower performance of the designs. These results highlight the potential of incorporating Ising formulations for optimization tasks but also show their limitations when used to compute design updates in an iterative optimization process. In conclusion, this work provides an efficient alternative for design updates in topology optimization and enhances the understanding of integrating Ising machine formulations in engineering optimization.

cs.CE↗

arXiv2024

Machine learning supported annealing for prediction of grand canonical crystal structures

This study investigates the application of Factorization Machines with Quantum Annealing (FMQA) to address the crystal structure problem (CSP) in materials science. FMQA is a black-box optimization algorithm that combines machine learning with annealing machines to find samples to a black-box function that minimize a given loss. The CSP involves determining the optimal arrangement of atoms in a material based on its chemical composition, a critical challenge in materials science. We explore FMQA's ability to efficiently sample optimal crystal configurations by setting the loss function to the energy of the crystal configuration as given by a predefined interatomic potential. Further we investigate how well the energies of the various metastable configurations, or local minima of the potential, are learned by the algorithm. Our investigation reveals FMQA's potential in quick ground state sampling and in recovering relational order between local minima.

cond-mat.mtrl-sci↗

arXiv2024

Annealing-Assisted Column Generation for Inequality-Constrained Combinatorial Optimization Problems

Ising machines are expected to solve combinatorial optimization problems faster than the existing integer programming solvers. These problems, particularly those encountered in practical situations, typically involve inequality constraints. However, owing to the hardware limitations of the current Ising machines, solving combinatorial optimization problems with inequality constraints remains challenging. The Capacitated Vehicle Routing Problem (CVRP) is a typical example of a problem with inequality constraints. The objective function of the CVRP is to minimize the total distance traveled by each vehicle while limiting the total demand of customers served by a single vehicle to the vehicle's capacity. The CVRP is classified as NP-hard and, thus, is commonly solved using heuristic algorithms, such as column generation. Column generation attempts to iteratively generate only the promising routes, as the number of feasible routes increases exponentially. Within this framework, the CVRP is formulated as a set cover problem. The corresponding dual solutions are used to define the pricing subproblem, which is intended to create a new route. By applying Ising machines to this pricing subproblem, the overall computation time can be reduced. This study aims to solve combinatorial optimization problems with inequality constraints using a hybrid algorithm that combines column generation and Ising machines, thereby extending the applications of the latter. We parameterize the difficulty of the inequality constraints and demonstrate that our annealing-assisted column generation can converge to a better lower bound.

cond-mat.stat-mech↗

arXiv2023

Hybrid Optimization Method Using Simulated-Annealing-Based Ising Machine and Quantum Annealer

Ising machines have the potential to realize fast and highly accurate solvers for combinatorial optimization problems. They are classified based on their internal algorithms. Examples include simulated-annealing-based Ising machines (non-quantum-type Ising machines) and quantum-annealing-based Ising machines (quantum annealers). Herein we propose a hybrid optimization method, which utilizes the advantages of both types. In this hybrid optimization method, the preprocessing step is performed by solving the non-quantum-annealing Ising machine multiple times. Then sub-Ising models with a reduced size by spin fixing are solved using a quantum annealer. The performance of the hybrid optimization method is evaluated via simulations using Simulated Annealing (SA) as a non-quantum-type Ising machine and D-Wave Advantage as a quantum annealer. Additionally, we investigate the parameter dependence of the proposed hybrid optimization method. The hybrid optimization method outperforms the preprocessing SA and the quantum annealing machine alone in fully connected random Ising models.

cond-mat.stat-mech↗

arXiv2023

Dynamical process of a bit-width reduced Ising model with simulated annealing

Ising machines have attracted attention as efficient solvers for combinatorial optimization problems, which are formulated as ground-state (lowest-energy) search problems of the Ising model. Due to the limited bit-width of coefficients on Ising machines, the Ising model must be transformed into a bit-width reduced (BWR) Ising model. According to previous research, the bit-width reduction method, which adds auxiliary spins, ensures that the ground state of the BWR Ising model is theoretically the same as the Ising model before bit-width reduction (original Ising model). However, while the dynamical process is closely related to solution accuracy, how the BWR Ising model progresses towards the ground state remains to be elucidated. Therefore, we compared the dynamical processes of these models using simulated annealing (SA). Our findings reveal significant differences in the dynamical process across models. Analysis from the viewpoint of statistical mechanics found that the BWR Ising model has two characteristic properties: an effective temperature and a slow relaxation. These properties alter the temperature schedule and spin flip probability in the BWR Ising model, leading to differences in the dynamical process. Therefore, to obtain the same dynamical process as the original Ising model, we proposed SA parameters for the BWR Ising model. We demonstrated the proposed SA parameters using a square lattice Ising model, in which all coefficients were set uniformly to the same positive values or randomly. Our experimental evaluations demonstrated that the dynamical process of the BWR and original Ising model became closer.

cond-mat.stat-mech↗