SearcharxivSearch

arXiv subjects

Ronald B. Morgan

Publications and source records attributed to Ronald B. Morgan.

At least 19 recordsLinked to original sources

Polynomial Preconditioning for Indefinite Matrices

Polynomial preconditioning is an important tool in solving large linear systems and eigenvalue problems. A polynomial from GMRES can be used to precondition restarted GMRES and restarted Arnoldi. Here we give methods for indefinite matrices that make polynomial preconditioning more generally applicable. The new techniques include balancing the polynomial so that it produces a definite spectrum. Then a stability approach is given that is specialized for the indefinite case. Also, very complex spectra are examined. Then convergence estimates are given for polynomial preconditioning of real, indefinite spectra. Finally, tests are preformed of finding interior eigenvalues.

math.NA

Polynomial Approximation to the Inverse of a Large Matrix

The inverse of a large matrix can often be accurately approximated by a polynomial of degree significantly lower than the order of the matrix. The iteration polynomial generated by a run of the GMRES algorithm is a good candidate, and its approximation to the inverse often seems to track the accuracy of the GMRES iteration. We investigate the quality of this approximation through theory and experiment, noting the practical need to add copies of some polynomial terms to improve stability. To mitigate storage and orthogonalization costs, other approaches have appeal, such as polynomial preconditioned GMRES and deflation of problematic eigenvalues. Applications of such polynomial approximations include solving systems of linear equations with multiple right-hand sides (where the solutions to subsequent problems come simply by multiplying the polynomial against the new right-hand sides) and variance reduction in multilevel Monte Carlo methods.

math.NA

Multipolynomial Monte Carlo Trace Estimation

In lattice QCD the calculation of disconnected quark loops from the trace of the inverse quark matrix has large noise variance. A multilevel Monte Carlo method is proposed for this problem that uses different degree polynomials on a multilevel system. The polynomials are developed from the GMRES algorithm for solving linear equations. To reduce orthogonalization expense, the highest degree polynomial is a composite or double polynomial found with a polynomial preconditioned GMRES iteration. Matrix deflation is used in three different ways: in the Monte Carlo levels, in the main solves, and in the deflation of the highest level double polynomial. A numerical comparison with optimized Hutchinson is performed on a quenched \(24^4\) lattice. The results demonstrate that the new Multipolynomial Monte Carlo method can significantly improve the trace computation for matrices that have a difficult spectrum due to small eigenvalues.}

hep-lat

Multi-Polynomial Monte Carlo for Trace Estimation in Lattice QCD

Estimating the trace of the inverse of a large matrix is an important problem in lattice quantum chromodynamics. A multilevel Monte Carlo method is proposed for this problem that uses different degree polynomials for the levels. The polynomials are developed from the GMRES algorithm for solving linear equations. To reduce orthogonalization expense, the highest degree polynomial is a composite or double polynomial found with a polynomial preconditioned GMRES iteration. Added to some of the Monte Carlo pieces is deflation of eigenvalues that reduces the variance. Deflation is also used for finding a reduced degree deflated polynomial. The new Multipolynomial Monte Carlo method can significantly improve the trace computation for matrices that have a difficult spectrum due to small eigenvalues.

hep-lat

High-degree Polynomial Noise Subtraction

In lattice QCD, the calculation of physical quantities from disconnected quark loop calculations have large variance due to the use of Monte Carlo methods for the estimation of the trace of the inverse lattice Dirac operator. In this work, we build upon our POLY and HFPOLY variance reduction methods by using high-degree polynomials. Previously, the GMRES polynomials used were only stable for low-degree polynomials, but through application of a new, stable form of the GMRES polynomial, we have achieved higher polynomial degrees than previously used. While the variance is not dependent on the trace correction term within the methods, the evaluation of this term will be necessary for forming the vacuum expectation value estimates. This requires computing the trace of high-degree polynomials, which can be evaluated stochastically through our new Multipolynomial Monte Carlo method. With these new high-degree noise subtraction polynomials, we obtained a variance reduction for the scalar operator of nearly an order of magnitude over that of no subtraction on a $24^3 \times 32$ quenched lattice at $β= 6.0$ and $κ= 0.1570 \approx κ_{crit}$. Additionally, we observe that for sufficiently high polynomial degrees, POLY and HFPOLY approach the same level of effectiveness. We also explore the viability of using double polynomials for variance reduction as a means of reducing the required orthogonalization and memory costs associated with forming high-degree GMRES polynomials.

hep-lat

Toward Efficient Polynomial Preconditioning for GMRES

We present a polynomial preconditioner for solving large systems of linear equations. The polynomial is derived from the minimum residual polynomial (the GMRES polynomial) and is more straightforward to compute and implement than many previous polynomial preconditioners. Our current implementation of this polynomial using its roots is naturally more stable than previous methods of computing the same polynomial. We implement further stability control using added roots, and this allows for high degree polynomials. We discuss the effectiveness and challenges of root-adding and give an additional check for stability. In this paper, we study the polynomial preconditioner applied to GMRES; however it could be used with any Krylov solver. This polynomial preconditioning algorithm can dramatically improve convergence for some problems, especially for difficult problems, and can reduce dot products by an even greater margin.

math.NA

Two-Grid Deflated Krylov Methods for Linear Equations

An approach is given for solving large linear systems that combines Krylov methods with use of two different grid levels. Eigenvectors are computed on the coarse grid and used to deflate eigenvalues on the fine grid. GMRES-type methods are first used on both the coarse and fine grids. Then another approach is given that has a restarted BiCGStab (or IDR) method on the fine grid. While BiCGStab is generally considered to be a non-restarted method, it works well in this context with deflating and restarting. Tests show this new approach can be very efficient for difficult linear equations problems.

math.NA

Disconnected Loop Subtraction Methods in Lattice QCD

Noise subtraction methods are a set of techniques that aim to reduce the variance of signals in LQCD which are often flooded with noise. The standard approach is a pertubative subtraction. In this work, we demonstrate the abilities of our new noise subtraction methods with methods which show considerable improvement over pertubative subtraction in the reduction of the variance for the set of LQCD operators that were studied. The methods were tested at $κ_{crit}$ on quenched configurations, as well as on dynamical quark configurations at $κ= 0.1453$. A significant improvement in the reduction of operator variance was observed in both cases.

hep-lat

Deflated GMRES with Multigrid for Lattice QCD

Lattice QCD solvers encounter critical slowing down for fine lattice spacings and small quark mass. Traditional matrix eigenvalue deflation is one approach to mitigating this problem. However, to improve scaling we study the effects of deflating on the coarse grid in a hierarchy of three grids for adaptive mutigrid applications of the two dimensional Schwinger model. We compare deflation at the fine and coarse levels with other non deflated methods. We find the inclusion of a partial solve on the intermediate grid allows for a low tolerance deflated solve on the coarse grid. We find very good scaling in lattice size near critical mass when we deflate at the coarse level using the GMRES-DR and GMRES-Proj algorithms.

hep-lat

Disconnected Loop Subtraction Methods in Lattice QCD

Lattice QCD calculations of disconnected quark loop operators are extremely computer time-consuming to evaluate. To compute these diagrams using lattice techniques, one generally uses stochastic noise methods. These employ a randomly generated set of noise vectors to project out physical signals. In order to strengthen the signal in these calculations, various noise subtraction techniques may be employed. In addition to the standard method of perturbative subtraction, one may also employ matrix deflation techniques using the GMRES-DR and MINRES-DR algorithms as well as polynomial subtraction techniques to reduce statistical uncertainty. Our matrix deflation methods play two roles: they both speed up the solution of the linear equations as well as decrease numerical noise. We show how to combine deflation with either perturbative and polynomial methods to produce extremely powerful noise suppression algorithms. We use a variety of lattices to study the effects. In order to set a benchmark, we first use the Wilson matrix in the quenched approximation. We see strong low eigenmode dominance at kappa critical ($κ_{crit}$) in the variance of the vector and scalar operators. We also use MILC dynamic lattices, where we observe deflation subtraction results consistent with the effectiveness seen in the quenched data.

hep-lat

Polynomial Preconditioned Arnoldi

Polynomial preconditioning can improve the convergence of the Arnoldi method for computing eigenvalues. Such preconditioning significantly reduces the cost of orthogonalization; for difficult problems, it can also reduce the number of matrix-vector products. Parallel computations can particularly benefit from the reduction of communication-intensive operations. The GMRES algorithm provides a simple and effective way of generating the preconditioning polynomial. For some problems high degree polynomials are especially effective, but they can lead to stability problems that must be mitigated. A two-level "double polynomial preconditioning" strategy provides an effective way to generate high-degree preconditioners.

math.NA

Weighted Inner Products for GMRES and GMRES-DR

The convergence of the restarted GMRES method can be significantly improved, for some problems, by using a weighted inner product that changes at each restart. How does this weighting affect convergence, and when is it useful? We show that weighted inner products can help in two distinct ways: when the coefficient matrix has localized eigenvectors, weighting can allow restarted GMRES to focus on eigenvalues that otherwise slow convergence; for general problems, weighting can break the cyclic convergence pattern into which restarted GMRES often settles. The eigenvectors of matrices derived from differential equations are often not localized, thus limiting the impact of weighting. For such problems, incorporating the discrete cosine transform into the inner product can significantly improve GMRES convergence, giving a method we call W-GMRES-DCT. Integrating weighting with eigenvalue deflation via GMRES-DR also can give effective solutions.

math.NA

New Noise Subtraction Methods in Lattice QCD

Noise subtraction techniques can help reduce the statistical uncertainty in the extraction of hard to detect signals. We describe new noise subtraction methods in Lattice QCD which apply to disconnected diagram evaluations. Some of the noise suppression techniques include polynomial quark matrix methods, eigenspectrum deflation methods, and combination methods. Our most promising technique combines polynomial and Hermitian deflation subtraction methods. The overall goal is to improve the efficiency of Lattice QCD noise method algorithms.

hep-lat

Eigenspectrum Noise Subtraction Methods in Lattice QCD

We propose a new noise subtraction method, which we call "eigenspectrum subtraction", which uses low eigenmode information to suppress statistical noise at low quark mass. This is useful for lattice calculations involving disconnected loops or all-to-all propagators. It has significant advantages over perturbative subtraction methods. We compare unsubtracted, eigenspectrum and perturbative error bar results for the scalar operator on a small Wilson QCD matrix.

hep-lat

Seed methods for linear equations in lattice qcd problems with multiple right-hand sides

We consider three improvements to seed methods for Hermitian linear systems with multiple right-hand sides: only the Krylov subspace for the first system is used for seeding subsequent right-hand sides, the first right-hand side is solved past convergence, and periodic re-orthogonalization is used in order to control roundoff errors associated with the Conjugate Gradient algorithm. The method is tested for the case of Wilson fermions near kappa critical and a considerable speed up in the convergence is observed.

hep-lat

Deflated Hermitian Lanczos Methods for Multiple Right-Hand Sides

A deflated and restarted Lanczos algorithm to solve hermitian linear systems, and at the same time compute eigenvalues and eigenvectors for application to multiple right-hand sides, is described. For the first right-hand side, eigenvectors with small eigenvalues are computed while simultaneously solving the linear system. Two versions of this algorithm are given. The first is called Lan-DR and is based on conjugate gradient (CG) implementation of the Lanczos algorithm. This version will be optimal for the hermitian positive definite case. The second version is called MinRes-DR and is based on the minimum residual (MinRes) implementation of Lanczos algorithm. This version is optimal for indefinite hermitian systems where the CG algorithm is subject to instabilities. For additional right-hand sides, we project over the calculated eigenvectors to speed up convergence. The algorithms used for subsequent right-hand sides are called D-CG and D-MinRes respectively. After some introductory examples are given, we show tests for the case of Wilson fermions at kappa critical. A considerable speed up in the convergence is observed compared to unmodified CG and MinRes.

hep-lat

Improved Seed Methods for Symmetric Positive Definite Linear Equations with Multiple Right-hand Sides

We consider symmetric positive definite systems of linear equations with multiple right-hand sides. The seed conjugate gradient method solves one right-hand side with the conjugate gradient method and simultaneously projects over the Krylov subspace thus developed for the other right-hand sides. Then the next system is solved and used to seed the remaining ones. Rounding error in the conjugate gradient method limits how much the seeding can improve convergence. We propose three changes to the seed conjugate gradient method: only the first right-hand side is used for seeding, this system is solved past convergence, and the roundoff error is controlled with some reorthogonalization. We will show that results are actually better with only one seeding, even in the case of related right-hand sides. Controlling rounding error gives the potential for rapid convergence for the second and subsequent right-hand sides.

math-ph

Deflated and restarted symmetric Lanczos methods for eigenvalues and linear equations with multiple right-hand sides

A deflated restarted Lanczos algorithm is given for both solving symmetric linear equations and computing eigenvalues and eigenvectors. The restarting limits the storage so that finding eigenvectors is practical. Meanwhile, the deflating from the presence of the eigenvectors allows the linear equations to generally have good convergence in spite of the restarting. Some reorthogonalization is necessary to control roundoff error, and several approaches are discussed. The eigenvectors generated while solving the linear equations can be used to help solve systems with multiple right-hand sides. Experiments are given with large matrices from quantum chromodynamics that have many right-hand sides.

math-ph