SearcharxivSearch

arXiv subjects

Leonid Litinskii

Publications and source records attributed to Leonid Litinskii.

14 recordsLinked to original sources

Hopfield model with quasi-diagonal connection matrix

We analyze a Hopfield neural network with a quasi-diagonal connection matrix. We use the term "quasi-diagonal matrix" to denote a matrix with all elements equal zero except the elements on the first super- and sub-diagonals of the principle diagonal. The nonzero elements are arbitrary real numbers. Such matrix generalizes the well-known connection matrix of the one dimensional Ising model with open boundary conditions where all nonzero elements equal +1. We present a simple description of the fixed points of the Hopfield neural network and their dependence on the matrix elements. The obtained results also allow us to analyze the cases of a) the nonzero elements constitute arbitrary super- and sub-diagonals and b) periodic boundary conditions.

cond-mat.dis-nn

Analytical solutions for Ising models on high dimensional lattices

We use an m-vicinity method to examine Ising models on hypercube lattices of high dimensions d>=3. This method is applicable for both short-range and long-range interactions. We introduce a small parameter, which determines whether the method can be used when calculating the free energy. When we account for interaction with the nearest neighbors only, the value of this parameter depends on the dimension of the lattice d. We obtain an expression for the critical temperature in terms of the interaction constants that is in a good agreement with results of computer simulations. For d=5, 6, 7, our theoretical estimates match the experiments both qualitatively and quantitatively. For d=3, 4, our method is sufficiently accurate for calculation of the critical temperatures, however, it predicts a finite jump of the heat capacity at the critical point. In the case of the three-dimensional lattice (d=3), this contradicts to the commonly accepted ideas of the type of the singularity at the critical point. For the four-dimensional lattice (d = 4) the character of the singularity is under current discussion. For the dimensions d=1, 2 the m-vicinity method is not applicable.

cond-mat.dis-nn

Inverse problem for Ising connection matrix with long-range interaction

In the present paper, we examine Ising systems on d-dimensional hypercube lattices and solve an inverse problem where we have to determine interaction constants of an Ising connection matrix when we know a spectrum of it eigenvalues. In addition, we define restrictions allowing a random number sequence to be a connection matrix spectrum. We use the previously obtained analytical expressions for the eigenvalues of Ising connection matrices accounting for an arbitrary long-range interaction and supposing periodic boundary conditions.

cond-mat.dis-nn

n-vicinity method for Ising Model with long-range interaction

The previously developed n-vicinity method allows us to calculate accurately critical values of inverse temperatures for Ising models with short-range interaction. We generalize the method to the case of long-range interactions in spin systems and obtain theoretical formulas for the inverse temperatures in terms of the spin interaction constants. The comparison of our theoretical estimates with computer simulations for the two- and three-dimensional Ising models shows that the larger the dimension of the problem the better their agreement.

cond-mat.stat-mech

Eigenvalues of Ising Hamiltonian with long-range interactions

We obtained analytically eigenvalues of a multidimensional Ising Hamiltonian on a hypercube lattice and expressed them in terms of spin-spin interaction constants and the eigenvalues of the one-dimensional Ising Hamiltonian (the latter are well known). To do this we wrote down the multidimensional Hamiltonian eigenvectors as the Kronecker products of the eigenvectors of the one-dimensional Ising Hamiltonian. For periodic boundary conditions, it is possible to obtain exact results taking into account interactions with an unlimited number of neighboring spins. In this paper, we present exact expressions for the eigenvalues for the planar and cubic Ising systems accounting for the first five coordination spheres (that is interactions with the nearest neighbors, the next neighbors, the next-next neighbors, the next-next-next neighbors and the next-next-next-next neighbors). In the case of free-boundary systems, we showed that in the two- and three-dimensions the exact expressions could be obtained only if we account for interactions with spins of first two coordination spheres and first three coordination spheres, respectively.

cond-mat.dis-nn

Spectral density and calculation of free energy

For planar and cubic Ising models, we examined two ways of approximation of a spectral density that describes a degeneracy of energy levels. We approximated the exponent of the spectral density by polynomials of even degrees and using our n-vicinity method [8, 9]. According our analysis, the free energy is almost independent of the chosen method of approximation. However, its derivatives depend on the way of approximation and substantially differ in the neighborhood of a critical temperature. Our calculations showed that when approximating by polynomials the system necessarily finds itself in the ground state at a finite temperature, which is forbidden. The n-vicinity method approximates the derivatives of the free energy correctly for the cubic Ising model and it works poorly in the planar case.

cond-mat.dis-nn

Applicability of n-vicinity method for calculation of free energy of Ising model

In a previous work, the n-vicinity method for approximate calculation of the partition function of a spin system was proposed. The equation of state was obtained in the most general form. In the present paper, we analyze the applicability of this method for the Ising model on a D-dimensional cubic lattice. The equation of state is solved for an arbitrary dimension D and the behavior of the free energy is analyzed. As expected, for large dimensions (D > 2) the system demonstrates a phase transition of the second kind. In this case, we obtain an analytical expression for the critical value of the inverse temperature. When 2 < D < 8 this expression is in a very good agreement with the results of computer simulations. In the case of small dimensions (D < 3), there is a noticeable discrepancy with the known exact results.

cond-mat.dis-nn

N-vicinities method for 3D Ising Model

The n-vicinities method for approximate calculations of the partition function of a spin system was proposed previously. The equation of state was obtained in the most general form. In the present publication these results are adapted to the Ising model on the D-dimensional cubic lattice. The state equation is solved for an arbitrary dimension D and the behavior of the free energy is analyzed. For large values of D (D > 2) the obtained results are in good agreement with the ones obtained by means of computer simulations. For small values of D (D < 3), there are noticeable discrepancies with the exact results.

cond-mat.dis-nn

Generalized approach to energy distribution of spin system

We examined energy spectrums of some particular systems of binary spins. It is shown that the configuration space can be divided into classes, and in the limit the energy distributions in these classes can be approximated by the normal distributions. For each class we obtained the expressions for the first three moments of the energy distribution, including the case of presence of a nonzero inhomogeneous magnetic field. We also derived the expression for the variance of the quasienergy distribution in the local minimum. We present the results of computer simulations for the standard Ising model and the Sherrington-Kirkpatrick and Edwards-Anderson models of spin glass. Basing on these results, we justified the new method of the partition function calculation.

cond-mat.dis-nn

Approximate method of free energy calculation for spin system with arbitrary connection matrix

The proposed method of the free energy calculation is based on the approximation of the energy distribution in the microcanonical ensemble by the Gaussian distribution. We hope that our approach will be effective for the systems with long-range interaction, where large coordination number q ensures the correctness of the central limit theorem application. However, the method provides good results also for systems with short-range interaction when the number q is not so large.

cond-mat.dis-nn

Weighted Patterns as a Tool for Improving the Hopfield Model

We generalize the standard Hopfield model to the case when a weight is assigned to each input pattern. The weight can be interpreted as the frequency of the pattern occurrence at the input of the network. In the framework of the statistical physics approach we obtain the saddle-point equation allowing us to examine the memory of the network. In the case of unequal weights our model does not lead to the catastrophic destruction of the memory due to its overfilling (that is typical for the standard Hopfield model). The real memory consists only of the patterns with weights exceeding a critical value that is determined by the weights distribution. We obtain the algorithm allowing us to find this critical value for an arbitrary distribution of the weights, and analyze in detail some particular weights distributions. It is shown that the memory decreases as compared to the case of the standard Hopfield model. However, in our model the network can learn online without the catastrophic destruction of the memory.

cond-mat.dis-nn

Local Minima of a Quadratic Binary Functional with a Quasi-Hebbian Connection Matrix

The local minima of a quadratic functional depending on binary variables are discussed. An arbitrary connection matrix can be presented in the form of quasi-Hebbian expansion where each pattern is supplied with its own individual weight. For such matrices statistical physics methods allow one to derive an equation describing local minima of the functional. A model where only one weight differs from other ones is discussed in detail. In this case the equation can be solved analytically. The critical values of the weight, for which the energy landscape is reconstructed, are obtained. Obtained results are confirmed by computer simulations.

cond-mat.dis-nn

Local Minima of a Quadratic Binary Functional with Quasi-Hebbian Connection Matrix

The local minima of a quadratic functional depending on binary variables are discussed. An arbitrary connection matrix can be presented in the form of quasi-Hebbian expansion where each pattern is supplied with its own individual weight. For such matrices statistical physics methods allow one to derive an equation describing local minima of the functional. A model where only one weight differs from other ones is discussed in details. In this case the above-mention equation can be solved analytically. Obtained results are confirmed by computer simulations.

cond-mat.dis-nn

Minimization of Quadratic Binary Functional with Additive Connection Matrix

(NxN)-matrix is called additive when its elements are pair-wise sums of N real numbers. For a quadratic binary functional with an additive connection matrix we succeeded in finding the global minimum expressing it through external parameters of the problem. Computer simulations show that energy surface of a quadratic binary functional with an additive matrix is complicate enough.

cond-mat.dis-nn