SearcharxivSearch

arXiv subjects

Oleksandr Balabanov

Publications and source records attributed to Oleksandr Balabanov.

10 recordsLinked to original sources

Learning Chern Numbers of Topological Insulators with Gauge Equivariant Neural Networks

Equivariant network architectures are a well-established tool for predicting invariant or equivariant quantities. However, almost all learning problems considered in this context feature a global symmetry, i.e. each point of the underlying space is transformed with the same group element, as opposed to a local ``gauge'' symmetry, where each point is transformed with a different group element, exponentially enlarging the size of the symmetry group. Gauge equivariant networks have so far mainly been applied to problems in quantum chromodynamics. Here, we introduce a novel application domain for gauge-equivariant networks in the theory of topological condensed matter physics. We use gauge equivariant networks to predict topological invariants (Chern numbers) of multiband topological insulators. The gauge symmetry of the network guarantees that the predicted quantity is a topological invariant. We introduce a novel gauge equivariant normalization layer to stabilize the training and prove a universal approximation theorem for our setup. We train on samples with trivial Chern number only but show that our models generalize to samples with non-trivial Chern number. We provide various ablations of our setup. Our code is available at https://github.com/sitronsea/GENet/tree/main.

cs.LG

Uncertainty quantification in fine-tuned LLMs using LoRA ensembles

Fine-tuning large language models can improve task specific performance, although a general understanding of what the fine-tuned model has learned, forgotten and how to trust its predictions is still missing. We derive principled uncertainty quantification for fine-tuned LLMs with posterior approximations using computationally efficient low-rank adaptation ensembles. We analyze three common multiple-choice datasets using low-rank adaptation ensembles based on Mistral-7b, and draw quantitative and qualitative conclusions on their perceived complexity and balance between retained prior knowledge and domain specific adaptation during and after fine-tuning. We identify unexpected retention of acquired knowledge during fine-tuning in the overfitting regime.

cs.LG

Bayesian posterior approximation with stochastic ensembles

We introduce ensembles of stochastic neural networks to approximate the Bayesian posterior, combining stochastic methods such as dropout with deep ensembles. The stochastic ensembles are formulated as families of distributions and trained to approximate the Bayesian posterior with variational inference. We implement stochastic ensembles based on Monte Carlo dropout, DropConnect and a novel non-parametric version of dropout and evaluate them on a toy problem and CIFAR image classification. For both tasks, we test the quality of the posteriors directly against Hamiltonian Monte Carlo simulations. Our results show that stochastic ensembles provide more accurate posterior estimates than other popular baselines for Bayesian inference.

cs.LG

Quantization of topological indices in critical chains at low temperatures

Various types of topological phenomena at criticality are currently under active research. In this paper we suggest to generalize the known topological quantities to finite temperatures, allowing us to consider gapped and critical (gapless) systems on the same footing. It is then discussed that the quantization of the topological indices, also at critically, is retrieved by taking the low-temperature limit. This idea is explicitly illustrated on a simple case study of chiral critical chains where the quantization is shown analytically and verified numerically. The formalism is also applied for studying robustness of the topological indices to various types of disordering perturbations.

cond-mat.mes-hall

Topology of critical chiral phases: multiband insulators and superconductors

Recent works have proved the existence of symmetry-protected edge states in certain one-dimensional topological band insulators and superconductors at the gap-closing points which define quantum phase transitions between two topologically nontrivial phases. We show how this picture generalizes to multiband critical models belonging to any of the chiral symmetry classes AIII, BDI, or CII of noninteracting fermions in one dimension.

cond-mat.mes-hall

Unsupervised interpretable learning of topological indices invariant under permutations of atomic bands

Multi-band insulating Bloch Hamiltonians with internal or spatial symmetries, such as particle-hole or inversion, may have topologically disconnected sectors of trivial atomic-limit (momentum-independent) Hamiltonians. We present a neural-network-based protocol for finding topologically relevant indices that are invariant under transformations between such trivial atomic-limit Hamiltonians, thus corresponding to the standard classification of band insulators. The work extends the method of "topological data augmentation" for unsupervised learning introduced in Ref. [1] by also generalizing and simplifying the data generation scheme and by introducing a special "mod" layer of the neural network appropriate for $Z_n$ classification. Ensembles of training data are generated by deforming seed objects in a way that preserves a discrete representation of continuity. In order to focus the learning on the topologically relevant indices, prior to the deformation procedure we stack the seed Bloch Hamiltonians with a complete set of symmetry-respecting trivial atomic bands. The obtained datasets are then used for training an interpretable neural network specially designed to capture the topological properties by learning physically relevant momentum space quantities, even in crystalline symmetry classes.

cond-mat.dis-nn

Unsupervised learning using topological data augmentation

Unsupervised machine learning is a cornerstone of artificial intelligence as it provides algorithms capable of learning tasks, such as classification of data, without explicit human assistance. We present an unsupervised deep learning protocol for finding topological indices of quantum systems. The core of the proposed scheme is a 'topological data augmentation' procedure that uses seed objects to generate ensembles of topologically equivalent data. Such data, assigned with dummy labels, can then be used to train a neural network classifier for sorting arbitrary objects into topological equivalence classes. Our protocol is explicitly illustrated on 2-band insulators in 1d and 2d, characterized by a winding number and a Chern number respectively. By using the augmentation technique also in the classification step we can achieve accuracy arbitrarily close to 100% even for objects with indices outside the training regime.

cond-mat.dis-nn

Transport signatures of symmetry protection in 1D Floquet topological insulators

Time-periodic external drives have emerged as a powerful tool to artificially create topological phases of matter. Prime examples are Floquet topological insulators (FTIs), where a gapped bulk supports in-gap edge states, protected against symmetry-preserving local perturbations. Similar to an ordinary static topological insulator, the robustness of an edge state in a one-dimensional (1D) FTI shows up as a pinning of its quasienergy level, but now inside one of two distinct bulk gaps. Here we propose a scheme for probing this unique feature by observing transport characteristics of a 1D finite-sized FTI attached to external leads. We present predictions for transmission spectra using a nonequilibrium Green's function approach. Our analysis covers FTIs with time-independent and periodically driven boundary perturbations which either preserve or break the protecting chiral symmetry.

cond-mat.mes-hall

Transport through periodically driven systems: Green's function approach formulated within frequency domain

The steady-state electronic transport across periodically driven systems can be efficiently addressed using Landauer-Büttiker formalism. The time-dependent nonequilibrium Green's function theory then may be adapted for developing direct and universal calculation schemes. Here we propose an alternative scheme to carry out the calculations. The idea is based on treating the transport problem in frequency domain and designing Green's functions for the corresponding Hamiltonians rewritten in Floquet-Sambe formalism. We show that within our approach the expressions for time-periodic currents and densities essentially replicate the well known formulas from time-independent theory. The results are then simplified for easier implementation in numeric computations.

cond-mat.mes-hall

Robustness of symmetry-protected topological states against time-periodic perturbations

The existence of gapless boundary states is a key attribute of any topological insulator. Topological band theory predicts that these states are robust against static perturbations that preserve the relevant symmetries. In this article, using Floquet theory, we examine how chiral symmetry-protection extends also to states subject to time-periodic perturbations $-$ in one-dimensional Floquet topological insulators as well as in ordinary one-dimensional time-independent topological insulators. It is found that, in the case of the latter, the edge modes are resistant to a much larger class of time-periodic symmetry-preserving perturbations than in Floquet topological insulators. Notably, boundary states in chiral time-independent topological insulators also exhibit an unexpected resilience against a certain type of symmetry-breaking time-periodic perturbations. We argue that this is a generic property for topological phases protected by chiral symmetry. Implications for experiments are discussed.

cond-mat.mes-hall