Searcharxiv⌕ Search

arXiv subjects

Anton Alekseev

Publications and source records attributed to Anton Alekseev.

At least 37 records · Page 2Linked to original sources

Machine Learning for SAT: Restricted Heuristics and New Graph Representations

Boolean satisfiability (SAT) is a fundamental NP-complete problem with many applications, including automated planning and scheduling. To solve large instances, SAT solvers have to rely on heuristics, e.g., choosing a branching variable in DPLL and CDCL solvers. Such heuristics can be improved with machine learning (ML) models; they can reduce the number of steps but usually hinder the running time because useful models are relatively large and slow. We suggest the strategy of making a few initial steps with a trained ML model and then releasing control to classical heuristics; this simplifies cold start for SAT solving and can decrease both the number of steps and overall runtime, but requires a separate decision of when to release control to the solver. Moreover, we introduce a modification of Graph-Q-SAT tailored to SAT problems converted from other domains, e.g., open shop scheduling problems. We validate the feasibility of our approach with random and industrial SAT problems.

cs.AI↗

On the coadjoint Virasoro action

The set of coadjoint orbits of the Virasoro algebra at level 1 is in bijection with the set of conjugacy classes in a certain open subset $\widetilde{\rm SL}(2,\mathbb{R})_+$ of the universal cover of ${\rm SL}(2,\mathbb{R})$. We strengthen this bijection to a Morita equivalence of quasi-symplectic groupoids, integrating the Poisson structure on $\mathfrak{vir}^*_\mathsf{1}(S^1)$ and the Cartan-Dirac structure on $\widetilde{\rm SL}(2,\mathbb{R})_+$, respectively.

math.DG↗

Towards bosonization of Virasoro coadjoint orbits

We show that Schwarzian theories associated to certain hyperbolic and parabolic Virasoro coadjoint orbits admit bosonization, i.e. a global $S^1$-equivariant Darboux chart in which the corresponding path integral becomes Gaussian. In this chart, correlation functions of bilocals, time-ordered and out-of-time ordered, can be computed explicitly. We conjecture that a similar global chart exists for the Teichmüller orbit.

math-ph↗

DetIE: Multilingual Open Information Extraction Inspired by Object Detection

State of the art neural methods for open information extraction (OpenIE) usually extract triplets (or tuples) iteratively in an autoregressive or predicate-based manner in order not to produce duplicates. In this work, we propose a different approach to the problem that can be equally or more successful. Namely, we present a novel single-pass method for OpenIE inspired by object detection algorithms from computer vision. We use an order-agnostic loss based on bipartite matching that forces unique predictions and a Transformer-based encoder-only architecture for sequence labeling. The proposed approach is faster and shows superior or similar performance in comparison with state of the art models on standard benchmarks in terms of both quality metrics and inference time. Our model sets the new state of the art performance of 67.7% F1 on CaRB evaluated as OIE2016 while being 3.35x faster at inference than previous state of the art. We also evaluate the multilingual version of our model in the zero-shot setting for two languages and introduce a strategy for generating synthetic multilingual data to fine-tune the model for each specific language. In this setting, we show performance improvement 15% on multilingual Re-OIE2016, reaching 75% F1 for both Portuguese and Spanish languages. Code and models are available at https://github.com/sberbank-ai/DetIE.

cs.CL↗

Near-Zero-Shot Suggestion Mining with a Little Help from WordNet

In this work, we explore the constructive side of online reviews: advice, tips, requests, and suggestions that users provide about goods, venues, services, and other items of interest. To reduce training costs and annotation efforts needed to build a classifier for a specific label set, we present and evaluate several entailment-based zero-shot approaches to suggestion classification in a label-fully-unseen fashion. In particular, we introduce the strategy of assigning target class labels to sentences in English language with user intentions, which significantly improves prediction quality. The proposed strategies are evaluated with a comprehensive experimental study that validated our results both quantitatively and qualitatively.

cs.CL↗

Characters, Coadjoint Orbits and Duistermaat-Heckman Integrals

The asymptotics of characters $χ_{kλ}(\exp(h/k))$ of irreducible representations of a compact Lie group $G$ for large values of the scaling factor $k$ are given by Duistermaat-Heckman (DH) integrals over coadjoint orbits of $G$. This phenomenon generalises to coadjoint orbits of central extensions of loop groups $\widehat{LG}$ and of diffeomorphisms of the circle $\widehat{\rm Diff}(S^1)$. We show that the asymptotics of characters of integrable modules of affine Kac-Moody algebras and of the Virasoro algebra factorize into a divergent contribution of the standard form and a convergent contribution which can be interpreted as a formal DH orbital integral. For some Virasoro modules, our results match the formal DH integrals recently computed by Stanford and Witten. In this case, the $k$-scaling has the same origin as the one which gives rise to classical conformal blocks. Furthermore, we consider reduced spaces of Virasoro coadjoint orbits and we suggest a new invariant which replaces symplectic volume in the infinite dimensional situation. We also consider other modules of the Virasoro algebra (in particular, the modules corresponding to minimal models) and we obtain DH-type expressions which do not correspond to any Virasoro coadjoint orbits. We study volume functions $V(x)$ corresponding to formal DH integrals over coadjoint orbits of the Virasoro algebra. We show that they are related by the Hankel transform to spectral densities $ρ(E)$ recently studied by Saad, Shenker and Stanford.

hep-th↗

Improving unsupervised neural aspect extraction for online discussions using out-of-domain classification

Deep learning architectures based on self-attention have recently achieved and surpassed state of the art results in the task of unsupervised aspect extraction and topic modeling. While models such as neural attention-based aspect extraction (ABAE) have been successfully applied to user-generated texts, they are less coherent when applied to traditional data sources such as news articles and newsgroup documents. In this work, we introduce a simple approach based on sentence filtering in order to improve topical aspects learned from newsgroups-based content without modifying the basic mechanism of ABAE. We train a probabilistic classifier to distinguish between out-of-domain texts (outer dataset) and in-domain texts (target dataset). Then, during data preparation we filter out sentences that have a low probability of being in-domain and train the neural model on the remaining sentences. The positive effect of sentence filtering on topic coherence is demonstrated in comparison to aspect extraction models trained on unfiltered texts.

cs.CL↗

Action-angle coordinates on coadjoint orbits and multiplicity free spaces from partial tropicalization

Coadjoint orbits and multiplicity free spaces of compact Lie groups are important examples of symplectic manifolds with Hamiltonian groups actions. Constructing action-angle variables on these spaces is a challenging task. A fundamental result in the field is the Guillemin-Sternberg construction of Gelfand-Zeitlin integrable systems for the groups $K=U(n), SO(n)$. Extending these results to groups of other types is one of the goals of this paper. Partial tropicalizations are Poisson spaces with constant Poisson bracket built using techniques of Poisson-Lie theory and the geometric crystals of Berenstein-Kazhdan. They provide a bridge between dual spaces of Lie algebras ${\rm Lie}(K)^*$ with linear Poisson brackets and polyhedral cones which parametrize the canonical bases of irreducible modules of $G=K^\mathbb{C}$. We generalize the construction of partial tropicalizations to allow for arbitrary cluster charts, and apply it to questions in symplectic geometry. For each regular coadjoint orbit of a compact group $K$, we construct an exhaustion by symplectic embeddings of toric domains. As a by product we arrive at a conjectured formula for Gromov width of regular coadjoint orbits. We prove similar results for multiplicity free $K$-spaces.

math.SG↗

Provenance of classical Hamiltonian time crystals

Classical Hamiltonian systems with conserved charges and those with constraints often describe dynamics on a pre-symplectic manifold. Here we show that a pre-symplectic manifold is also the proper stage to describe autonomous energy conserving Hamiltonian time crystals. We explain how the occurrence of a time crystal relates to the wider concept of spontaneously broken symmetries; in the case of a time crystal, the symmetry breaking takes place in a dynamical context. We then analyze in detail two examples of time crystalline Hamiltonian dynamics. The first example is a piecewise linear closed string, with dynamics determined by a Lie-Poisson bracket and Hamiltonian that relates to membrane stability. We explain how the Lie-Poisson brackets descents to a time crystalline pre-symplectic bracket, and we show that the Hamiltonian dynamics supports two phases; in one phase we have a time crystal and in the other phase time crystals are absent. The second example is a discrete Hamiltonian variant of the Q-ball Lagrangian of time dependent non-topological solitons. We explain how a Q-ball becomes a time crystal, and we construct examples of time crystalline Q-balls.

hep-th↗

RecVAE: a New Variational Autoencoder for Top-N Recommendations with Implicit Feedback

Recent research has shown the advantages of using autoencoders based on deep neural networks for collaborative filtering. In particular, the recently proposed Mult-VAE model, which used the multinomial likelihood variational autoencoders, has shown excellent results for top-N recommendations. In this work, we propose the Recommender VAE (RecVAE) model that originates from our research on regularization techniques for variational autoencoders. RecVAE introduces several novel ideas to improve Mult-VAE, including a novel composite prior distribution for the latent codes, a new approach to setting the $β$ hyperparameter for the $β$-VAE framework, and a new approach to training based on alternating updates. In experimental evaluation, we show that RecVAE significantly outperforms previously proposed autoencoder-based models, including Mult-VAE and RaCT, across classical collaborative filtering datasets, and present a detailed ablation study to assess our new developments. Code and models are available at https://github.com/ilya-shenbin/RecVAE.

cs.IR↗

Concentration of symplectic volumes on Poisson homogeneous spaces

For a compact Poisson-Lie group $K$, the homogeneous space $K/T$ carries a family of symplectic forms $ω_ξ^s$, where $ξ\in \mathfrak{t}^*_+$ is in the positive Weyl chamber and $s \in \mathbb{R}$. The symplectic form $ω_ξ^0$ is identified with the natural $K$-invariant symplectic form on the $K$ coadjoint orbit corresponding to $ξ$. The cohomology class of $ω_ξ^s$ is independent of $s$ for a fixed value of $ξ$. In this paper, we show that as $s\to -\infty$, the symplectic volume of $ω_ξ^s$ concentrates in arbitrarily small neighbourhoods of the smallest Schubert cell in $K/T \cong G/B$. This strengthens earlier results [9,10] and is a step towards a conjectured construction of global action-angle coordinates on $Lie(K)^*$ [4, Conjecture 1.1].

math.SG↗

Langlands Duality and Poisson-Lie Duality via Cluster Theory and Tropicalization

Let $G$ be a connected semisimple Lie group. There are two natural duality constructions that assign to it the Langlands dual group $G^\vee$ and the Poisson-Lie dual group $G^*$. The main result of this paper is the following relation between these two objects: the integral cone defined by the cluster structure and the Berenstein-Kazhdan potential on the double Bruhat cell $G^{\vee; w_0, e} \subset G^\vee$ is isomorphic to the integral Bohr-Sommerfeld cone defined by the Poisson structure on the partial tropicalization of $K^* \subset G^*$ (the Poisson-Lie dual of the compact form $K \subset G$). By [5], the first cone parametrizes the canonical bases of irreducible $G$-modules. The corresponding points in the second cone belong to integral symplectic leaves of the partial tropicalization labeled by the highest weight of the representation. As a by-product of our construction, we show that symplectic volumes of generic symplectic leaves in the partial tropicalization of $K^*$ are equal to symplectic volumes of the corresponding coadjoint orbits in $\operatorname{Lie}(K)^*$. To achieve these goals, we make use of (Langlands dual) double cluster varieties defined by Fock and Goncharov [9]. These are pairs of cluster varieties whose seed matrices are transpose to each other. There is a naturally defined isomorphism between their tropicalizations. The isomorphism between the cones described above is a particular instance of such an isomorphism associated to the double Bruhat cells $G^{w_0, e} \subset G$ and $G^{\vee; w_0, e} \subset G^\vee$.

math.RT↗

Stochastic differential equations for Lie group valued moment maps

The celebrated result by Biane-Bougerol-O'Connell relates Duistermaat-Heckman (DH) measures for coadjoint orbits of a compact Lie group $G$ with the multi-dimensional Pitman transform of the Wiener process on its Cartan subalgebra. The DH theory admits several non-trivial generalizations. In this paper, we consider the case of $G=SU(2)$, and we give an interpretation of DH measures for $SU(2) \cong S^3$ valued moment maps in terms of an interesting stochastic process on the unit disc, and an interpretation of the DH measures for Poisson $\mathbb{H}^3$ valued moment maps (in the sense of Lu) in terms of a stochastic process on the interior of a hyperbola.

math-ph↗

AspeRa: Aspect-based Rating Prediction Model

We propose a novel end-to-end Aspect-based Rating Prediction model (AspeRa) that estimates user rating based on review texts for the items and at the same time discovers coherent aspects of reviews that can be used to explain predictions or profile users. The AspeRa model uses max-margin losses for joint item and user embedding learning and a dual-headed architecture; it significantly outperforms recently proposed state-of-the-art models such as DeepCoNN, HFT, NARRE, and TransRev on two real world data sets of user reviews. With qualitative examination of the aspects and quantitative evaluation of rating prediction models based on these aspects, we show how aspect embeddings can be used in a recommender system.

cs.CL↗

Goldman-Turaev formality implies Kashiwara-Vergne

Let $Σ$ be a compact connected oriented 2-dimensional manifold with non-empty boundary. In our previous work, we have shown that the solution of generalized (higher genus) Kashiwara-Vergne equations for an automorphism $F \in {\rm Aut}(L)$ of a free Lie algebra implies an isomorphism between the Goldman-Turaev Lie bialgebra $\mathfrak{g}(Σ)$ and its associated graded ${\rm gr}\, \mathfrak{g}(Σ)$. In this paper, we prove the converse: if $F$ induces an isomorphism $\mathfrak{g}(Σ) \cong {\rm gr} \, \mathfrak{g}(Σ)$, then it satisfies the Kashiwara-Vergne equations up to conjugation. As an application of our results, we compute the degree one non-commutative Poisson cohomology of the Kirillov-Kostant-Souriau double bracket. The main technical tool used in the paper is a novel characterization of conjugacy classes in the free Lie algebra in terms of cyclic words.

math.GT↗

The $U(n)$ Gelfand-Zeitlin system as a tropical limit of Ginzburg-Weinstein diffeomorphisms

We show that the Ginzburg-Weinstein diffeomorphism $\mathfrak{u}(n)^* \to U(n)^*$ of Alekseev-Meinrenken admits a scaling tropical limit on an open dense subset of $\mathfrak{u}(n)^*$. The target of the limit map is a product $\mathcal{C} \times T$, where $\mathcal{C}$ is the interior of a cone, $T$ is a torus, and $\mathcal{C} \times T$ carries an integrable system with natural action-angle coordinates. The pull-back of these coordinates to $\mathfrak{u}(n)^*$ recovers the Gelfand-Zeitlin integrable system of Guillemin-Sternberg. As a by-product of our proof, we show that the Lagrangian tori of the Flaschka-Ratiu integrable system on the set of upper triangular matrices meet the set of totally positive matrices for sufficiently large action coordinates.

math.SG↗

The Goldman-Turaev Lie bialgebra in genus zero and the Kashiwara-Vergne problem

In this paper, we describe a surprising link between the theory of the Goldman-Turaev Lie bialgebra on surfaces of genus zero and the Kashiwara-Vergne (KV) problem in Lie theory. Let $Σ$ be an oriented 2-dimensional manifold with non-empty boundary and $\mathbb{K}$ a field of characteristic zero. The Goldman-Turaev Lie bialgebra is defined by the Goldman bracket $\{ -,- \}$ and Turaev cobracket $δ$ on the $\mathbb{K}$-span of homotopy classes of free loops on $Σ$. Applying an expansion $θ: \mathbb{K}π\to \mathbb{K}\langle x_1, \dots, x_n \rangle$ yields an algebraic description of the operations $\{ -,- \}$ and $δ$ in terms of non-commutative variables $x_1, \dots, x_n$. If $Σ$ is a surface of genus $g=0$ the lowest degree parts $\{ -,- \}_{-1}$ and $δ_{-1}$ are canonically defined (and independent of $θ$). They define a Lie bialgebra structure on the space of cyclic words which was introduced and studied by T. Schedler. It was conjectured by the second and the third authors that one can define an expansion $θ$ such that $\{ -,- \}=\{ -,- \}_{-1}$ and $δ=δ_{-1}$. The main result of this paper states that for surfaces of genus zero constructing such an expansion is essentially equivalent to the KV problem. G. Massuyeau constructed such expansions using the Kontsevich integral. In order to prove this result, we show that the Turaev cobracket $δ$ can be constructed in terms of the double bracket (upgrading the Goldman bracket) and the non-commutative divergence cocycle which plays the central role in the KV theory. Among other things, this observation gives a new topological interpretation of the KV problem and allows to extend it to surfaces with arbitrary number of boundary components (and of arbitrary genus, see [C. R. Acad. Sci. Paris, Ser. I 355 (2017), 123--127]).

math.GT↗

Coadjoint Orbits, Cocycles and Gravitational Wess-Zumino

About 30 years ago, in a joint work with L. Faddeev we introduced a geometric action on coadjoint orbits. This action, in particular, gives rise to a path integral formula for characters of the corresponding group $G$. In this paper, we revisit this topic and observe that the geometric action is a 1-cocycle for the loop group $LG$. In the case of $G$ being a central extension, we construct Wess-Zumino (WZ) type terms and show that the cocycle property of the geometric action gives rise to a Polyakov-Wiegmann (PW) formula. In particular, we obtain a PW type formula for the Polyakov's gravitational WZ action. After quantization, this formula leads to an interesting bulk-boundary decoupling phenomenon previously observed in the WZW model. We explain that this decoupling is a general feature of the Wess-Zumino terms obtained from geometric actions, and that in this case the path integral is expressed in terms of the 2-cocycle which defines the central extension. In memory of our teacher Ludwig Faddeev.

hep-th↗