Searcharxiv⌕ Search
Home/Archive/arXiv

arXiv · 1810.10136

Local Homology of Word Embeddings

Tadas Temčinas
View original source ↗Read source document ↗Export metadata ↓

Abstract

Topological data analysis (TDA) has been widely used to make progress on a number of problems. However, it seems that TDA application in natural language processing (NLP) is at its infancy. In this paper we try to bridge the gap by arguing why TDA tools are a natural choice when it comes to analysing word embedding data. We describe a parallelisable unsupervised learning algorithm based on local homology of datapoints and show some experimental results on word embedding data. We see that local homology of datapoints in word embedding data contains some information that can potentially be used to solve the word sense disambiguation problem.

Explore related subjects

math.ATcs.CL

Keep this discovery

BibTeXRIS

Tadas Temčinas. 2018-10-24. Local Homology of Word Embeddings. https://arxiv.org/abs/1810.10136

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Homogeneous Milnor fibers and Kato--Matsumoto bounds via simplicial multiwedges

For every $n\geq 3$ and $s\geq 2$, we construct a homogeneous polynomial of degree $n(n+1)/2$ whose Milnor fiber is exactly $2s$-connected and whose rational cohomology contains a strictly defined nontrivial $n$-fold Massey product on classes of degree $2s+1$, implying that the Milnor fiber is non-formal, while attaining the Kato--Matsumoto connectivity bound. Our construction is based on the simplicial multiwedges of the nerve complexes of simple polytopes introduced by Limonchenko, combined with Suciu's realization of weighted homogeneous Milnor fibers. We thereby answer two problems posed by Suciu.

math.AT↗
arXiv2026

The homotopy types of directed path and trace spaces

We construct a saturated directed space with a Hausdorff $\Delta$-generated underlying space and two distinct points such that the trace space between them is homeomorphic to a square, whereas the directed path space has a nontrivial fundamental group. In particular, the canonical quotient map is not a weak homotopy equivalence. The same conclusion holds for regular directed paths modulo increasing homeomorphisms.

math.AT↗
arXiv2026

Moduli spaces of geometric functorial field theories

We develop tools to compute moduli spaces of geometric functorial field theories as mapping spaces of equivariant simplicial presheaves. Given a d-dimensional geometric structure F, presented as a presheaf on the site of smooth families of d-manifolds, we define its Cartesian realization, which is an O(d)-equivariant simplicial presheaf on the site of Cartesian spaces. We use Cartesian realizations to present the moduli space of functorial field theories with geometric structure F as a mapping space between O(d)-equivariant simplicial presheaves. In a companion paper, we use this result to compute the moduli space of smooth one-dimensional oriented Riemannian functorial field theories valued in an arbitrary smooth symmetric monoidal infinity-category.

math.AT↗