arXiv · 2004.02705
Quantum Inspired Word Representation and Computation
Abstract
Word meaning has different aspects, while the existing word representation "compresses" these aspects into a single vector, and it needs further analysis to recover the information in different dimensions. Inspired by quantum probability, we represent words as density matrices, which are inherently capable of representing mixed states. The experiment shows that the density matrix representation can effectively capture different aspects of word meaning while maintaining comparable reliability with the vector representation. Furthermore, we propose a novel method to combine the coherent summation and incoherent summation in the computation of both vectors and density matrices. It achieves consistent improvement on word analogy task.
Explore related subjects
Keep this discovery
Shen Li, Renfen Hu, Jinshan Wu. 2020-04-06. Quantum Inspired Word Representation and Computation. https://arxiv.org/abs/2004.02705
Cite the original work for its findings. Save a collection to share your selection of sources.