Multi-Relational Latent Semantic Analysis

Kai-Wei Chang, Wen-tau Yih, and Chris Meek, in EMNLP, 2013.

[Full Text]


We present Multi-Relational Latent Semantic Analysis (MRLSA) which generalizes Latent Semantic Analysis (LSA). MRLSA provides an elegant approach to combining multiple relations between words by constructing a 3-way tensor. Similar to LSA, a low-rank approximation of the tensor is derived using a tensor decomposition. Each word in the vocabulary is thus represented by a vector in the latent semantic space and each relation is captured by a latent square matrix. The degree of two words having a specific relation can then be measured through simple linear algebraic operations. We demonstrate that by integrating multiple relations from both homogeneous and heterogeneous information sources, MRLSA achieves state-of-the-art performance on existing benchmark datasets for two relations, antonymy and is-a.

Bib Entry

  author = {Chang, Kai-Wei and Yih, Wen-tau and Meek, Chris},
  title = {Multi-Relational Latent Semantic Analysis},
  booktitle = {EMNLP},
  slides_url = {/documents/slides/chang2013mrlsa_slide.pdf},
  year = {2013}