A comparison of latent semantic analysis and correspondence analysis of document-term matrices

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Latent semantic analysis (LSA) and correspondence analysis (CA) are two techniques that use a singular value decomposition for dimensionality reduction. LSA has been extensively used to obtain low-dimensional representations that capture relationships among documents and terms. In this article, we present a theoretical analysis and comparison of the two techniques in the context of document-term matrices. We show that CA has some attractive properties as compared to LSA, for instance that effects of margins, that is, sums of row elements and column elements, arising from differing document lengths and term frequencies are effectively eliminated so that the CA solution is optimally suited to focus on relationships among documents and terms. A unifying framework is proposed that includes both CA and LSA as special cases. We empirically compare CA to various LSA-based methods on text categorization in English and authorship attribution on historical Dutch texts and find that CA performs significantly better. We also apply CA to a long-standing question regarding the authorship of the Dutch national anthem Wilhelmus and provide further support that it can be attributed to the author Datheen, among several contenders.
Original languageEnglish
Pages (from-to)722-752
JournalNatural Language Engineering
Volume30
Issue number4
Early online date18 May 2023
DOIs
Publication statusPublished - Jul 2024

Bibliographical note

Funding Information:
Author Qianqian Qi is supported by the China Scholarship Council.

Publisher Copyright:
© The Author(s), 2023. Published by Cambridge University Press.

Keywords

  • Authorship attribution
  • Information retrieval
  • Singular value decomposition
  • Statistical methods
  • Text classification
  • Text data mining

Fingerprint

Dive into the research topics of 'A comparison of latent semantic analysis and correspondence analysis of document-term matrices'. Together they form a unique fingerprint.

Cite this