Skip to main navigation Skip to search Skip to main content

Topical coherence in LDA-based models through induced segmentation

  • Hesam Amoualian
  • , Wei Lu
  • , Eric Gaussier
  • , Georgios Balikas
  • , Massih Reza Amini
  • , Marianne Clausel
  • LTHE (UMR 5564 CNRS/IRD/Université de Grenoble)
  • Singapore University of Technology and Design

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

24 Citations (Scopus)

Abstract

This paper presents an LDA-based model that generates topically coherent segments within documents by jointly segmenting documents and assigning topics to their words. The coherence between topics is ensured through a copula, binding the topics associated to the words of a segment. In addition, this model relies on both document and segment specific topic distributions so as to capture fine grained differences in topic assignments. We show that the proposed model naturally encompasses other state-of-the-art LDA-based models designed for similar tasks. Furthermore, our experiments, conducted on six different publicly available datasets, show the effectiveness of our model in terms of perplexity, Normalized Pointwise Mutual Information, which captures the coherence between the generated topics, and the Micro F1 measure for text classification.

Original languageEnglish
Title of host publicationACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)
PublisherAssociation for Computational Linguistics (ACL)
Pages1799-1809
Number of pages11
ISBN (Electronic)9781945626753
DOIs
Publication statusPublished - 1 Jan 2017
Externally publishedYes
Event55th Annual Meeting of the Association for Computational Linguistics, ACL 2017 - Vancouver, Canada
Duration: 30 Jul 20174 Aug 2017

Publication series

NameACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)
Volume1

Conference

Conference55th Annual Meeting of the Association for Computational Linguistics, ACL 2017
Country/TerritoryCanada
CityVancouver
Period30/07/174/08/17

Fingerprint

Dive into the research topics of 'Topical coherence in LDA-based models through induced segmentation'. Together they form a unique fingerprint.

Cite this