Towards Interpreting Topic Models with ChatGPT

Emil Rijcken*, Floortje Scheepers, Kalliopi Zervanou, Marco Spruit, Pablo Mosteiro Romero, Uzay Kaymak

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

Topic modeling has become a popular approach to identify semantic structures in text corpora. Despite its wide applications, interpreting the outputs of topic models remains challenging. This paper presents an initial study regarding a new approach to better understand this output, leveraging the large language model ChatGPT. Our approach is built on a three- stage process where we first use topic modeling to identify the main topics in the corpus. Then, we ask a domain expert to assign themes to these topics and prompt ChatGPT to generate human- readable summaries of the topics. Lastly, we compare the human- and machine-produced interpretations. The domain expert found half of ChatGPT’s descriptions useful. This explorative work demonstrates ChatGPT’s capability to describe topics accurately and provide useful insights if prompted accurately.
Original languageEnglish
Title of host publicationThe 20th World Congress of the International Fuzzy Systems Association (IFSA 2023)
PublisherInternational Fuzzy Systems Association
Pages269-275
Number of pages7
Publication statusPublished - 31 Aug 2023
EventThe 20th World Congress of the International Fuzzy Systems Association - EXCO, Daegu, Korea, Republic of
Duration: 20 Aug 202323 Aug 2023

Conference

ConferenceThe 20th World Congress of the International Fuzzy Systems Association
Abbreviated titleIFSA 2023
Country/TerritoryKorea, Republic of
CityDaegu
Period20/08/2323/08/23

Keywords

  • ChatGPT
  • Electronic Health Records
  • Fuzzy Topic Models
  • Large Language Models
  • Prompt Engineering
  • Topic Modeling

Fingerprint

Dive into the research topics of 'Towards Interpreting Topic Models with ChatGPT'. Together they form a unique fingerprint.

Cite this