To path indicator Subpages of “Teaching“ To navigation To quick access To footer with other services
To content
Logo "Digital Transformation" with text
Department of Business and Economics
A lecture in the Audimax © Oliver Schaper​/​TU Dortmund
Master thesis

AI-enabled evaluation of the quality of content on information platforms

This thesis is carried out in cooperation with Tür an Tür - Digitalfabrik gGmbH, which offers Integreat. Integreat is Germany's largest multilingual information platform for refugees and immigrants, used by over 150 cities and districts. The content is maintained decentrally by municipal administrations - with limited resources and little feedback on what users actually need.

A study published in 2025 (Khalil, JQD:DM) evaluated over 11 million page views (2018-2024) for the first time and shows that there is a systematic gap between municipal prioritization and actual user demand. Topics such as opening hours, mobility and LGBTQ content are structurally underserved in terms of their intensity of use.

This master's thesis aims to develop an automated evaluation of the quality of content using a Large Language Model (LLM) to improve the provision of information. Specifically, quality dimensions are to be determined and then an LLM-supported software tool for the automated evaluation of quality dimensions is to be developed and tested.

Exemplary questions

  • Which quality dimensions are relevant for the evaluation of content on information platforms?
  • How can an LLM-supported approach for the automated evaluation of these quality dimensions be designed?
  • To what extent do LLM-supported evaluations of content quality differ from human evaluations?

The following research methods, for example, can be used for the work:

  • Design science research (development of an LLM-supported software prototype)
  • Primary data collection (interviews with stakeholders)
  • Analysis of company data

Requirements

This topic is aimed at students of economics, industrial engineering or business informatics who meet the following requirements:

  • Interest in current research on the use of LLMs
  • A high degree of independence and personal responsibility
  • Experience with scientific research methods and analytical skills

Literature

  • Khalil, S. (2025). Information on Integration: Administrative Offerings & Immigrant Engagement—An Explorative Large-N Analysis of the 'Integreat' Platform in Germany. Journal of Quantitative Description: Digital Media, 5.