Doctoral Researcher in LVLM Hallucination Detection

About us

The University of Luxembourg is an international research university with a distinctly multilingual and interdisciplinary character.

The  Interdisciplinary Centre for Security, Reliability and Trust ( SnT ) at the University of Luxembourg is a leading international research and innovation centre in secure, reliable and trustworthy ICT systems and services.

We play an instrumental role in Europe by fueling innovation through research partnerships with industry, boosting R&D investments leading to economic growth, and attracting highly qualified talent. We look for researchers from diverse academic backgrounds to contribute to our projects in areas such as : Network Security, Information Assurance, Model-driven Security, Cloud Computing, Cryptography, Satellite Systems, Vehicular Networks, and ICT Services & Applications.

Your role

Large vision-language models (LVLMs) can describe driving scenes and support decisions [Li25], but they sometimes hallucinate objects, relations, or events that are not present [Liu24,Liu25]. In a safety-critical domain, reducing hallucinations and improving robustness and trustworthiness are essential. This PhD targets principled ways to detect, analyze, and mitigate hallucinations in video-based LVLMs for autonomous driving.

Objectives

• Design, develop, and evaluate novel method(s) to detect and localize hallucinations in LVLM outputs for autonomous driving tasks
• Investigate and propose mitigation strategies to reduce hallucinations or improve model confidence
• Evaluate and benchmark against state-of-the-art methods the reliability and robustness of the hallucination detection system under diverse visual and textual conditions

Primary experiments will be conducted in CARLA (https : / / carla.org), enabling controlled and repeatable evaluation of hallucinations under diverse driving conditions. The PhD student will work closely with POST Telecom's company (Luxembourg), who is co-funding this PhD position.

Research Environment

The PhD student will join the Secure and Reliable Software Engineering and Decision-Making (SerVal) group at the University of Luxembourg. SerVal conducts research in security and reliability in software engineering, with a particular focus on AI, data science, and decision-making, as well as designing, testing, and debugging to improve software quality across domains such as FinTech, energy, and Industry 4.0.

Within this context, the PhD will contribute to the group's growing research on trustworthy AI, focusing on methods that improve the transparency, reliability, and interpretability of intelligent systems in safety-critical domains like autonomous driving.

Your profile

LanguageRequiremets :

Applicants must demonstrate at least B2-level proficiency in the language of their thesis. For details and accepted certificates, please visit the Application for admission - Doctoral Candidates .

We offer

How to apply

Applic ations should include :

All qualified individuals are encouraged to apply. In line with our values, the University of Luxembourg promotes an inclusive culture. We encourage applications from individuals of all backgrounds and are dedicated to upholding equality and respect for our employees and students.

General information :

The yearly gross salary for every PhD at the UL is EUR 41976 (full time).