The Fraunhofer Institute for Secure Information Technology SIT is one of the leading research and development institutions for cybersecurity in Germany and Europe and is part of ATHENE, the national research center for applied cybersecurity. ATHENE is a collaboration between the Fraunhofer Society, TU Darmstadt, Hochschule Darmstadt, and Goethe University Frankfurt. Our common goal: to make the world of tomorrow safer.
Be part of change
LLMs have gained significant attention recently due to their remarkable capabilities. A similar, yet less explored field focuses on text-to-image (T2I) model architectures. Since a picture is worth more than a thousand words, one can assume that T2I models possess at least as many capabilities as text-to-text models (T2T). Therefore, it is important to subject these models to an "alignment" process. In T2T models, some neurones in the architecture are repurposed as safety neurones. To better understand the alignment process, the locations of safety neurones in both architectures should be compared.
Objective: The work aims to investigate the localisations of safety neurones in T2I models and compare them with T2T models. For this purpose, the proposed approaches for the localisation of safety neurones from T2T models will be adapted and implemented for T2I models. Finally, results regarding the localisation and significance of the neurones are analysed to highlight similarities and differences in the architectures.
Results: The results of this work aim to conceptualise the differences in model architectures for LLM security research. Since T2I models receive less attention, it is important to motivate further research on these models. For this purpose, a comprehensive comparison of different architectures and their associated safety neurones will be conducted as part of the work. The results are verified by a targeted deactivation of the identified neurones and then compared with randomly deactivated neurones.
What you do with us:
What you contribute
What we offer
Related works:
We value and promote the diversity of our employees' skills and therefore welcome all applications – regardless of age, gender, nationality, ethnic and social origin, religion, ideology, disability, sexual orientation and identity. Severely disabled persons are given preference in the event of equal suitability. Our tasks are diverse and adaptable – for applicants with disabilities, we work together to find solutions that best promote their abilities.
With its focus on developing key technologies that are vital for the future and enabling the commercial utilization of this work by business and industry, Fraunhofer plays a central role in the innovation process. As a pioneer and catalyst for groundbreaking developments and scientific excellence, Fraunhofer helps shape society now and in the future.
Ready for a change? Then apply now and make a difference! Once we have received your online application, you will receive an automatic confirmation of receipt. We will then get back to you as soon as possible and let you know what happens next.
Fraunhofer Institute for Secure Information Technology SIT
Requisition Number: 81219 Application Deadline:
Master's Thesis: Localisation of Safety Neurones in Text2Image Models • Darmstadt
There are many great reasons for a career at Porsche Consulting.With more than 900 employees around the globe, Porsche Consulting is one of the world's leading management consultancies.Founded in 1... Mehr anzeigen
If you want to be a Maxonian and help bring the best 2D and 3D visual effects, motion graphics, gaming, AR/MR/VR, visualization and design software to the market, then we should have a chat.Packed ... Mehr anzeigen
VINFAST is a pioneering electric vehicle (EV) company committed to revolutionizing the automotive industry with sustainable and innovative mobility solutions.As a leading player in the EV market, V... Mehr anzeigen
Work Your Magic with us! Ready to explore, break barriers, and discover more? We know you’ve got big plans – so do we! Our colleagues across the globe love innovating with science and technology to... Mehr anzeigen
As ADAS/AD moves towards model‑driven intelligence, industry value is extending from map delivery to model training and validation.HERE can convert its map and drive data into a scalable AI model‑c... Mehr anzeigen
The integrated planning approach of our software products ranges from the long-term optimization of network structures to the short-term optimization of transportation capacity utilization.In addit... Mehr anzeigen
Zur Verstärkung unseres Teams suchen wir zum nächstmöglichen Zeitpunkt einen AI Developer (m/w/d), der unsere KI-Projekte vorantreibt und in produktionsreife Lösungen überführt.Als Shift Agency AI ... Mehr anzeigen
Postdoctoral Position in Computational Humanities to Research the Macroevolution of European Literature.The Max Planck Institute for Empirical Aesthetics (MPIEA) investigates why and how people cre... Mehr anzeigen
Jobs in Structural Biology and Related Fields.Digital Twins of Subcellular Life - SCALE Cluster of Excellence - Founding Team.Are you excited about building the next generation of Digital Twins for... Mehr anzeigen
Risk Manager Medical Device (m/w/d).Wieder mobil werden bei schwerer Arthrose oder Knochenerkrankungen? Operationsergebnisse mit Knochenzement verbessern? Heraeus Medical bietet fortschrittliche Lö... Mehr anzeigen
Erinnerst du dich an deinen Kindheitstraum, die Welt zu verändern? Diese Neugier steckt immer noch in dir! Bei msg kannst du den digitalen Wandel der Versicherungsbranche mitgestalten – mit innovat... Mehr anzeigen
Research Assistant / Doctoral Student (f/m/d) – AI & Historical Data at the SAFE Research Data Center.The Leibniz Institute for Financial Research SAFE – Sustainable Architecture for Finance in Eur... Mehr anzeigen
Associated British Foods, is a leading company in the innovation and production of enzymes worldwide.Operating in the biotechnology industry we are an important partner for customers in the applica... Mehr anzeigen
We invite you to become part of our dynamic Health, Safety, and Environment (HSE) team, which specializes in implementing exciting general planning (EPCMV) projects in the thrilling world of the ph... Mehr anzeigen
Senior) Manager (all genders) Life Sciences.Join to apply for the (Senior) Manager role at Porsche Consulting.We’re open to new ideas, and we welcome people who contribute and think for themselves.... Mehr anzeigen
SAP Business AI Architect (m/w/d) - Germany.Senior Technology Architect / SAP Business AI Architect.SAP Business AI, Embedded AI, Premium AI, Joule, BTP, CAP, RAP, RISE, BW, DataSphere, BDC.Germany... Mehr anzeigen
Expert Motion Planning Engineer - Self-Driving.Frankfurt am Main, Germany | Posted on 11/06/2025.VINFAST is a pioneering electric vehicle (EV) company committed to revolutionizing the automotive in... Mehr anzeigen
The Life Sciences team is the fastest-growing industry sector within Porsche Consulting.We support pharmaceutical, medtech, biotech, laboratory, and healthcare organizations in addressing some of t... Mehr anzeigen
Develop training programs for Videojet printing technologies during new product development.This hybrid role is based in Lübeck, Germany.Work closely with engineering, product management, and train... Mehr anzeigen
Are you experienced in leading software projects and enjoy working with intercultural project teams? Are you looking for an exciting opportunity to apply your existing knowledge and continuously ex... Mehr anzeigen
