PhD Position on Cultural Bias in Multimodal AI

We are looking for a motivated PhD candidate to join our interdisciplinary research project addressing biases and representation in cultural heritage collections through human-AI interaction. This project sits at the intersection of computer vision, cultural heritage, and human-computer interaction.

Join our team!
Our aim with this project is to develop multimodal methods for analysing biases in cultural collections through human-agent interaction. With these methods we aim to establish more nuanced and ethical approaches for identifying and understanding issues of biased representation in cultural heritage collections.
This project addresses a critical gap in current AI tools for cultural heritage analysis. While museums, archives, and galleries increasingly seek to understand historical biases in their collections, existing AI methods rely heavily on demographic labels that are costly to produce and often ethically problematic to collect. Your research will explore how interactive vision-language models can work with human expertise to identify patterns of representation without requiring explicit annotations.

Note that this job opening is one of several Hybrid Intelligence job openings, see all on the HI page with job openings. You can apply to more than just this one. If you do so, please inform the Hybrid Intelligence Centre’s Project Manager via email of the projects you are applying to.

This is what you will do
You will investigate how Vision-Language Models (VLMs) can be adapted through techniques like Reinforcement Learning from Human Feedback (RLHF) and Direct Preference Optimization (DPO). These approaches will allow the models to learn from interactions with cultural heritage experts, progressively improving their ability to address questions about representation. The project specifically focuses on developing systems that can adapt to individual users rather than assuming a universal perspective on bias.
The research will make methodological contributions in three converging directions: bias mitigation in AI systems, personalization to individual users, and interactive learning. While existing research typically addresses these areas separately, your work will explore their intersection specifically for visual cultural heritage analysis. This approach has the potential to create tools that respect the subjective nature of bias analysis while still providing meaningful automated assistance.
Your evaluation approach will combine technical benchmarks with user studies involving real cultural heritage experts and students. This dual methodology ensures your systems not only perform well on standard measures but also genuinely help users understand representation issues in collections. Throughout the project, we will work with cultural institutions and experts to develop ethical guidelines for this sensitive research area, ensuring your technical innovations have real impact in the cultural heritage sector.

As the PhD candidate on this project within the Hybrid Intelligene Centre, you will be expected to contribute to the project, described above, and:

• pursue and complete a PhD thesis within the appointment duration of four years;
• collaborate with researchers in the lab and the Hybrid Intelligence Centre;
• present intermediate research results at conferences and workshops, and publishing in proceedings and journals;
• assist in teaching activities.

For this position you will be supervised by Dr. Nanne van Noord (University of Amsterdam) and Dr. Shenghui Wang (University of Twente).

Your profile

• A Master’s degree in a relevant disciplines, such as AI, computer vision, human-computer interaction, or a closely related field;
• technical skills and scientific interest to conduct cutting-edge interdisciplinary research in artificial intelligence and cultural heritage;
• ability to work with a high degree of independence and eagerness to contribute your own ideas;
• good writing and presentation skills;
• full proficiency in spoken and written English.

Experience with or an interest in cultural heritage, bias, and human-centred research are considered a plus. We strongly encourage applications coming from a unique perspective. Tell us how your background fits within the project.

This is what we offer
A temporary contract for 38 hours per week for the duration of 4 years (the initial contract will be for a period of 18 months and after satisfactory evaluation it will be extended for a total duration of 4 years). The required starting date is within 2025. This should lead to a dissertation (PhD thesis). We will draft an educational plan that includes attendance of courses and (international) meetings. We also expect you to assist in teaching undergraduates and master students.

The gross monthly salary, based on 38 hours per week and dependent on relevant experience, ranges between € 2,901 to € 3,707 (scale P). This does not include 8% holiday allowance and 8,3% year-end allowance. The UFO profile PhD candidate is applicable. A favourable tax agreement, the ‘30% ruling’, may apply to non-Dutch applicants. The Collective Labour Agreement of Universities of the Netherlands is applicable.

Besides the salary and a vibrant and challenging environment at Science Park we offer you multiple fringe benefits:

• 232 holiday hours per year (based on fulltime) and extra holidays between Christmas and 1 January;
• multiple courses to follow from our Teaching and Learning Centre;
• a complete educational program for PhD students;
• multiple courses on topics such as leadership for academic staff;
• multiple courses on topics such as time management, handling stress and an online learning platform with 100+ different courses;
• 7 weeks birth leave (partner leave) with 100% salary;
• partly paid parental leave;
• the possibility to set up a workplace at home;
• a pension at ABP for which UvA pays two third part of the contribution;
• the possibility to follow courses to learn Dutch;
• help with housing for a studio or small apartment when you’re moving from abroad.

Are you curious to read more about our extensive package of secondary employment benefits, take a look here.

Where you will work
The Faculty of Science has a student body of around 8,000, as well as 1,800 members of staff working in education, research or support services. Researchers and students at the Faculty of Science are fascinated by every aspect of how the world works, be it elementary particles, the birth of the universe or the functioning of the brain.

The mission of the Informatics Institute (IvI) is to perform curiosity-driven and use-inspired fundamental research in Computer Science. The main research themes are Artificial Intelligence, Computational Science and Systems and Network Engineering. Our research involves complex information systems at large, with a focus on collaborative, data driven, computational and intelligent systems, all with a strong interactive component.

At Multimedia Analytics (MultiX) we research multimedia analytics by developing AI techniques for getting the richest information possible from the data, visualizations, and interactions surpassing human and machine intelligence. We blend multi-modal data in effective interfaces for applications and social impact in public health, forensics and law enforcement, cultural heritage, and data-driven business.

If you feel the profile fits you, and you are interested in the job, we look forward to receiving your application. You can apply online via the button below. We accept applications until and including 16 May 2025.

Applications should include the following information (all files besides your cv should be submitted in one single pdf file):

• a detailed CV including the months (not just years) when referring to your education and work experience;
• a letter of motivation;
• a list of publications;
• the names and email addresses of two references who can provide letters of recommendation.

A knowledge security check can be part of the selection procedure.
(for details: national knowledge security guidelines)

Only complete applications received within the response period via the link below will be considered.

The interviews will be held in the latter half of May and early June.

Do you have any questions or do you require additional information? Please contact:

• dr. Nanne van Noord: n.j.e.vannoord@uva.nl

We aim to create hybrid intelligence for everyone, see also our Diversity Statement. To do this, we need an inclusive and diverse team of researchers. We especially encourage people from underrepresented groups to apply for this job.

38 hours per week

Science Park 904