Senior/Research Associate, AI Evaluation and Assurance

The Alan Turing Institute; Greater London; Presencial; GBP 46.000 - 52.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible working

Family friendly policies

Descripción de la vacante

The Alan Turing Institute in London invites applications for a Research Associate and Senior level to lead a focused project on combining evaluation evidence and explanation methods for machine-learning systems. You will explore evidence theory, probabilistic reasoning, machine reasoning, and human interpretation to demonstrate approaches within the evaluation platform.

You will collaborate with research software engineers and cross-cut teams, contributing to defence and civil aviation

Formación

• You will be technically strong in machine-learning evaluation, uncertainty or assurance.
• You will design and analyse machine-learning evaluations using Python and statistical methods.
• You will communicate complex results clearly to researchers, engineers and external stakeholders.

Responsabilidades

• Lead research for evaluation and explanation evidence in ML systems.
• Design evaluation studies with appropriate metrics and protocols.
• Map evaluation evidence to assurance frameworks and arguments.
• Develop protocols with domain experts including ethics and data protection.
• Communicate findings to diverse stakeholders and contribute to platform design.
• Promote reproducible and ethical data science.

Conocimientos

Machine-learning evaluation

Uncertainty assessment

Python

Statistical methods

Reproducible research

Herramientas

Python

Descripción del empleo

HOURS: 36

CLOSES: Sunday 29th November 23:59

The Role

The Research Associate will lead a scoped research project on the combination of evaluation evidence and explanation methods about machine-learning systems. Drawing on evidence theory, probabilistic reasoning, machine reasoning and human interpretation, you will develop theoretical approaches and demonstrate them using results form the themes evaluation platform.

Alongside the theoretical work, the role contributes to evaluation studies and assurance frameworks in defence and civil aviation, while helping shape a longer-term research programme exploring AI evaluation, verification and uncertainty across emerging technologies such as language models and agentic systems.

You’ll collaborate closely with a team of research software engineers developing the theme’s evaluation infrastructure, colleagues across Fundamental Research and other missions, and external industry stakeholders.

About you

You’ll be a technically strong and curious researcher with expertise in machine-learning evaluation, uncertainty or assurance, and an interest in developing credible evidence that AI systems can be trusted. You’ll combine strong technical skills with experience designing and analysing machine-learning evaluations, using Python, statistical methods and reproducible research practices to turn complex results into meaningful insights.

The successful candidate will be comfortable working across disciplines and communicating technical ideas clearly to researchers, engineers and external stakeholders, including those in defence and regulated environments. At Senior level, you’ll also have the confidence to lead research independently, shape research direction, influence partners and mentor others.

How you will make an impact

• - Lead research for a peer-reviewed paper on combining evaluation and explanation evidence for machine-learning systems.
• - Design and analyse evaluation studies, selecting appropriate metrics, experimental protocols and statistical methods.
• - Map evaluation evidence to assurance and certification frameworks and structured assurance arguments.
• - Develop protocols for eliciting requirements from domain experts and operators, including relevant ethics and data protection processes.
• - Communicate research findings to diverse stakeholders and contribute to dataset specifications and evaluation platform design.
• - Promote reproducible and ethical data science and secure data handling.

Additional Senior duties

• - Provide intellectual and technical leadership, shaping research direction with the Principal Investigator and wider team.
• - Lead engagement with partners and stakeholders on research priorities and assurance requirements.
• - Support proposals, applications and reports for follow-on funding and partnerships.
• - Coordinate delivery across researchers and research software engineers, managing dependencies, risks and key decisions.

Terms and Conditions

This post is offered on a fixed term basis. The annual salary range is £46,415 - £52,494 for Research Associate level / £57,000 - £59,000 for Senior level.

Our offers include excellent benefits including flexible working and family friendly policies, which can be seen here.

Equality Diversity and Inclusion

We value diversity of background, experience, and perspective, and are proud to be an inclusive employer. We warmly encourage applications from all backgrounds, particularly from groups currently under-represented in our sector.

If you feel passionate about this role but don’t meet every single requirement, please apply – we recognise that great candidates may bring strengths beyond the criteria listed.

£46,415 to £59,000. Research Associate level / Senior level