AI Evaluation Engineer - Impact & Safety for PublicServices

Incubator for Artificial Intelligence; Manchester; Hybrid; GBP 46,000 - 60,000; Full time

Benefits offered by this job

Cycle to work

Dental insurance

Hybrid work arrangement

25+ days leave

Job summary

The Incubator for AI (i.AI) is hiring two AI Evaluation Engineers to focus on model-level evaluation of accuracy, bias and safety. You will design evaluation pipelines and work with product and engineering teams to embed evaluation from day one through to scale, ensuring responsible AI across public services.

You'll turn findings into actionable recommendations, collaborate with domain experts on high-quality datasets, and help stakeholders understand real-world impact.

Qualifications

• Experience in a scientific, analytical or engineering role.
• Ability to design experiments and interpret results.
• Experience evaluating AI/ML systems.
• Strong communication of technical findings to diverse audiences.
• Proficiency in Python and version control (Git).

Responsibilities

• Designing and building evaluation pipelines and experiments for AI products.
• Running model and system evaluations to test accuracy, bias, safety and overall performance.
• Working with product and engineering teams to integrate evaluation from day one through scale.
• Partnering with domain experts to create and maintain high-quality golden datasets and benchmarks.
• Turning evaluation results into clear, practical recommendations for product teams.
• Helping teams understand the real-world impact of their products on public services.
• Communicating findings to both technical and non-technical audiences through reports and presentations.
• Developing reusable evaluation approaches that work across many products and services.

Skills

Analytical thinking

Python

Git

Experimental design

AI/ML evaluation

Communication

Tools

Git

Job description

The Incubator for AI (i.AI) is hiring two AI Evaluation Engineers to focus on model-level evaluation of accuracy, bias and safety. You will design evaluation pipelines and work with product and engineering teams to embed evaluation from day one through to scale, ensuring responsible AI across public services.

You'll turn findings into actionable recommendations, collaborate with domain experts on high-quality datasets, and help stakeholders understand real-world impact.