AI Evaluation & Benchmarking Lead, Data Science

Jobtailor; Manchester; On-site; GBP 60,000 - 90,000; Full time

Job summary

Jobtailor in Manchester is seeking a data science professional to design and run end-to-end benchmarking workflows, build scalable evaluation pipelines and translate findings into actionable insights. You will review literature, deploy ML workloads to cloud platforms, and contribute to production-grade experimentation infrastructure while supporting client demos and strategic technical direction.

The role requires hands-on data science skills, strong Python proficiency, and willingness to travel

Qualifications

• Strong hands-on experience in Data Science concepts or LLM experimentation using structured evaluation frameworks.
• Highly proficient in Python, including asynchronous programming, multithreading and writing maintainable code.
• Experience deploying ML workloads to cloud platforms (Azure, AWS or GCP).
• Familiarity with CI/CD and containerisation (Docker/ Podman).
• Applied knowledge of statistics and experimental design.
• Ability to translate findings into actionable recommendations.
• Comfortable managing fastmoving workstreams and operating autonomously.
• Emerging leadership behaviours, including taking initiative, influencing technical direction, communicating clearly and supporting the development of others.
• Available for work visa sponsorship.
• Up to 20% travel.

Responsibilities

• Design and run end-to-end benchmarking workflows from understanding client use cases through generating business-ready insights
• Build scalable evaluation frameworks, metrics and pipelines
• Review academic literature to ensure evaluation strategies reflect leading research and best practice
• Develop, maintain and improve experimentation infrastructure
• Ensure robustness and production-grade engineering
• Produce clear, client-ready insights
• Support technical demos and deep-dive sessions
• Influence AI model selection and technical strategy across PwC projects and client engagements

Skills

Data Science Concepts

LLM Experimentation

Python Programming

Async Programming

Multithreading

ML Deployment

Statistics

Experimental Design

Tools

Azure

AWS

GCP

Docker

Podman

Job description

Jobtailor in Manchester is seeking a data science professional to design and run end-to-end benchmarking workflows, build scalable evaluation pipelines and translate findings into actionable insights. You will review literature, deploy ML workloads to cloud platforms, and contribute to production-grade experimentation infrastructure while supporting client demos and strategic technical direction.

The role requires hands-on data science skills, strong Python proficiency, and willingness to travel