Senior Product Engineer, AI Agent Training

Prolific; United Kingdom; On-site; GBP 90,000 - 130,000; Full time

Job summary

Prolific is seeking a Senior Product Engineer to join the Agent Training & Eval s team in a remote UK setting. You’ll help build the infrastructure to evaluate AI agents while collaborating with human experts in safe, secure environments.

You’ll own the technical direction of the team, turning ambiguous problems into scalable systems and directly affecting product outcomes. This role blends engineering rigor with AI research impact.

Qualifications

• Experience building scalable cloud infrastructure and distributed systems.
• Experience deploying and securing services.
• Hands-on experience evaluating AI models or agents.
• Interest in training and evaluating AI agents.
• Bonus: image/video/audio processing experience.

Responsibilities

• Solve hard problems around compute, orchestration, scaling, security and reliability.
• Help develop approaches for training, benchmarking and evaluating AI agents.
• Work with emerging agentic AI technologies and rapidly evolving models.
• Make pragmatic technical decisions in a highly ambiguous environment.
• Partner closely with product engineering and AI research to turn customer problems into working products.
• Drive direct impact in a fast-moving, high-ownership, cross-functional team.

Skills

Scalable infrastructure

Distributed systems

API design

Python

Security & reliability

Tools

FastAPI

Kubernetes

GitHub Actions

DataDog

Job description

Prolific is seeking a Senior Product Engineer to join the Agent Training & Eval s team in a remote UK setting. You’ll help build the infrastructure to evaluate AI agents while collaborating with human experts in safe, secure environments.

You’ll own the technical direction of the team, turning ambiguous problems into scalable systems and directly affecting product outcomes. This role blends engineering rigor with AI research impact.