Senior Product Engineer - AI Agent Evaluation & Infra

Prolific

Greater London

On-site

GBP 85,000 - 120,000

Full time

14 days+

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Remote working

Benefits

Job summary

Prolific is seeking a Senior Product Engineer to join the Agentic Training & Evals team, building the infrastructure to evaluate AI agents in secure environments. This 0-1 role offers ownership over technical direction and close collaboration with engineering, product, and AI research.

You’ll tackle scalable cloud infrastructure, security, and deployment challenges, while shaping how agents are trained, evaluated and improved.

Qualifications

Strong experience building scalable infrastructure or distributed systems in the cloud.
Solid understanding of how systems are deployed, scaled and secured.
Hands-on experience with evaluating AI models or agents.
Interest in how AI agents are trained, evaluated and improved.
Bonus: experience with image, video, or audio processing.
Strong product mindset with a focus on delivering business and customer value.
Comfort with ambiguity, and the ability to move quickly from idea to working system.
Strong communication and collaboration skills.
Python experience is useful, but not essential.

Responsibilities

Solve hard problems around compute, orchestration, scaling, security and reliability.
Help develop approaches for training, benchmarking and evaluating AI agents.
Work with emerging agentic AI technologies and rapidly evolving models.
Make pragmatic technical decisions in a highly ambiguous environment.
Partner closely with product engineering and AI research to turn customer problems into working products.
Drive direct impact in a fast-moving, high-ownership, cross-functional team.