Senior Product Engineer: AI Agent Training & Evals Remote

Prolific; United Kingdom; Remote; GBP 70,000 - 110,000; Full time

Job summary

Prolific is seeking a Senior Product Engineer to help build the Agentic Training & Evals infrastructure in a remote, UK-based role. You will shape architecture and tooling for evaluating AI agents, working as one of the first engineers in the team and owning significant technical direction.

You will collaborate with engineering, product and AI research to translate ambiguous problems into scalable systems, delivering measurable business value and user impact.

Qualifications

• Experience building scalable infrastructure or distributed systems in the cloud.
• Solid understanding of how systems are deployed, scaled and secured.
• Hands-on experience with evaluating AI models or agents.
• Interest in how AI agents are trained, evaluated and improved.
• Bonus: experience with image, video, or audio processing.
• Strong product mindset with a focus on delivering business and customer value.
• Comfort with ambiguity, and the ability to move quickly from idea to working system.
• Strong communication and collaboration skills.
• Python experience is useful, but not essential.

Responsibilities

• Solve hard problems around compute, orchestration, scaling, security and reliability.
• Help develop approaches for training, benchmarking and evaluating AI agents.

Skills

Distributed systems

Cloud infrastructure

Security engineering

AI model evaluation

Python

Collaboration

Ambiguity tolerance

Communication

Tools

AWS

GCP

CI/CD

Job description

Prolific is seeking a Senior Product Engineer to help build the Agentic Training & Evals infrastructure in a remote, UK-based role. You will shape architecture and tooling for evaluating AI agents, working as one of the first engineers in the team and owning significant technical direction.

You will collaborate with engineering, product and AI research to translate ambiguous problems into scalable systems, delivering measurable business value and user impact.