Senior Software Engineer, AI Agent Training & Evals

Prolific; United Kingdom; Remote; GBP 90,000 - 120,000; Full time

Job summary

Prolific is seeking a Senior Software Engineer to join the Agent Training & Evals team. You’ll help design and build scalable infrastructure to evaluate AI agents, collaborating with product, AI research and other engineers.

This remote UK role offers high ownership, fast iteration and impact on real-world AI safety and reliability. You’ll ship production-ready systems and influence technical direction in a growing, mission-driven company.

Qualifications

• Experience building scalable infrastructure or distributed systems in the cloud.
• Hands-on experience with deploying and operating in production environments.
• Experience integrating and evaluating AI models or agents is a plus.

Responsibilities

• Build platform to support evaluating and tuning agents.
• Take prototypes to production; turn experiments into reliable software.
• Own what is shipped as it scales in production.
• Solve hard problems around data, compute, orchestration, scaling, security and reliability.

Skills

Software Engineering

Cloud infrastructure

Distributed systems

MLOps

Python

Tools

FastAPI

Vue.js

Kubernetes

Datadog

GitHub Actions

PostgreSQL

Job description

Prolific is seeking a Senior Software Engineer to join the Agent Training & Evals team. You’ll help design and build scalable infrastructure to evaluate AI agents, collaborating with product, AI research and other engineers.

This remote UK role offers high ownership, fast iteration and impact on real-world AI safety and reliability. You’ll ship production-ready systems and influence technical direction in a growing, mission-driven company.