Senior Software Engineer – Agent Training & Evaluations (Remote)

Prolific; United States; Remote; GBP 90.000 - 130.000; Vollzeit

Benefits dieser Stelle

Remote work

Competitive salary and benefits

Zusammenfassung

Prolific is seeking a Senior Software Engineer to join the Agent Training & Evals team. You'll help build scalable infrastructure to evaluate AI agents at scale, turning research ideas into reliable production software and shaping the team's technical direction.

You’ll work with product, AI research and customers to turn problems into working products, own what you ship in production, and tackle data, compute, security and reliability challenges in a fast-moving, high-ownership environment.

Qualifikationen

• Background in Software Engineering, Data Engineering or MLOps.
• Experience building scalable infrastructure or distributed systems in the cloud.
• Solid understanding of deployment, scaling and security of systems.
• Hands-on experience integrating and evaluating AI models or agents.

Aufgaben

• Build a platform to support evaluating and fine-tuning agents.
• Take prototypes to production; turn experiments into reliable, well-tested software.
• Own what we ship as it scales in production.
• Solve hard problems around data, compute, orchestration, scaling, security and reliability.
• Work with emerging agentic AI technologies and rapidly evolving models.
• Make informed product and technical decisions in a highly experimental environment.
• Partner closely with customers, product engineering and AI research to turn problems into working products.
• Drive direct impact in a fast-moving, high-ownership, cross-functional team.

Kenntnisse

Software Engineering

Data Engineering

MLOps

Cloud infrastructure

Distributed systems

Python

Ausbildung

Bachelor's degree in Computer Science or related field

Tools

GitHub Actions

Kubernetes

Datadog

Langfuse

FastAPI

Vue.js

Postgres SQL

Jobbeschreibung

Prolific is seeking a Senior Software Engineer to join the Agent Training & Evals team. You'll help build scalable infrastructure to evaluate AI agents at scale, turning research ideas into reliable production software and shaping the team's technical direction.

You’ll work with product, AI research and customers to turn problems into working products, own what you ship in production, and tackle data, compute, security and reliability challenges in a fast-moving, high-ownership environment.