Backend Engineer for ML Evals & Automation

Slope

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

OpenAI's Support Automation team seeks a Backend Software Engineer to design and build an evals infrastructure that measures the quality of our support automation. This deeply technical role focuses on robust backends and data workflows to support knowledge systems and AI-enabled automation.

You will work closely with Data Science and Research to scale evals, pipelines, and APIs, owning development end-to-end and shipping iteratively with a long-term vision.

Qualifications

4+ years of backend engineering experience at product-driven companies (excluding internships).
Proficiency in backend technologies. Our stack includes Python, FastAPI, and Postgres.
Experience designing and scaling distributed systems, APIs, or data processing pipelines.
Have experience building AI agents or applications, including evals and prompting/scaffolding.
Familiar with evaluation methods for LLMs and multi-agent workflows.

Responsibilities

Design eval pipelines that are reliable, reproducible, and extendable.
Build infrastructure for continuous eval monitoring (regression/drift) and robust datasets.
Design, build, and maintain backend services and APIs for intelligent automation.
Integrate and structure data across internal platforms for AI workflows.
Collaborate with data, research, and engineering teams to integrate OpenAI models.

Skills

Python

FastAPI

Postgres

Distributed systems

ML/LLM evals

APIs

Data orchestration

Tools

Python

Job description

You will work closely with Data Science and Research to scale evals, pipelines, and APIs, owning development end-to-end and shipping iteratively with a long-term vision.

Get your free, confidential resume review.

or drag and drop your file here.