Software Engineer, Agent Infrastructure — Scalable AI

OpenAI; Greater London; Hybrid; GBP 155,000 - 200,000; Full time

Benefits offered by this job

Relocation assistance

Hybrid work model

Job summary

OpenAI is seeking a Software Engineer for the Agent Infrastructure team, to build and scale systems that train and deploy agentic models and to launch new agents to hundreds of millions of users worldwide.

You will work closely with researchers and product teams to stand up in-house container orchestration, production platforms, and integrations, enabling high-performance AI infrastructure at scale.

Qualifications

• Experience building large-scale machine learning infrastructure.
• Ability to design and scale containerized systems.
• Proficiency with Python frameworks (e.g., FastAPI) and API services.
• Experience with Terraform and IaC for complex infra.
• Hands-on with virtualization/containerization tech (Kata, Firecracker, gVisor, Sysbox).

Responsibilities

• Push massive compute clusters to their limits with in-house orchestration.
• Develop and maintain FastAPI and gRPC APIs for agent infrastructure.
• Use Terraform to provision and evolve infrastructure for research and production.
• Collaborate with research teams to optimize systems for AI training runs.

Skills

Large-scale ML infra

Container orchestration

FastAPI

gRPC APIs

Terraform

Kata

Firecracker

gVisor

Sysbox

Cloud platforms

Tools

Terraform

Kata virtualization

Firecracker

gVisor

Sysbox

Job description

OpenAI is seeking a Software Engineer for the Agent Infrastructure team, to build and scale systems that train and deploy agentic models and to launch new agents to hundreds of millions of users worldwide.

You will work closely with researchers and product teams to stand up in-house container orchestration, production platforms, and integrations, enabling high-performance AI infrastructure at scale.