Software Engineer, AI Inference Infrastructure Platform

Slope; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

OpenAI is seeking a software engineer to design and operate APIs and control‑plane services for long‑running workload qualification and optimization campaigns across heterogeneous compute environments. You will build OpenAI‑hosted services and secure partner‑side software to compile, run, verify, profile, and benchmark artifacts on accelerator hardware.

You will collaborate across model architecture, distributed execution, compilers, runtimes, and security boundaries to turn research prototypes

Qualifications

• Experience building distributed systems, infrastructure platforms, production services, or orchestration systems.
• Proficiency in Python, C++, Go, or Rust.
• Strong understanding of Linux, networking, storage, containers, distributed execution.

Responsibilities

• Design, build, and operate APIs and control‑plane services for long‑running workload qualification and optimization campaigns, including scheduling, retries, checkpointing, resource budgets, and observability.
• Build secure partner‑side execution and evaluation software that can compile, run, verify, profile, and benchmark candidate artifacts on accelerator hardware.
• Integrate model workloads, hardware profiles, compiler toolchains, runtimes, serving engines, and distributed‑execution backends into a repeatable platform.
• Develop correctness and performance evaluation systems spanning fidelity, latency, throughput, memory footprint, accelerator utilization, and cost efficiency.
• Automate generation and improvement of kernels, runtime configurations, parallelization strategies, and serving‑stack changes.
• Diagnose performance and correctness issues across model code, kernels, compilers, runtimes, memory systems, networking, and hardware.

Skills

Distributed systems

Infrastructure platforms

Production services

Developer platforms

Orchestration systems

Tools

Linux

Containers

Networking

Profiling/Tracing

Job description

OpenAI is seeking a software engineer to design and operate APIs and control‑plane services for long‑running workload qualification and optimization campaigns across heterogeneous compute environments. You will build OpenAI‑hosted services and secure partner‑side software to compile, run, verify, profile, and benchmark artifacts on accelerator hardware.

You will collaborate across model architecture, distributed execution, compilers, runtimes, and security boundaries to turn research prototypes