GPT Inference & Optimization Infrastructure Engineer

OpenAI; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

OpenAI is seeking a software engineer to build the platform that qualifies and optimizes inference workloads across heterogeneous compute environments. You will develop OpenAI-hosted services and secure partner-side software for long-lived optimization workflows, turning research prototypes into reliable, reusable infrastructure with clear contracts and strong observability.

The role involves collaborating across model architecture, distributed execution, compilers, runtimes, and accelerator

Responsibilities

• Design, build, and operate APIs and control-plane services for long-running workload qualification and optimization campaigns, including scheduling, retries, checkpointing, resource budgets, and observability.
• Build secure partner-side execution and evaluation software that can compile, run, verify, profile, and benchmark candidate artifacts on accelerator hardware.
• Integrate model workloads, hardware profiles, compiler toolchains, runtimes, serving engines, and distributed-exe

Job description

OpenAI is seeking a software engineer to build the platform that qualifies and optimizes inference workloads across heterogeneous compute environments. You will develop OpenAI-hosted services and secure partner-side software for long-lived optimization workflows, turning research prototypes into reliable, reusable infrastructure with clear contracts and strong observability.

The role involves collaborating across model architecture, distributed execution, compilers, runtimes, and accelerator