Software Engineer, Model Deployment- ChatGPT Engineering

OpenAI; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

OpenAI seeks a software engineer to design and operate large-scale production systems that support the model lifecycle in production. You will build and evolve the platform used to deploy, configure, and manage models across ChatGPT, with emphasis on deployment orchestration, operational visibility, and reliability.

You will partner with research, infrastructure, and product teams to create scalable platform capabilities and improve the developer experience, enabling teams to deploy models with

Qualifications

• Experience building or operating large-scale production systems.
• Ability to design and implement deployment orchestration and configuration management.
• Strong debugging, reliability, and capacity planning skills.

Responsibilities

• Build and evolve the platform to deploy, configure, and manage models.
• Develop deployment orchestration and model rollouts.
• Create tooling to simplify infrastructure and improve developer experience.
• Automate incident detection, diagnosis, mitigation, and recovery.
• Improve reliability, scalability, and efficiency of model deployments.

Skills

Large-scale systems

Production engineering

Platform engineering

Education

BS in Computer Science or related field

Tools

Kubernetes

Terraform

CI/CD

Observability tooling

Job description

About the Team

ChatGPT relies on a large and growing GPU fleet to serve inference workloads reliably and efficiently. We develop the systems and tools that make it possible to introduce new models, manage production deployments, respond to operational issues, and use infrastructure effectively at scale. Our work spans distributed systems, platform engineering, infrastructure automation, and developer experience. We partner closely with research, infrastructure, and product teams to make model deployment more reliable, more efficient, and easier to manage.

About the Role

We are looking for a software engineer with experience building or operating large-scale production systems. You will design and develop systems that support the model lifecycle in production, including deployment orchestration, configuration management, operational automation, reliability, and capacity management. You will help transform complex operational processes into scalable platform capabilities that enable teams across OpenAI to deploy and manage models with greater confidence and less manual effort. This role is a good fit for engineers who enjoy solving complex operational problems and building software that makes production infrastructure easier to run at scale.

In This Role

You Will Build and evolve the platform used to deploy, configure, and manage models across ChatGPT. Develop systems for deployment orchestration, model rollouts, operational visibility, and production readiness. Create abstractions and tooling that simplify complex infrastructure and improve the developer experience. Automate operational workflows, including incident detection, diagnosis, mitigation, and recovery. Improve the reliability, scalability, and efficiency of model deployments and the infrastructure that supports them. Build systems that support capacity planning, resource allocation, and infrastructure utilization. Partner with research, infrastructure, and product engineering teams to identify common chal