GPU Infrastructure Engineer — Scale & Reliability for Production

Triwill Group; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

OpenAI in London seeks a software engineer to build and operate large-scale production systems powering ChatGPT. You’ll develop tooling for fleet health, capacity planning, automation, and incident response, collaborating with infra, research, and product teams to improve reliability and compute utilization.

The role suits engineers who enjoy solving complex operational problems and building software that makes production infrastructure easier to run at scale.

Qualifications

• Five or more years of software engineering experience building production infrastructure.
• Strong programming skills in Go, Python, C++, Rust, or a comparable language.
• Experience designing or operating highly available distributed systems.
• Experience with GPU infrastructure, high-performance computing, ML infra, or large-scale compute platforms.

Responsibilities

• Build software and internal tools to manage large-scale GPU infrastructure supporting ChatGPT inference.
• Develop systems for capacity planning, fleet health monitoring, and resource utilization.
• Automate operational workflows, including incident detection, diagnosis, and response.
• Identify and address bottlenecks affecting fleet reliability, scalability, and performance.
• Partner with infrastructure, research, and product engineering teams to improve the compute platform.

Skills

Go

Python

C++

Rust

Job description

OpenAI in London seeks a software engineer to build and operate large-scale production systems powering ChatGPT. You’ll develop tooling for fleet health, capacity planning, automation, and incident response, collaborating with infra, research, and product teams to improve reliability and compute utilization.

The role suits engineers who enjoy solving complex operational problems and building software that makes production infrastructure easier to run at scale.