GPU Infrastructure Engineer - Scale & Automation

United States Digital Space LLC; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

United States Digital Space LLC is seeking a Software Engineer to design, build, and operate software for large-scale GPU infrastructure powering ChatGPT inference. You will collaborate with infrastructure, research, and product teams to improve reliability and compute utilization.

The role emphasizes automating fleet operations, improving observability, and delivering scalable solutions across thousands of GPUs in a fast-moving environment.

Qualifications

• 5+ years of software engineering experience building production infrastructure.
• Strong programming skills in Go, Python, C++, Rust, or similar systems languages.
• Experience designing and operating highly available distributed systems.
• Experience with GPU infrastructure, high‑performance computing, ML infrastructure, or large‑scale compute platforms.
• Experience with Kubernetes, cloud infrastructure, Linux, networking, and observability tooling.
• Excellent debugging, systems design, and operational problem‑solving skills.
• Strong communication skills and experience collaborating across engineering organizations.

Responsibilities

• Design, build, and operate software that manages large‑scale GPU infrastructure supporting ChatGPT inference.
• Build internal platforms, tooling, and AI‑powered agents that automate fleet operations and reduce operational overhead.
• Improve observability, reliability, and operational efficiency across thousands of GPUs.
• Develop systems for capacity planning, scheduling, fleet health monitoring, and incident response.
• Identify infrastructure bottlenecks and implement solutions that improve utilization, scalability, and performance.
• Partner with research, platform, networking, and systems teams to improve our compute platform.
• Help establish engineering best practices around operational excellence, automation, and infrastructure reliability.

Skills

Distributed systems

Software engineering

Cross-team collaboration

Problem solving

System design

Tools

Go

Python

C++

Rust

Kubernetes

Linux

Cloud infrastructure

Observability tooling

Job description

United States Digital Space LLC is seeking a Software Engineer to design, build, and operate software for large-scale GPU infrastructure powering ChatGPT inference. You will collaborate with infrastructure, research, and product teams to improve reliability and compute utilization.

The role emphasizes automating fleet operations, improving observability, and delivering scalable solutions across thousands of GPUs in a fast-moving environment.