AI Infrastructure Architect: Kubernetes & GPU Scaling

NVIDIA

United States

Remote

USD 272,000 - 431,000

Full time

5 days ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

NVIDIA is seeking an experienced software engineer to help scale AI infrastructure. You will join the DGX Cloud team and work on production systems that enable large GPU clusters for diverse AI workloads, including scheduling GPU resources in Kubernetes and building monitoring for reliability and performance.

The role demands deep software engineering experience with Kubernetes APIs, strong data structures and algorithms, and proficiency in Go or Python.

Qualifications

Direct experience in a software engineering role within a highly technical organization with demonstrable impact.
Software development experience with kubernetes APIs and frameworks, not just cluster operations.
Strong communication, able to coordinate across teams and geographies.
15+ years in a similar role on large-scale production systems.
BS in Computer Science, Engineering, Physics, Mathematics, or related field.
Proficiency in Go and/or Python, and solid data structures and algorithms.

Responsibilities

Develop and operate large-scale production GPU clusters on DGX Cloud.
Advance scheduling of GPU resources within Kubernetes and related frameworks.
Implement monitoring and health management for high reliability and performance.
Analyze failures and drive incident response improvements.
Collaborate with cross-functional teams across NVIDIA to maintain production readiness.