Senior Software Engineer - Distributed AI Infra (Kubernetes)

Engg; Santa Clara (CA); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is hiring experienced software engineers with Kubernetes experience to help scale AI Infrastructure. You will contribute to production systems for large GPU clusters and develop scheduling software on Kubernetes, with a focus on reliability and high performance.

Ideal candidates have 8+ years in a similar role, strong Go or Python skills, and a track record in large-scale production systems. This position offers equity and benefits, with base pay varying by level and location.

Qualifications

• Direct experience in a software engineering role within a highly technical organization with demonstrable impact.
• Software development experience with kubernetes APIs and frameworks, not just cluster operation.
• Strong communication skills and ability to coordinate across teams and geographies.
• 8+ years in a similar role and experience on large-scale production systems.
• Technical knowledge including Go or Python and solid understanding of data structures and algorithms.

Responsibilities

• Be part of a DGX Cloud team responsible for production systems enabling large scalable GPU clusters for AI workloads.
• Develop custom software related to scheduling GPU resources on Kubernetes.
• Implement monitoring and health management to ensure reliability, availability, and scalability of GPU assets.
• Process multiple data streams from hardware diagnostics to cluster and network telemetry.
• Collaborate across NVIDIA teams to ensure production AI clusters run reliably with maximum performance.
• Evaluate failures and improve services via a defined incident management process.

Skills

Kubernetes APIs

Go

Python

Distributed systems

Education

BS in Computer Science, Engineering, Physics, Mathematics or comparable degree

Tools

Slurm

Bright Cluster Manager

GPU scheduling tooling

Job description

NVIDIA is hiring experienced software engineers with Kubernetes experience to help scale AI Infrastructure. You will contribute to production systems for large GPU clusters and develop scheduling software on Kubernetes, with a focus on reliability and high performance.

Ideal candidates have 8+ years in a similar role, strong Go or Python skills, and a track record in large-scale production systems. This position offers equity and benefits, with base pay varying by level and location.