Senior AI Infrastructure Engineer - Kubernetes & Scale

NVIDIA; Seattle (WA); Hybrid; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Systems Software Engineer for the DGX Cloud org. You will tackle scaling AI infrastructure, building scalable Kubernetes-based runtimes, and optimizing performance across thousands of GPU nodes.

The role emphasizes collaboration with open-source communities and upstream projects. The team values innovation, cost efficiency, and driving impact at scale, with a preference for hybrid work and open to remote arrangements.

Qualifications

• Bachelor’s or Master’s degree in Engineering or equivalent experience, ideally inElectrical, Computer Engineering, or Computer Science
• 8+ years of experience in computer architecture, networking, storage systems and accelerator‑based platforms
• Expertise in Kubernetes and familiarity with the broader CNCF ecosystem
• Deep experience with large‑scale, parallel, distributed accelerator systems and performance optimization of AI workloads
• Experience with performance modeling and benchmarking for large‑scale systems
• Proficiency in Golang and/or Python
• Strong familiarity with the NVIDIA software stack across training and inference
• Expertise with at least one major public cloud provider (for example, AWS, Azure, GCP, or OCI)

Responsibilities

• Lead end-to-end performance and scalability analysis across the Kubernetes‑based accelerated runtime stack.
• Design and contribute upstream architectural changes to the Kubernetes control plane for hyperscale clusters.
• Improve container startup and cold-start latency for scalable AI inference on Kubernetes across thousands of GPU nodes.
• Contribute to open-source Kubernetes projects for AI workloads, focusing on scalability and multi-node training/inference.
• Advance scalability and performance of confidential containers (CoCo) on Kubernetes.
• Model AI-factory deployments using DSX to validate scalability on thousands of simulated GPUs.
• Collaborate to design automated, at-scale workload tests and CI/CD performance testing.
• Document results and present at industry events; engage with upstream groups to influence AI workload performance.

Skills

Kubernetes

Distributed systems

Golang

Python

Cloud platforms

Performance optimization

GPU/accelerator stacks

Education

Bachelor's or Master's in Engineering or CS

Job description

NVIDIA is seeking a Senior Systems Software Engineer for the DGX Cloud org. You will tackle scaling AI infrastructure, building scalable Kubernetes-based runtimes, and optimizing performance across thousands of GPU nodes.

The role emphasizes collaboration with open-source communities and upstream projects. The team values innovation, cost efficiency, and driving impact at scale, with a preference for hybrid work and open to remote arrangements.