Senior AI Infra Engineer: Kubernetes & Distributed Systems

NVIDIA; Santa Clara (CA); Hybrid; USD 184,000 - 357,000; Full time

Job summary

NVIDIA is seeking a Senior Systems Software Engineer to advance distributed AI infrastructure on Kubernetes, containers, and performance optimization at scale in production. You will own hard technical problems across hyperscale clusters and collaborate with diverse teams to drive innovations.

You will work with researchers and upstream communities to shape AI workloads, contribute to OSS projects, and optimize AI runtime performance while controlling costs.

Qualifications

• Bachelor’s or Master’s degree in Engineering or equivalent experience, ideally in Electrical, Computer Engineering, or Computer Science
• 8+ years of experience in computer architecture, networking, storage systems, and accelerator-based platforms
• Expertise in Kubernetes and familiarity with the broader CNCF ecosystem
• Deep experience with large-scale, parallel, distributed accelerator systems and performance optimization of AI workloads
• Experience with performance modeling and benchmarking for large-scale systems
• Proficiency in Golang and/or Python
• Strong familiarity with the NVIDIA software stack across training and inference
• Expertise with at least one major public cloud provider (e.g., AWS, Azure, GCP, OCI)

Responsibilities

• Lead end-to-end performance and scalability analyses across the Kubernetes-based accelerated runtime stack
• Design upstream architectural changes to Kubernetes control plane for hyperscale clusters
• Improve container startup and latency for scalable AI workloads on Kubernetes
• Contribute to open-source projects related to Kubernetes for AI workloads
• Advance scalability of confidential containers (CoCo) on Kubernetes
• Model full AI-factory deployments using DSX and-scale simulators
• Collaborate with researchers, developers, customers, and upstream groups to automate at-scale workload tests
• Document methods and present findings at industry events and within NVIDIA OSS communities

Skills

Distributed systems

Performance optimization

CI/CD

Education

Bachelor's degree in Engineering or equivalent

Master's degree in Engineering or equivalent

Tools

Kubernetes

Grove

gateway-api-inference-extension

DSX

Job description

NVIDIA is seeking a Senior Systems Software Engineer to advance distributed AI infrastructure on Kubernetes, containers, and performance optimization at scale in production. You will own hard technical problems across hyperscale clusters and collaborate with diverse teams to drive innovations.

You will work with researchers and upstream communities to shape AI workloads, contribute to OSS projects, and optimize AI runtime performance while controlling costs.