Principal Kubernetes & AI Infrastructure Engineer

NVIDIA

Durham (NC)

On-site

USD 272,000 - 431,000

Full time

5 days ago
Be an early applicant
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA is seeking experienced software engineers with Kubernetes experience to help scale up AI infrastructure. You will work on production systems enabling large scalable GPU clusters for AI workloads, focusing on scheduling GPU resources on Kubernetes and health monitoring.

We value deep systems programming expertise (Go, Python), strong communication, and a track record of delivering reliable, high-performance infrastructure.

Qualifications

  • 15+ years in a similar role with impact on large-scale production systems.
  • Software engineering experience with Kubernetes APIs and frameworks, not just cluster ops.
  • Solid knowledge of data structures, algorithms and systems programming languages (Go, Python).
  • Bachelor’s degree or equivalent in CS, Engineering, Physics, Mathematics or related field.

Responsibilities

  • Develop and operate production GPU clusters for AI workloads on DGX Cloud.
  • Implement monitoring and health management to ensure reliability, availability and scalability.
  • Collaborate across NVIDIA teams to improve services and incident response.

Skills

Kubernetes
Go
Python
Data structures & algorithms
Communication skills
Distributed systems

Education

BS in CS/Engineering/Physics/Mathematics

Tools

Slurm
Bright Cluster Manager

Job description

NVIDIA is seeking experienced software engineers with Kubernetes experience to help scale up AI infrastructure. You will work on production systems enabling large scalable GPU clusters for AI workloads, focusing on scheduling GPU resources on Kubernetes and health monitoring.

We value deep systems programming expertise (Go, Python), strong communication, and a track record of delivering reliable, high-performance infrastructure.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infra & Kubernetes Architect
Senior AI Infra & Kubernetes Architect

NVIDIA Corporation • Durham (NC)

On-site
USD 272,000 - 431,000
Equity
Benefits
AI Infrastructure Architect: Kubernetes & GPU Scaling
AI Infrastructure Architect: Kubernetes & GPU Scaling

NVIDIA • United States

Remote
USD 272,000 - 431,000
Senior Software Engineer - Distributed AI Infra (Kubernetes)
Senior Software Engineer - Distributed AI Infra (Kubernetes)

Engg • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
AI Infrastructure Engineer: Kubernetes & GPU Clusters
AI Infrastructure Engineer: Kubernetes & GPU Clusters

NVIDIA • United States

Remote
USD 184,000 - 288,000
Senior AI Infra Engineer - Kubernetes Scale & Performance
Senior AI Infra Engineer - Kubernetes Scale & Performance

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 184,000 - 357,000
Equity
Benefits
Hybrid work
Senior Cloud AI Infra Engineer: Go/C, Kubernetes, GPUs
Senior Cloud AI Infra Engineer: Go/C, Kubernetes, GPUs

Nvidia • Santa Clara (CA)

On-site
USD 240,000 - 340,000
Competitive salaries
Comprehensive benefits package
Equity
Senior Systems Software Engineer: AI Infra & Kubernetes
Senior Systems Software Engineer: AI Infra & Kubernetes

NVIDIA • Seattle (WA)

Hybrid
USD 184,000 - 357,000
Equity
Health benefits
Flexible work arrangement
+1
Senior AI Infrastructure Engineer - GPU & Kubernetes
Senior AI Infrastructure Engineer - GPU & Kubernetes

HCL Technologies Limited • California (MO)

On-site
USD 120,000 - 180,000
401(k) retirement plan
Paid time off (PTO)
Paid holidays
+1
AI Infra Engineer – SRE (Kubernetes)
AI Infra Engineer – SRE (Kubernetes)

Berrybytes • United States

On-site
USD 110,000 - 150,000
Senior AI Infra Architect: Kubernetes at Scale (Equity)
Senior AI Infra Architect: Kubernetes at Scale (Equity)

NVIDIA Corporation • Santa Clara (CA), Northern (KY)

Hybrid
USD 224,000 - 357,000
Equity
Benefits