Senior Systems Software Engineer: AI Infra & Kubernetes

NVIDIA; Seattle (WA); Hybrid; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Health benefits

Flexible work arrangement

Hybrid/Remote options

Job summary

NVIDIA DGX Cloud team seeks a Senior Systems Software Engineer with deep expertise in distributed systems, Kubernetes, containers, and performance at scale. You’ll own hard technical problems across GPU operators, inference serving, and cloud platforms, shaping AI infrastructure in production.

In this role you’ll optimize startup and latency, contribute to upstream Kubernetes and CNCF efforts, and model AI factory deployments with large-scale simulations.

Qualifications

• Bachelor’s or Master’s degree in Engineering or equivalent experience.
• 8+ years in computer architecture, networking, storage, and accelerators.
• Expertise in Kubernetes and CNCF ecosystem.
• Deep experience with large-scale distributed accelerator systems and AI workloads.

Responsibilities

• Lead end-to-end performance and scalability analyses in Kubernetes-based runtime stacks.
• Design upstream architectural changes for hyperscale clusters.
• Improve container startup and latency for GPU-based inference.
• Contribute to open-source projects for AI workloads and orchestration.

Skills

Kubernetes expertise

Golang

Python

Distributed systems

Performance optimization

Education

Bachelor's degree in Engineering or related

Master's degree preferred

Tools

NVIDIA GPU Operator

Docker

Gateway API (inference extension)

Job description

NVIDIA DGX Cloud team seeks a Senior Systems Software Engineer with deep expertise in distributed systems, Kubernetes, containers, and performance at scale. You’ll own hard technical problems across GPU operators, inference serving, and cloud platforms, shaping AI infrastructure in production.

In this role you’ll optimize startup and latency, contribute to upstream Kubernetes and CNCF efforts, and model AI factory deployments with large-scale simulations.