Senior Software Engineer - Cluster Readiness & Validation

NVIDIA Corporation; Austin (TX); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity compensation

Benefits

Job summary

NVIDIA is seeking a Senior Software Engineer to join the DSX team to build and operate tooling that verifies AI infrastructure is ready for production. You will work on cluster readiness, certification, and evidence workflows across Kubernetes and Slurm.

You'll design controllers and CLIs in Go and Python, contribute to the open-source Cluster Readiness Engine, benchmark distributed workloads, and collaborate with platform and cloud partners to close gaps before deployment.

Qualifications

• BS, MS, or Ph.D. in Computer Science, Computer/Electrical Engineering, or related field, or equivalent experience.
• 8+ years of software engineering experience building infrastructure or systems software for large-scale compute, cloud, or HPC environments.
• Strong programming skills in Go and Python with production-quality services, controllers, or CLIs.
• Deep familiarity with Linux, containers, and Kubernetes, including writing operators or controllers against the Kubernetes API.
• Working knowledge of HPC schedulers such as Slurm and GPU cluster fundamentals (drivers, NCCL, InfiniBand or RoCE, and DCGM).
• Experience benchmarking or validating distributed systems with rigorous measurement, reproducibility, and evidence.
• Ability to drive complex technical investigations to root cause and communicate findings clearly to engineering and leadership.

Responsibilities

• Shape the future of validation by turning cluster validation into repeatable software.
• Design and implement cluster readiness and certification tooling in Go and Python for Kubernetes and Slurm.
• Build a catalog of benchmarks and real workloads spanning compute, training, inference, reliability, and security.
• Develop provenance pipelines that capture what ran, where, and under which configuration with auditable results.
• Integrate new GPU platforms, schedulers, and fabrics from single-node bring-up to multi-node production validation.
• Collaborate with platform, networking, and cloud partners to root-cause performance gaps and feed fixes back into architectures.
• Contribute to the open-source Cluster Readiness Engine and related projects with design docs and reviews.
• Author design documents, runbooks, and operational guides for validated clusters.

Skills

Go

Python

Linux

Kubernetes

HPC environments

Troubleshooting

Education

Bachelor's degree or higher in CS/EE or related field

Tools

Cluster Readiness Engine

Kubernetes controllers/Operators

DCGM

Prometheus/Grafana/OpenTelemetry

Job description

NVIDIA is seeking a Senior Software Engineer to join the DSX team to build and operate tooling that verifies AI infrastructure is ready for production. You will work on cluster readiness, certification, and evidence workflows across Kubernetes and Slurm.

You'll design controllers and CLIs in Go and Python, contribute to the open-source Cluster Readiness Engine, benchmark distributed workloads, and collaborate with platform and cloud partners to close gaps before deployment.