ML Infra Engineer - GPU Clusters & AIOps

NVIDIA Corporation; Santa Clara, Northern (CA, KY); Hybrid; USD 124,000 - 196,000; Full time

Job summary

NVIDIA is seeking a Software Engineer to accelerate ML infrastructure for GPU clusters, enabling researchers to train, fine-tune, and deploy models with reduced operational overhead.

You will design, develop, and maintain scalable engineering solutions, work on Linux environments, and apply container technologies like Docker and Kubernetes. On-call support for production systems is part of the role.

Qualifications

• BS/MS in Computer Science, Engineering, or equivalent experience.
• 2+ years in software/platform engineering, including 1 year in ML infrastructure or distributed systems.
• Experience in software development lifecycle on Linux-based platforms.
• Strong coding skills in languages such as Python, C++ or Rust.
• Experience with Docker, Kubernetes, GitLab CI, automated deployments.
• Experience with AIOps or Agentic AI and apply it successfully in production environment.

Responsibilities

• Understand pain points of validating, monitoring and operating GPU clusters at scale.
• Design, develop and maintain engineering solutions to solve those pain points systematically.
• Research in traditional AIOps and the emerging Agentic AI, and leverage it to further reduce the operation toil.
• Participate in on-call support for systems, platforms built and owned by the team.

Skills

CS/Engineering knowledge

Python

C++

Rust

Linux

Education

BS/MS in Computer Science/Engineering

Tools

Docker

Kubernetes

GitLab CI

Slurm

Job description

NVIDIA is seeking a Software Engineer to accelerate ML infrastructure for GPU clusters, enabling researchers to train, fine-tune, and deploy models with reduced operational overhead.

You will design, develop, and maintain scalable engineering solutions, work on Linux environments, and apply container technologies like Docker and Kubernetes. On-call support for production systems is part of the role.