Senior Production Engineer: AI Cloud Reliability Automation

Devopsroles; Santa Clara (CA); On-site; USD 184,000 - 357,000; Full time

Job summary

NVIDIA DGX Cloud seeks a Senior Production Engineer to build software and automation for reliable, scalable, and safe operation across DGX Cloud environments. You will work on large-scale distributed systems spanning Kubernetes, cloud infra, and on-prem deployments, designing health metrics and durable automation.

You will lead on-call, incident response, and collaborate with model, platform, storage, and GPU infra teams to ensure high availability and predictable performance at scale.

Qualifications

• 8+ years building or operating production services and large-scale distributed systems.
• Strong programming in Python, Go, or similar for production tooling.
• Experience with infrastructure as code and GitOps for repeatable deployments.
• Strong knowledge of Linux, Kubernetes, containers, cloud infra, networking fundamentals.
• Understanding of SRE principles: SLIs/SLOs, error budgets, incident response.
• Experience instrumenting services with metrics, logs, and traces.
• Clear technical communication across engineering teams.
• BS/MS in Computer Science or equivalent experience.

Responsibilities

• Build and operate production software, automation, and tooling for control plane services and model deployments.
• Improve reliability of inference and agentic platforms with health validation and observability.
• Improve endpoint availability, routing, capacity management, and service health.
• Use infrastructure as code and GitOps to deploy and recover services consistently.
• Create workflows for model releases, handoff, deprecation, and ongoing operations.
• Define and instrument SLIs/SLOs; monitor health and communicate risk to teams.
• Participate in on-call and incident response; automate recurring issues.

Skills

Python

Go

Automation tooling

SRE concepts

Kubernetes

Linux

GitOps

Networking basics

Education

BS/MS in Computer Science

Tools

Terraform

Argo CD

CI/CD tooling

Docker

Job description

NVIDIA DGX Cloud seeks a Senior Production Engineer to build software and automation for reliable, scalable, and safe operation across DGX Cloud environments. You will work on large-scale distributed systems spanning Kubernetes, cloud infra, and on-prem deployments, designing health metrics and durable automation.

You will lead on-call, incident response, and collaborate with model, platform, storage, and GPU infra teams to ensure high availability and predictable performance at scale.