Senior Cloud Infra Engineer, Day 2 Ops for AI Clusters

NVIDIA AI; Indiana (PA); On-site; USD 180,000 - 240,000; Full time

Job summary

NVIDIA is hiring an NCX Senior Engineer to drive Day 2 operations for NVIDIA Cloud Partners and ensure reliable, large-scale accelerated infrastructure in production. You will work across compute, storage, networking, and AI workloads in partnership with partner teams.

You will develop observability, automation, and lifecycle management practices, translate reference architectures into production runbooks, and lead ongoing validation to sustain high availability and performance for critical

Qualifications

• BS, MS, or Ph.D. in CS/Engineering or related field, or equivalent experience.
• 8+ years of infrastructure engineering, SRE, DevOps or related large-scale production roles.
• Strong Linux-based distributed systems and cloud infrastructure experience.
• Deep Kubernetes and container lifecycle knowledge for large multi-node environments.
• Strong production observability including metrics, logging, dashboards and SLAs.
• Experience crafting automation for infra lifecycle, failure detection, remediation and upgrades.
• Strong networking fundamentals across compute, network and storage layers.
• Programming and automation with Python, Go or shell scripting.

Responsibilities

• Lead NCP Day 2 operational readiness efforts with partner teams to set up systems and runbooks.
• Build continuous infrastructure validation across GPU/CPU/storage/network health for large AI clusters.
• Establish observability, telemetry, dashboards, alerts across compute, networking, storage and AI workloads.
• Develop automated detection and remediation workflows to minimize disruption.
• Refine fleet lifecycle administration including driver firmware and patch management.
• Operationalize NVIDIA reference architectures into production practices and criteria.
• Define health signals, SLOs and validation mechanisms for reliability and readiness.
• Create reusable operational frameworks, guides, and reference implementations.

Skills

Linux

Kubernetes

Observability

Python

Go

Education

BS/MS/PhD in CS/Engineering or related field

Tools

Prometheus

Grafana

OpenTelemetry

Alertmanager

Job description

NVIDIA is hiring an NCX Senior Engineer to drive Day 2 operations for NVIDIA Cloud Partners and ensure reliable, large-scale accelerated infrastructure in production. You will work across compute, storage, networking, and AI workloads in partnership with partner teams.

You will develop observability, automation, and lifecycle management practices, translate reference architectures into production runbooks, and lead ongoing validation to sustain high availability and performance for critical