Senior ML Ops Engineer — AI Infrastructure & Cloud

NVIDIA Corporation; Santa Clara (CA); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation seeks an NCX Senior Engineer to advance AI infrastructure capabilities and collaborate with strategic customers to deploy high-performance AI workloads. You will lead hands-on delivery, optimize distributed training and inference, and drive MLOps pipelines on NVIDIA reference architectures.

From Kubernetes-based deployments to GPU scheduling across multi-tenant environments, you will guide partner teams, ensure observability, and articulate architectures and trade-offs to

Qualifications

• 8+ years in customer-facing technical roles such as Solutions Engineering, DevOps, Site Reliability, or ML Infrastructure Engineering.
• Strong expertise in Linux systems, distributed computing, Kubernetes, containers, and GPU scheduling on multi-tenant or service-provider platforms.
• Demonstrated AI/ML experience with large-scale training and inference workloads in production.

Responsibilities

• Develop innovative AI infrastructure solutions for customers.
• Directly influence customer success with breakthrough AI initiatives.
• Build and deploy custom AI solutions on NCP and Neo Cloud platforms with distributed training, inference optimization, and MLOps pipelines.
• Act as the main technical contact for strategic NCPs, provide remote and on-site support, and guide partner engineering teams on NVIDIA guidelines.
• Deploy and manage AI workloads across DGX Cloud, NCP data centers, and major CSP environments using Kubernetes and GPU scheduling.
• Profile and tune large-scale training and inference workloads on NCP platforms.
• Implement observability and SLO/SLA monitoring.
• Lead efforts to reduce latency, cost, and operational risk.
• Develop integrations with partner control planes and customer environments; create implementation guides and runbooks.

Skills

Customer-facing experience

Solution engineering mindset

Strong communication

Education

BS/MS/PhD in CS or related

Tools

Kubernetes

Containers

GPU scheduling

Python/Go

PyTorch/TensorFlow

Linux

Job description

NVIDIA Corporation seeks an NCX Senior Engineer to advance AI infrastructure capabilities and collaborate with strategic customers to deploy high-performance AI workloads. You will lead hands-on delivery, optimize distributed training and inference, and drive MLOps pipelines on NVIDIA reference architectures.

From Kubernetes-based deployments to GPU scheduling across multi-tenant environments, you will guide partner teams, ensure observability, and articulate architectures and trade-offs to