Senior ML Ops Engineer: AI Workloads & Distributed Systems

NVIDIA Corporation; United States; Remote; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits package

Job summary

NVIDIA Corporation is seeking an NCX Senior Engineer to join the DSX team. You will work with strategic customers to implement and optimize AI workloads, delivering hands-on technical assistance for distributed systems and NVIDIA's AI platform across diverse environments.

Lead efforts on distributed training, inference optimization, and MLOps pipelines built on NVIDIA reference architectures. You will deploy on NCP and Neo Cloud, provide remote/on-site support, and guide partner teams in

Qualifications

• BS, MS, or Ph.D. in Computer Science, Computer/Electrical Engineering, or related field, or equivalent experience.
• 8+ years in customer-facing technical roles such as Solutions Engineering, DevOps, Site Reliability, or ML Infrastructure Engineering.
• Strong expertise in Linux systems, distributed computing, Kubernetes, containers, and GPU scheduling on multi-tenant/service-provider platforms.
• Experience with AI/ML workloads in production (training/inference) at scale.
• Python/Go programming with PyTorch or TensorFlow for training/serving.
• Ability to collaborate with customer/partner teams and communicate architectures and trade-offs.

Responsibilities

• Deliver hands-on technical assistance for AI deployments and distributed systems.
• Build and deploy AI solutions on NCP and Neo Cloud platforms with distributed training and inference optimization.
• Act as main technical contact for strategic NCPs and guide partner engineering teams on NVIDIA guidelines.
• Deploy and manage AI workloads across DGX Cloud, NCP data centers, and CSP environments using Kubernetes and GPU scheduling.
• Develop implementation guides, runbooks, and post-mortem documentation for scaling NVIDIA AI workloads on NCP platforms.

Skills

Linux

Kubernetes

Distributed computing

Containerization

Python/Go

PyTorch/TensorFlow

Education

BS/MS/PhD in CS/EE or related field

Tools

Kubernetes

Docker

Terraform/Ansible

Job description

NVIDIA Corporation is seeking an NCX Senior Engineer to join the DSX team. You will work with strategic customers to implement and optimize AI workloads, delivering hands-on technical assistance for distributed systems and NVIDIA's AI platform across diverse environments.

Lead efforts on distributed training, inference optimization, and MLOps pipelines built on NVIDIA reference architectures. You will deploy on NCP and Neo Cloud, provide remote/on-site support, and guide partner teams in