Senior MLOps Engineer, AI Infrastructure & Open-Source

NVIDIA Corporation; Santa Clara, Northern (CA, KY); Hybrid; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation is seeking a Senior MLOps Engineer to join the DSX Enablement team, collaborating with strategic customers to implement and enhance AI workloads. You will develop innovative AI infrastructure solutions, advise on ML workload demands, and work on production systems including LLM evaluation and supporting new hardware in open-source frameworks.

This role emphasizes scalable pipelines, collaboration with NVIDIA Cloud Partners, and building open-source tools to manage AI workloads

Qualifications

• BS, MS, or Ph.D. in Computer Science, Computer/Electrical Engineering, or a related technical field, or equivalent experience.
• 8+ years of experience in technical roles such as data science, data engineering, or ML engineering, ideally targeting large‑scale production systems.
• Demonstrated AI/ML experience across multiple phases of the machine learning lifecycle, from exploratory analysis to production systems.
• Facility with systems topics including Linux, batch schedulers, Kubernetes, distributed filesystems, and advanced networking at datacenter scale.
• Solid scripting and programming skills in languages like bash and Python and solid systems programming skills in a language like C++, Go, or Rust.
• Experience using machine learning or deep learning frameworks for training and inference.
• Excellent communication and technical presentation skills, with the ability to clearly articulate architectures, trade‑offs, and recommendations to both engineering and leadership audiences.
• A clear record of engineering discipline and execution on interesting projects, whether you’re working alone or collaborating on a team.

Responsibilities

• Build and deploy custom AI solutions on NeoCloud platforms and NVIDIA Cloud Partners (NCPs), including distributed training, inference optimization, and MLOps pipelines.
• Act as a primary technical contact for internal and external customers and partners, guiding joint engagements, ensuring the success of initiatives on DGX Cloud, and solving complex problems in production.
• Work closely with the teams building the infrastructure software and accelerated frameworks that support today’s most compelling AI applications.
• Profile and tune large-scale training and inference workloads on NCP platforms, leading efforts to reduce latency, cost, and operational risk.
• Develop open-source tools and reference architectures to make it easier to build and manage machine learning and AI workloads, pipelines, and systems at scale.

Skills

Linux

Kubernetes

Python

Bash

C++

Go

Rust

ML/DL frameworks

Education

BS/MS/PhD in CS/Engineering or related field

Tools

CUDA

NeMo

RAPIDS

Triton

Job description

NVIDIA Corporation is seeking a Senior MLOps Engineer to join the DSX Enablement team, collaborating with strategic customers to implement and enhance AI workloads. You will develop innovative AI infrastructure solutions, advise on ML workload demands, and work on production systems including LLM evaluation and supporting new hardware in open-source frameworks.

This role emphasizes scalable pipelines, collaboration with NVIDIA Cloud Partners, and building open-source tools to manage AI workloads