Engineering Manager, AI Infra Platform

NVIDIA Corporation

Colorado

On-site

USD 224,000 - 431,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA is seeking an experienced Engineering Manager to lead one of our AI infrastructure teams within the MARS organization. You will grow a team of software and systems engineers, own the end-to-end platform for model training workloads, and collaborate with researchers to translate their needs into scalable platform capabilities.

You will drive fleet-scale reliability, establish clear ownership, and partner with Kubernetes, cloud, and storage teams to advance NVIDIA's AI compute platform

Qualifications

  • BS or MS in Computer Science, Computer Engineering or related field, or equivalent experience.
  • 12+ years in software engineering with 5+ years leading engineering teams.
  • Track record building and running large-scale distributed systems used by other engineers.
  • Hands-on depth in workload scheduling, distributed storage/data systems, or Kubernetes-based platforms.
  • Experience hiring and growing senior engineers and building teams that stay productive under pressure.
  • Experience owning reliability for critical services (on-call, incident response, postmortems).
  • Clear written communication and ability to document decisions across teams.

Responsibilities

  • Lead, hire and grow a team of software and systems engineers, including senior and staff engineers and tech leads.
  • Own end-to-end core AI infrastructure platform: roadmap, architecture, reliability and on-call health.
  • Translate research needs into platform capabilities by collaborating with model training teams.
  • Define ownership and decision rights with clear interfaces to partner teams.
  • Drive platform quality at fleet scale: automation, observability, safe rollouts across clusters.
  • Collaborate with infrastructure, storage, networking, Kubernetes and cloud-provider teams across NVIDIA and with external partners.
  • Measure reliability and latency and use data to set priorities.
  • Contribute to open-source platform codebase alongside your team.

Skills

Team leadership
Software engineering
Distributed systems
Kubernetes
Communication
Hiring

Education

BS/MS CS/CE

Tools

Kubernetes
Distributed storage
Workload scheduling

Job description

NVIDIA is seeking an experienced Engineering Manager to lead one of our AI infrastructure teams within the MARS organization. You will grow a team of software and systems engineers, own the end-to-end platform for model training workloads, and collaborate with researchers to translate their needs into scalable platform capabilities.

You will drive fleet-scale reliability, establish clear ownership, and partner with Kubernetes, cloud, and storage teams to advance NVIDIA's AI compute platform

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Engineering Manager - AI Infra & Large-Scale Clusters
Engineering Manager - AI Infra & Large-Scale Clusters

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 357,000
Engineering Manager, AI Infrastructure & Kubernetes
Engineering Manager, AI Infrastructure & Kubernetes

NVIDIA Corporation • Durham (NC)

On-site
USD 224,000 - 431,000
Equity
Benefits
Engineering Manager, AI Infra & GPU Clusters (Equity Eligible)
Engineering Manager, AI Infra & GPU Clusters (Equity Eligible)

NVIDIA Corporation • United States

On-site
USD 224,000 - 431,000
Head of AI Infrastructure Platform
Head of AI Infrastructure Platform

NVIDIA Corporation • Westford (MA)

On-site
USD 224,000 - 431,000
Equity
Benefits
Engineering Manager — AI Infrastructure & Kubernetes Platform
Engineering Manager — AI Infrastructure & Kubernetes Platform

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 431,000
Equity
Benefits
AI Infrastructure Platform Manager
AI Infrastructure Platform Manager

NVIDIA Corporation • Austin (TX)

On-site
USD 224,000 - 431,000
Manager, Software Engineering
Manager, Software Engineering

Nvidia Corporation in • Santa Clara (CA)

On-site
USD 224,000 - 431,000
Equity
Benefits
Manager, Software Engineering
Manager, Software Engineering

2100 NVIDIA USA • Santa Clara (CA)

On-site
USD 224,000 - 357,000
Engineering Manager, GPU AI Inference at Scale
Engineering Manager, GPU AI Inference at Scale

NVIDIA • New York (NY)

On-site
USD 184,000 - 357,000
Equity
Benefits
Manager, Software Engineering
Manager, Software Engineering

NVIDIA • United States

On-site
USD 224,000 - 431,000