Engineering Manager, AI Infrastructure & Kubernetes

NVIDIA Corporation; Durham (NC); On-site; USD 224,000 - 431,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking an engineering manager for the MARS AI infrastructure platform in Durham, NC. You will grow and lead a team of software and systems engineers, owning end-to-end platform delivery for large-scale AI workloads.

You’ll translate research needs into platform capabilities, set ownership and interfaces, and drive reliability, observability, and safe rollouts across clusters, collaborating with cross-functional teams and external partners.

Qualifications

• BS or MS in Computer Science, Computer Engineering or a related field, or equivalent experience.
• 12+ years in software engineering, with 5+ years managing engineering teams.
• Track record building and running large-scale distributed systems in production.
• Hands-on depth in workload scheduling and resource management, distributed storage or Kubernetes-based platforms.
• Experience owning reliability for critical services: on-call, incident response, postmortems and fixes.

Responsibilities

• Lead, hire and grow a team of software and systems engineers, including senior and staff-level engineers and tech leads.
• Lead a core part of the AI infrastructure platform end to end: its roadmap, architecture, reliability and on-call health.
• Turn research needs into platform capabilities by working directly with model training teams.
• Set clear ownership and decision rights for your area: named owners, written decisions, and clean interfaces to partner teams.
• Drive engineering quality at fleet scale: automation over manual operations, observability built in, safe rollouts across many clusters.
• Partner with infrastructure, storage, networking, Kubernetes and cloud-provider teams across NVIDIA, and with external vendors and open-source communities.

Skills

Team leadership

Software engineering

Distributed systems

Kubernetes

Incident response

Communication

Education

CS/CE degree

Tools

Kubernetes

Job description

NVIDIA is seeking an engineering manager for the MARS AI infrastructure platform in Durham, NC. You will grow and lead a team of software and systems engineers, owning end-to-end platform delivery for large-scale AI workloads.

You’ll translate research needs into platform capabilities, set ownership and interfaces, and drive reliability, observability, and safe rollouts across clusters, collaborating with cross-functional teams and external partners.