Senior Distributed Systems Engineer, AI Inference Factory

NVIDIA Corporation; United States; On-site; USD 184,000 - 288,000; Full time

Job summary

NVIDIA Corporation is seeking a senior engineer to design and build factory infrastructure and automation for NVIDIA Inference Microservices (NIMs). The role focuses on creating scalable, validated pipelines across Cloud, On-prem and Kubernetes environments to accelerate AI model deployment on NVIDIA GPUs.

You will mentor teams, define metrics, and collaborate with multiple model groups to deliver high-performance, reliable infrastructure and tooling, including Docker builds, test harnesses, and

Qualifications

• Experience building distributed and compute systems, backend services and microservices.
• Experience collaborating with multi-functional teams and architects.
• Mentorship and ability to grow teams and people.
• Deep expertise in distributed containerized applications using Docker, Kubernetes, Cloud Endpoints, Helm, and Prometheus.
• Passion for building robust microservice apps and test automation pipelines.
• Excellent interpersonal skills and ability to lead cross-functional efforts.
• BS or MS in Computer Science/Engineering or related field.
• 8+ years of experience in performant microservice, cloud software or tooling roles.

Responsibilities

• Develop a factory pipeline taking an AI model to a deployable, service-ready artifact.
• Collaborate with AI model teams to design scalable infrastructure and improve productivity.
• Define metrics, mentor the team, and drive continuous improvement.

Skills

Distributed systems

Backend services

Microservices

Cloud technologies

Leadership & mentorship

Education

BS or MS in Computer Science, Computer Engineering or related field

Tools

Docker

Kubernetes

Cloud Endpoints

Helm

Prometheus

CI/CD pipelines

Temporal

Kafka

Redis

Job description

NVIDIA Corporation is seeking a senior engineer to design and build factory infrastructure and automation for NVIDIA Inference Microservices (NIMs). The role focuses on creating scalable, validated pipelines across Cloud, On-prem and Kubernetes environments to accelerate AI model deployment on NVIDIA GPUs.

You will mentor teams, define metrics, and collaborate with multiple model groups to deliver high-performance, reliable infrastructure and tooling, including Docker builds, test harnesses, and