Senior Cloud AI Infra Engineer

NVIDIA Corporation; Seattle (WA); On-site; USD 152,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation in Seattle is seeking a Senior Distributed Software Engineer to develop and optimize AI infrastructure services for DGX Cloud. You will help deliver scalable, resilient backend systems, enabling AI researchers to run large-scale workloads with high efficiency.

The role focuses on cloud-native backend services, micro-services orchestration with Kubernetes, and API co-design across NVIDIA’s resiliency stacks.

Qualifications

• A Bachelor's degree or higher in Computer Science or a related technical field (or equivalent experience).
• 5+ years of hands-on experience in backend development, preferably with Python, Go, C/C++, or similar high-performance languages.
• Consistent track record of building and scaling large-scale distributed systems.
• Experience with cloud computing platforms such as AWS, Azure, and GCP, as well as container technologies like Docker and Kubernetes, and HPC/AI platforms such as Slurm.

Responsibilities

• Developing solutions at the intersection of machine learning, distributed systems, and high-performance computing, supplying to the advancement of AI technologies.
• Designing, developing, and optimizing (micro-)services orchestrated by Kubernetes to provide large-scale AI training workflows on AI training supercomputers located at major CSPs, with resiliency and efficiency.
• Co-designing and implementing the APIs that allow these services to integrate vertically with NVIDIA's resiliency stacks, ranging from tier-0 telemetry services to break/fix automation services to checkpoint and execution systems.
• Crafting a submission abstraction that enables model engineers and training platforms/frameworks to seamlessly submit long-running training jobs while hiding the complexity of handling infrastructure failures, running job lifecycles with auto-restarts on failure, ensuring full efficiency, and promptly advising users.
• Crafting these services to be modular, enabling them to be coordinated with and deployed onto on-premises AI clusters that apply NVIDIA Hardware and Cloud services.

Skills

Python

Go

C/C++

Education

Bachelor's degree in Computer Science

Tools

Docker

Kubernetes

Slurm

AWS

Azure

GCP

Job description

NVIDIA Corporation in Seattle is seeking a Senior Distributed Software Engineer to develop and optimize AI infrastructure services for DGX Cloud. You will help deliver scalable, resilient backend systems, enabling AI researchers to run large-scale workloads with high efficiency.

The role focuses on cloud-native backend services, micro-services orchestration with Kubernetes, and API co-design across NVIDIA’s resiliency stacks.