Senior Cloud AI Infrastructure Engineer (Equity)

NVIDIA Corporation; Santa Clara (CA); On-site; USD 152,000 - 288,000; Full time

Job summary

NVIDIA Corporation is seeking a Senior Distributed Software Engineer to join the DGX Cloud Team. You will help optimize AI infrastructure, focusing on backend services and scalable AI training workflows, working with Kubernetes orchestration and cloud integration.

You will design APIs, co-develop with cloud platforms (AWS, Azure, GCP), and contribute to resilience and performance for AI workloads across NVIDIA’s on-prem and cloud environments.

Qualifications

• Bachelor's degree or higher in Computer Science or a related technical field (or equivalent experience).
• 5+ years of hands-on experience in backend development, preferably with Python, Go, C/C++, or similar high-performance languages.
• Consistent track record of building and scaling large-scale distributed systems.
• Experience with cloud computing platforms such as AWS, Azure, and GCP, as well as container technologies like Docker and Kubernetes, and HPC/AI platforms such as Slurm.

Responsibilities

• Developing solutions at the intersection of machine learning, distributed systems, and high-performance computing, supplying to the advancement of AI technologies.
• Design, develop, and optimize (micro-)services orchestrated by Kubernetes to provide large-scale AI training workflows on AI training supercomputers located at major CSPs, with resiliency and efficiency.
• Co-designing and implementing the APIs that allow these services to integrate vertically with NVIDIA's resiliency stacks, ranging from tier-0 telemetry services to break/fix automation services to checkpoint and execution systems.
• Crafting a submission abstraction that enables model engineers and training platforms/frameworks to seamlessly submit long-running training jobs while hiding the complexity of handling infrastructure failures, running job lifecycles with auto-restarts on failure, ensuring full efficiency, and promptly advising users.
• Crafting these services to be modular, enabling them to be coordinated with and deployed onto on-premises AI clusters that apply NVIDIA Hardware and Cloud services.

Skills

Backend development

Distributed systems

Python

Go

C/C++

Performance computing

Education

Bachelor's degree in Computer Science

Tools

Docker

Kubernetes

Slurm

AWS

Azure

GCP

Job description

NVIDIA Corporation is seeking a Senior Distributed Software Engineer to join the DGX Cloud Team. You will help optimize AI infrastructure, focusing on backend services and scalable AI training workflows, working with Kubernetes orchestration and cloud integration.

You will design APIs, co-develop with cloud platforms (AWS, Azure, GCP), and contribute to resilience and performance for AI workloads across NVIDIA’s on-prem and cloud environments.