Senior AI Infra Architect: Cloud, GPUs & Kubernetes

2100 NVIDIA USA; Santa Clara (CA); On-site; USD 152,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation is seeking a Senior AI Infrastructure Engineer to design, build, and operate large-scale AI training and inference platforms on cloud infrastructure. You will own tooling, performance analysis, and lifecycle management across multi-GPU clusters.

The role requires strong automation, distributed systems experience, and proficiency in Python/Go/C/C++/Java, Linux networking, and container tech. Equity and benefits accompany the base salary.

Qualifications

• BS degree in Computer Science or a related technical field involving coding
• 5+ years of experience in infrastructure engineering or related field
• Proven ability to initiate and drive projects and collaborate across teams
• Experience in infrastructure automation and distributed systems architecture for large-scale cloud platforms
• Proficiency in Python/Go/C/C++/Java and strong Linux networking and storage knowledge
• Familiarity with Public Cloud, Infrastructure as Code (Terraform), and Kubernetes/Slurm is a plus

Responsibilities

• Design, build, deploy, and run internal tooling for large-scale AI training and inference platform on cloud infrastructure
• Characterize and analyze performance on multi-GPU and multi-node clusters
• Own lifecycle from design to deployment, operation, and refinement
• Support services via design consulting, tooling, capacity management, and launch reviews
• Maintain service health, latency, and uptime; monitor systems and automate improvements
• Scale systems through automation and drive reliability and velocity
• Participate in blameless postmortems and on-call rotations

Skills

Python

Go

C/C++

Java

Linux

Networking

Storage

Containers

Terraform

Cloud Platforms

Education

BS degree in Computer Science or related field

Tools

Kubernetes

OpenStack

Terraform

Job description

NVIDIA Corporation is seeking a Senior AI Infrastructure Engineer to design, build, and operate large-scale AI training and inference platforms on cloud infrastructure. You will own tooling, performance analysis, and lifecycle management across multi-GPU clusters.

The role requires strong automation, distributed systems experience, and proficiency in Python/Go/C/C++/Java, Linux networking, and container tech. Equity and benefits accompany the base salary.