Senior AI Data Infrastructure Engineer

Thomas To; Santa Clara (CA); On-site; USD 152,000 - 242,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is hiring for a senior data platform role within the MARS team in Santa Clara, focusing on building and scaling the AI data layer for a multi-cloud GPU fleet. You will design storage-aware compute integrations and high-throughput data paths that enable tens of thousands of GPU cores for AI research.

You will own quotas, capacity, and data lifecycle across dozens of research groups, with on-call reliability work and improvements to storage performance and data placement.

Qualifications

• BS or MS in Computer Science, Computer Engineering, Electrical Engineering or related field
• 5+ years building production systems or data-infrastructure software
• Experience with distributed file systems or object storage at scale
• Deep understanding of I/O performance and data access patterns
• Strong programming in Go, Rust, C or C++, plus Python for tooling
• Track record of owning a service in production and improving it
• Clear written and spoken communication with engineers and researchers

Responsibilities

• Design and build the AI data layer for a multi-cloud GPU fleet: data placement, caching, tiering and movement between storage backends
• Build high-throughput data paths for training and RL with streaming loaders, caches, and checkpoint IO across thousands of GPUs
• Develop Kubernetes-native APIs, operators and storage integrations for data declaration and mounting on Slurm and Kubernetes
• Own quotas, capacity and data lifecycle across hundreds of research teams with attribution and forecasting
• Measure data workloads with telemetry and analytics to drive placement and fixes
• Maintain reliability: on-call, incident analysis, and preventing large-scale data incidents

Skills

Go

Rust

C/C++

Python

Kubernetes

Distributed systems

Data infrastructure

I/O performance

Education

BS or MS in CS/CE/EE

Tools

Lustre

GPFS

Ceph

S3

Job description

NVIDIA is hiring for a senior data platform role within the MARS team in Santa Clara, focusing on building and scaling the AI data layer for a multi-cloud GPU fleet. You will design storage-aware compute integrations and high-throughput data paths that enable tens of thousands of GPU cores for AI research.

You will own quotas, capacity, and data lifecycle across dozens of research groups, with on-call reliability work and improvements to storage performance and data placement.