Senior AI Data Infrastructure Engineer

NVIDIA Corporation; Santa Clara (CA); On-site; USD 152,000 - 288,000; Full time

Benefits offered by this job

Equity

Comprehensive benefits

Career growth opportunities

Job summary

NVIDIA is seeking a data infra engineer in Santa Clara to design and implement the AI data layer for a multi-cloud GPU fleet. You will manage datasets, checkpoints, and scratch data, enabling researchers to scale training efficiently.

You will build high-throughput data paths, enable Kubernetes-native APIs and storage integrations, and own quotas and lifecycle across teams to ensure reliable data availability for NVIDIA’s AI models.

Qualifications

• BS or MS in Computer Science, Computer Engineering, Electrical Engineering or related field, or equivalent experience.
• 5+ years building production systems or data-infrastructure software.
• Deep experience with distributed file systems or object storage at scale (e.g., Lustre, GPFS, Ceph, S3).
• Strong understanding of I/O performance, throughput, latency, and caching implications.
• Proficient programming in Go, Rust, C/C++, and Python for tooling.
• Proven track record owning a service in production and improving it.

Responsibilities

• Design and build the AI data layer for a multi-cloud GPU fleet: datasets, checkpoints, and scratch data storage and movement.
• Build high-throughput data paths for training and RL with streaming loaders, caches, and checkpointing across thousands of GPUs.
• Create Kubernetes-native APIs, operators, and storage integrations so jobs declare data needs and platforms mount and account for it.
• Own quotas, capacity, and data lifecycle across research teams, including attribution and retention.
• Measure workloads with I/O telemetry to optimize data placement and performance.
• Ensure reliability with on-call duties and incident analysis to prevent data incidents.

Skills

Go

Rust

C/C++

Python

Distributed systems

Communication

Education

BS in Computer Science or related field

MS in Computer Science or related field

Tools

Lustre

WEKA

GPFS

Ceph

S3

Job description

NVIDIA is seeking a data infra engineer in Santa Clara to design and implement the AI data layer for a multi-cloud GPU fleet. You will manage datasets, checkpoints, and scratch data, enabling researchers to scale training efficiently.

You will build high-throughput data paths, enable Kubernetes-native APIs and storage integrations, and own quotas and lifecycle across teams to ensure reliable data availability for NVIDIA’s AI models.