Staff Data Infrastructure Engineer – Storage for AI GPUs

New York tech; San Mateo (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Fireworks AI is hiring for a Data Infrastructure Storage role in San Mateo. Lead design, build and operate a unified storage and caching layer across multi-clouds to support AI model training and inference at scale.

You will optimize placement, replication and movement of datasets, checkpoints, and KV caches while collaborating with GPU teams to minimize data latency and ensure reliable throughput for training jobs.

Qualifications

• BS/BE in CS/engineering or equivalent experience.
• 5+ years building storage, caching, or data infra at scale.
• Proficient in C/C++, Rust or Go; Python automation welcomed.

Responsibilities

• Design, build and run scalable storage and data‑infrastructure systems.
• Improve data placement, replication, caching, and movement across clouds.
• Collaborate with GPU/AI teams to minimize data latency and stalls.

Skills

C/C++

Rust

Go

Python

Automation

Education

Bachelor's degree in CS/Engineering

Tools

Kubernetes CSI

Terraform

Pulumi

Ceph

MinIO

Job description

Fireworks AI is hiring for a Data Infrastructure Storage role in San Mateo. Lead design, build and operate a unified storage and caching layer across multi-clouds to support AI model training and inference at scale.

You will optimize placement, replication and movement of datasets, checkpoints, and KV caches while collaborating with GPU teams to minimize data latency and ensure reliable throughput for training jobs.