Frontier AI GPU Storage Infrastructure Engineer

Prime Intellect AI; San Francisco (CA); On-site; USD 150,000 - 300,000; Full time

Job summary

Prime Intellect AI is building the open frontier AI storage stack to support frontier-scale workloads. You will design, deploy, and operate high-throughput storage for datasets, checkpoints, and model artifacts, ensuring durability and cost efficiency as GPU clusters scale.

Join a team shaping the next generation of AI infrastructure, collaborating across storage, compute, and networking to enable large-scale training and inference workflows.

Qualifications

• 3+ years building or operating production distributed storage systems.
• Hands-on experience with at least one parallel or distributed filesystem or object storage platform.
• Strong Linux administration and performance troubleshooting skills.
• Experience automating infrastructure operations in Python, Go, Bash, or similar languages.
• Understanding of storage failure modes, data integrity, replication, and recovery.

Responsibilities

• Design and operate storage architectures for training datasets, checkpointing, inference artifacts, and shared research workflows.
• Deploy and tune parallel filesystems, object storage, and local NVMe caching for demanding AI workloads.
• Benchmark throughput, latency, metadata performance, and concurrent access with representative training and checkpoint workloads.
• Build provisioning, capacity planning, lifecycle management, and operational automation for storage services.
• Design and test replication, recovery, backup, and failure-handling procedures with explicit durability and availability targets.
• Diagnose performance and reliability issues across applications, clients, networks, filesystems, and devices.
• Implement access controls, tenant separation, quotas, monitoring, and runbooks; collaborate with compute and networking teams.

Skills

Distributed storage fundamentals

Linux administration

Python/Go automation

Storage failure modes & data integrity

Education

Bachelor’s degree or higher in a related field

Tools

Lustre

Ceph

GPFS

BeeGFS

Job description

Prime Intellect AI is building the open frontier AI storage stack to support frontier-scale workloads. You will design, deploy, and operate high-throughput storage for datasets, checkpoints, and model artifacts, ensuring durability and cost efficiency as GPU clusters scale.

Join a team shaping the next generation of AI infrastructure, collaborating across storage, compute, and networking to enable large-scale training and inference workflows.