Staff Storage Infrastructure Engineer – Frontier AI

AI Chopping Block; San Francisco, Northern (CA, KY); On-site; USD 150,000 - 300,000; Full time

Job summary

Prime Intellect is building the frontier AI open stack and is seeking an engineer to own storage systems for frontier AI workloads. You will design, deploy, and optimize storage architectures that feed training datasets, checkpoints, and model artifacts, balancing performance, durability, and cost as GPU clusters scale.

The role focuses on high-throughput, reliable storage services, replication, backup, and automation, with collaboration across compute and networking teams, and a drive to

Qualifications

• 3+ years building or operating production distributed storage systems
• Strong Linux administration and performance troubleshooting skills
• Experience automating infrastructure operations in Python, Go, Bash, or similar languages
• Understanding of storage failure modes, data integrity, consistency, replication, and recovery

Responsibilities

• Design and operate storage architectures for training datasets, checkpointing, inference artifacts, and shared research workflows
• Deploy and tune parallel filesystems, object storage, and local NVMe caching for demanding AI workloads
• Benchmark throughput, latency, metadata performance, and concurrent access with representative training and checkpoint workloads
• Build provisioning, capacity planning, lifecycle management, and operational automation for storage services
• Design and test replication, recovery, backup, and failure-handling procedures with explicit durability and availability targets
• Diagnose performance and reliability issues across applications, clients, networks, filesystems, and devices
• Implement access controls, tenant separation, quotas, monitoring, and runbooks; collaborate with compute and networking teams

Skills

Linux administration

Performance troubleshooting

Infrastructure automation

Storage concepts

Networking basics

Tools

Lustre

BeeGFS

Ceph

GPFS

Job description

Prime Intellect is building the frontier AI open stack and is seeking an engineer to own storage systems for frontier AI workloads. You will design, deploy, and optimize storage architectures that feed training datasets, checkpoints, and model artifacts, balancing performance, durability, and cost as GPU clusters scale.

The role focuses on high-throughput, reliable storage services, replication, backup, and automation, with collaboration across compute and networking teams, and a drive to