Storage Systems Engineer for Frontier AI

Prime Intellect; San Francisco (CA); On-site; USD 150,000 - 300,000; Full time

Job summary

Prime Intellect is building the open frontier AI stack and storage systems powering frontier workloads. You will design and operate storage architectures for training datasets, checkpoints, and model artifacts, balancing performance, durability, and cost as GPU clusters scale.

Join a hands-on, collaboration-heavy team working with Lustre, Ceph, and NVMe caching to support large GPU training and high-volume checkpoint workloads, with opportunities to contribute to open-source storage and scale

Qualifications

• 3+ years building or operating production distributed storage systems.
• Hands-on experience with at least one parallel or distributed filesystem or object storage platform (Lustre, BeeGFS, Ceph, GPFS).
• Strong Linux administration and performance troubleshooting.
• Experience automating infrastructure operations in Python, Go, Bash, or similar languages.
• Understanding of storage failure modes, data integrity, replication, and recovery.

Responsibilities

• Design and operate storage architectures for training datasets, checkpointing, inference artifacts, and shared research workflows.
• Deploy and tune parallel filesystems, object storage, and local NVMe caching for demanding AI workloads.
• Benchmark throughput, latency, metadata performance, and concurrent access with representative training and checkpoint workloads.
• Build provisioning, capacity planning, lifecycle management, and operational automation for storage services.
• Design and test replication, recovery, backup, and failure-handling procedures with explicit durability and availability targets.
• Diagnose performance and reliability issues across applications, clients, networks, filesystems, and devices.
• Implement access controls, tenant separation, quotas, monitoring, and runbooks; collaborate with compute and networking teams.

Skills

Distributed storage

Linux administration

Scripting (Python/Go/Bash)

Storage systems knowledge

Performance troubleshooting

Tools

Lustre

BeeGFS

Ceph

GPFS

Job description

Prime Intellect is building the open frontier AI stack and storage systems powering frontier workloads. You will design and operate storage architectures for training datasets, checkpoints, and model artifacts, balancing performance, durability, and cost as GPU clusters scale.

Join a hands-on, collaboration-heavy team working with Lustre, Ceph, and NVMe caching to support large GPU training and high-volume checkpoint workloads, with opportunities to contribute to open-source storage and scale