Storage Infrastructure Engineer – Frontier AI (Equity)

Prime Intellect, Inc.; San Francisco (CA); On-site; USD 150,000 - 300,000; Full time

Benefits offered by this job

Equity incentives

Competitive cash compensation

Job summary

Prime Intellect, Inc. is building an open frontier AI platform and storage stack to support frontier-scale workloads. You will own reliable, high-throughput storage for datasets, checkpoints, and model artifacts, balancing performance, durability, and cost as GPU clusters scale.

You’ll design architectures, deploy FS and object storage, benchmark systems, and implement robust replication, recovery, and security controls while collaborating with compute and networking teams.

Qualifications

• 3+ years building or operating production distributed storage systems.
• Hands-on experience with Lustre, BeeGFS, Ceph, or GPFS.
• Strong Linux administration and performance troubleshooting skills.
• Experience automating infrastructure operations in Python, Go, Bash, or similar languages.
• Understanding of storage failure modes, data integrity, replication, and recovery.

Responsibilities

• Design and operate storage architectures for training datasets, checkpointing, inference artifacts, and shared research workflows.
• Deploy and tune parallel filesystems, object storage, and local NVMe caching for demanding AI workloads.
• Benchmark throughput, latency, metadata performance, and concurrent access with representative training and checkpoint workloads.
• Build provisioning, capacity planning, lifecycle management, and operational automation for storage services.
• Design and test replication, recovery, backup, and failure-handling procedures with explicit durability and availability targets.
• Diagnose performance and reliability issues across applications, clients, networks, filesystems, and devices.
• Implement access controls, tenant separation, quotas, monitoring, and runbooks; collaborate with compute and networking teams.

Skills

Storage architecture

Linux administration

Performance troubleshooting

Infrastructure automation

SRE best practices

GPU training clusters

S3-compatible storage

Tools

Lustre

BeeGFS

Ceph

GPFS

Python

Go

Bash

Job description

Prime Intellect, Inc. is building an open frontier AI platform and storage stack to support frontier-scale workloads. You will own reliable, high-throughput storage for datasets, checkpoints, and model artifacts, balancing performance, durability, and cost as GPU clusters scale.

You’ll design architectures, deploy FS and object storage, benchmark systems, and implement robust replication, recovery, and security controls while collaborating with compute and networking teams.