Staff Engineer: AI & HPC Distributed Storage Architect

Togetherai; Amsterdam; Hybrid; EUR 150,000 - 210,000; Full time

Job summary

Together AI is seeking a seasoned Storage Systems Architect to design and deliver multi-petabyte AI storage architectures, integrating WekaFS, Ceph, Lustre, and GPFS. You will optimize end-to-end data paths, build Kubernetes-native storage operators, and enable automated provisioning with strict multi-tenancy and quotas at cluster scale.

You will lead capacity planning, cost optimization (30-50% savings via tiering and right-sizing), and collaborate with ML/SRE teams while mentoring peers and

Qualifications

• 8+ years in storage engineering with 3+ years distributing storage at multi-petabyte scale
• Proven track record deploying and operating high-performance storage for GPU/HPC clusters
• Deep Kubernetes and cloud-native storage experience in production environments
• Strong coding skills in Go and Python for production tools
• BS/MS in Computer Science or Engineering or equivalent
• History of technical leadership: designs improving performance or cost efficiency
• Expertise in WekaFS, Lustre, GPFS, BeeGFS at scale
• Production experience with S3/MinIO/Ceph or similar object storage

Responsibilities

• Design multi-petabyte AI/ML storage systems and integrate WekaFS, Ceph, and others; lead capacity planning and cost optimization
• Design/optimize RDMA, InfiniBand, 400GbE networks; tune for max throughput and low latency
• Build Kubernetes storage operators/controllers for automated provisioning and multi-tenant isolation
• Deliver 10-50 GB/s per GPU node; optimize caching, parallel filesystems, and data paths
• Build multi-tier caches (local NVMe, distributed, object); optimize data locality and distribution
• Implement monitoring, alerting, SLOs; design DR/backups and run chaos engineering
• Partner with ML/SRE teams; mentor storage best practices; contribute to open source; write docs

Skills

Go

Python

Distributed storage

Leadership

Education

BS/MS in Computer Science or Engineering

Tools

WekaFS

Ceph

Lustre

GPFS

BeeGFS

CSI drivers

Terraform

Ansible

Helm

GitOps (ArgoCD)

Job description

Together AI is seeking a seasoned Storage Systems Architect to design and deliver multi-petabyte AI storage architectures, integrating WekaFS, Ceph, Lustre, and GPFS. You will optimize end-to-end data paths, build Kubernetes-native storage operators, and enable automated provisioning with strict multi-tenancy and quotas at cluster scale.

You will lead capacity planning, cost optimization (30-50% savings via tiering and right-sizing), and collaborate with ML/SRE teams while mentoring peers and