Staff Engineer: Distributed Storage & AI Infra

Together Computer Inc; United States; Remote; USD 250,000 - 300,000; Full time

Benefits offered by this job

Equity

Health insurance

Remote work flexibility

Job summary

Together AI is seeking a senior storage engineer to design and operate multi-petabyte storage systems for AI training and inference. You will integrate Vast, Weka, Ceph, and Lustre, build Kubernetes-native storage operators, and enable automated provisioning with strong multi-tenancy and performance isolation.

You will architect end-to-end data paths, optimize caching, and scale storage across thousands of nodes, delivering 10+ GB/s per GPU node while contributing to open-source and internal

Qualifications

• 8+ years in storage engineering at multi-petabyte scale.
• Proven track record deploying and operating high-performance storage for GPU/HPC clusters.
• Deep Kubernetes and cloud-native storage experience in production environments.
• Strong coding skills in Go and Python for production-grade systems.
• BS/MS in Computer Science, Engineering, or equivalent practical experience.
• History of technical leadership with improvements in performance, reliability, or cost.
• Distributed storage systems expertise: Ceph, WekaFS, Lustre, Vast, GPFS, or similar.
• Object storage experience with S3/MinIO/Ceph/R2 and performance optimization.
• Kubernetes storage: CSI drivers, StatefulSets, PVs, storage operators, controllers.
• Storage optimization for GPU workloads, RDMA/InfiniBand networking, TB/s throughput.
• Programming: Go and Python for automation, operators, and tooling.
• Infrastructure as Code: Terraform, Ansible, Helm, GitOps (ArgoCD).
• Linux storage stack: Ext4, XFS, LVM, NVMe optimization, RAID.
• Observability: Prometheus, Grafana, Thanos.

Responsibilities

• Architect and implement the storage strategy and roadmap for Together AI as we scale GPU fleets.
• Engineer and scale multi-petabyte AI/ML storage systems by integrating Vast, Weka, Ceph and optimizing costs via tiering.
• Develop intelligent caching and tiered architectures to achieve extreme IOPS and throughput at GPU scale.
• Tune storage isolation at L2/L3 network layers for secure multi-tenancy.
• Code Kubernetes storage operators and controllers for automated provisioning and quota enforcement.
• Engineer end-to-end data paths to achieve 10+ GB/s per GPU node and multi-tier caching for models and datasets.
• Optimize data paths with benchmarking and profiling; contribute to open-source storage projects and internal tooling.

Skills

Go

Python

Kubernetes

Distributed storage

Cloud-native storage

Leadership

Linux storage stack

Education

BS/MS in Computer Science or Engineering

Tools

CSI drivers

Terraform

Ansible

Helm

GitOps (ArgoCD)

Job description

Together AI is seeking a senior storage engineer to design and operate multi-petabyte storage systems for AI training and inference. You will integrate Vast, Weka, Ceph, and Lustre, build Kubernetes-native storage operators, and enable automated provisioning with strong multi-tenancy and performance isolation.

You will architect end-to-end data paths, optimize caching, and scale storage across thousands of nodes, delivering 10+ GB/s per GPU node while contributing to open-source and internal