Staff Data Infrastructure Engineer - Petabyte Storage

Cohere

United States

Hybrid

USD 180,000 - 240,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

A weekly lunch stipend of $75/£75 or 0
Full health and dental benefits
100% Parental Leave top-up for up to 6
Education & learning stipend and offis
6 weeks of paid vacation
Travel budget for other offices

Job summary

Cohere is building a secure, scalable storage layer to feed petabyte-scale model training and checkpoints. You will architect and deploy this system across multiple Kubernetes clusters, defining data movement patterns and ensuring low latency and high durability.

You will collaborate with researchers and training-infra teams to optimize throughput, latency, and GPU utilization while guiding operational strategies and best practices across the organization.

Qualifications

  • Strong storage fundamentals with replication, consistency, caching, and data lifecycle management.
  • Proven coding ability in Python and Go and ability to mentor others.
  • Experience running stateful systems on Kubernetes including PVs, CSI, StatefulSets.
  • Hands-on experience with cloud object storage (S3) and POSIX-style filesystems.

Responsibilities

  • Design, architect, and operate the distributed storage system feeding model training data.
  • Lead deployment of the system across Kubernetes clusters at petabyte scale.
  • Define data read/write patterns with researchers to shape throughput and durability requirements.
  • Solve networking and I/O challenges for large datasets across regions to reduce GPU idle time.

Skills

Storage fundamentals
Python
Go
Kubernetes
S3 cloud storage
POSIX filesystems

Tools

Persistent Volumes
CSI drivers
StatefulSets

Job description

Cohere is building a secure, scalable storage layer to feed petabyte-scale model training and checkpoints. You will architect and deploy this system across multiple Kubernetes clusters, defining data movement patterns and ensuring low latency and high durability.

You will collaborate with researchers and training-infra teams to optimize throughput, latency, and GPU utilization while guiding operational strategies and best practices across the organization.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Data Infrastructure Engineer - Petabyte-Scale Storage
Staff Data Infrastructure Engineer - Petabyte-Scale Storage

cohere • United States

Hybrid
USD 180,000 - 260,000
Weekly lunch stipend
Full health and dental benefits
RRSP matching
+4
Staff Data Infrastructure Engineer - Petabyte-Scale Storage
Staff Data Infrastructure Engineer - Petabyte-Scale Storage

Cohere • New York (NY)

Remote
USD 245,000 - 335,000
Weekly lunch stipend
Health and dental benefits
RRSP/401K, Pension
+2
Staff Software Engineer: Petabyte-Scale Data Infrastructure
Staff Software Engineer: Petabyte-Scale Data Infrastructure

ResumeXrays LLC • New York (NY)

Hybrid
USD 190,000 - 270,000
Lunch stipend
Health and dental benefits
RRSP/401k matching
+6
Staff Data Infrastructure Engineer - Scale Storage & Kubernetes
Staff Data Infrastructure Engineer - Scale Storage & Kubernetes

The Briefed • New York (NY)

On-site
USD 245,000 - 335,000
Lunch stipend
Health & dental benefits
RRSP matching/401K
+3
Staff Data Platform Engineer - Petabyte-Scale Pipelines
Staff Data Platform Engineer - Petabyte-Scale Pipelines

Kindredventures • San Francisco (CA)

On-site
USD 130,000 - 170,000
Staff Engineer: GPU-Scale Distributed Storage & AI Infra
Staff Engineer: GPU-Scale Distributed Storage & AI Infra

Fdetimes • San Francisco (CA)

Remote
USD 250,000 - 330,000
Startup equity
Health insurance
Remote work flexibility
+1
AI Data Infrastructure Engineer – Petabyte-Scale Storage
AI Data Infrastructure Engineer – Petabyte-Scale Storage

Cohere • New York (NY)

Remote
USD 120,000 - 160,000
Inclusive work culture
Weekly lunch stipend
Full health and dental benefits
+4
Staff Software Engineer, Data Infrastructure
Staff Software Engineer, Data Infrastructure

cohere • United States

Hybrid
USD 180,000 - 260,000
Weekly lunch stipend
Full health and dental benefits
RRSP matching
+4
Staff Storage Architect for Exabyte-Scale Systems
Staff Storage Architect for Exabyte-Scale Systems

Anthropic Limited • San Francisco (CA)

Hybrid
USD 180,000 - 280,000
GPU Infrastructure Engineer – Kubernetes & Multi-Cloud
GPU Infrastructure Engineer – Kubernetes & Multi-Cloud

Cohere • Seattle (WA)

Hybrid
USD 180,000 - 260,000
Weekly lunch stipend: $75/£75 or local
Health and dental benefits
RRSP matching / Pension
+6