Staff Data Infrastructure Engineer - Petabyte-Scale Storage

Cohere

New York (NY)

Remote

USD 245,000 - 335,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Weekly lunch stipend
Health and dental benefits
RRSP/401K, Pension
Parental leave top‑up
Education & learning stipend + offsite

Job summary

Cohere is hiring for a Data Infrastructure role focused on building the storage layer for large-scale model training. You will architect and operate a petabyte-scale distributed system, deploying it across multiple Kubernetes clusters and aligning data patterns with throughput, latency, and durability goals.

The role emphasizes strong storage fundamentals, Python/Go coding, and Kubernetes stateful workloads. Remote-friendly with global offices and generous benefits.

Qualifications

  • Strong storage fundamentals including replication, consistency, caching, and data lifecycle management.
  • Proficient in Python and Go with leadership capability.
  • Experience running stateful systems on Kubernetes (PV, CSI, StatefulSets).
  • Hands-on with cloud object storage such as S3 and POSIX-style filesystems.

Responsibilities

  • Design, architect, and operate the distributed storage system for model training and evaluation.
  • Lead deployment across multiple Kubernetes clusters at petabyte scale.
  • Collaborate with researchers to define data read/write patterns and QoS requirements.
  • Address networking, I/O, and data movement challenges across regions and backends.

Skills

Python
Go
Kubernetes
Distributed storage architecture
Replication & data lifecycle
Throughput & latency optimization

Tools

Persistent Volumes
CSI drivers
StatefulSets
S3-compatible storage
POSIX filesystems

Job description

Cohere is hiring for a Data Infrastructure role focused on building the storage layer for large-scale model training. You will architect and operate a petabyte-scale distributed system, deploying it across multiple Kubernetes clusters and aligning data patterns with throughput, latency, and durability goals.

The role emphasizes strong storage fundamentals, Python/Go coding, and Kubernetes stateful workloads. Remote-friendly with global offices and generous benefits.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Software Engineer: Petabyte-Scale Data Infrastructure
Staff Software Engineer: Petabyte-Scale Data Infrastructure

ResumeXrays LLC • New York (NY)

Hybrid
USD 190,000 - 270,000
Lunch stipend
Health and dental benefits
RRSP/401k matching
+6
Staff Data Infrastructure Engineer - Petabyte-Scale Storage
Staff Data Infrastructure Engineer - Petabyte-Scale Storage

cohere • United States

Hybrid
USD 180,000 - 260,000
Weekly lunch stipend
Full health and dental benefits
RRSP matching
+4
Staff Data Infrastructure Engineer - Petabyte Storage
Staff Data Infrastructure Engineer - Petabyte Storage

Cohere • United States

Hybrid
USD 180,000 - 240,000
A weekly lunch stipend of $75/£75 or 0
Full health and dental benefits
100% Parental Leave top-up for up to 6
+3
Staff Data Infrastructure Engineer - Scale Storage & Kubernetes
Staff Data Infrastructure Engineer - Scale Storage & Kubernetes

The Briefed • New York (NY)

On-site
USD 245,000 - 335,000
Lunch stipend
Health & dental benefits
RRSP matching/401K
+3
AI Data Infrastructure Engineer – Petabyte-Scale Storage
AI Data Infrastructure Engineer – Petabyte-Scale Storage

Cohere • New York (NY)

Remote
USD 120,000 - 160,000
Inclusive work culture
Weekly lunch stipend
Full health and dental benefits
+4
Staff Software Engineer, Data Infrastructure
Staff Software Engineer, Data Infrastructure

Cohere • New York (NY)

Remote
USD 245,000 - 335,000
Weekly lunch stipend
Health and dental benefits
RRSP/401K, Pension
+2
Staff Software Engineer, Data Infrastructure
Staff Software Engineer, Data Infrastructure

cohere • United States

Hybrid
USD 180,000 - 260,000
Weekly lunch stipend
Full health and dental benefits
RRSP matching
+4
Staff Software Engineer, Data Infrastructure
Staff Software Engineer, Data Infrastructure

Cohere • United States

Hybrid
USD 180,000 - 240,000
A weekly lunch stipend of $75/£75 or 0
Full health and dental benefits
100% Parental Leave top-up for up to 6
+3
Staff Software Engineer, Data Infrastructure
Staff Software Engineer, Data Infrastructure

ResumeXrays LLC • New York (NY)

Hybrid
USD 190,000 - 270,000
Lunch stipend
Health and dental benefits
RRSP/401k matching
+6
Staff Data Platform Engineer - Petabyte-Scale Pipelines
Staff Data Platform Engineer - Petabyte-Scale Pipelines

Kindredventures • San Francisco (CA)

On-site
USD 130,000 - 170,000