Distributed Storage & Database Engineer (Petabyte Scale)

ahrefsjobs

Cambridge (MA)

On-site

USD 180,000 - 260,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Ahrefs is seeking an experienced systems engineer to own and operate the data layer behind our crawler. You will build and run ClickHouse, MooseFS, SeaweedFS, TiDB and Elasticsearch clusters across multiple regions. You’ll write code, ship it, and partner with AI coding agents as a normal part of the job.

You’ll ensure high availability, performance, and correctness at petabyte-scale. You’ll work on storage, replication, and lineage features, while keeping CI green and deploying regular

Qualifications

  • Strong C++, C and Rust programming skills.
  • Experience with large-scale distributed databases/storage systems.
  • Understanding of distributed consensus (Raft or Paxos).
  • Familiarity with Linux storage internals (page cache, fsync, FUSE).
  • Experience running databases/storage on hundreds of nodes and leading recovery.

Responsibilities

  • Build storage and query features in ClickHouse and related storage layers.
  • Keep CI green and ship our own releases regularly.
  • Roll out releases and storage migrations across many servers without downtime.
  • Find performance problems in production and fix in code (queries to storage).
  • Build an SRE agent to monitor clusters and propose fixes.

Skills

C++
C
Rust
Go
Distributed systems
Raft/Paxos
Linux internals
GDB/Perf

Tools

ClickHouse
MooseFS
SeaweedFS
TiDB
Elasticsearch
TiKV
TiCDC

Job description

Ahrefs is seeking an experienced systems engineer to own and operate the data layer behind our crawler. You will build and run ClickHouse, MooseFS, SeaweedFS, TiDB and Elasticsearch clusters across multiple regions. You’ll write code, ship it, and partner with AI coding agents as a normal part of the job.

You’ll ensure high availability, performance, and correctness at petabyte-scale. You’ll work on storage, replication, and lineage features, while keeping CI green and deploying regular

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Distributed DB & Storage Engineer
Senior Distributed DB & Storage Engineer

Ahrefs • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Distributed DB Engineer: Scale Big Data & Performance
Distributed DB Engineer: Scale Big Data & Performance

Ahrefs Pte Ltd. • Cambridge (MA), Palo Alto (CA)

On-site
USD 170,000 - 230,000
Data Systems Engineer - Distributed Storage & ClickHouse
Data Systems Engineer - Distributed Storage & ClickHouse

Ahrefs Pte Ltd. • Boston (MA)

On-site
USD 180,000 - 280,000
Database Engineer
Database Engineer

ahrefsjobs • Cambridge (MA)

On-site
USD 180,000 - 260,000
Database Engineer
Database Engineer

Ahrefs • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Database Engineer
Database Engineer

Ahrefs Pte Ltd. • Cambridge (MA), Palo Alto (CA)

On-site
USD 170,000 - 230,000
Database Engineer
Database Engineer

Ahrefs • Boston (MA)

On-site
USD 180,000 - 280,000
Staff Data Infrastructure Engineer - Petabyte-Scale Storage
Staff Data Infrastructure Engineer - Petabyte-Scale Storage

cohere • United States

Hybrid
USD 180,000 - 260,000
Weekly lunch stipend
Full health and dental benefits
RRSP matching
+4
Staff Software Engineer: Petabyte-Scale Data Infrastructure
Staff Software Engineer: Petabyte-Scale Data Infrastructure

ResumeXrays LLC • New York (NY)

Hybrid
USD 190,000 - 270,000
Lunch stipend
Health and dental benefits
RRSP/401k matching
+6
Staff Engineer: Distributed Storage for AI & HPC
Staff Engineer: Distributed Storage for AI & HPC

Hidden Jobs • United States

Remote
USD 160,000 - 210,000