Distributed DB Engineer: Scale Big Data & Performance

Ahrefs Pte Ltd.

Cambridge, Palo Alto (MA, CA)

On-site

USD 170,000 - 230,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Ahrefs is seeking a senior data-layer engineer to own and operate our storage stack. You will work on ClickHouse storage, MooseFS/SeaweedFS and TiDB/Elasticsearch clusters, shipping features and ensuring high availability across our production systems.

You will debug complex performance issues, contribute to open-source-like processes, and help scale to hundreds of servers in multiple regions. A strong systems background is essential.

Qualifications

  • Strong proficiency in C++, C and Rust; ability to work with Go.
  • Solid understanding of distributed consensus (Raft/Paxos) and failure modes.
  • Knowledge of Linux storage internals (page cache, fsync, FUSE, file systems, NVMe/HDD behavior).
  • Experience running databases/storage on hundreds of nodes and leading recovery after incidents.
  • Proficient debugging with gdb, perf, sanitizers and production data metrics.

Responsibilities

  • Build and operate the data layer: ClickHouse, MooseFS, SeaweedFS, TiDB and Elasticsearch clusters.
  • Implement storage and query features, keep CI green, ship releases.
  • Roll out storage migrations across ~1,200 servers in multiple regions with minimal downtime.
  • Diagnose production performance issues and fix root causes in code.
  • Develop an SRE agent to monitor clusters and propose fixes.

Skills

C++
C
Rust
Go
Distributed systems
Raft/Paxos
Linux storage
Performance debugging

Tools

GDB
Perf
Sanitizers

Job description

Ahrefs is seeking a senior data-layer engineer to own and operate our storage stack. You will work on ClickHouse storage, MooseFS/SeaweedFS and TiDB/Elasticsearch clusters, shipping features and ensuring high availability across our production systems.

You will debug complex performance issues, contribute to open-source-like processes, and help scale to hundreds of servers in multiple regions. A strong systems background is essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Distributed DB & Storage Engineer
Senior Distributed DB & Storage Engineer

Ahrefs • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Data Systems Engineer - Distributed Storage & ClickHouse
Data Systems Engineer - Distributed Storage & ClickHouse

Ahrefs Pte Ltd. • Boston (MA)

On-site
USD 180,000 - 280,000
Database Engineer
Database Engineer

Ahrefs • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Database Engineer
Database Engineer

Ahrefs Pte Ltd. • Cambridge (MA), Palo Alto (CA)

On-site
USD 170,000 - 230,000
Staff Engineer - Scalable Distributed Data & Infrastructure
Staff Engineer - Scalable Distributed Data & Infrastructure

Remote • San Francisco (CA)

On-site
USD 200,000 - 280,000
Senior Performance Engineer — Remote, Equity & Resilience
Senior Performance Engineer — Remote, Equity & Resilience

ClickHouse • United States

Remote
USD 150,000 - 230,000
Healthcare benefits
Company equity
Home office setup stipend 500 USD
+2
Engineer (Systems/Database)
Engineer (Systems/Database)

Veritas Partners • Philadelphia

On-site
USD 90,000 - 135,000
Staff Software Engineer (Data/Infrastructure)
Staff Software Engineer (Data/Infrastructure)

UMATR • New York (NY)

On-site
USD 225,000 - 275,000
Competitive salary up to $250k
Sizeable equity
High ownership in architecture
+2
Senior Data Platform Engineer: ClickHouse at Scale
Senior Data Platform Engineer: ClickHouse at Scale

Qualys • Foster City (CA)

On-site
USD 180,000 - 250,000
Senior Distributed Data Systems Engineer
Senior Distributed Data Systems Engineer

Onehouse • United States

Remote
USD 150,000 - 210,000
Equity compensation
Health & Well-being
Financial future
+4