Senior Data Engineer

Harnham; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

Harnham is seeking a Senior Data Engineer in San Francisco to take ownership of the data pipelines essential to their data ecosystem. The candidate will design and implement scalable ingestion architectures, ensuring data accuracy and compliance with financial standards.

Ideal applicants should have over 5 years of experience, advanced skills in SQL and dbt, and familiarity with cloud-native architectures across AWS, GCP, or Azure. Join a recognized platform and collaborate with diverse teams.

Qualifications

• 5+ years in data engineering or hybrid data/analytics role with end-to-end pipeline ownership.
• Experience with ingestion tools like Fivetran or Airbyte.
• Strong communication and collaboration skills.

Responsibilities

• Design and build scalable ingestion pipelines and orchestration frameworks.
• Own reliability, observability, and performance of data pipelines.
• Ensure revenue data accuracy and compliance.

Skills

Data Engineering

Advanced SQL

dbt

Python

Airflow

Cloud Architecture

Kafka

Self-serve Analytics

Tools

Snowflake

AWS

GCP

Azure

ClickHouse

Job description

We're partnered with one of the most recognised developer platforms in the world, trusted by engineering teams at OpenAI, Meta, Netflix, and Adobe, who are scaling their data platform and looking to hire a Senior Data Engineer to own the pipelines and foundations at the core of their data ecosystem.

You’ll own the full pipeline lifecycle, from ingestion architecture through to analytics‑ready data, working closely with Data Platform Engineers and partnering with analysts and data scientists who depend on what you build every day.

What you’ll do

• Design and build scalable ingestion pipelines and orchestration frameworks across structured, semi‑structured, and event‑based sources
• Own reliability, observability, and performance across the full pipeline lifecycle from raw ingestion to analytics‑ready delivery
• Build and maintain dbt transformation pipelines serving as the single source of truth across Finance, Product, GTM, and Engineering
• Ensure revenue and billing data meets the accuracy and auditability required for public company reporting, including SOX compliance
• Apply software engineering principles throughout: CI/CD, testing, observability, version control, and automation
• Enable self‑serve analytics through semantic layer development, strong abstractions, and clear documentation
• Champion data quality and governance across classification, ownership, access policies, and data lifecycle management

What we’re looking for

• 5+ years in data engineering or a hybrid data/analytics engineering role, with a track record of owning pipelines end‑to‑end in high‑growth or enterprise environments
• Advanced SQL and dbt (Core or Cloud), Snowflake or comparable cloud data warehouse, Python, and Airflow
• Experience with Kafka and streaming data systems, with working knowledge of ClickHouse, Iceberg, or similar technologies
• Experience with ingestion tools such as Fivetran, Airbyte, or Polytomic
• Cloud‑native architecture experience across AWS, GCP, or Azure
• Exposure to designing data systems that meet compliance and governance requirements, including SOX or equivalent
• Strong communication and collaboration skills, with the ability to contribute as a technical voice across engineering and business stakeholders