Senior Data Platform Architect — Real-Time & Governance

Harvey; San Francisco (CA); On-site; USD 193,000 - 290,000; Full time

Job summary

Harvey is building the data platform to empower product engineers, data engineers, and analysts with scalable data access. You will own the architecture, guide ingestion and orchestration, and enable self-serve pipelines across teams in a multi-region, privacy-conscious environment.

The role focuses on establishing robust data infrastructure with Snowflake as the backbone, streaming through Kafka and Spark, and governance that meets strict data residency requirements.

Qualifications

• 5+ years building and operating production data infrastructure.
• Deep experience with cloud data warehouses (Snowflake preferred).
• Hands-on experience building CDC and streaming pipelines (Kafka, Debezium, Flink, Spark Streaming).
• Experience with managed ingestion tooling (Fivetran, Airbyte).
• Strong orchestration experience (Temporal, Airflow, Dagster).
• Strong programming in Python and SQL.
• Experience building internal tooling and data governance.

Responsibilities

• Own data platform architecture and direction.
• Build and operate ingestion layer across streaming, batch, CDC, and connectors.
• Land data into Snowflake with freshness and cost characteristics.
• Own orchestration platform across the data graph.
• Build transformation and compute frameworks and self-serve tooling.
• Design and operate stream processing for real-time needs.
• Build trust layer: quality, observability, lineage, discovery.
• Develop patterns for PII and multi-region residency.
• Set technical bar via reviews, standards, and mentoring.

Skills

Python

SQL

Data pipelines

Cloud data platforms

Tools

Snowflake

Kafka

Debezium

Flink

Spark Streaming

Fivetran

Airbyte

Temporal

Airflow

Dagster

Kubernetes

Terraform

Pulumi

dbt

Job description

Harvey is building the data platform to empower product engineers, data engineers, and analysts with scalable data access. You will own the architecture, guide ingestion and orchestration, and enable self-serve pipelines across teams in a multi-region, privacy-conscious environment.

The role focuses on establishing robust data infrastructure with Snowflake as the backbone, streaming through Kafka and Spark, and governance that meets strict data residency requirements.