Staff Data Platform Engineer — Ingestion & Real-Time

Engg; New York (NY); On-site; USD 180,000 - 240,000; Full time

Job summary

Harvey is building a modern data platform. Join as one of the first on the central data platform team to design and implement data ingestion, streaming, and analytics features. You’ll shape architecture for Snowflake-based pipelines, ensure data quality and governance, and empower product teams with trusted data.

Based in San Francisco, CA or New York, NY, you will collaborate with Analytics, Data Engineering, and Infra to deliver scalable data infrastructure for high-security environments.

Qualifications

• 10+ years building and operating production data infrastructure.
• Deep experience with cloud data warehouses, Snowflake preferred.
• Hands-on experience with CDC and streaming pipelines (Kafka, Debezium, Flink, Spark Streaming).
• Experience with managed ingestion tooling (Fivetran, Airbyte or similar).
• Strong fluency with workflow orchestration (Temporal, Airflow, Dagster).
• Strong programming skills in Python and advanced SQL.
• Experience building frameworks or internal tooling used by other engineers.
• Practical experience with data quality, observability, and lineage tooling.

Responsibilities

• Own the data platform's architecture and technical direction for scalable data infrastructure.
• Build and operate the ingestion layer across streaming, batch, CDC, and connectors.
• Land data into Snowflake with reliable freshness and cost characteristics for downstream analytics.
• Own the orchestration platform with scheduling, retries and backfills.
• Build transformation and compute frameworks and self-serve tooling for pipelines.
• Design and operate real-time stream processing for features and alerts.
• Develop trust layer with quality, lineage, and governance components.

Skills

Data platform architecture

Snowflake

CDC/Streaming pipelines

Ingestion tooling

Workflow orchestration

Python

Advanced SQL

Internal tooling/frameworks

Data quality/observability

Tools

Kafka

Debezium

Flink

Spark Streaming

Snowflake

Airflow

Dagster

Temporal

Airbyte

Fivetran

Job description

Harvey is building a modern data platform. Join as one of the first on the central data platform team to design and implement data ingestion, streaming, and analytics features. You’ll shape architecture for Snowflake-based pipelines, ensure data quality and governance, and empower product teams with trusted data.

Based in San Francisco, CA or New York, NY, you will collaborate with Analytics, Data Engineering, and Infra to deliver scalable data infrastructure for high-security environments.