Senior Data Platform Engineer - Scale Data Infra

Engg; San Francisco (CA); On-site; USD 180,000 - 250,000; Full time

Job summary

Harvey in the United States is seeking a Senior Data Platform Engineer to lead the architecture and delivery of a central data platform. You will work across Analytics, Data Engineering, and Infrastructure to shape ingestion, storage, and access to data for multiple teams.

Based in San Francisco, CA or New York, NY, you will implement ingestion pipelines, streaming architectures, schema evolution, and governance to ensure data quality, security, and scalable access for enterprise customers.

Qualifications

• 5+ years building and operating production data infrastructure.
• Experience with cloud data warehouses and data quality tooling.
• Proven ability to partner with analytics, data engineering, and product teams.

Responsibilities

• Own the data platform's architecture and technical direction - treating data infrastructure as a software product built from reusable frameworks, and making deliberate build-vs-buy tradeoffs as the platform grows
• Build and operate the ingestion layer across streaming, batch, CDC, and third-party connectors, including schema evolution that absorbs upstream change safely rather than silently breaking consumers, so onboarding a new source is a paved path instead of a project
• Land data into Snowflake with the freshness, completeness, and cost characteristics downstream consumers can plan around, and define a clean handoff for Analytics Engineering
• Own the orchestration platform - scheduling, retries, backfills, and dependency management across the full data graph
• Build the transformation and compute frameworks teams can use to process data at scale, and the self-serve tooling that lets product engineers and analysts stand up their own pipelines against primitives you've already made safe
• Design and operate stream processing infrastructure for use cases that can't wait for batch - real-time product features, operational alerting, and near-live reporting
• Build the trust layer: quality and observability (freshness, validation, reconciliation, anomaly detection, alerting routed to the right owner) alongside lineage, cataloging, and discovery, so anyone can find data and know where it came from and what depends on it
• Build the patterns and tooling for PII and sensitive data - classification, masking, retention, access control - and for multi-region residency requirements
• Set the technical bar for data at Harvey through design reviews, standards, documentation, and mentorship as the team grows

Skills

Data platform ownership

Python

SQL

Data modeling

Observability & monitoring

Data governance

Multi-region data architectures

Tools

Snowflake

Kafka

Flink

Airflow

Dagster

Temporal

Job description

Harvey in the United States is seeking a Senior Data Platform Engineer to lead the architecture and delivery of a central data platform. You will work across Analytics, Data Engineering, and Infrastructure to shape ingestion, storage, and access to data for multiple teams.

Based in San Francisco, CA or New York, NY, you will implement ingestion pipelines, streaming architectures, schema evolution, and governance to ensure data quality, security, and scalable access for enterprise customers.