Staff Data Lake Engineer — Lead & Scale Platform

H1

New York (NY)

On-site

USD 190,000 - 220,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
Wellness holidays
Retirement options
Stipends for health & charity
Employee Resource Groups

Job summary

H1 is seeking a Staff Data Engineer on the Data Lake team to shape the architecture, scalability, reliability, and long-term direction of our core data platform. This role blends hands-on engineering with leadership aspirations as you grow into an Engineering Manager track while remaining technically active.

You will mentor engineers, own data quality workflows, and drive secure data delivery across global sources, partnering with Product, Infrastructure, Security, and Compliance to maintain

Qualifications

  • 8+ years in data or software engineering building distributed data platforms.
  • Experience leading engineers and mentoring.
  • Strong proficiency in Python (PySpark), Java, Scala.
  • Advanced SQL and performance tuning on large datasets.
  • Deep experience with Apache Spark and cloud-native data platforms in AWS.
  • Experience with orchestration tools such as Argo or Airflow.
  • Familiarity with Parquet/Avro/ORC formats, Docker and Kubernetes.
  • Healthcare data experience and data quality focus are a plus.

Responsibilities

  • Architect, build, and scale distributed ETL/ELT pipelines and large-scale ingestion across healthcare datasets.
  • Lead evolution of Data Lake architecture with focus on scalability, observability, reliability, and cost.
  • Own and improve data quality, validation, normalization, and standardization workflows.
  • Design and optimize batch and near real-time data processing frameworks.
  • Improve monitoring, governance, production reliability across the platform.
  • Mentor engineers through technical leadership and architecture reviews.
  • Help define technical roadmap priorities and long-term platform strategy.

Skills

Python (PySpark)
Java
Scala
SQL
Apache Spark
AWS data lake (EMR/Glue/S3)
Airflow
Argo
Docker
Kubernetes

Tools

Airflow
Argo

Job description

H1 is seeking a Staff Data Engineer on the Data Lake team to shape the architecture, scalability, reliability, and long-term direction of our core data platform. This role blends hands-on engineering with leadership aspirations as you grow into an Engineering Manager track while remaining technically active.

You will mentor engineers, own data quality workflows, and drive secure data delivery across global sources, partnering with Product, Infrastructure, Security, and Compliance to maintain

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Data Platform Engineer – Scale Data Pipelines
Staff Data Platform Engineer – Scale Data Pipelines

Faire • West Covina (CA)

Hybrid
USD 247,000 - 339,000
Equity
Benefits
Hybrid work model
Enterprise Data Lake Platform Lead
Enterprise Data Lake Platform Lead

Accion Labs • Dallas (TX)

On-site
USD 140,000 - 200,000
Staff Data Engineer
Staff Data Engineer

robotsandpencils • United States

Remote
USD 130,000 - 190,000
Cloud Data Platform Lead — Lakehouse & BI Pipelines
Cloud Data Platform Lead — Lakehouse & BI Pipelines

Stafford Gray • Lansing (MI)

Hybrid
USD 120,000 - 170,000
Senior Data Platform Engineer — Lakehouse & AI Pipelines
Senior Data Platform Engineer — Lakehouse & AI Pipelines

Qualified Health PBC • United States

Hybrid
USD 215,000 - 235,000
Equity
Medical/Dental/Vision insurance
Flexible working hours
+1
Senior Data Platform Engineer - Lakehouse Infra (Remote)
Senior Data Platform Engineer - Lakehouse Infra (Remote)

Remote • San Francisco (CA)

Remote
USD 195,000 - 255,000
Equity rewards
Remote work
Healthcare subsidy
Senior Data Platform Architect – Lakehouse
Senior Data Platform Architect – Lakehouse

Workday, Inc. (old) • Pleasanton (CA)

Hybrid
USD 187,000 - 334,000
Senior Staff Data Platform Architect
Senior Staff Data Platform Architect

Databricks Inc. • San Francisco (CA)

On-site
USD 229,000 - 314,000
Staff Data Platform Engineer - Streaming & Lakehouse
Staff Data Platform Engineer - Streaming & Lakehouse

Faire • New York (NY), San Francisco (CA)

Hybrid
USD 247,000 - 339,000
Senior Data Platform Engineer: Lakehouse & AI Infra
Senior Data Platform Engineer: Lakehouse & AI Infra

CreativeTechy • Lebanon

On-site
USD 150,000 - 190,000