Staff Data Engineer — Data Lake Architect

h1; New York (NY); Hybrid; USD 170,000 - 190,000; Full time

Benefits offered by this job

Health insurance options

Generous paid time off

Flexible work hours

Job summary

H1 in New York seeks a Staff Data Engineer to shape the architecture of their Data Lake. You will lead efforts in building robust data pipelines and ensure the quality of data used across the organization. This position offers a pathway to engineering management while remaining hands-on.

The ideal candidate has significant experience with distributed data platforms, a deep understanding of cloud-native systems, and a passion for mentoring teams. A comprehensive benefits package is included in this full-time role.

Qualifications

• 8+ years of experience in data engineering or software engineering.
• Demonstrated technical leadership and mentoring skills.
• Strong proficiency in Python (PySpark) and advanced SQL expertise.

Responsibilities

• Architect and build distributed ETL/ELT pipelines.
• Lead the evolution of H1's Data Lake architecture.
• Own and improve data quality across global sources.

Skills

Distributed data platforms

Data engineering

Python (PySpark)

Apache Spark

SQL performance tuning

Cloud-native environments

Containerization (Docker, Kubernetes)

Tools

AWS

Airflow

Argo

Job description

H1 in New York seeks a Staff Data Engineer to shape the architecture of their Data Lake. You will lead efforts in building robust data pipelines and ensure the quality of data used across the organization. This position offers a pathway to engineering management while remaining hands-on.

The ideal candidate has significant experience with distributed data platforms, a deep understanding of cloud-native systems, and a passion for mentoring teams. A comprehensive benefits package is included in this full-time role.