Staff Data Engineer, Emerald — Flexible Hours & Remote

h1; New York (NY); On-site; USD 170,000 - 190,000; Full time

Benefits offered by this job

Health insurance options

Flexible work hours

Generous paid time off

Job summary

H1 is seeking a Staff Data Engineer in New York, NY, responsible for shaping the architecture and direction of the healthcare entity resolution platform. This role involves managing large-scale healthcare datasets and leading technical initiatives for system optimization.

The ideal candidate has 8+ years of experience in data engineering, strong leadership skills, and expertise in technologies like Apache Spark, Python, and AWS. H1 offers a competitive salary of $170k-$190k annually, alongside stock options.

Qualifications

• 8+ years of experience building and maintaining large-scale distributed data systems and pipelines.
• Technical leadership experience mentoring engineers and driving complex technical initiatives.
• Extensive experience with AWS-based big data technologies.

Responsibilities

• Design and optimize distributed Spark/PySpark pipelines.
• Lead a team and build scalable processing frameworks.
• Partner with various teams to enhance platform performance.

Skills

Distributed data processing

Apache Spark

Python (PySpark)

Cloud-native environments

Data engineering best practices

Tools

Docker

Kubernetes

AWS

Job description

H1 is seeking a Staff Data Engineer in New York, NY, responsible for shaping the architecture and direction of the healthcare entity resolution platform. This role involves managing large-scale healthcare datasets and leading technical initiatives for system optimization.

The ideal candidate has 8+ years of experience in data engineering, strong leadership skills, and expertise in technologies like Apache Spark, Python, and AWS. H1 offers a competitive salary of $170k-$190k annually, alongside stock options.