Data Platform Manager - AI-Powered Healthcare Data

Garner Health; New York (NY); Hybrid; USD 310,000 - 385,000; Full time

Job summary

Garner Health, based in New York City, is seeking an execution-focused Data Engineering Manager to lead the Data Platform Team. You will drive end-to-end design, implement high-throughput data infrastructure, and champion an AI-native development philosophy in a fast-paced startup environment.

The role requires 5+ years in data engineering and 2+ years of managing engineers, with hands-on expertise in Hadoop/Spark, Kafka, and modern data tools.

Qualifications

• 5+ years of hands-on engineering experience in Big Data and distributed systems.
• 2+ years managing engineering teams.
• Expertise with batch data processing frameworks such as Hadoop, Spark, EMR.
• Experience with stream processing systems such as Kafka and RedPanda.
• Proficiency with technologies such as Temporal, Apache Iceberg, AWS Glue, Spark, DBT, and Soda.
• Ownership mindset with ability to translate complex business needs into scalable roadmaps.

Responsibilities

• Lead and manage the Data Platform Engineering team and the end-to-end design of scalable data systems.
• Provide architectural guidance and establish standards for data modeling and processing.
• Build and optimize data abstractions, pipelines, and frameworks for high scalability.
• Translate complex requirements into well-scoped architectural pieces.
• Foster an AI-native engineering culture and integrate AI tools to enhance workflows and automate data ops.
• Manage stakeholder relationships across Engineering and Product and align priorities with OKRs.
• Mentor and coach team members with design reviews and RCA to elevate technical rigor.

Skills

Big Data

Distributed systems

Team management

Data pipelines

Python

Spark

Tools

Hadoop

Spark

EMR

Kafka

RedPanda

Temporal

Apache Iceberg

AWS Glue

dbt

Snowflake

Airflow

Kubernetes

OpenMetadata

Terraform

Job description

Garner Health, based in New York City, is seeking an execution-focused Data Engineering Manager to lead the Data Platform Team. You will drive end-to-end design, implement high-throughput data infrastructure, and champion an AI-native development philosophy in a fast-paced startup environment.

The role requires 5+ years in data engineering and 2+ years of managing engineers, with hands-on expertise in Hadoop/Spark, Kafka, and modern data tools.