Remote Lead Data Engineer: Lakehouse & API Platform

Astrana Health Management; Monterey Park (CA); Remote; USD 170,000 - 240,000; Full time

Benefits offered by this job

Remote in US

Job summary

Astrana Health is seeking a Lead - Data Engineer to drive design, development, and operation of our enterprise data platform, including the Constellation Lakehouse, GraphQL API layer, and Lakebase-backed apps.

You will build scalable data pipelines, integrate healthcare data sources, and develop unified data models for analytics, AI, and operations, while ensuring reliability, security, and governance in an Azure Databricks environment.

Qualifications

• Bachelor's degree in CS/Engineering/Data Science or related field.
• 5+ years of data engineering experience building enterprise data platforms and pipelines.
• 3+ years hands-on Databricks in production environments.
• Strong Python, PySpark, SQL, and Spark proficiency.
• Experience with Delta Lake and lakehouse architectures.
• Hands-on with Azure data services and cloud platforms.
• Experience with Git, CI/CD, and automated deployment.

Responsibilities

• Lead the design, development, and delivery of core platform components (Databricks Lakehouse, GraphQL API, Lakebase-backed apps).
• Build and maintain scalable batch and incremental data pipelines using Databricks, Spark, PySpark, SQL, and Delta Lake.
• Integrate data from databases, APIs, files, and partners into governed datasets for analytics and operations.
• Design unified healthcare data models across membership, claims, encounters, clinical data, and more.
• Develop ingestion and transformation processes with CDC, schema evolution, deduplication, and historical tracking.
• Mentor engineers and establish engineering standards; collaborate with analytics, infra, security, and business stakeholders.

Skills

Databricks

Python

PySpark

SQL

Spark

Data Modeling

Cloud Data Platforms

CI/CD

Leadership

Mentoring

Communication

Education

Bachelor's degree in Computer Science, Engineering, Data Science, or a related field

Tools

Azure

PostgreSQL

GraphQL

Job description

Astrana Health is seeking a Lead - Data Engineer to drive design, development, and operation of our enterprise data platform, including the Constellation Lakehouse, GraphQL API layer, and Lakebase-backed apps.

You will build scalable data pipelines, integrate healthcare data sources, and develop unified data models for analytics, AI, and operations, while ensuring reliability, security, and governance in an Azure Databricks environment.