Senior Data Platform Engineer — Lakehouse & AI Pipelines

Qualified Health PBC; United States; Hybrid; USD 215,000 - 235,000; Full time

Benefits offered by this job

Equity

Medical/Dental/Vision insurance

Flexible working hours

Hybrid work options

Job summary

Qualified Health PBC is seeking a Senior Staff Engineer to drive the technical direction for the Data Platform. You will own the Databricks lakehouse architecture, data pipelines, governance, and performance, and you will build AI pipelines alongside product teams.

You will set platform-wide strategy, shape the roadmap with leadership, and raise engineering effectiveness across the organization while staying hands-on with the hardest parts of the codebase.

Qualifications

• Bachelor's degree in a relevant field.
• 12+ years of software or data engineering experience.
• Experience in regulated domains (Healthcare, Insurance, Finance).
• Deep, hands-on Databricks expertise preferred; Snowflake or Fabric ok.
• Experience building ML/LLM pipelines and embeddings.
• Fluency in Python and SQL with best practices (CI/CD, IaC).
• Experience owning ambiguous, cross-team problems end to end.

Responsibilities

• Own the Databricks lakehouse architecture and evolve data platforms.
• Build and tune Spark/SQL pipelines on Databricks; manage data quality and costs.
• Define data contracts and phi-aware governance with security/compliance.
• Build AI pipelines, datasets, retrieval/vector stores, and evaluation data.
• Design durable Temporal workflows for AI pipelines and ensure handoffs with Databricks.

Skills

Python

SQL

Databricks

Data pipelines

ML/LLM pipelines

Cross-team collaboration

Cloud platforms (GCP/AWS/Azure)

Education

Bachelor's Degree in CS/EE/Math or related field

Tools

Temporal

Databricks / Delta Lake

Snowflake / Microsoft Fabric

Terraform / Kubernetes

Airflow / Dagster / Prefect

Job description

Qualified Health PBC is seeking a Senior Staff Engineer to drive the technical direction for the Data Platform. You will own the Databricks lakehouse architecture, data pipelines, governance, and performance, and you will build AI pipelines alongside product teams.

You will set platform-wide strategy, shape the roadmap with leadership, and raise engineering effectiveness across the organization while staying hands-on with the hardest parts of the codebase.