Senior Data Platform Architect — Lakehouse & AI Pipelines

Qualified Health PBC; United States; Hybrid; USD 215,000 - 235,000; Full time

Benefits offered by this job

Equity

Health insurance

Flexible working hours

Hybrid work options

Job summary

Qualified Health is hiring a Senior Staff Engineer to set the technical direction for the Data Platform. You will own the Databricks lakehouse architecture, governance, and data pipelines, and you will build AI pipelines alongside it using Temporal for durable orchestration.

You will lead cross-team initiatives, craft designs, and raise engineering effectiveness while staying hands-on with the hardest parts of the codebase.

Qualifications

• Bachelor's degree or higher in a related field.
• 12+ years of software or data engineering experience in production data platforms.
• Experience with regulated domains (Healthcare, Insurance, Finance) is required.
• Hands-on Databricks expertise strongly preferred (Snowflake/Microsoft Fabric aligned).
• Experience building ML/LLM pipelines and using AI tooling.

Responsibilities

• Own the Databricks lakehouse architecture (bronze, silver, gold) and governance.
• Design and optimize Spark/SQL pipelines on Databricks; ensure quality and cost efficiency.
• Define data contracts, access controls, and PHI-aware governance.
• Build AI pipelines and Temporal workflows for durable orchestration.
• Lead agentic engineering efforts: tooling, prompts, guardrails, reviews, tests.
• Set technical direction; write designs and drive multi-team alignment.
• Mentor engineers and communicate trade-offs across teams.

Skills

Databricks

Python

SQL

Spark

Delta Lake

Unity Catalog

Temporal

LLM pipelines

agentic engineering

cross-team collaboration

data governance

PHI governance

Education

Bachelor's degree in Computer Science, Electrical Engineering, Mathematics or related field

Tools

Snowflake

Microsoft Fabric

Databricks Delta Live Tables

Airflow

Kubernetes

Job description

Qualified Health is hiring a Senior Staff Engineer to set the technical direction for the Data Platform. You will own the Databricks lakehouse architecture, governance, and data pipelines, and you will build AI pipelines alongside it using Temporal for durable orchestration.

You will lead cross-team initiatives, craft designs, and raise engineering effectiveness while staying hands-on with the hardest parts of the codebase.