Senior PHI Pipeline Architect (Dagster)

Harvey Nash; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

Harvey Nash is seeking a data engineering lead to own PHI pipelines, handling identified patient data in Dagster on a DuckLake/Ibis/DuckDB lakehouse.

You'll design ingestion lifecycle end to end—file submission, preprocessing, validation, masking, and audit—and improve observability and automation.

Remote-friendly US-based role requiring healthcare data literacy, SQL mastery, and experience with Kubernetes and modern orchestrators such as Dagster or Airflow.

Qualifications

• Experience with healthcare data under HIPAA.
• Production SQL: write, tune, and read query plans.
• Ingestion lifecycle: file intake, validation, enrichment, masking, audit.
• Experience with cloud and orchestration tools.

Responsibilities

• Own PHI pipeline portfolio and ingestion system.
• Design, build and operate pipelines in Dagster on the DuckLake/Ibis/DuckDB lakehouse.
• Ensure observability and governance across pipelines.
• Collaborate with CTO and US engineers to refine architecture and code.
• Translate requirements into robust, scalable data workflows.

Skills

Healthcare data literacy

Production SQL

Observability mindset

AI-assisted development

Tools

Dagster

Airflow

Kubernetes

Azure

DuckDB

Ibis

DuckLake

MySQL

Event Grid

Service Bus

Job description

Harvey Nash is seeking a data engineering lead to own PHI pipelines, handling identified patient data in Dagster on a DuckLake/Ibis/DuckDB lakehouse.

You'll design ingestion lifecycle end to end—file submission, preprocessing, validation, masking, and audit—and improve observability and automation.

Remote-friendly US-based role requiring healthcare data literacy, SQL mastery, and experience with Kubernetes and modern orchestrators such as Dagster or Airflow.