Remote Healthcare Lead Data Engineer — PHI Pipelines

Harvey Nash; United States; Remote; USD 160,000 - 180,000; Full time

Job summary

Harvey Nash is seeking a Healthcare Lead Data Engineer to own PHI pipelines touching patient data, built in Python with Ibis/DuckDB, Dagster, and Kubernetes, in a 100% remote US-based role.

You’ll own the ingestion lifecycle end-to-end—from submission through preprocessing, validation, enrichment, masking, and audit—while improving observability and automation with an Azure event-driven stack. The position emphasizes hands-on leadership and strong architectural judgment.

Qualifications

• Healthcare data literacy required; experience with HIPAA patient data.
• Experience designing, building, and operating patient-data pipelines using a DuckLake/Ibis/DuckDB lakehouse.
• Production SQL—write, tune, read query plans.
• Deep experience with orchestration (Dagster preferred) and justification for choices.
• Ingestion lifecycle experience—file intake, validation, event-driven processing, audit.
• Kubernetes deployment/operation knowledge.
• Observability-focused to diagnose failures.
• AI-assisted development discipline and ownership of output.
• EMR/EHR integration at multi-hospital scale.

Responsibilities

• Own PHI pipeline portfolio—design, build, operate pipelines on Dagster with DuckLake/Ibis/DuckDB.
• Own ingestion lifecycle end-to-end: submission to preprocessing, validation, enrichment, masking, audit.
• Turn data movement into idempotent, retriable, observable processes with governance.

Skills

Healthcare data literacy

DuckLake/Ibis/DuckDB lakehouse

SQL

Dagster

Kubernetes

Ingestion lifecycle

Observability

AI-assisted development

EMR/EHR integration

Tools

Dagster

Airflow

Prefect

Azure Event Grid

Service Bus

Kubernetes

DuckLake

DuckDB

Ibis

MySQL

Job description

Harvey Nash is seeking a Healthcare Lead Data Engineer to own PHI pipelines touching patient data, built in Python with Ibis/DuckDB, Dagster, and Kubernetes, in a 100% remote US-based role.

You’ll own the ingestion lifecycle end-to-end—from submission through preprocessing, validation, enrichment, masking, and audit—while improving observability and automation with an Azure event-driven stack. The position emphasizes hands-on leadership and strong architectural judgment.