Staff Data Engineer

Storm3; San Francisco (CA); Remote; USD 180,000 - 210,000; Full time

Benefits offered by this job

Remote-first environment

Direct partnership with CTO

Equity opportunity

High ownership over critical systems

Job summary

Storm3 is partnering with a profitable healthcare analytics company to hire a Senior Data Engineer who will own the PHI data pipelines and the end-to-end data ingestion lifecycle. You will work directly with the CTO to shape the lakehouse architecture and ensure high-quality, secure data delivery.

The role requires strong Python and SQL skills, Kubernetes deployment experience, and expertise with orchestration tools such as Dagster or Airflow. Remote-first environment with equity opportunity.

Qualifications

• Experience with HIPAA-regulated healthcare data.
• Production-grade data systems built with Python.
• Advanced SQL with optimization and troubleshooting.
• Experience with orchestration tools (Dagster preferred).
• Experience building ingestion, validation, audit and recovery workflows.
• Kubernetes deployment and operations.
• Strong observability mindset for critical systems.
• Familiar with AI-assisted development tools.

Responsibilities

• Own design, development, and operation of PHI data pipelines in Python.
• Lead patient identity resolution and record-linkage workflows.
• Own data-ingestion lifecycle from intake to delivery.
• Automate data operations with observability and governance.
• Serve as escalation point for production issues in healthcare data pipelines.
• Collaborate with CTO on lakehouse architecture decisions.

Skills

Python

SQL

Data pipelines

Dagster

Kubernetes

Airflow

Prefect

HIPAA compliance

Observability

Tools

Dagster

Airflow

Prefect

Kubernetes

Job description

Storm3 is partnered with a profitable healthcare analytics company that helps health systems improve cardiovascular outcomes through advanced benchmarking, clinical analytics, and performance improvement. By combining registry data, patient-level clinical information, and health system operational data, they enable hospitals to deliver higher-quality care to more patients at a lower cost.

As they continue to scale, they’re looking for a Senior Data Engineer to own and evolve the pipelines responsible for their most sensitive healthcare data, working directly alongside the CTO.

What you’ll do

• Own the design, development, and operation of PHI data pipelines built in Python using Ibis, DuckDB, Pandas, Dagster, and Kubernetes
• Lead patient identity resolution and record-linkage workflows to ensure accurate alignment of healthcare data
• Own the data-ingestion lifecycle from file intake through validation, enrichment, masking, audit, and delivery
• Automate data operations and recovery processes with enterprise-grade observability, governance, and retry mechanisms
• Serve as the escalation point for critical production issues impacting client-facing healthcare data pipelines
• Partner closely with the CTO to make key engineering decisions within the organization’s lakehouse architecture

What we’re looking for

• Experience working with patient-level healthcare data under HIPAA regulations
• Strong Python expertise building production-grade data systems
• Advanced SQL skills, including query optimization and troubleshooting
• Hands-on experience with orchestration tools such as Dagster, Airflow, or Prefect (Dagster strongly preferred)
• Experience building and supporting ingestion pipelines, validation frameworks, audit processes, and failure recovery workflows
• Experience deploying and operating workloads on Kubernetes
• Strong observability and troubleshooting mindset with the ability to own business-critical systems
• Comfortable using AI-assisted development tools while maintaining full ownership of technical decisions and output quality

Benefits

• 185k base + quarterly bonus+ equity opportunity
• Remote-first environment working alongside a highly technical engineering team
• Direct partnership with the CTO and high ownership over critical systems