Data Engineer: ETL Pipelines & Spark on Cloud

definitivehc; United States; On-site; USD 110,000 - 165,000; Full time

Job summary

Definitive Healthcare is seeking a Data Engineer to build, maintain, and support reliable data pipelines powering critical healthcare data products and customer-facing solutions.

This role requires hands-on experience with Python, SQL, Spark/PySpark, cloud data platforms, workflow orchestration, and modern engineering practices. You’ll collaborate with engineers, analysts, Product, Support, and data consumers to deliver reliable data changes.

Qualifications

• Bachelor’s degree or equivalent practical experience in CS/Engineering/IS.
• 2+ years building and supporting production data solutions.
• Proficiency in Python and SQL with pipelines in production.

Responsibilities

• Build, maintain, test, and support moderate-complexity ETL/ELT pipelines using Python, SQL, Spark, and related technologies.
• Own defined pipeline components from implementation through testing, deployment, and production support.
• Troubleshoot pipeline failures, data quality issues, and performance problems; identify root causes and implement fixes.

Skills

Python

SQL

Spark/PySpark

ETL/ELT pipelines

Airflow

Cloud platforms

Databricks/Snowflake

Data modeling

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Snowflake

Airflow

AWS/Azure/GCP

Job description

Definitive Healthcare is seeking a Data Engineer to build, maintain, and support reliable data pipelines powering critical healthcare data products and customer-facing solutions.

This role requires hands-on experience with Python, SQL, Spark/PySpark, cloud data platforms, workflow orchestration, and modern engineering practices. You’ll collaborate with engineers, analysts, Product, Support, and data consumers to deliver reliable data changes.