Senior Data Engineer (Healthcare)

VeeRteq Solutions Inc.; Philadelphia (Philadelphia County); Hybrid; USD 120,000 - 150,000; Full time

Job summary

VeeRteq Solutions Inc. is seeking a senior Data Engineer to build and support cloud-based healthcare data platforms using Azure Databricks, ADF, and ADLS Gen2.

You will design PySpark/SQL pipelines, implement Delta Lake, and contribute to data modeling and governance within an Agile team in a hybrid Philadelphia setting. The ideal candidate has 7+ years in data engineering, 5+ years with Azure data technologies, and healthcare domain experience.

Qualifications

• 7+ years in data engineering with cloud data platforms.
• Proven experience building end-to-end data pipelines on Azure.
• Healthcare domain experience including Payer/Health Plan preferred.

Responsibilities

• Build and maintain ETL/ELT data pipelines.
• Develop data solutions with Azure Databricks, ADF, and ADLS Gen2.
• Create PySpark/SQL processing frameworks and Delta Lake architectures.
• Support data migration, modernization, and cloud transformation initiatives.
• Ensure data quality, reliability, and performance across pipelines.
• Build data models and curated datasets for reporting/analytics.
• Implement CI/CD, monitoring, and DevOps practices for data services.
• Collaborate with business users, architects, and product teams in Agile.

Skills

Azure Databricks

Azure Data Factory

ADLS Gen2

PySpark

Python

SQL

Delta Lake

Data Modeling

ETL/ELT

Azure Cloud

Git

CI/CD

Agile/Scrum

Lakehouse

DevOps

FHIR/HL7

AI/ML Pipelines

Power BI

Tools

Azure DevOps

Git

CI/CD

Job description

Build and support cloud-based healthcare data platforms using Azure and Databricks.

• Location: Philadelphia, PA (hybrid)
• Experience: 7+ years

Responsibilities

• Build and maintain ETL/ELT data pipelines.
• Develop data solutions using Azure Databricks, Azure Data Factory (ADF), and Azure Data Lake Storage (ADLS Gen2).
• Create and optimize PySpark and SQL data processing frameworks.
• Implement Delta Lake and Lakehouse architectures.
• Support data migration, modernization, and cloud transformation initiatives.
• Ensure data quality, reliability, and performance across pipelines and downstream reporting.
• Build data models and curated datasets used for reporting and analytics.
• Implement CI/CD, monitoring, and DevOps best practices for data services.
• Collaborate with business users, architects, and product teams in an Agile environment.

Requirements

• Azure Databricks
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS Gen2)
• PySpark and Python
• SQL
• Delta Lake
• Data Modeling
• ETL/ELT development
• Azure Cloud Platform
• Git & CI/CD
• Agile/Scrum

Preferred Skills

• Azure Synapse Analytics
• Power BI
• Azure DevOps
• Infrastructure as Code (IaC)
• FHIR/HL7
• AI/ML Data Pipelines

Required Experience

• 7+ years in Data Engineering
• 5+ years with Azure Data Technologies
• 2+ years in Healthcare, including Payer, Health Plan, or Managed Care domains
• Experience with large-scale data pipelines and integration solutions

Nice to Have

• Claims Data
• Membership Data
• Provider Data
• Care Management Data

Technologies

• Azure Databricks
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS Gen2)
• PySpark, Python, SQL
• Delta Lake
• Azure Cloud Platform
• Git, CI/CD
• Lakehouse architectures
• DevOps
• Azure Synapse Analytics
• Power BI
• Azure DevOps
• Infrastructure as Code (IaC)
• FHIR/HL7
• AI/ML Data Pipelines