Senior Data Engineer

On-Demand Group; BLOOMINGTON (MN); Hybrid; USD 103,000 - 124,000; Full time

Benefits offered by this job

Healthcare benefits

Hybrid/remote options

Job summary

On-Demand Group is seeking a hands-on Data Engineer to advance healthcare data initiatives in a modern Azure/Databricks environment. You will build reliable pipelines and data products while partnering with analysts, data scientists, and business stakeholders.

The role emphasizes Python and SQL development, PySpark/Databricks, and delivering high-volume datasets with quality, governance, and scalable architectures. Hybrid/remote options are available depending on team needs.

Qualifications

• 5+ years in a hands-on data engineering role.
• Strong Python and SQL.
• Experience with Databricks/Spark and cloud data platforms (Azure strongly preferred).
• Familiarity with data modeling and common formats (Parquet/Delta/JSON/CSV).

Responsibilities

• Build and maintain scalable ETL/ELT pipelines for ingestion, transformation, validation, and delivery of enterprise datasets.
• Develop in Python and SQL (often PySpark/Databricks) to process high-volume, complex data.
• Improve data quality, governance, and operational reliability across pipelines.
• Collaborate in an Agile/Scrum environment with cross-functional teams.

Skills

Data engineering

Python

SQL

Databricks/Spark

Azure

Tools

Parquet/Delta/JSON/CSV

Job description

High-impact healthcare initiatives- interoperability and patient-facing experiences, pharmacy/claims analytics, value-based care delivery, and platform modernization.

This is a hands-on data engineering role building reliable, scalable pipelines and data products in a modern Azure/Databricks environment, partnering closely with analysts, data scientists, and business stakeholders.

What you'll do

• Build and maintain scalable ETL/ELT pipelines for ingestion, transformation, validation, and delivery of enterprise datasets
• Develop in Python and SQL (often PySpark/Databricks) to process high-volume, complex data
• Improve data quality, governance, and operational reliability across pipelines
• Collaborate in an Agile/Scrum environment with cross-functional teams

You may align to one or more of these areas:

• Interoperability / FHIR: deliver data from the lake into a FHIR server and expose via APIs for patient portal experiences
• Pharmacy / Claims: support claims-related data pipelines and evolving vendor formats
• Value-Based Care / Epic: map payer claims & roster data into Epic-ready datasets (Epic Clarity/Caboodle exposure is a plus)
• Modernization: refactor legacy workloads (including SAS) into Databricks on Azure
• Data routing / Egress: deliver curated datasets to PostgreSQL and API endpoints; build lightweight apps (e.g., Streamlit) for stakeholders

Required experience

• 5+ years in a hands-on data engineering role (more senior profiles welcome)
• Strong Python and SQL
• Experience with Databricks/Spark and cloud data platforms (Azure strongly preferred)
• Familiarity with data modeling and common formats (e.g., Parquet/Delta/JSON/CSV)
• Strong communication skills and comfort working directly with business partners

Nice to have

• Healthcare domain experience (claims, pharmacy, interoperability, value-based care)
• Azure services such as ADF, Synapse, Purview, etc.
• CI/CD or IaC exposure (tools vary by team)

Hybrid/remote options depending on the team; preference often for MN / regional candidates, with some roles open to broader remote.

$75-90/hr

On-Demand Group (ODG) provides employee benefits which includes healthcare, dental, and vision insurance. ODG is an equal opportunity employer that does not discriminate on the basis of race, color, religion, gender, sexual orientation, age, national origin, disability, or any other characteristic protected by law.