Senior Data Engineer - Azure Databricks Data Pipelines

On-Demand Group; BLOOMINGTON (MN); Hybrid; USD 103,000 - 124,000; Full time

Benefits offered by this job

Healthcare benefits

Hybrid/remote options

Job summary

On-Demand Group is seeking a hands-on Data Engineer to advance healthcare data initiatives in a modern Azure/Databricks environment. You will build reliable pipelines and data products while partnering with analysts, data scientists, and business stakeholders.

The role emphasizes Python and SQL development, PySpark/Databricks, and delivering high-volume datasets with quality, governance, and scalable architectures. Hybrid/remote options are available depending on team needs.

Qualifications

• 5+ years in a hands-on data engineering role.
• Strong Python and SQL.
• Experience with Databricks/Spark and cloud data platforms (Azure strongly preferred).
• Familiarity with data modeling and common formats (Parquet/Delta/JSON/CSV).

Responsibilities

• Build and maintain scalable ETL/ELT pipelines for ingestion, transformation, validation, and delivery of enterprise datasets.
• Develop in Python and SQL (often PySpark/Databricks) to process high-volume, complex data.
• Improve data quality, governance, and operational reliability across pipelines.
• Collaborate in an Agile/Scrum environment with cross-functional teams.

Skills

Data engineering

Python

SQL

Databricks/Spark

Azure

Tools

Parquet/Delta/JSON/CSV

Job description

On-Demand Group is seeking a hands-on Data Engineer to advance healthcare data initiatives in a modern Azure/Databricks environment. You will build reliable pipelines and data products while partnering with analysts, data scientists, and business stakeholders.

The role emphasizes Python and SQL development, PySpark/Databricks, and delivering high-volume datasets with quality, governance, and scalable architectures. Hybrid/remote options are available depending on team needs.