Senior Data Engineer: Azure + Databricks & Governance

Allina Health; Minneapolis (MN); On-site; USD 75,000 - 104,000; Full time

Benefits offered by this job

Medical/Dental

PTO/Time Away

Retirement Savings Plans

Life Insurance

Disability

Tuition Reimbursement

Job summary

Allina Health in Minneapolis seeks a Senior Data Engineer to develop and deploy data assets using Azure Data Factory, Databricks, and Unity Catalog. You will translate legacy SQL logic into optimized Spark SQL and Python code, build Analytics Mart notebooks, and ensure functional equivalence across platforms.

You will partner with stakeholders to validate outputs and optimize performance for scalable analytics.

Qualifications

• Bachelor's degree in computer science, engineering or related field.
• 5+ years experience in data engineering or related role.
• 5+ years experience in SQL and Python.

Responsibilities

• Lead data warehouse migration efforts and architect data pipelines.
• Develop reusable code assets for Data Engineers and Analytics Engineers.
• Ensure data governance, security and compliance.
• Optimize performance for real-time data processing and analytics.

Skills

Databricks

Azure DevOps

GIT integration

Pipeline development

Data ingestion concepts

Operational mindset

Education

Bachelor's degree in computer science, engineering or related field

Tools

Azure Data Factory

Power BI

Databricks Unity Catalog

Databricks notebooks

Job description

Allina Health in Minneapolis seeks a Senior Data Engineer to develop and deploy data assets using Azure Data Factory, Databricks, and Unity Catalog. You will translate legacy SQL logic into optimized Spark SQL and Python code, build Analytics Mart notebooks, and ensure functional equivalence across platforms.

You will partner with stakeholders to validate outputs and optimize performance for scalable analytics.