Senior Data Engineer - Azure Databricks Platform Lead

Aurora Engineering AB; Stockholms kommun; On-site; SEK 900,000 - 1,400,000; Full time

Job summary

Aurora Engineering AB in Stockholm is seeking an experienced Senior Data Engineer / IT Developer for a prominent assignment with a large organization. You will design and implement dimensional and semantic data models, and build Bronze/Silver/Gold layers using medallion architecture.

You'll develop scalable pipelines using Azure Databricks, Delta Lake, Lakeflow, and Unity Catalog, while ensuring data quality, governance, and GDPR compliance.

Qualifications

• Senior-level professional experience in data engineering or data platform development.
• Hands-on experience with Azure Databricks, Delta Lake, Lakeflow, and Unity Catalog.
• Advanced proficiency in SQL, Python, and PySpark.
• Experience developing and orchestrating large-scale pipelines using Azure Data Factory.
• Strong knowledge of dimensional and semantic data modeling, including star schemas, SCD, role-playing dimensions, and calculation groups.
• Experience integrating data from Workday, Peakon, or similar HR/employee/financial systems.
• Experience implementing automated data-quality checks, testing, validation and monitoring.
• Knowledge of GDPR, data protection, access controls, and information governance.

Responsibilities

• Design and develop dimensional and semantic data models.
• Build Bronze, Silver, and Gold layers using Medallion Architecture.
• Develop reusable, scalable datasets with version control.
• Maintain clear data definitions, documentation, and traceability.
• Design, develop, and optimize ETL/ELT pipelines with Azure tools and Python.
• Collaborate with BI teams to optimize Power BI datasets and models.
• Support Agile planning, CI/CD, incident management, and platform improvements.

Skills

Azure Databricks

Delta Lake

Lakeflow

Unity Catalog

SQL

Python

PySpark

Azure Data Factory

Dimensional modeling

SCD

Data governance

GDPR

Stakeholder collaboration

Communication

Job description

Aurora Engineering AB in Stockholm is seeking an experienced Senior Data Engineer / IT Developer for a prominent assignment with a large organization. You will design and implement dimensional and semantic data models, and build Bronze/Silver/Gold layers using medallion architecture.

You'll develop scalable pipelines using Azure Databricks, Delta Lake, Lakeflow, and Unity Catalog, while ensuring data quality, governance, and GDPR compliance.