Azure Databricks Data Engineer — Lakehouse Platform Builder

Head Resourcing Ltd; Glasgow; Hybrid; GBP 50,000 - 70,000; Full time

Job summary

A leading data solutions provider is looking for a Mid-Level Data Engineer to transform their data landscape using Azure and Databricks. This role involves building scalable ELT pipelines, contributing to CI/CD processes, and collaborating with teams to deliver high-quality datasets. Ideal candidates will have experience with PySpark and Spark SQL, and a keen interest in developing within a modern data platform environment. Join a forward-thinking team and make a direct impact across multiple business domains.

Benefits

Progression opportunities

Hands-on work with leading technologies

Opportunity to shape modern platforms

Qualifications

• Hands-on experience delivering solutions on Azure + Databricks.
• Understanding of dimensional modelling (Kimball), including SCD Type 1/2.
• Exposure to operational concepts such as monitoring and retries.

Responsibilities

• Build and maintain scalable ELT pipelines using Lakeflow Declarative Pipelines.
• Contribute to CI/CD pipelines in Azure DevOps.
• Work with BI and Analytics teams to deliver curated datasets.

Skills

Data engineering experience

Azure + Databricks

PySpark

Spark SQL

Dimensional modelling

Tools

Azure Data Factory

Git

Power BI

Job description

A leading data solutions provider is looking for a Mid-Level Data Engineer to transform their data landscape using Azure and Databricks. This role involves building scalable ELT pipelines, contributing to CI/CD processes, and collaborating with teams to deliver high-quality datasets. Ideal candidates will have experience with PySpark and Spark SQL, and a keen interest in developing within a modern data platform environment. Join a forward-thinking team and make a direct impact across multiple business domains.