Senior Data Engineer - Azure/Databricks Platform Lead

Head Resourcing; Glasgow; On-site; GBP 60,000 - 70,000; Full time

Benefits offered by this job

Enhanced pension scheme

Life assurance

Job summary

Head Resourcing in Glasgow is seeking a Senior Data Engineer to own a modern data platform, build pipelines, and drive best practices across an Azure/Databricks data estate.

You will design Databricks pipelines, create Delta Lake solutions with Medallion architecture, and develop Azure Data Factory pipelines while owning data models across bronze, silver and gold layers. Expect CI/CD via Azure DevOps and ongoing monitoring of workloads.

Qualifications

• Strong production Databricks experience.
• Excellent data modelling and architecture skills.
• Expertise in Delta Lake and Medallion design principles.
• Azure Data Factory pipelines experience.
• Strong SQL, Python and/or Scala.
• Experience delivering enterprise-scale data platforms.

Responsibilities

• Design, build and optimise Databricks pipelines and jobs.
• Create scalable Delta Lake solutions using Medallion architecture.
• Develop and maintain Azure Data Factory pipelines.
• Own data models across bronze, silver and gold layers.
• Drive CI/CD, deployment and release processes through Azure DevOps.
• Monitor performance, reliability and cost across critical data workloads.
• Support delivery of data into Microsoft Fabric and OneLake environments.

Skills

Databricks

Data modelling

Delta Lake

Medallion design

SQL

Python

Scala

Tools

Azure Data Factory

Azure DevOps

CI/CD

Job description

Head Resourcing in Glasgow is seeking a Senior Data Engineer to own a modern data platform, build pipelines, and drive best practices across an Azure/Databricks data estate.

You will design Databricks pipelines, create Delta Lake solutions with Medallion architecture, and develop Azure Data Factory pipelines while owning data models across bronze, silver and gold layers. Expect CI/CD via Azure DevOps and ongoing monitoring of workloads.