Senior Data Engineer

Head Resourcing; Glasgow; On-site; GBP 60,000 - 70,000; Full time

Benefits offered by this job

Enhanced pension scheme

Life assurance

Job summary

Head Resourcing in Glasgow is seeking a Senior Data Engineer to own a modern data platform, build pipelines, and drive best practices across an Azure/Databricks data estate.

You will design Databricks pipelines, create Delta Lake solutions with Medallion architecture, and develop Azure Data Factory pipelines while owning data models across bronze, silver and gold layers. Expect CI/CD via Azure DevOps and ongoing monitoring of workloads.

Qualifications

• Strong production Databricks experience.
• Excellent data modelling and architecture skills.
• Expertise in Delta Lake and Medallion design principles.
• Azure Data Factory pipelines experience.
• Strong SQL, Python and/or Scala.
• Experience delivering enterprise-scale data platforms.

Responsibilities

• Design, build and optimise Databricks pipelines and jobs.
• Create scalable Delta Lake solutions using Medallion architecture.
• Develop and maintain Azure Data Factory pipelines.
• Own data models across bronze, silver and gold layers.
• Drive CI/CD, deployment and release processes through Azure DevOps.
• Monitor performance, reliability and cost across critical data workloads.
• Support delivery of data into Microsoft Fabric and OneLake environments.

Skills

Databricks

Data modelling

Delta Lake

Medallion design

SQL

Python

Scala

Tools

Azure Data Factory

Azure DevOps

CI/CD

Job description

Glasgow | £60,000 - £70,000 + Excellent Benefits | On-site

Ready to take ownership of a modern data platform and shape how data powers business decisions?

We're seeking a Senior Data Engineer to play a pivotal role in the ongoing development of a large-scale Azure and Databricks data estate. This is a genuinely hands-on position where you'll spend your time building pipelines, modelling data, solving complex engineering challenges, and driving best practice across the platform.

What you'll be doing

• Designing, building and optimising Databricks pipelines and jobs
• Creating scalable Delta Lake solutions using Medallion architecture
• Developing and maintaining Azure Data Factory pipelines
• Owning data models across bronze, silver and gold layers
• Driving CI/CD, deployment and release processes through Azure DevOps
• Monitoring performance, reliability and cost across critical data workloads
• Supporting the delivery of data into Microsoft Fabric and OneLake environments

What we're looking for

• Strong commercial experience with Databricks in production environments
• Excellent data modelling and architecture skills
• Expertise in Delta Lake and Medallion design principles
• Azure Data Factory experience, including parameterised and environment-driven pipelines
• Strong SQL skills plus Python and/or Scala
• Experience delivering enterprise-scale data platforms and engineering solutions

Nice to have

• Microsoft Fabric and OneLake experience
• CI/CD and Infrastructure as Code exposure
• Unity Catalog knowledge
• Azure or Databricks certifications
• Experience working alongside Power BI teams

What's on offer?

• Salary up to £70,000
• Enhanced pension scheme
• Life assurance
• The opportunity to become the technical lead within a growing data function and have a direct impact on the future of the platform.