Senior Data Engineer

Head Resourcing Ltd; Glasgow; On-site; GBP 60,000 - 70,000; Full time

Benefits offered by this job

Private healthcare

Enhanced pension scheme

Life assurance

Job summary

Head Resourcing Ltd is seeking a Senior Data Engineer in Glasgow to own the design, development and optimisation of a large-scale Azure and Databricks data estate. You will spend time building pipelines, modelling data and driving best practices across the platform.

The role focuses on hands-on engineering with Databricks, Delta Lake and Azure Data Factory, delivering enterprise-grade data platforms with CI/CD practices and cost monitoring.

Qualifications

• Strong commercial experience with Databricks in production environments.
• Excellent data modelling and architecture skills.
• Expertise in Delta Lake and Medallion design principles.
• Azure Data Factory experience with parameterised pipelines.
• Strong SQL skills plus Python and/or Scala.
• Experience delivering enterprise-scale data platforms and engineering solutions.

Responsibilities

• Designing, building and optimising Databricks pipelines and jobs.
• Creating scalable Delta Lake solutions using Medallion architecture.
• Developing and maintaining Azure Data Factory pipelines.
• Owning data models across bronze, silver and gold layers.
• Driving CI/CD, deployment and release processes through Azure DevOps.
• Monitoring performance, reliability and cost across critical data workloads.
• Supporting the delivery of data into Microsoft Fabric and OneLake environments.

Skills

Databricks

Data modelling

Delta Lake

Azure Data Factory

SQL

Python/Scala

Enterprise data platforms

Job description

Senior Data Engineer

Glasgow | £60,000 - £70,000 + Excellent Benefits | On-site

Ready to take ownership of a modern data platform and shape how data powers business decisions?

We're seeking a Senior Data Engineer to play a pivotal role in the ongoing development of a large-scale Azure and Databricks data estate. This is a genuinely hands‑on position where you'll spend your time building pipelines, modelling data, solving complex engineering challenges, and driving best practice across the platform.

What you'll be doing

• Designing, building and optimising Databricks pipelines and jobs
• Creating scalable Delta Lake solutions using Medallion architecture
• Developing and maintaining Azure Data Factory pipelines
• Owning data models across bronze, silver and gold layers
• Driving CI/CD, deployment and release processes through Azure DevOps
• Monitoring performance, reliability and cost across critical data workloads
• Supporting the delivery of data into Microsoft Fabric and OneLake environments

What we're looking for

• Strong commercial experience with Databricks in production environments
• Excellent data modelling and architecture skills
• Expertise in Delta Lake and Medallion design principles
• Azure Data Factory experience, including parameterised and environment-driven pipelines
• Strong SQL skills plus Python and/or Scala
• Experience delivering enterprise-scale data platforms and engineering solutions

Nice to have

• Microsoft Fabric and OneLake experience
• CI/CD and Infrastructure as Code exposure
• Unity Catalog knowledge
• Azure or Databricks certifications
• Experience working alongside Power BI teams

What's on offer?

• Salary up to £75,000
• Private healthcare
• Enhanced pension scheme
• Life assurance
• The opportunity to become the technical lead within a growing data function and have a direct impact on the future of the platform.

If you're a Senior Data Engineer who enjoys ownership, autonomy and building robust data solutions with Azure and Databricks, we'd love to hear from you.