Senior Data Engineer — Azure & Databricks Platform Lead

Head Resourcing Ltd; Glasgow; On-site; GBP 60,000 - 70,000; Full time

Benefits offered by this job

Private healthcare

Enhanced pension scheme

Life assurance

Job summary

Head Resourcing Ltd is seeking a Senior Data Engineer in Glasgow to own the design, development and optimisation of a large-scale Azure and Databricks data estate. You will spend time building pipelines, modelling data and driving best practices across the platform.

The role focuses on hands-on engineering with Databricks, Delta Lake and Azure Data Factory, delivering enterprise-grade data platforms with CI/CD practices and cost monitoring.

Qualifications

• Strong commercial experience with Databricks in production environments.
• Excellent data modelling and architecture skills.
• Expertise in Delta Lake and Medallion design principles.
• Azure Data Factory experience with parameterised pipelines.
• Strong SQL skills plus Python and/or Scala.
• Experience delivering enterprise-scale data platforms and engineering solutions.

Responsibilities

• Designing, building and optimising Databricks pipelines and jobs.
• Creating scalable Delta Lake solutions using Medallion architecture.
• Developing and maintaining Azure Data Factory pipelines.
• Owning data models across bronze, silver and gold layers.
• Driving CI/CD, deployment and release processes through Azure DevOps.
• Monitoring performance, reliability and cost across critical data workloads.
• Supporting the delivery of data into Microsoft Fabric and OneLake environments.

Skills

Databricks

Data modelling

Delta Lake

Azure Data Factory

SQL

Python/Scala

Enterprise data platforms

Job description

Head Resourcing Ltd is seeking a Senior Data Engineer in Glasgow to own the design, development and optimisation of a large-scale Azure and Databricks data estate. You will spend time building pipelines, modelling data and driving best practices across the platform.

The role focuses on hands-on engineering with Databricks, Delta Lake and Azure Data Factory, delivering enterprise-grade data platforms with CI/CD practices and cost monitoring.