Senior Data Engineer - Azure Databricks & Delta Lake Lead

Head Resourcing Ltd; Glasgow; On-site; GBP 60,000 - 75,000; Full time

Benefits offered by this job

Enhanced pension scheme

Life assurance

Technical leadership opportunity

Job summary

Head Resourcing Ltd in Glasgow is seeking a Senior Data Engineer to own and evolve a large-scale Azure and Databricks data estate, building robust pipelines and data models.

You will design Databricks pipelines, Delta Lake architectures, and Azure Data Factory workflows, while driving CI/CD through Azure DevOps and optimizing cost and performance.

This on-site role offers £60,000-£75,000 plus excellent benefits, with potential to lead the data function as the platform matures.

Qualifications

• Strong production Databricks experience.
• Excellent data modelling and architecture skills.
• Expertise in Delta Lake and Medallion design principles.
• Azure Data Factory experience with parameterised pipelines.
• Strong SQL plus Python and/or Scala.
• Experience delivering enterprise-scale data platforms.

Responsibilities

• > Designing, building and optimising Databricks pipelines and jobs.
• > Creating scalable Delta Lake solutions using Medallion architecture.
• > Developing and maintaining Azure Data Factory pipelines.
• > Owning data models across bronze, silver and gold layers.
• > Driving CI/CD, deployment and release processes through Azure DevOps.
• > Monitoring performance, reliability and cost across critical data workloads.
• > Supporting the delivery of data into Microsoft Fabric and OneLake environments.

Skills

Databricks

Data modelling

Delta Lake

Medallion design

Azure Data Factory

SQL

Python/Scala

Azure DevOps

Tools

Azure DevOps

Job description

Head Resourcing Ltd in Glasgow is seeking a Senior Data Engineer to own and evolve a large-scale Azure and Databricks data estate, building robust pipelines and data models.

You will design Databricks pipelines, Delta Lake architectures, and Azure Data Factory workflows, while driving CI/CD through Azure DevOps and optimizing cost and performance.

This on-site role offers £60,000-£75,000 plus excellent benefits, with potential to lead the data function as the platform matures.