Senior Data Engineer

Head Resourcing Ltd; Glasgow; In loco; GBP 60.000 - 75.000; Tempo pieno

Vantaggi offerti da questo lavoro

Enhanced pension scheme

Life assurance

Technical leadership opportunity

Descrizione del lavoro

Head Resourcing Ltd in Glasgow is seeking a Senior Data Engineer to own and evolve a large-scale Azure and Databricks data estate, building robust pipelines and data models.

You will design Databricks pipelines, Delta Lake architectures, and Azure Data Factory workflows, while driving CI/CD through Azure DevOps and optimizing cost and performance.

This on-site role offers £60,000-£75,000 plus excellent benefits, with potential to lead the data function as the platform matures.

Competenze

• Strong production Databricks experience.
• Excellent data modelling and architecture skills.
• Expertise in Delta Lake and Medallion design principles.
• Azure Data Factory experience with parameterised pipelines.
• Strong SQL plus Python and/or Scala.
• Experience delivering enterprise-scale data platforms.

Mansioni

• > Designing, building and optimising Databricks pipelines and jobs.
• > Creating scalable Delta Lake solutions using Medallion architecture.
• > Developing and maintaining Azure Data Factory pipelines.
• > Owning data models across bronze, silver and gold layers.
• > Driving CI/CD, deployment and release processes through Azure DevOps.
• > Monitoring performance, reliability and cost across critical data workloads.
• > Supporting the delivery of data into Microsoft Fabric and OneLake environments.

Conoscenze

Databricks

Data modelling

Delta Lake

Medallion design

Azure Data Factory

SQL

Python/Scala

Azure DevOps

Strumenti

Azure DevOps

Descrizione del lavoro

Glasgow | £60,000 - £75,000 + Excellent Benefits | On-site

Ready to take ownership of a modern data platform and shape how data powers business decisions?

We're seeking a Senior Data Engineer to play a pivotal role in the ongoing development of a large-scale Azure and Databricks data estate. This is a genuinely hands‑on position where you'll spend your time building pipelines, modelling data, solving complex engineering challenges, and driving best practice across the platform.

What you'll be doing

• Designing, building and optimising Databricks pipelines and jobs
• Creating scalable Delta Lake solutions using Medallion architecture
• Developing and maintaining Azure Data Factory pipelines
• Owning data models across bronze, silver and gold layers
• Driving CI/CD, deployment and release processes through Azure DevOps
• Monitoring performance, reliability and cost across critical data workloads
• Supporting the delivery of data into Microsoft Fabric and OneLake environments

What we're looking for

• Strong commercial experience with Databricks in production environments
• Excellent data modelling and architecture skills
• Expertise in Delta Lake and Medallion design principles
• Azure Data Factory experience, including parameterised and environment-driven pipelines
• Strong SQL skills plus Python and/or Scala
• Experience delivering enterprise-scale data platforms and engineering solutions

Nice to have

• Microsoft Fabric and OneLake experience
• CI/CD and Infrastructure as Code exposure
• Unity Catalog knowledge
• Azure or Databricks certifications
• Experience working alongside Power BI teams

What's on offer?

• Salary up to £70,000
• Enhanced pension scheme
• Life assurance
• The opportunity to become the technical lead within a growing data function and have a direct impact on the future of the platform.

If you're a Senior Data Engineer who enjoys ownership, autonomy and building robust data solutions with Azure and Databricks, we'd love to hear from you.