Senior Data Engineer

ScaleOps Search Ltd; Leeds; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading data consultancy is seeking an experienced Senior Data Engineer to join their team in Leeds, UK. This role involves designing and implementing scalable data solutions using the Microsoft Azure Data Stack for a flagship transportation project. The ideal candidate will have 5–10 years of experience in data engineering, strong skills in Databricks and Azure Data Factory, and excellent stakeholder management. This position offers opportunities for professional growth and the chance to work in an innovative team environment.

Benefits

Opportunities for professional growth

Azure certifications

Qualifications

• 5–10 years in data engineering roles, ideally within consultancy environments.
• Strong proficiency in data engineering tools.

Responsibilities

• Design and optimise data pipelines and ETL processes using Azure Data Factory and Databricks.
• Develop and maintain data models, transformations, and integrations.
• Collaborate with client teams to deliver high‑quality solutions.
• Mentor junior engineers and contribute to architectural decisions.
• Implement best practices for data governance and security.

Skills

Databricks (PySpark)

Azure Data Factory (ADF)

SQL (complex queries and optimisation)

Azure Data Services (Data Lake, Synapse)

Excellent communication

Stakeholder management

Job description

A leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting‑edge solutions for a major transportation project. This is an exciting opportunity to work on a high‑impact initiative for a well‑known UK transport provider, leveraging modern cloud technologies to transform data capabilities.

About the Role

The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You’ll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring best practices in data governance, security, and performance.

Key Responsibilities

• Design and optimise data pipelines and ETL processes using Azure Data Factory and Databricks.
• Develop and maintain data models, transformations, and integrations across multiple systems.
• Collaborate with client teams to deliver high‑quality, timely solutions.
• Mentor junior engineers and contribute to architectural decisions.
• Implement best practices for data governance and security.

Required Skills & Experience

• 5–10 years in data engineering roles, ideally within consultancy environments.
• Strong proficiency in :
• Databricks (PySpark)
• Azure Data Factory (ADF)
• SQL (complex queries and optimisation)
• Azure Data Services (Data Lake, Synapse, etc.)
• Excellent communication and stakeholder management skills.

Nice-to-Have

• Experience with Scala for Spark development.
• Knowledge of CI / CD pipelines and DevOps practices in Azure.
• Familiarity with data governance frameworks.

Why Apply?

• Work on a flagship transportation project with real‑world impact.
• Join a collaborative, innovative team culture.
• Opportunities for professional growth and Azure certifications.

Apply now online for a confidential discussion.