Senior Data Engineer

ScaleOps Search Ltd; Manchester; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading data consultancy is seeking an experienced Senior Data Engineer to design and implement scalable data solutions using Microsoft Azure Data Stack. This role involves optimizing ETL processes and mentoring junior engineers while working on a flagship transportation project that leverages modern cloud technologies. Strong proficiency in Databricks and Azure Data Factory is required, along with excellent communication skills. This is an exciting opportunity for professional growth within a collaborative team.

Benefits

Opportunities for professional growth and Azure certifications

Collaborative, innovative team culture

Qualifications

• 5–10 years in data engineering roles, ideally within consultancy environments.
• Strong proficiency in data engineering tools and technologies.

Responsibilities

• Design and optimise data pipelines and ETL processes using Azure Data Factory and Databricks.
• Develop and maintain data models, transformations, and integrations across multiple systems.
• Collaborate with client teams to deliver high‑quality, timely solutions.
• Mentor junior engineers and contribute to architectural decisions.
• Implement best practices for data governance and security.

Skills

Databricks (PySpark)

Azure Data Factory (ADF)

SQL (complex queries and optimisation)

Azure Data Services (Data Lake, Synapse, etc.)

Excellent communication and stakeholder management skills

Job description

A leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting‑edge solutions for a major transportation project. This is an exciting opportunity to work on a high‑impact initiative for a well‑known UK transport provider, leveraging modern cloud technologies to transform data capabilities.

About the Role

The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You’ll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring best practices in data governance, security, and performance.

Key Responsibilities

• Design and optimise data pipelines and ETL processes using Azure Data Factory and Databricks.
• Develop and maintain data models, transformations, and integrations across multiple systems.
• Collaborate with client teams to deliver high‑quality, timely solutions.
• Mentor junior engineers and contribute to architectural decisions.
• Implement best practices for data governance and security.

Required Skills & Experience

• 5–10 years in data engineering roles, ideally within consultancy environments.
• Strong proficiency in :
• Databricks (PySpark)
• Azure Data Factory (ADF)
• SQL (complex queries and optimisation)
• Azure Data Services (Data Lake, Synapse, etc.)
• Excellent communication and stakeholder management skills.

Nice-to-Have

• Experience with Scala for Spark development.
• Knowledge of CI / CD pipelines and DevOps practices in Azure.
• Familiarity with data governance frameworks.

Why Apply?

• Work on a flagship transportation project with real‑world impact.
• Join a collaborative, innovative team culture.
• Opportunities for professional growth and Azure certifications.

Apply now online for a confidential discussion.