Senior Data Engineer - Inside IR35

Eden Smith Limited; Greater London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading consulting organisation in the UK is seeking a Senior Data Engineer to support high-impact data initiatives. This hybrid role involves designing and optimising data pipelines using Azure Data Factory, Databricks, and managing data lakes. The ideal candidate will have a strong background in Azure-based data architectures and experience in mentoring others. This contract position is Inside IR35, offering a day rate of £500 - £600, with 2 days a week in London or Birmingham.

Qualifications

• Proven experience in data engineering or cloud data development.
• Strong background building Azure-based data architectures and pipelines.
• Experience leading technical workstreams and mentoring others.

Responsibilities

• Design, build and optimise scalable data pipelines using Azure Data Factory.
• Manage data lakes/warehouses using Delta Lake.
• Provide technical guidance and mentoring to junior engineers.

Skills

Data engineering

Azure Data Factory

Databricks

Python (PySpark, Pandas)

APIs

Data modelling

Tools

Terraform

GitHub

Azure DevOps CI/CD

Job description

Contract Senior Data Engineer - Inside IR35 - Azure/Databricks/ADF
£500 - £600 Day Rate

We are the chosen talent partner for a leading consulting organisation and looking for an experienced Senior Data Engineer (contract) to support large-scale, cloud-first data initiatives across complex UK infrastructure programmes. You'll build and optimise modern data pipelines that enable analytics, AI, automation, and data-driven decision-making.

Role Overview

• Design, build and optimise scalable data pipelines using Azure Data Factory, Synapse and Databricks
• Develop and maintain ETL/ELT workflows with strong data quality and reliability
• Build reusable data products in collaboration with analysts and AI engineers
• Manage data lakes/warehouses using Delta Lake, Parquet and related technologies
• Apply best practice in governance, performance and security
• Contribute to platform evolution, tooling adoption and engineering standards
• Provide technical guidance and mentoring to junior engineers

Tech Stack

• Core: Azure Data Factory, Azure Synapse, ADLS Gen2, SQL Server, Databricks
• Enhancements: Python (PySpark, Pandas), Azure DevOps CI/CD, Terraform/Bicep, REST APIs, GitHub/GitHub Actions
• Desirable: Microsoft Fabric, Delta Live Tables, Power BI automation, DataOps

What We're Looking For

• Proven experience in data engineering or cloud data development
• Strong background building Azure-based data architectures and pipelines
• Solid understanding of data modelling, APIs and modern data engineering practices
• Experience leading technical workstreams and mentoring others
• Proactive, adaptable engineer who enjoys solving complex problems

Contract: Inside IR35

Start: ASAP

Location: Hybrid - 2 Days a Week in London, Birmingham

If you're a Senior Data Engineer ready to join a fast-growing consultancy delivering high-impact data solutions, please apply with your latest CV.