Senior Data Engineer

Nicoll Curtin; Leicester; Hybrid; GBP 95,755 - 125,644; Part time

Benefits offered by this job

Outside IR35

Modern tech stack

Friendly team

Job summary

A leading tech recruitment firm in the UK is seeking a Senior Data Engineer to enhance their data engineering capabilities. This hybrid contract role focuses on building ETL/ELT pipelines, optimizing data governance, and developing real-time data solutions using Azure technologies. The ideal candidate will have strong experience with Azure, Databricks, and proficiency in Python and Terraform. This position offers competitive pay of £600/day, fostering a collaborative work environment.

Qualifications

• Strong hands-on experience with Azure & Databricks.
• Proficiency in Python, Spark SQL, and Terraform.
• Solid understanding of data governance and real-time processing.
• Great communication skills and a collaborative mindset.

Responsibilities

• Building and optimising ETL/ELT pipelines with Databricks & Apache Spark.
• Designing scalable solutions using Azure Data Factory, Synapse & Data Lake.
• Implementing Delta Lake with ACID transactions and schema enforcement.
• Automating testing and CI/CD with Azure DevOps & Terraform.
• Driving data governance with Azure Purview & Unity Catalog.
• Developing real-time data solutions with Event Hubs & Structured Streaming.
• Managing infrastructure as code and optimising cloud costs.
• Working closely with engineers, QA, Product Owner, and stakeholders.

Skills

Azure

Databricks

Python

Spark SQL

Terraform

Data governance

Real-time processing

Communication

Collaboration

Job description

Associate Consultant - UK market | Web3 | AI | Crypto Trader | Business Development

We’re looking for a Senior Data Engineer to join a growing data team (currently three members plus a lead) and play a key role in strengthening the group’s engineering capability. The focus will be on migrating and integrating data platforms, cleaning and documenting legacy data, and contributing to the design and build of the new data architecture.

This is an opportunity to get involved early in the platform’s development, close to Greenfield, and help establish engineering standards and best practices that will support long-term scalability. The environment is primarily Databricks‑based, with legacy data quality posing some interesting challenges that the team is keen to resolve properly this time around.

What you’ll be doing:

• Building and optimising ETL/ELT pipelines with Databricks & Apache Spark
• Designing scalable solutions using Azure Data Factory, Synapse & Data Lake
• Implementing Delta Lake with ACID transactions and schema enforcement
• Automating testing and CI/CD with Azure DevOps & Terraform
• Driving data governance with Azure Purview & Unity Catalog
• Developing real‑time data solutions with Event Hubs & Structured Streaming
• Managing infrastructure as code and optimising cloud costs
• Working closely with engineers, QA, Product Owner, and stakeholders

What we’re looking for:

• Strong hands‑on experience with Azure & Databricks
• Proficiency in Python, Spark SQL, and Terraform
• Solid understanding of data governance and real‑time processing
• Great communication skills and a collaborative mindset

£600/day - outside IR35 | Hybrid | Contract | Modern tech stack | Friendly team

If this sounds like something you’d be interested in, feel free to reach out or share with someone who might be.