Senior Data Engineer

Data Science Festival; Greater London; Hybrid; GBP 75,000 - 85,000; Full time

Job summary

Data Idols is seeking a Senior Data Engineer to design, build and operate cloud-native data solutions at enterprise scale. You will work in a high-performing engineering squad, owning technical challenges and driving best practices across the team.

You’ll build scalable pipelines using Azure, Databricks and PySpark, collaborating with Product and Delivery to deliver reliable data platforms and business value. London-based with hybrid working conditions.

Qualifications

• Strong experience building cloud-native data platforms, ideally on Azure.
• Commercial experience with Databricks, PySpark and Python.
• Strong SQL and data engineering expertise.
• Experience designing and delivering scalable ETL and data pipeline solutions.

Responsibilities

• Design, build and deliver robust, cloud-native data solutions.
• Take ownership of technical challenges and contribute to engineering standards.
• Support engineers through code reviews, knowledge sharing and pair programming.
• Collaborate with Product and Delivery teams to deliver reliable data solutions that create business value.

Skills

Azure data platform

Databricks PySpark Python

SQL data engineering

ETL pipelines

Tools

Azure Databricks

Job description

Senior Data Engineer

Salary: £75,000 - £85,000

Location: London | Hybrid

Data Idols are working with one of the UK's most recognised retail brands as they continue to invest heavily in their enterprise data platform. They are looking for a Senior Data Engineer to join a high-performing engineering team, helping build and evolve a modern cloud-based data ecosystem at significant scale.

This role sits at the heart of a major data transformation, offering the opportunity to work on scalable, production-grade data platforms that power business-critical decisions across the organisation.

The Opportunity

As a Senior Data Engineer, you'll take a hands-on role in designing, building and delivering robust, cloud-native data solutions. Working within an experienced engineering squad, you'll take ownership of technical challenges, contribute to engineering standards and help drive best practices across the team.

You'll build scalable data pipelines and frameworks using Azure, Databricks and PySpark, working across the full engineering lifecycle from design through to production. You'll also support other engineers through code reviews, knowledge sharing and pair programming, while collaborating closely with Product and Delivery teams to deliver reliable data solutions that create real business value.

Skills & Experience

• Strong experience building cloud-native data platforms, ideally on Azure
• Commercial experience with Databricks, PySpark and Python
• Strong SQL and data engineering expertise
• Experience designing and delivering scalable ETL and data pipeline solutions

If you're looking for a Senior Data Engineer role where you can work on complex technical challenges, take ownership of meaningful projects and contribute to a modern data platform at enterprise scale, please submit your CV for initial screening and further details.

Senior Data Engineer