Staff Data Engineer

Data Science Festival; Greater London; Hybrid; GBP 85,000 - 95,000; Full time

Job summary

Data Science Festival is seeking a Staff Data Engineer to enhance their data platform in London with a hybrid work model. This role focuses on building scalable data pipelines and implementing cloud-native solutions on Azure and Databricks.

You’ll lead technical efforts within the team, making decisions on data processing and best practices while supporting fellow engineers. Ideal candidates have hands-on Azure experience, advanced SQL skills, and a proven track record in data pipeline maintenance.

Qualifications

• Strong hands-on experience with Azure data platforms.
• Advanced SQL skills are required.
• Commercial experience using Databricks and PySpark.
• Proven background building and maintaining scalable data pipelines.

Responsibilities

• Take ownership of complex, production-grade data pipelines.
• Act as a technical leader within the data engineering team.
• Make key decisions around data processing and modeling.
• Help set best practices and support other engineers.

Skills

Azure data platforms

Advanced SQL

Databricks

PySpark

Scalable data pipelines

Job description

Staff Data Engineer

Salary: £85,000 – £95,000

Location: London, hybrid

Data Idols are working with one of the best-known retail brands in the UK that are investing heavily in its data platform. They are looking for a Staff Data Engineer to play a key role in scaling production data systems and raising engineering standards across the wider data function.

This role sits at the centre of a major data transformation and offers the chance to work on high‑impact data platforms used across the business.

The Opportunity

As a Staff Data Engineer, you’ll take ownership of complex, production‑grade data pipelines and act as a technical leader within the data engineering team.

You’ll work on cloud‑native solutions built on Azure and Databricks, making key decisions around data processing, modelling, and performance. Alongside hands‑on delivery, you’ll help set best practices, support other engineers, and influence how data engineering is done across the organisation.

Skills & Experience

• Strong hands‑on experience with Azure data platforms
• Advanced SQL skills
• Commercial experience using Databricks and PySpark
• Proven background building and maintaining scalable data pipelines