Staff Data Engineer: Cloud-Native Pipelines & Tech Leadership

Data Idols; Greater London; Hybrid; GBP 85,000 - 95,000; Full time

Job summary

Data Idols is seeking a Staff Data Engineer to design and deliver cloud-native data solutions in a hybrid London setting. You'll shape the data platform and guide a squad of engineers by setting standards and best practices.

You will build scalable pipelines using Azure, Databricks and PySpark, mentoring peers while partnering with Product and Delivery to realise business value at enterprise scale.

Qualifications

• Experience building cloud-native data platforms, preferably on Azure.
• Commercial experience with Databricks, PySpark, and Python.
• Advanced SQL and data engineering expertise.
• Experience delivering scalable ETL/data pipelines.
• Leadership, mentoring engineers and enforcing best practices.

Responsibilities

• Lead development of scalable data pipelines and data platforms.
• Mentor engineers through code reviews and guidance.
• Collaborate with Product and Delivery teams to shape cloud data platform.
• Own complex technical challenges and influence engineering standards.

Skills

Cloud data platforms

Databricks

PySpark

Python

SQL

ETL pipelines

Technical leadership

Tools

Azure

Databricks

Python

PySpark

SQL

Job description

Data Idols is seeking a Staff Data Engineer to design and deliver cloud-native data solutions in a hybrid London setting. You'll shape the data platform and guide a squad of engineers by setting standards and best practices.

You will build scalable pipelines using Azure, Databricks and PySpark, mentoring peers while partnering with Product and Delivery to realise business value at enterprise scale.