Senior Data Engineer: Cloud Pipelines (Azure, Databricks)

Data Idols; Greater London; Hybrid; GBP 75,000 - 85,000; Full time

Job summary

Data Idols are seeking a Senior Data Engineer to help design, build and scale cloud-native data solutions in a hybrid London environment. You’ll join a high-performing engineering squad and own technical challenges from design through production, driving best practices and engineering standards.

You'll work with Azure, Databricks and PySpark to deliver scalable ETL pipelines and data platforms that power critical business decisions.

Qualifications

• Experience building cloud-native data platforms, ideally on Azure.
• Commercial experience with Databricks, PySpark and Python.
• Strong SQL and data engineering expertise.
• Experience designing and delivering scalable ETL and data pipeline solutions.

Responsibilities

• Take a hands-on role in designing, building and delivering robust, cloud-native data solutions.
• Own technical challenges within an experienced engineering squad and drive engineering standards.
• Support colleagues through code reviews, knowledge sharing and pair programming.
• Collaborate with Product and Delivery teams to deliver reliable data solutions that create business value.

Skills

Cloud data platforms

Databricks

PySpark

Python

SQL

Tools

Azure

Databricks

PySpark

Python

SQL

Job description

Data Idols are seeking a Senior Data Engineer to help design, build and scale cloud-native data solutions in a hybrid London environment. You’ll join a high-performing engineering squad and own technical challenges from design through production, driving best practices and engineering standards.

You'll work with Azure, Databricks and PySpark to deliver scalable ETL pipelines and data platforms that power critical business decisions.