Lead Data Engineer (Databricks) - Lakehouse Architect

Tenth Revolution Group; Greater London; Hybrid; GBP 99,000 - 121,000; Full time

Benefits offered by this job

Hybrid working model

Leadership of engineering team

Exposure to AI/ML initiatives

Job summary

Tenth Revolution Group is seeking a Lead Data Engineer (Databricks) in London, offering a hybrid work model and a leadership path to shape a modern data platform. You will own architecture and development of a Databricks environment while mentoring a team of data engineers and partnering with data scientists and product teams.

The role requires deep Databricks/Spark/Delta Lake expertise, cloud platform design skills and a track record of delivering enterprise-scale data solutions.

Qualifications

• Proven senior/lead data engineering track record.
• Deep expertise in Databricks, Spark, Delta Lake, Python and SQL.
• Experience designing and scaling cloud-based data platforms.
• Strong ETL/ELT, data modelling and distributed processing knowledge.
• Experience with Azure, AWS or GCP environments.

Responsibilities

• Lead design, development and optimisation of a Databricks-based data platform.
• Define enterprise-scale Lakehouse architectures across the cloud.
• Set data governance, security and quality standards.
• Lead and mentor a team of Data Engineers.
• Collaborate with Data Scientists, Analysts and Product teams to enable analytics and ML/AI initiatives.
• Drive platform performance, scalability and cloud cost optimisation.

Skills

Databricks

Apache Spark

Delta Lake

Python

SQL

Azure

Job description

Tenth Revolution Group is seeking a Lead Data Engineer (Databricks) in London, offering a hybrid work model and a leadership path to shape a modern data platform. You will own architecture and development of a Databricks environment while mentoring a team of data engineers and partnering with data scientists and product teams.

The role requires deep Databricks/Spark/Delta Lake expertise, cloud platform design skills and a track record of delivering enterprise-scale data solutions.