Lead Data Engineer (Databricks)

Tenth Revolution Group; Greater London; Hybrid; GBP 99,000 - 121,000; Full time

Benefits offered by this job

Hybrid working model

Leadership of engineering team

Exposure to AI/ML initiatives

Job summary

Tenth Revolution Group is seeking a Lead Data Engineer (Databricks) in London, offering a hybrid work model and a leadership path to shape a modern data platform. You will own architecture and development of a Databricks environment while mentoring a team of data engineers and partnering with data scientists and product teams.

The role requires deep Databricks/Spark/Delta Lake expertise, cloud platform design skills and a track record of delivering enterprise-scale data solutions.

Qualifications

• Proven senior/lead data engineering track record.
• Deep expertise in Databricks, Spark, Delta Lake, Python and SQL.
• Experience designing and scaling cloud-based data platforms.
• Strong ETL/ELT, data modelling and distributed processing knowledge.
• Experience with Azure, AWS or GCP environments.

Responsibilities

• Lead design, development and optimisation of a Databricks-based data platform.
• Define enterprise-scale Lakehouse architectures across the cloud.
• Set data governance, security and quality standards.
• Lead and mentor a team of Data Engineers.
• Collaborate with Data Scientists, Analysts and Product teams to enable analytics and ML/AI initiatives.
• Drive platform performance, scalability and cloud cost optimisation.

Skills

Databricks

Apache Spark

Delta Lake

Python

SQL

Azure

Job description

Lead Data Engineer (Databricks) - London (Hybrid) - Up to £110,000

Databricks - Apache Spark - Delta Lake - Python - SQL - Azure

We’re partnering with a growing technology business investing heavily in its cloud data platform and AI capabilities. This is a senior, hands‑on leadership role where you’ll own the architecture and development of a modern Databricks environment, drive engineering best practice, and mentor a team of Data Engineers while shaping the future of the organisation’s data strategy.

The Role

As Lead Data Engineer, you’ll be responsible for:

• Leading the design, development and optimisation of a Databricks-based data platform.
• Designing enterprise‑scale Lakehouse architectures across cloud platforms.
• Defining data modelling, governance, security and quality standards.
• Leading and mentoring a team of Data Engineers.
• Collaborating with Data Scientists, Analysts and Product teams to support analytics, machine learning and AI initiatives.
• Driving platform performance, scalability and cloud cost optimisation.

What’s On Offer?

• Salary up to £110,000.
• Hybrid working model.
• Technical ownership of a modern Databricks platform.
• Opportunity to influence architecture, tooling and engineering standards.
• Leadership responsibilities with a growing engineering team.
• Exposure to AI, machine learning and large-scale data initiatives.

Key Experience Required

• Proven experience as a Senior or Lead Data Engineer.
• Deep expertise in Databricks, Spark, Delta Lake, Python and SQL.
• Experience designing and scaling cloud-based data platforms.
• Strong knowledge of ETL/ELT, data modelling and distributed processing.
• Experience with Azure, AWS or GCP environments.
• Previous team leadership or mentoring experience.
• Strong stakeholder management and communication skills.