Senior Data Engineer - Databricks (Hybrid, London)

Tenth Revolution Group; Greater London; Hybrid; GBP 51,000 - 85,000; Full time

Job summary

Tenth Revolution Group seeks a Senior Data Engineer to shape a modern Databricks environment in London. You will own scalable data pipelines, design Lakehouse architectures, and drive quality, security, and governance across enterprise data platforms.

You will collaborate with Data Scientists and Analysts, optimise cloud costs, and advance engineering standards while delivering impactful data products in a cloud-first setting.

Qualifications

• Proven experience as a Data Engineer in production environments.
• Hands-on with Databricks, Spark, Delta Lake, Python and SQL.
• Experience building scalable ETL/ELT pipelines.
• Understanding of distributed data processing and data modelling.
• Cloud experience across Azure/AWS/GCP.
• Experience implementing data quality frameworks and monitoring.
• Excellent communication with stakeholders.
• Databricks certification.
• Knowledge of Unity Catalog and Databricks Asset Bundles.
• Terraform or Bicep.
• dbt or similar tools.
• Kafka or other streaming tech.
• Retail or consumer goods industry exposure.

Responsibilities

• Build and maintain scalable data pipelines within Databricks.
• Develop and optimise batch and streaming data workflows.
• Design Lakehouse architectures and medallion data models.
• Implement data quality, monitoring, and observability frameworks.
• Maintain security, governance, and access controls.
• Collaborate with Data Scientists and Analysts on data products.
• Promote engineering best practices through code reviews.
• Identify platform optimisation and cloud cost reduction opportunities.
• Translate business requirements into scalable technical solutions.
• Contribute to tooling decisions and documentation.

Skills

ETL/ELT pipelines

Data quality & observability

Stakeholder engagement

Architecture design

Cost optimization

Tools

Databricks

Apache Spark

Delta Lake

Python

SQL

dbt

Terraform

Azure

AWS

GCP

Kafka

Job description

Tenth Revolution Group seeks a Senior Data Engineer to shape a modern Databricks environment in London. You will own scalable data pipelines, design Lakehouse architectures, and drive quality, security, and governance across enterprise data platforms.

You will collaborate with Data Scientists and Analysts, optimise cloud costs, and advance engineering standards while delivering impactful data products in a cloud-first setting.