Senior Data Engineer

Tenth Revolution Group; Greater London; Hybrid; GBP 51,000 - 85,000; Full time

Job summary

Tenth Revolution Group seeks a Senior Data Engineer to shape a modern Databricks environment in London. You will own scalable data pipelines, design Lakehouse architectures, and drive quality, security, and governance across enterprise data platforms.

You will collaborate with Data Scientists and Analysts, optimise cloud costs, and advance engineering standards while delivering impactful data products in a cloud-first setting.

Qualifications

• Proven experience as a Data Engineer in production environments.
• Hands-on with Databricks, Spark, Delta Lake, Python and SQL.
• Experience building scalable ETL/ELT pipelines.
• Understanding of distributed data processing and data modelling.
• Cloud experience across Azure/AWS/GCP.
• Experience implementing data quality frameworks and monitoring.
• Excellent communication with stakeholders.
• Databricks certification.
• Knowledge of Unity Catalog and Databricks Asset Bundles.
• Terraform or Bicep.
• dbt or similar tools.
• Kafka or other streaming tech.
• Retail or consumer goods industry exposure.

Responsibilities

• Build and maintain scalable data pipelines within Databricks.
• Develop and optimise batch and streaming data workflows.
• Design Lakehouse architectures and medallion data models.
• Implement data quality, monitoring, and observability frameworks.
• Maintain security, governance, and access controls.
• Collaborate with Data Scientists and Analysts on data products.
• Promote engineering best practices through code reviews.
• Identify platform optimisation and cloud cost reduction opportunities.
• Translate business requirements into scalable technical solutions.
• Contribute to tooling decisions and documentation.

Skills

ETL/ELT pipelines

Data quality & observability

Stakeholder engagement

Architecture design

Cost optimization

Tools

Databricks

Apache Spark

Delta Lake

Python

SQL

dbt

Terraform

Azure

AWS

GCP

Kafka

Job description

Senior Data Engineer (Databricks) - London (Hybrid) - Up to £85,000

We're partnering with a fast-growing technology business that's investing heavily in its data platform and engineering capability. This is an opportunity to join a highly collaborative team where you'll play a key role in shaping a modern Databricks environment, influencing technical decisions, and delivering scalable data solutions that directly impact the business.

Working within a cloud-first environment, you'll collaborate closely with Data Scientists, Analysts, Product teams, and senior stakeholders to build robust, high-performing data products whilst helping drive engineering best practice across the organisation.

The Role

As a Senior Data Engineer, you'll be responsible for:

• Building and maintaining scalable data pipelines within Databricks.
• Developing and optimising batch and streaming data workflows.
• Designing and implementing Lakehouse architectures and medallion data models.
• Implementing data quality, monitoring, and observability frameworks.
• Maintaining security, governance, and access control standards.
• Collaborating with Data Scientists and Analysts to deliver business-critical data products.
• Driving engineering best practice through code reviews and technical standards.
• Identifying platform optimisation and cloud cost reduction opportunities.
• Translating business requirements into scalable technical solutions.
• Contributing to tooling decisions, documentation, and continuous improvement initiatives.

What's On Offer?

• Salary up to £85,000.
• Modern Databricks and Azure technology stack.
• Exposure to large-scale, enterprise-level data platforms.
• Opportunity to influence architecture and engineering standards.
• Collaborative and supportive engineering culture.
• Ongoing learning and professional development opportunities.
• Strong career progression within a growing technology business.

Key Experience Required

• Proven experience as a Data Engineer within production environments.
• Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python, and SQL.
• Experience building and supporting scalable ETL/ELT pipelines.
• Strong understanding of distributed data processing and data modelling.
• Cloud platform experience across Azure, AWS, or GCP.
• Experience implementing data quality frameworks and pipeline monitoring.
• Excellent communication and stakeholder engagement skills.
• Databricks certification.
• Unity Catalog and Databricks Asset Bundles.
• Terraform or Bicep.
• dbt or similar transformation frameworks.
• Kafka, Event Hubs, or other streaming technologies.
• Retail, supply chain, or consumer goods industry experience.