Senior Data Platform Engineer

Tenth Revolution Group; Greater London; Hybrid; GBP 72,000 - 98,000; Full time

Job summary

Tenth Revolution Group is partnering with a fast-growing tech business in London to hire a Senior Data Platform Engineer (Databricks) in a hybrid role. You will shape a modern Databricks environment and deliver scalable data solutions that directly impact the business.

You will collaborate with Data Scientists, Analysts, and senior stakeholders to build robust data products, drive engineering best practices, and contribute to architecture decisions across Azure and cloud platforms.

Qualifications

• Proven data engineer experience in production environments.
• Hands-on Databricks, Spark, Delta Lake, Python and SQL.
• Experience building scalable ETL/ELT pipelines.
• Cloud platform experience across Azure, AWS, or GCP.
• Databricks certification.
• Unity Catalog and Databricks Asset Bundles.
• Terraform or Bicep.
• dbt or similar transformation frameworks.
• Kafka, Event Hubs or other streaming technologies.
• Retail, supply chain or consumer goods industry experience.

Responsibilities

• Build and maintain scalable data pipelines within Databricks.
• Develop and optimise batch and streaming data workflows.
• Design Lakehouse architectures and medallion data models.
• Implement data quality, monitoring, and observability frameworks.
• Maintain security, governance, and access control standards.
• Collaborate with Data Scientists and Analysts to deliver data products.
• Drive engineering best practices through code reviews and standards.
• Identify platform optimisation and cloud cost reduction opportunities.
• Translate business requirements into scalable technical solutions.
• Contribute to tooling decisions, documentation, and continuous improvement initiatives.

Skills

Databricks

Apache Spark

Delta Lake

Python

SQL

Databricks certification

Unity Catalog

Databricks Asset Bundles

Terraform

dbt

Kafka

Event Hubs

Retail/CPG industry experience

Tools

Terraform

dbt

Job description

Senior Data Platform Engineer (Databricks) - London (Hybrid) - Up to £85,000

We're partnering with a fast-growing technology business that's investing heavily in its data platform and engineering capability. This is an opportunity to join a highly collaborative team where you'll play a key role in shaping a modern Databricks environment, influencing technical decisions, and delivering scalable data solutions that directly impact the business.

Working within a cloud-first environment, you'll collaborate closely with Data Scientists, Analysts, Product teams, and senior stakeholders to build robust, high-performing data products whilst helping drive engineering best practice across the organisation.

The Role

As a Senior Data Engineer, you'll be responsible for:

• Building and maintaining scalable data pipelines within Databricks.
• Developing and optimising batch and streaming data workflows.
• Designing and implementing Lakehouse architectures and medallion data models.
• Implementing data quality, monitoring, and observability frameworks.
• Maintaining security, governance, and access control standards.
• Collaborating with Data Scientists and Analysts to deliver business-critical data products.
• Driving engineering best practice through code reviews and technical standards.
• Identifying platform optimisation and cloud cost reduction opportunities.
• Translating business requirements into scalable technical solutions.
• Contributing to tooling decisions, documentation, and continuous improvement initiatives.

What's On Offer?

• Salary up to £85,000.
• Modern Databricks and Azure technology stack.
• Exposure to large-scale, enterprise-level data platforms.
• Opportunity to influence architecture and engineering standards.
• Collaborative and supportive engineering culture.
• Ongoing learning and professional development opportunities.
• Strong career progression within a growing technology business.

Key Experience Required

• Proven experience as a Data Engineer within production environments.
• Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python, and SQL.
• Experience building and supporting scalable ETL/ELT pipelines.
• Strong understanding of distributed data processing and data modelling.
• Cloud platform experience across Azure, AWS, or GCP.
• Experience implementing data quality frameworks and pipeline monitoring.
• Excellent communication and stakeholder engagement skills.
• Databricks certification.
• Unity Catalog and Databricks Asset Bundles.
• Terraform or Bicep.
• dbt or similar transformation frameworks.
• Kafka, Event Hubs, or other streaming technologies.
• Retail, supply chain, or consumer goods industry experience.

This is a fantastic opportunity to join a business that is genuinely investing in modern data technologies and offers the chance to work on complex, large-scale engineering challenges.