Databricks Data Engineer

Tenth Revolution Group; City Of London; Híbrido; GBP 77 000 - 94 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Hybrid work model

Databricks/Azure tech stack

Large-scale data platforms

Professional development

Resumo da oferta

Databricks in London is seeking a Senior Data Engineer to build and scale data pipelines in a hybrid, cloud-first environment. You will shape the Databricks Lakehouse architecture, collaborate with data scientists and product teams, and drive best practices across the data platform.

The role focuses on Databricks, Spark, Delta Lake, Python and SQL, delivering robust data products, monitoring, and governance while enabling cost-efficient cloud operations and scalable analytics.

Qualificações

• Proven experience as a Data Engineer in production environments.
• Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python and SQL.
• Experience building and supporting scalable ETL/ELT pipelines.
• Strong understanding of distributed data processing and data modelling.
• Cloud platform experience across Azure, AWS, or GCP.
• Experience implementing data quality frameworks and pipeline monitoring.
• Excellent communication and stakeholder engagement skills.

Responsabilidades

• Build and maintain scalable data pipelines within Databricks.
• Develop and optimise batch and streaming data workflows.
• Design and implement Lakehouse architectures and medallion data models.
• Implement data quality, monitoring, and observability frameworks.
• Maintain security, governance, and access control standards.
• Collaborate with Data Scientists and Analysts to deliver business-critical data products.
• Drive engineering best practice through code reviews and standards.
• Identify platform optimisation and cloud cost reduction opportunities.
• Translate business requirements into scalable technical solutions.
• Contribute to tooling decisions, documentation, and continuous improvement.

Conhecimentos

Databricks

Apache Spark

Delta Lake

Python

SQL

Cloud platforms

ETL/ELT pipelines

Data modelling

Ferramentas

Databricks Certification

Unity Catalog

Terraform

dbt

Kafka

Descrição da oferta de emprego

Databricks Senior Data Engineer - London (Hybrid) - Up to £85,000

Databricks - Apache Spark - Delta Lake - Python - SQL - Azure

We're partnering with a fast-growing technology business that's investing heavily in its data platform and engineering capability. This is an opportunity to join a highly collaborative team where you'll play a key role in shaping a modern Databricks environment, influencing technical decisions, and delivering scalable data solutions that directly impact the business.

Working within a cloud-first environment, you'll collaborate closely with Data Scientists, Analysts, Product teams, and senior stakeholders to build robust, high-performing data products whilst helping drive engineering best practice across the organisation.

The Role

• Building and maintaining scalable data pipelines within Databricks.
• Developing and optimising batch and streaming data workflows.
• Designing and implementing Lakehouse architectures and medallion data models.
• Implementing data quality, monitoring, and observability frameworks.
• Maintaining security, governance, and access control standards.
• Collaborating with Data Scientists and Analysts to deliver business-critical data products.
• Driving engineering best practice through code reviews and technical standards.
• Identifying platform optimisation and cloud cost reduction opportunities.
• Translating business requirements into scalable technical solutions.
• Contributing to tooling decisions, documentation, and continuous improvement initiatives.

What's On Offer?

• Salary up to £85,000.
• Hybrid working model.
• Modern Databricks and Azure technology stack.
• Exposure to large-scale, enterprise-level data platforms.
• Opportunity to influence architecture and engineering standards.
• Collaborative and supportive engineering culture.
• Ongoing learning and professional development opportunities.
• Strong career progression within a growing technology business.

Key Experience Required

• Proven experience as a Data Engineer within production environments.
• Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python, and SQL.
• Experience building and supporting scalable ETL/ELT pipelines.
• Strong understanding of distributed data processing and data modelling.
• Cloud platform experience across Azure, AWS, or GCP.
• Experience implementing data quality frameworks and pipeline monitoring.
• Excellent communication and stakeholder engagement skills.

Desirable Experience

• Databricks certification.
• Unity Catalog and Databricks Asset Bundles.
• Terraform or Bicep.
• dbt or similar transformation frameworks.
• Kafka, Event Hubs, or other streaming technologies.
• Retail, supply chain, or consumer goods industry experience.

This is a fantastic opportunity to join a business that is genuinely investing in modern data technologies and offers the chance to work on complex, large-scale engineering challenges.