Databricks Data Engineer

Tenth Revolution Group; Greater London; Hybrid; GBP 48,000 - 80,000; Full time

Benefits offered by this job

Annual performance bonus

Flexible benefits package

Job summary

Databricks is hiring a Data Engineer in London (Hybrid) to join a growing Data & AI practice. You will design and implement Databricks Lakehouse solutions, develop data pipelines using PySpark, and work directly with clients to define architectures and deliver end-to-end projects.

The role emphasizes cutting-edge data platforms, AI readiness, and strong collaboration with architects and data scientists. The opportunity includes exposure to enterprise-scale implementations and a clear career

Qualifications

• Commercial data engineering experience in cloud environments.
• Strong Databricks expertise with Delta Lake and Lakehouse patterns.
• Experience delivering Databricks solutions in consultancy or industry environments.

Responsibilities

• Design and build enterprise-scale Databricks Lakehouse solutions.
• Develop high-performance batch and streaming pipelines using PySpark and Spark SQL.
• Collaborate with clients to gather requirements and define solution architectures.
• Deliver end-to-end data engineering projects from design to production deployment.
• Optimise data platforms for performance, scalability and cost efficiency.
• Support advanced analytics and AI initiatives with data foundations.

Skills

Databricks expertise

Python/Scala

SQL proficiency

CI/CD

Cloud data engineering

Tools

Azure Data Factory

Airflow

Databricks Workflows

Terraform

Docker

Kubernetes

MLflow

Job description

Databricks Data Engineer - London (Hybrid) – Up to £80,000

Databricks - Azure - PySpark - Unity Catalog - AI & Machine Learning - Consulting

Are you looking to join a growing Data & AI team delivering some of the UK's most ambitious transformation programmes.

Due to continued growth, we're hiring multiple Databricks Data Engineers to join a rapidly expanding Data & AI practice. Whether you're currently working within a consultancy or delivering Databricks solutions in industry, we'd love to hear from engineers passionate about modern data platforms, AI and cloud technologies.

Our client is building one of the UK's leading Databricks practices and is investing heavily in Data & AI. You'll work on Databricks-led transformation programmes, helping enterprise organisations design and build modern Lakehouse platforms that support advanced analytics, machine learning and AI initiatives.

You'll join a high-performing team of architects, engineers and AI specialists, solving complex technical challenges for large-scale clients. This is an opportunity to work with cutting-edge Databricks technologies, gain exposure to major Data & AI programmes and accelerate your career within a collaborative and highly respected consulting environment.

If you enjoy combining hands-on engineering with stakeholder engagement and solving real-world business challenges through data, this is a fantastic opportunity to make an impact.

You Will Work With

• Designing and building enterprise-scale Databricks Lakehouse solutions
• Developing high-performance batch and streaming data pipelines using PySpark and Spark SQL
• Building AI-ready data products and trusted data foundations
• Implementing Delta Lake, Unity Catalog, Databricks SQL and modern governance frameworks
• Working directly with clients to gather requirements and define solution architectures
• Delivering end-to-end data engineering projects from design through to production deployment
• Optimising data platforms for performance, scalability, reliability and cost efficiency
• Supporting advanced analytics, machine learning and emerging Generative AI initiatives
• Applying modern engineering practices including CI/CD, automated testing and Infrastructure as Code
• Collaborating with architects, data scientists and cloud specialists across complex transformation programmes
• Contributing to technical leadership, best practices and mentoring less experienced consultants
• Annual performance bonus
• Access to market-leading Data, AI and Cloud projects
• Clear and structured career progression framework
• Industry-recognised training and certifications
• Exposure to enterprise-scale Databricks and AI implementations
• Flexible benefits package
• Inclusive and collaborative culture focused on professional development

Key Experience

To be successful in this role, you'll likely have experience with:

• Commercial experience in Data Engineering within cloud environments
• Strong hands-on Databricks expertise
• Deep understanding of Lakehouse architecture, Delta Lake and Medallion design patterns
• Advanced SQL skills and strong development experience with Python and/or Scala
• Experience building and supporting production-grade data pipelines
• Experience delivering Databricks solutions within a production environment.
• Strong stakeholder engagement and client-facing communication skills
• Knowledge of modern data engineering best practices including CI/CD and automated testing
• Azure Data Factory, Airflow or Databricks Workflows
• MLflow, Feature Engineering, Vector Search and modern AI enablement technologies
• Terraform, Docker and Kubernetes
• Databricks certifications
• Experience supporting Machine Learning, GenAI or Agentic AI solutions
• Background working within a consultancy or client-facing environment
• Whether you're currently working within a consultancy or delivering Databricks solutions in industry, we'd love to hear from engineers passionate about modern data platforms, AI and cloud technologies.