Databricks Data Platform Lead — Senior Data Engineer

Hireful Ltd; West of England; Remote; GBP 77,000 - 94,000; Full time

Benefits offered by this job

Health insurance

Income protection

Life assurance

Gym membership

25 days holiday + birthday off

Job summary

Hireful Ltd in the UK is seeking a Senior Data Engineer to shape a scalable data platform. You’ll own Databricks-based pipelines and enterprise data products, enabling trusted self-serve data access across the business.

This remote role with occasional London visits offers up to £85,000 base salary, plus a 10% bonus and a comprehensive benefits package including health insurance, income protection and a pension.

Qualifications

• Senior level experience in data engineering with hands-on Databricks skills (PySpark, Spark SQL, Delta Lake).
• Advanced SQL and Python coding skills.
• Track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions.
• Solid grounding in data architecture, modelling and modern data platform design.
• Cloud experience (AWS preferred, Azure acceptable) and familiarity with CI/CD and source control.

Responsibilities

• Design, build and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL and Delta Lake.
• Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems.
• Shape enterprise data architecture, balancing scalability, performance, security and maintainability.
• Partner with stakeholders across Finance, Product, Sales, Marketing and Engineering to turn business challenges into technical solutions.
• Embed data quality, governance and access controls throughout the data lifecycle.
• Mentor a junior engineer and help mature a growing data function.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

SQL

Python

Data pipelines

Data architecture

Cloud AWS/Azure

CI/CD

ML/AI data

Job description

Hireful Ltd in the UK is seeking a Senior Data Engineer to shape a scalable data platform. You’ll own Databricks-based pipelines and enterprise data products, enabling trusted self-serve data access across the business.

This remote role with occasional London visits offers up to £85,000 base salary, plus a 10% bonus and a comprehensive benefits package including health insurance, income protection and a pension.