Senior Data Engineer, Databricks Platform (Remote UK)

hireful.; Greater London; Remote; GBP 77,000 - 94,000; Full time

Benefits offered by this job

health insurance

income protection

life assurance

subsidised gym membership

25 days' holiday

your birthday off

Job summary

Hireful, a UK-based software business, seeks a Senior Data Engineer to shape its data platform. You will own scalable data solutions in Databricks, enabling trusted, self-serve access to data across the business, with collaboration across Finance, Product, Sales, Marketing and Engineering.

Design and maintain enterprise-grade data pipelines, mentor junior engineers, and advance data architecture while ensuring quality and governance.

Qualifications

• Senior level data engineering with Databricks expertise.
• Advanced SQL and Python coding skills.
• Proven experience building enterprise data pipelines and ETL/ELT.
• Strong grounding in data architecture and modern data platform design.
• Experience mentoring junior data engineers.
• Experience with multiple data sources: CRM, revenue, financial, subscription data.
• Cloud experience (AWS preferred; Azure acceptable) and CI/CD familiarity.
• Desirable: data science leanings, ML/AI or predictive modelling.

Responsibilities

• Design, build and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL and Delta Lake.
• Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems.
• Shape enterprise data architecture, balancing scalability, performance, security and maintainability.
• Partner with stakeholders across Finance, Product, Sales, Marketing and Engineering to translate business challenges into technical solutions.
• Embed data quality, governance and access controls throughout the data lifecycle.
• Mentor a junior engineer and help mature the data function.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

SQL

Python

Data pipelines

ETL/ELT

Data architecture

Mentoring

Cloud AWS

CI/CD

Azure acceptable

Tools

Databricks

PySpark

Spark SQL

Delta Lake

Job description

Hireful, a UK-based software business, seeks a Senior Data Engineer to shape its data platform. You will own scalable data solutions in Databricks, enabling trusted, self-serve access to data across the business, with collaboration across Finance, Product, Sales, Marketing and Engineering.

Design and maintain enterprise-grade data pipelines, mentor junior engineers, and advance data architecture while ensuring quality and governance.