Senior Data Engineer - Databricks, Remote, Shape Platform

hireful; City Of London; Remote; GBP 77,000 - 94,000; Full time

Benefits offered by this job

Health insurance

Income protection

Life assurance

Gym membership

Birthday leave

25 days holiday

Job summary

hireful, a UK-based fast-growing software company, is seeking a Senior Data Engineer to shape its data platform. You will own scalable data pipelines in Databricks, enable self-service analytics, and collaborate with Finance, Product, Sales and Engineering to translate business needs into data solutions.

The role is remote with occasional London visits. We offer up to £85,000 base salary plus a 10% bonus and a comprehensive benefits package, including health insurance and 25 days holiday.

Qualifications

• Senior level experience in data engineering with strong hands-on Databricks (PySpark, Spark SQL, Delta Lake)
• Advanced SQL and Python coding skills
• Track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions
• Solid grounding in data architecture, modelling and modern data platform design
• Cloud experience, preferably AWS (Azure is fine) and familiarity with CI/CD and source control
• Desirable: ML/AI data/predictive modelling interest

Responsibilities

• Design, build and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL and Delta Lake.
• Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems.
• Shape enterprise data architecture, balancing scalability, performance, security and maintainability.
• Partner with stakeholders across Finance, Product, Sales, Marketing and Engineering to turn business challenges into technical solutions.
• Embed data quality, governance and access controls throughout the data lifecycle.
• Mentor a junior engineer and help mature a growing data function.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

SQL

Python

ETL/ELT

Data architecture

AWS

CI/CD

Azure

Mentoring

Job description

hireful, a UK-based fast-growing software company, is seeking a Senior Data Engineer to shape its data platform. You will own scalable data pipelines in Databricks, enable self-service analytics, and collaborate with Finance, Product, Sales and Engineering to translate business needs into data solutions.

The role is remote with occasional London visits. We offer up to £85,000 base salary plus a 10% bonus and a comprehensive benefits package, including health insurance and 25 days holiday.