Senior Databricks Data Engineer

MANNING SERVICES LIMITED; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

MANNING SERVICES LIMITED in London is seeking a senior analytics professional to lead data engineering and integration initiatives within the insurance domain. This hybrid role involves guiding delivery teams and shaping robust data pipelines.

The ideal candidate has extensive experience in data modelling (Dimensional, ODS, Data Vault), large datasets, and distributed computing, with strong SQL, Git, and CI/CD skills, plus Agile/DevOps exposure (Azure DevOps, JIRA).

Qualifications

• Insurance industry experience is essential for policy, claims and regulatory data.
• Minimum of 5 years' management experience leading technical delivery.
• 8-10 years' experience in data engineering and integration in enterprise environments.

Skills

Insurance industry experience

Management experience

Data engineering

Spark PySpark SparkSQL

ETL/ELT design

Data pipeline orchestration

Data modelling (Dimensional, ODS, Data

Data warehousing concepts

SQL

Git

CI/CD pipelines

Agile delivery

Azure DevOps

JIRA

Tools

Spark

SparkSQL

Azure DevOps

JIRA

Git

Job description

BU/Segment: Analytics / Data Management / Insurance Domain

Location: London, United Kingdom (Hybrid, 3-4 days in the office)

Employment Type: Permanent to start ASAP

Qualifications and experience we consider to be essential for the role:

• Insurance industry experience is essential, with a strong understanding of policy, claims, and regulatory data.
• A minimum of 5 years' management experience required - leading technical delivery or overseeing project teams within data engineering or integration environments.
• 8-10 years' experience in data engineering and integration, ideally in enterprise-scale environments.
• Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design, and data pipeline orchestration.
• Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts.
• Experience working with large, complex datasets and distributed computing environments.
• Proficiency in SQL, version control (e.g. Git), and CI/CD pipelines.
• Familiarity with Agile delivery and DevOps practices (Azure DevOps, JIRA, etc.).