Azure Databricks Data Engineer — Insurance Analytics

EXL

Greater London

Hybrid

GBP 90,000 - 130,000

Full time

9 hours ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Private healthcare

Critical illness life assurance

Income protection

Pension

Employee stock purchase plan

Job summary

EXL seeks an Azure Databricks Data Engineer to design, develop and deliver cloud-based data integration and analytics solutions for our Insurance portfolio in London. You will build scalable pipelines, optimise performance and ensure data quality and governance, working across data engineering, modelling and transformation initiatives in a hands-on role.

This position offers a hybrid working model with exposure to cutting-edge Azure and Databricks technologies and collaboration with senior data

Qualifications

Insurance industry experience is essential
Minimum of 5 years’ management experience
8–10 years’ data engineering and integration experience
Hands-on with Spark (PySpark/SparkSQL) and ETL/ELT design
Strong data modelling skills (Dimensional, ODS, Data Vault)
Proficiency in SQL, Git, and CI/CD pipelines
Familiarity with Agile delivery and DevOps practices

Responsibilities

Design, build, and deploy scalable data pipelines using Azure Databricks, Azure Data Factory, and Azure SQL Database
Optimize Databricks environments for performance, cost, and security
Develop and maintain data integration, ETL/ELT processes, and data quality frameworks
Translate business requirements into data models ensuring consistency across data layers
Work with stakeholders to deliver effective data solutions and analytics
Create technical documentation including data flow diagrams and test plans
Stay current with emerging data engineering and Azure ecosystem technologies