Azure Databricks Data Engineer: Insurance Analytics Lead

Ex; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

EXL in London, United Kingdom is seeking a highly skilled Azure Databricks Data Engineer to design, develop and deliver cloud-based data integration and analytics solutions within our Insurance portfolio. You will work across data engineering, modelling, and transformation initiatives—building scalable pipelines, optimising performance, and ensuring best practices in data quality and governance.

This is a hands-on technical role requiring strong Azure and Databricks experience, coupled with

Qualifications

• Insurance industry experience is essential, with a strong understanding of policy and regulatory data.
• Minimum of 5 years’ management experience leading technical delivery or data engineering teams.
• 8–10 years’ experience in data engineering and integration within enterprise-scale environments.

Responsibilities

• Design, build, and deploy scalable data pipelines using Azure Databricks, Azure Data Factory, and Azure SQL Database.
• Optimise Databricks environments for performance, cost, and security.
• Develop and maintain data integration, ETL/ELT processes, and data quality frameworks.
• Translate business requirements into data models ensuring consistency across data layers.
• Collaborate with stakeholders to deliver effective data solutions and analytics.
• Create technical documentation including data flow diagrams, architecture designs, and test plans.
• Stay current with emerging data engineering and Azure ecosystem technologies.

Skills

Azure Databricks

SQL

PySpark

ETL/ELT

Data Modeling

CI/CD

Azure Data Factory

Data Warehousing

Agile

Git

DevOps

Tools

Azure DevOps

JIRA

Git

Job description

EXL in London, United Kingdom is seeking a highly skilled Azure Databricks Data Engineer to design, develop and deliver cloud-based data integration and analytics solutions within our Insurance portfolio. You will work across data engineering, modelling, and transformation initiatives—building scalable pipelines, optimising performance, and ensuring best practices in data quality and governance.

This is a hands-on technical role requiring strong Azure and Databricks experience, coupled with