Insurance Data Engineer — Azure Databricks

EXL; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Private healthcare

Critical illness life assurance at 4x

Income protection insurance

Pension

Employee Stock Purchase Plan (ESPP)

Cycle scheme

Hybrid working model

Job summary

EXL is hiring an Azure Databricks Data Engineer to design and deliver cloud-based data integration and analytics solutions for the Insurance portfolio. You will work across data engineering, modelling, and transformation initiatives, building scalable pipelines with Azure Databricks, Data Factory, and SQL DB.

The role requires hands-on Azure Databricks experience and strong Insurance domain knowledge, with governance, data quality and performance optimisation as core priorities.

Qualifications

• 5–10+ years in data engineering/analytics.
• Strong Microsoft Azure data services experience.
• Insurance domain knowledge strongly preferred.
• Hands-on experience with Databricks, Spark, and ETL/ELT pipelines.

Responsibilities

• Design, build, and deploy scalable data pipelines using Azure Databricks and Azure Data Factory.
• Optimize Databricks environments for performance, cost, and security.
• Develop data integration, ETL/ELT processes, and data quality frameworks.
• Translate business requirements into robust data models and architectures.
• Collaborate with stakeholders to deliver effective data solutions and analytics.
• Create technical documentation including data flow diagrams and test plans.
• Stay current with Azure ecosystem and data engineering innovations.

Skills

Azure Databricks

Azure Data Factory

Azure SQL Database

Spark PySpark

ETL/ELT design

Data modeling

Data pipelines

SQL

CI/CD pipelines

Agile delivery

DevOps

Insurance domain knowledge

Team leadership

Tools

Git

JIRA

CI/CD tools

Job description

EXL is hiring an Azure Databricks Data Engineer to design and deliver cloud-based data integration and analytics solutions for the Insurance portfolio. You will work across data engineering, modelling, and transformation initiatives, building scalable pipelines with Azure Databricks, Data Factory, and SQL DB.

The role requires hands-on Azure Databricks experience and strong Insurance domain knowledge, with governance, data quality and performance optimisation as core priorities.