Senior Azure Databricks Data Engineer Insurance Hybrid UK

EXL Service; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Private healthcare

Critical illness life assurance 4x

Income protection insurance

Pension

Job summary

EXL is seeking a highly skilled Azure Databricks Data Engineer to design, develop and deliver cloud-based data integration and analytics solutions within our Insurance portfolio. You will build scalable pipelines, optimise performance, and ensure data quality, governance, and security.

The role requires strong Azure Databricks experience, Spark, and data modelling skills, with a focus on Insurance data transformation and cross-functional collaboration in a hybrid London setting.

Qualifications

• Experience with data engineering and integration in enterprise environments.
• Strong knowledge of Azure Databricks, Data Factory, Synapse, and Data Lake.
• Hands-on Spark (PySpark) and ETL/ELT design.

Responsibilities

• Design, build and deploy scalable data pipelines using Azure Databricks, Data Factory and SQL Database.
• Optimize Databricks environments for performance, cost and security.
• Develop and maintain data integration and ETL/ELT processes and data quality frameworks.
• Translate business requirements into data models across data layers.
• Collaborate with stakeholders to deliver effective data solutions and analytics.
• Create technical docs including data flow diagrams, architecture and test plans.
• Stay current with emerging data engineering and Azure technologies for continuous improvement.

Skills

Insurance domain

Management experience

Data engineering

Azure Databricks

Azure Data Factory

Azure Synapse

Azure Data Lake

Spark PySpark

ETL/ELT

Data modeling

SQL

CI/CD pipelines

Agile

DevOps

Job description

EXL is seeking a highly skilled Azure Databricks Data Engineer to design, develop and deliver cloud-based data integration and analytics solutions within our Insurance portfolio. You will build scalable pipelines, optimise performance, and ensure data quality, governance, and security.

The role requires strong Azure Databricks experience, Spark, and data modelling skills, with a focus on Insurance data transformation and cross-functional collaboration in a hybrid London setting.