Retail Data Engineer - Azure Databricks Specialist

EXL Talent Acquisition Team; Greater London; Hybrid; GBP 65,000 - 100,000; Full time

Benefits offered by this job

Private healthcare

Life assurance 4x salary

Income protection insurance

Pension plan

Job summary

EXL is seeking an Azure Databricks Data Engineer to design, develop and deliver cloud-based data integration and analytics solutions within our Retail portfolio. You will build scalable pipelines, optimise performance and ensure data quality across data layers, collaborating with data professionals in a fast-paced, hybrid work setting in the UK.

You will work hands-on with Azure Databricks, Azure Data Factory and Azure SQL, translating retail requirements into robust data models while adhering

Qualifications

• Retail industry experience essential.
• 8–10 years in data engineering and integration, ideally in enterprise-scale environments.
• Hands-on experience with Spark (PySpark/SparkSQL) and ETL/ELT design.
• Strong data modelling skills (Dimensional, ODS, Data Vault) and data warehousing concepts.
• Experience with large, complex retail datasets and distributed computing environments.
• Proficiency in SQL, version control (Git) and CI/CD pipelines.
• Familiarity with Agile delivery and DevOps practices (Azure DevOps, JIRA).
• Knowledge of EDM, data governance, and multi-cloud exposure (AWS/GCP).

Responsibilities

• Design, build and deploy scalable data pipelines using Azure Databricks, Azure Data Factory and Azure SQL Database.
• Optimise Databricks environments for performance, cost and security.
• Develop and maintain data integration, ETL/ELT processes and data quality frameworks.
• Translate retail business requirements into data models across data layers.
• Partner with business and technology stakeholders to deliver data solutions and analytics.
• Create technical documentation including data flow diagrams and architecture designs.
• Support Retail data transformation initiatives and ensure data governance.
• Stay current with Azure and Databricks technologies to drive improvement.

Skills

Retail data knowledge

Leadership experience

Data modeling

SQL

CI/CD

Agile DevOps

Distributed computing

PySpark

Tools

Azure Databricks

Azure Data Factory

Azure SQL Database

Spark

Git

Job description

EXL is seeking an Azure Databricks Data Engineer to design, develop and deliver cloud-based data integration and analytics solutions within our Retail portfolio. You will build scalable pipelines, optimise performance and ensure data quality across data layers, collaborating with data professionals in a fast-paced, hybrid work setting in the UK.

You will work hands-on with Azure Databricks, Azure Data Factory and Azure SQL, translating retail requirements into robust data models while adhering