Senior Azure Data Engineer (Databricks) – Hybrid London

Capco; Greater London; Hybrid; GBP 80,000 - 110,000; Full time

Benefits offered by this job

Discretionary bonus

Health insurance

Continuous learning opportunities

Family-friendly policies

Holiday flexibility

Gym memberships

Job summary

A financial services technology firm is seeking a Principal Azure Data Engineer to lead the architecture of data platforms. You will drive the design and implementation of data solutions using Databricks within Azure, guiding cross-functional teams on best practices. The ideal candidate will have extensive experience with Databricks and Python, coupled with strong skills in CI/CD development and data governance. This role offers competitive benefits and opportunities for professional growth in a collaborative environment.

Qualifications

• Proven experience with the Databricks platform including Unity Catalog and DeltaLake.
• Expertise in Python, PySpark, and distributed data processing frameworks.
• Extensive background in CI/CD pipeline development.

Responsibilities

• Lead the end-to-end delivery of Databricks-based solutions.
• Architect secure and scalable pipelines using DeltaLake.
• Engage with clients to define solution strategies.

Skills

Databricks expertise

Python

PySpark

CI/CD development

Data lakehouse principles

Tools

Databricks

Azure DevOps

Jenkins

GitHub Actions

Job description

A financial services technology firm is seeking a Principal Azure Data Engineer to lead the architecture of data platforms. You will drive the design and implementation of data solutions using Databricks within Azure, guiding cross-functional teams on best practices. The ideal candidate will have extensive experience with Databricks and Python, coupled with strong skills in CI/CD development and data governance. This role offers competitive benefits and opportunities for professional growth in a collaborative environment.