Lead Data Engineer (FTC)

Oliver James; City Of London; Hybrid; GBP 65,000 - 85,000; Full time

Job summary

A leading insurance broker in London is seeking a Lead Azure Data Engineer for a 12-month contract. The role requires proven experience as a lead data engineer, managing teams, and deploying Azure Databricks pipelines. Ideal candidates should be proficient in SQL, Python, and PySpark, and must work on-site at least two days a week. Competitive contract rates apply.

Qualifications

• Proven experience working as a principal or lead data engineer.
• Strong background working with large datasets.
• Experience managing and mentoring engineers.

Responsibilities

• Deploy pipelines within Azure Databricks.
• Follow the Medallion Architecture framework.

Skills

SQL

Python

PySpark

Data engineering leadership

Job description

Lead Azure Data Engineer

I'm currently working with a leading insurance broker who is looking to hire a Lead Azure Data Engineer on an initial 12-month fixed-term contract, with strong potential for extension.

Key Requirements

• Proven experience working as a principal or lead data engineer
• Strong background working with large datasets, with proficiency in SQL, Python, and PySpark
• Experience managing and mentoring engineers with varying levels of experience
• Hands‑on experience deploying pipelines within Azure Databricks, ideally following the Medallion Architecture framework

Hybrid working: Minimum two days per week on‑site in London.

Thanks,
Oliver