Lead Data Engineer - Azure & Databricks Delta Lake (Remote)

IO Associates

United Kingdom

Remote

GBP 90,000 - 130,000

Full time

2 days ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Remote work

Outside IR35

12-month engagement

Job summary

IO Associates is hiring a Senior Data Engineer in the United Kingdom to lead data engineering delivery on Azure and Databricks. You will own technical direction across multiple projects, mentor engineers, and collaborate with governance, migrations and automation teams.

You will design scalable pipelines, migrate data, and implement Delta Lake features while ensuring quality, reliability and performance. This is a remote, outside IR35, 12-month engagement.

Qualifications

8+ years of data engineering with leadership experience.
Strong Microsoft Azure and Databricks expertise.
Proven experience delivering large-scale data projects.

Responsibilities

Design scalable pipelines and lakehouse architectures on Databricks.
Move data from legacy systems to the new platform with quality focus.
Write production-grade Python and SQL for multiple projects.
Develop Databricks integrations with external systems.
Apply advanced Delta Lake features to control performance and cost.
Support planning, estimation, and delivery roadmaps.
Mentor distributed data engineering teams across workstreams.
Collaborate with stakeholders to deliver data products.

Skills

Azure

Databricks

Python

SQL

Leadership

Data migration

Education

Databricks/Azure Data Engineer certification

Tools

Delta Lake

Unity Catalog

Azure Databricks

Job description

You will design scalable pipelines, migrate data, and implement Delta Lake features while ensuring quality, reliability and performance. This is a remote, outside IR35, 12-month engagement.

Get your free, confidential resume review.

or drag and drop your file here.