Azure Data Engineering Lead — AI‑Ready Platform

DAC Beachcroft; Greater London; On-site; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Private medical insurance

Income protection insurance

Discounted gym membership

Professional funding

Job summary

DAC Beachcroft is seeking an experienced Data Engineering Lead in London (Woolgate) to shape and deliver an enterprise data platform. You will lead design and implementation of scalable, secure data pipelines and AI-ready components across case management, finance, CRM, and third-party systems.

You will collaborate with Data Architecture, Analytics and business teams to ensure data remains trusted, accessible, and fit for purpose while promoting engineering best practices, CI/CD, automated

Qualifications

• Senior data engineering professional with leadership experience.
• Hands-on with Azure data tech including ADF, Synapse, Fabric, and Data Lake.
• Strong SQL, Python, and data security in cloud.

Responsibilities

• Design, develop and maintain enterprise ETL/ELT pipelines from diverse systems.
• Lead the cloud data platform development within Azure.
• Ensure pipelines are scalable, reliable, and cost-efficient.
• Build datasets for reporting, analytics and data-enabled products.
• Establish engineering best practices including CI/CD, testing, monitoring.
• Collaborate with data architects to implement target-state models.
• Partner with data scientists to operationalise analytics and AI.
• Manage integrations with insurer portals and external providers.
• Support the organisation's shift to AI-enabled data.

Skills

Senior Data Engineer

Azure data technologies

Python

SQL

CI/CD & automation

Stakeholder management

Tools

Azure Data Factory

Azure Synapse Analytics

Microsoft Fabric

Azure Data Lake

CI/CD tools

Job description

DAC Beachcroft is seeking an experienced Data Engineering Lead in London (Woolgate) to shape and deliver an enterprise data platform. You will lead design and implementation of scalable, secure data pipelines and AI-ready components across case management, finance, CRM, and third-party systems.

You will collaborate with Data Architecture, Analytics and business teams to ensure data remains trusted, accessible, and fit for purpose while promoting engineering best practices, CI/CD, automated