Azure Data Engineering Lead for AI-Ready Platform

DAC Beachcroft LLP; Birmingham; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Private medical insurance

Income protection insurance

Discounted gym membership

Job summary

DAC Beachcroft LLP is seeking a Data Engineering Lead in Birmingham to shape and deliver an enterprise data platform. You will design robust pipelines, lead Azure-based development and partner with analytics teams to enable AI-enabled processes.

The role combines hands-on delivery with leadership, focusing on scalable data architectures, trusted data, and secure data flows across insurer portals and external systems.

Qualifications

• Senior Data Engineering or Lead Data Engineer experience.
• Hands-on with Azure data technologies including ADF, Synapse, Fabric and Data Lake.
• Advanced SQL development skills.
• Proficiency in Python and modern data pipeline orchestration tools.
• Track record of building reliable, production-grade data pipelines.
• Experience integrating data from multiple business-critical apps and legacy systems.
• Good understanding of data security, data protection and access control in cloud data platforms.
• Excellent stakeholder management and communication skills.

Responsibilities

• Design, develop and maintain enterprise ETL/ELT pipelines, integrating data from case management, finance, CRM and third-party systems into a central data platform.
• Lead the development and continuous improvement of our cloud-based data platform within Azure.
• Ensure data pipelines are scalable, reliable, cost-effective and resilient.
• Build and maintain datasets that support business reporting, analytics, dashboards and data-enabled products.
• Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures.
• Work closely with Data Architects to implement target-state data models and modern data engineering principles.
• Partner with data scientists and analysts to operationalise advanced analytics and predictive models.
• Manage integrations with insurer portals and external data providers, ensuring high-quality, timely and secure data flows.
• Support the organisation's ambition to become increasingly data-driven and AI-enabled.

Skills

Data engineering leadership

SQL development

Python

Data integration

Cloud data platforms

Stakeholder management

Tools

Azure Data Factory

Azure Synapse Analytics

Microsoft Fabric

Azure Data Lake

Job description

DAC Beachcroft LLP is seeking a Data Engineering Lead in Birmingham to shape and deliver an enterprise data platform. You will design robust pipelines, lead Azure-based development and partner with analytics teams to enable AI-enabled processes.

The role combines hands-on delivery with leadership, focusing on scalable data architectures, trusted data, and secure data flows across insurer portals and external systems.