Data Engineering Lead — Hybrid, Scale Data Lakes & Pipelines

ICAEW; Milton Keynes; Hybrid; GBP 75,000 - 85,000; Full time

Benefits offered by this job

Private Medical Insurance

24 days' holiday

Option to buy/sell extra days

Wellbeing support

Job summary

ICAEW in Milton Keynes is seeking a Data Engineering Lead to provide technical leadership for data platforms and a small team. You will balance hands-on development with mentoring two engineers and work closely with analytics, governance and wider Technology teams.

The ideal candidate will have a strong Microsoft-first data engineering background, experience delivering complex pipelines, and a passion for secure, scalable architectures in a hybrid work environment.

Qualifications

• Proven track record leading data engineering delivery in a Microsoft-first environment (Azure).
• Hands-on experience building and managing ETL/ELT pipelines, data lakes and data warehouses in cloud.
• Proficient in Python and SQL; Scala or R advantageous.
• Experience with data orchestration and workflow tools such as Airflow or Azure Data Factory.

Responsibilities

• Lead, mentor and develop the data engineering team, ensuring delivery of robust pipelines and platforms.
• Manage delivery of data engineering projects, aligned to ICAEW's transformation programme.
• Define and enforce engineering standards, patterns and best practices across the team.
• Design scalable data architectures including data lakes, warehouses and integration layers.
• Ensure data is accessible, well-structured and compliant with governance, quality and security requirements.
• Collaborate with Data Analytics & Insights Lead to align engineering and analytics capabilities.

Skills

Data engineering

Azure Data Factory

Databricks

Synapse

ETL/ELT

Python

SQL

Data lakes

Data warehouses

Airflow

Tools

Azure Data Factory

Databricks

Synapse

Azure Data Lake

Airflow

Job description

ICAEW in Milton Keynes is seeking a Data Engineering Lead to provide technical leadership for data platforms and a small team. You will balance hands-on development with mentoring two engineers and work closely with analytics, governance and wider Technology teams.

The ideal candidate will have a strong Microsoft-first data engineering background, experience delivering complex pipelines, and a passion for secure, scalable architectures in a hybrid work environment.