Lead Data Engineer - Build Scalable Data Pipelines

AND Digital; West of England; Hybrid; GBP 80,000 - 110,000; Full time

Benefits offered by this job

Blended Working model

Annual training budget and upskilling

Team socials

Job summary

AND Digital is seeking a Lead Data Engineer to shape and evolve data capabilities underpinning the Accounts platform. You will lead design and implementation of scalable data pipelines and data stores, ensuring accuracy, traceability and governance across the data ecosystem.

You will mentor engineers, set engineering standards and drive modern practices such as Infrastructure as Code and cloud-native tooling, collaborating with software engineers, architects and product teams.

Qualifications

• Strong SQL skills with relational/modern databases.
• Commercial experience building data solutions using Python.
• Understanding of data engineering principles, patterns, and design.
• Experience designing ETL/ELT pipelines and data processing frameworks.
• Experience with data quality, monitoring, governance and lineage.
• Experience with Infrastructure as Code (Terraform).
• Experience with cloud-based data platforms and tooling.
• Experience leading technical delivery in complex environments.

Responsibilities

• Lead the design and evolution of scalable data ingestion and processing pipelines.
• Provide technical leadership across ETL/ELT, data transformation and integration services.
• Design operational data stores and reference data services for the Accounts platform.
• Establish data quality, monitoring, validation and observability controls.
• Shape data architecture and governance standards with the team.

Skills

SQL

Python

Data pipelines

ETL/ELT

Data governance

Terraform

Cloud data platforms

Leadership

Job description

AND Digital is seeking a Lead Data Engineer to shape and evolve data capabilities underpinning the Accounts platform. You will lead design and implementation of scalable data pipelines and data stores, ensuring accuracy, traceability and governance across the data ecosystem.

You will mentor engineers, set engineering standards and drive modern practices such as Infrastructure as Code and cloud-native tooling, collaborating with software engineers, architects and product teams.