Lead Data Engineer (12 Month FTC)

AND Digital; Greater London; Hybrid; GBP 75,000 - 105,000; Full time

Benefits offered by this job

Blended Working

Dedicated career scrum team

Training & upskilling budget

Team socials

Autonomy to drive data architecture

Job summary

AND Digital is seeking a Lead Data Engineer for a 12 Month FTC to shape and evolve data capabilities underpinning the Accounts platform. You will provide technical leadership across data pipelines, governance and architecture, while mentoring engineers and promoting best practices.

You will work across data engineering, architecture and platform delivery, ensuring data is accurate, accessible and trusted. Strong SQL, Python and IaC experience are essential in this role.

Qualifications

• Strong SQL skills and extensive experience working with relational and/or modern database technologies.
• Proven commercial experience developing data solutions using Python.
• Strong understanding of modern data engineering principles, practices and design patterns.
• Experience designing and implementing ETL/ELT pipelines and data processing frameworks.
• Experience working with data quality, reconciliation, monitoring and operational data management.
• Experience contributing to data architecture and governance standards.
• Experience with Infrastructure as Code, ideally using Terraform.
• Experience working with cloud-based data platforms and modern engineering tooling.
• Experience leading technical delivery and making pragmatic architectural decisions in a complex technology environment.

Responsibilities

• Lead the design, development and ongoing evolution of robust, scalable data ingestion and processing pipelines.
• Provide technical leadership across ETL/ELT processes, data transformation and data integration services.
• Design and implement operational data stores and reference data services that support the Accounts platform and its consumers.
• Establish and maintain effective data quality, validation, monitoring, reconciliation and observability controls.
• Contribute to the evolution of data architecture, ensuring solutions are scalable, resilient, secure and aligned with wider technology strategy.
• Define and promote data engineering standards, patterns and best practices across the team.
• Support the development and implementation of data governance, lineage and data management practices.
• Work closely with software engineers, architects, product teams and other stakeholders to understand data requirements and translate them into effective technical solutions.
• Provide technical guidance and mentoring to other data engineers, helping to raise engineering capability and consistency across the team.
• Champion automation, Infrastructure as Code and modern engineering practices across the data landscape.
• Identify opportunities to improve the reliability, performance, maintainability and cost-effectiveness of data services and pipelines.

Job description

Lead Data Engineer - 12 Month FTC

Who We Are:

AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We’ve been helping organisations build better digital products and stronger digital teams since 2014.

We believe our work should always leave a legacy for the client. We do this through close relationships with our offices (or ‘Clubs’) so that our partners are always prioritised by a regional team close to them.

This unique model has driven success for our clients and ourselves, evidenced by our remarkable organic growth since 2014. Today we number more than 1,300 people with Clubs all over the UK and Europe with plans for global expansion in the next couple of years.

Join us - and help us fulfil our mission to close the world’s digital skills gap.

The Role

The Lead Data Engineer will play a key role in shaping, building and evolving the data capabilities that underpin our clients Accounts platform.

Working across data engineering, architecture and platform delivery, the role will provide technical leadership in the design and implementation of scalable, reliable and well-governed data solutions. This includes data pipelines, reference data services and operational data stores, ensuring that data is accurate, accessible, traceable and trusted across the wider ecosystem.

The successful candidate will combine strong hands‑on data engineering expertise with the ability to lead technical direction, influence architecture decisions and establish engineering standards and best practices.

Key Responsibilities

• Lead the design, development and ongoing evolution of robust, scalable data ingestion and processing pipelines.
• Provide technical leadership across ETL/ELT processes, data transformation and data integration services.
• Design and implement operational data stores and reference data services that support the Accounts platform and its consumers.
• Establish and maintain effective data quality, validation, monitoring, reconciliation and observability controls.
• Contribute to the evolution of data architecture, ensuring solutions are scalable, resilient, secure and aligned with wider technology strategy.
• Define and promote data engineering standards, patterns and best practices across the team.
• Support the development and implementation of data governance, lineage and data management practices.
• Work closely with software engineers, architects, product teams and other stakeholders to understand data requirements and translate them into effective technical solutions.
• Provide technical guidance and mentoring to other data engineers, helping to raise engineering capability and consistency across the team.
• Champion automation, Infrastructure as Code and modern engineering practices across the data landscape.
• Identify opportunities to improve the reliability, performance, maintainability and cost-effectiveness of data services and pipelines.

We’re particularly interested in candidates with experience in:

• Strong SQL skills and extensive experience working with relational and/or modern database technologies.
• Proven commercial experience developing data solutions using Python.
• Strong understanding of modern data engineering principles, practices and design patterns.
• Experience designing and implementing ETL/ELT pipelines and data processing frameworks.
• Experience working with data quality, reconciliation, monitoring and operational data management.
• Experience contributing to data architecture and governance standards.
• Experience with Infrastructure as Code, ideally using Terraform.
• Experience working with cloud-based data platforms and modern engineering tooling.
• Experience leading technical delivery and making pragmatic architectural decisions in a complex technology environment.

Why join AND Digital?

We have three values: wonder, share, and delight. These values inform how we work with clients, and our culture: what it feels like to work for AND. We believe collaboration, ambition, curiosity and fun can drive innovation by creating a better environment for problem-solving.

By joining AND, we’ll provide:

• Opportunities to work on projects with big clients and the chance to produce meaningful work that makes a difference to people’s lives.
• A “Blended Working” model, meaning you will be able to work in a range of locations from; your home, in your clubhouse, on a client, as well as just a change of scenery.
• A dedicated career scrum team, designed to help you reach your career goals and develop the skills you need to be your best self.
• An annual budget for training and upskilling, including allocated days off so you don’t have to study in your own free time.
• Monthly and quarterly team socials - on us - ranging from after work drinks, to driving experience days with your fellow club members.
• A safe environment for you to be yourself and challenge yourself.

Equal Opportunities Statement

At AND Digital we embrace diversity and are committed to equal opportunities. We are actively recruiting for a diverse and inclusive workforce so want to ensure we do everything we can to support your application.

We want you to feel safe and empowered to let us know if you require any adjustments to be made to your application or interview process so please speak to our recruitment team.