Lead Data Engineer (12 Month Ftc)

And Digital; United Kingdom; Hybrid; GBP 80,000 - 110,000; Full time

Benefits offered by this job

Blended working model

Dedicated career scrum team

Training budget for upskilling

Monthly and quarterly team socials

Safe environment to be yourself

Job summary

AND Digital is seeking a Lead Data Engineer on a 12 Month FTC to shape, build and evolve data capabilities underpinning the Accounts platform. You will lead data ingestions, ETL/ELT pipelines and data services across architecture, platform delivery and governance.

You will combine hands-on data engineering excellence with leadership to set engineering standards, drive best practices and mentor teammates, while championing automation and modern engineering approaches in a hybrid work environment.

Qualifications

• Strong SQL skills across relational and modern databases.
• Commercial experience building data solutions with Python.
• Knowledge of data engineering principles and design patterns.
• Experience designing ETL/ELT pipelines and data processing frameworks.
• Experience with data quality, reconciliation and monitoring.
• Experience contributing to data architecture and governance standards.
• Experience with Infrastructure as Code, ideally using Terraform.
• Experience with cloud-based data platforms and modern engineering tooling.
• Experience leading technical delivery and making architectural decisions in a complex technology environment.

Responsibilities

• Lead the design, development and ongoing evolution of robust, scalable data pipelines.
• Provide technical leadership across ETL/ELT processes and data integration services.
• Design operational data stores and reference data services for the Accounts platform.
• Establish data quality, validation, monitoring, reconciliation and observability controls.
• Contribute to evolution of data architecture to be scalable, secure and aligned with strategy.
• Promote data engineering standards and best practices across the team.
• Support data governance, lineage and management practices.
• Collaborate with software engineers and product teams to translate data requirements into technical solutions.
• Provide mentoring to other data engineers and raise engineering capability.
• Champion automation, IaC and modern engineering practices across the data landscape.

Skills

SQL

Python

Data architecture

ETL/ELT

Data governance

Data quality

Terraform

Cloud platforms

Leadership

Tools

Terraform

Job description

Lead Data Engineer - 12 Month FTC

Who We Are:
AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We've been helping organisations build better digital products and stronger digital teams since 2014.

We believe our work should always leave a legacy for the client. We do this through close relationships with our offices (or 'Clubs') so that our partners are always prioritised by a regional team close to them.

This unique model has driven success for our clients and ourselves, evidenced by our remarkable organic growth since 2014. Today we number more than 1,300 people with Clubs all over the UK and Europe with plans for global expansion in the next couple of years.

Join us - and help us fulfil our mission to close the world's digital skills gap.

The Role

The Lead Data Engineer will play a key role in shaping, building and evolving the data capabilities that underpin our clients Accounts platform.

Working across data engineering, architecture and platform delivery, the role will provide technical leadership in the design and implementation of scalable, reliable and well-governed data solutions. This includes data pipelines, reference data services and operational data stores, ensuring that data is accurate, accessible, traceable and trusted across the wider ecosystem.

The successful candidate will combine strong hands-on data engineering expertise with the ability to lead technical direction, influence architecture decisions and establish engineering standards and best practices.

Key Responsibilities

• Lead the design, development and ongoing evolution of robust, scalable data ingestion and processing pipelines.
• Provide technical leadership across ETL/ELT processes, data transformation and data integration services.
• Design and implement operational data stores and reference data services that support the Accounts platform and its consumers.
• Establish and maintain effective data quality, validation, monitoring, reconciliation and observability controls.
• Contribute to the evolution of data architecture, ensuring solutions are scalable, resilient, secure and aligned with wider technology strategy.
• Define and promote data engineering standards, patterns and best practices across the team.
• Support the development and implementation of data governance, lineage and data management practices.
• Work closely with software engineers, architects, product teams and other stakeholders to understand data requirements and translate them into effective technical solutions.
• Provide technical guidance and mentoring to other data engineers, helping to raise engineering capability and consistency across the team.
• Champion automation, Infrastructure as Code and modern engineering practices across the data landscape.
• Identify opportunities to improve the reliability, performance, maintainability and cost-effectiveness of data services and pipelines.

Essential Experience

We're particularly interested in candidates with experience in:

• Strong SQL skills and extensive experience working with relational and/or modern database technologies.
• Proven commercial experience developing data solutions using Python.
• Strong understanding of modern data engineering principles, practices and design patterns.
• Experience designing and implementing ETL/ELT pipelines and data processing frameworks.
• Experience working with data quality, reconciliation, monitoring and operational data management.
• Experience contributing to data architecture and governance standards.
• Experience with Infrastructure as Code, ideally using Terraform.
• Experience working with cloud-based data platforms and modern engineering tooling.
• Experience leading technical delivery and making pragmatic architectural decisions in a complex technology environment.

Why join AND Digital?

We have three values: wonder, share, and delight. These values inform how we work with clients, and our culture: what it feels like to work for AND. We believe collaboration, ambition, curiosity and fun can drive innovation by creating a better environment for problem-solving.

By joining AND, we'll provide:

• Opportunities to work on projects with big clients and the chance to produce meaningful work that makes a difference to people’s lives.
• A Blended Working model, meaning you will be able to work in a range of locations from; your home, in your clubhouse, on a client, as well as just a change of scenery.
• A dedicated career scrum team, designed to help you reach your career goals and develop the skills you need to be your best self.
• An annual budget for training and upskilling, including allocated days off so you don't have to study in your own free time.
• Monthly and quarterly team socials - on us - ranging from after work drinks, to driving experience days with your fellow club members.
• A safe environment for you to be yourself and challenge yourself.

Equal Opportunities Statement

At AND Digital we embrace diversity and are committed to equal opportunities. We are actively recruiting for a diverse and inclusive workforce so want to ensure we do everything we can to support your application.

We want you to feel safe and empowered to let us know if you require any adjustments to be made to your application or interview process so please speak to our recruitment team.