Lead Data Engineer

AND Digital; Leeds; On-site; GBP 85,000 - 110,000; Full time

Benefits offered by this job

25 days bookable holiday + flexible 银行

Pension: 6% of salary paid by AND with

Aviva healthcare cover (including pre‑

Flexibenefit: £1000 assigned to you to

Life Assurance

Income Protection

Eye test + first pair of glasses

Parental Benefits: Generous Enhanced M

Job summary

AND Digital in Leeds is seeking a Lead Data Engineer to design and deliver scalable data pipelines in production-safe environments, using Python and SQL within DataOps practices. You’ll define architectures for data platforms (Snowflake, DataBricks), work across cloud platforms (AWS/Azure/GCP), and translate stakeholder needs into robust data products in a fast-moving, agile team.

You will join multidisciplinary teams to deliver modern data platforms for large organisations, helping them

Qualifications

• Hands-on data engineering with Python and SQL.
• Experience designing scalable data pipelines in production.
• Familiarity with Snowflake and DataBricks.
• Cloud platform experience across AWS/Azure/GCP.

Responsibilities

• Design and develop pipelines that bring data to life for decision making, either delivering insight or for more sophisticated data science applications.
• Define architectures for data platforms like DataBricks.
• Understand the use of AI in tools like Foundry/Bedrock that depend on data.
• Experience being hands on with data, ensuring quality and organisation of information.
• Bridge the gap between technical engineering and business value by translating stakeholder needs into robust data product specifications.

Skills

Python

SQL

Data engineering

DataOps

Data products

Tools

Snowflake

DataBricks

AWS

Azure

GCP

Job description

Who we are:

We’re on a mission to close the world’s tech skills gap.

We help organisations navigate the future of technology, combining human expertise, emerging tech and AI to deliver better outcomes, faster.

Since 2014, we’ve worked side-by-side with clients to solve complex challenges, build high-performing teams, and create lasting capability. As technology continues to evolve, we believe the most successful organisations will be those that combine the best of both: human ingenuity AND intelligent technology.

That belief is embedded in everything we do. We call it the genius of the AND: deep expertise AND practical delivery, innovation AND responsibility, ambitious work AND sustainable careers.

Through our Guide, Build and Equip approach, we help organisations embrace change, deliver meaningful impact, and develop the skills they need to thrive in an increasingly agentic world.

About you:

• You care deeply about producing high-quality work that delivers real value
• You’re comfortable navigating ambiguity and solving complex problems collaboratively
• You bring strong expertise in your craft, alongside a willingness to keep learning
• You communicate clearly and build trust quickly with clients and teammates
• You’re pragmatic, adaptable and outcome-focused
• You enjoy sharing knowledge and helping others grow
• You value low-ego collaboration and enjoy working as part of multidisciplinary teams

What you’ll bring to the table:

As a Lead Data Engineer, you’ll help our clients deploy and maintain data pipelines in a production-safe manner, using the latest technologies and with a DataOps culture. You’ll work in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations.

Your responsibilities:

• Design and Develop pipelines that brings data to life for decision making, either delivering insight or for more sophisticated data science applications
• Define architectures for data platforms like DataBricks
• Understand the use of AI in tools like Foundry/Bedrock that depend on data
• Experience in being hands on with data, applying the practicalities of quality, flow, and organisation of information.
• Be comfortable working in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations.
• Bring experience in coding in Python and SQL
• Have solid experience of Snowflake and/or DataBricks
• Understanding of at least one cloud platform (AWS, Azure or GCP) and experience of associated technologies (for example with AWS: DynamoDB, Redshift, Kinesis Pipelines, Glue, Lambda, QuickSight, etc)
• Have experience with DataOps concepts
• Have experience adopting a Data Product mindset, ensuring datasets are discoverable, addressable, trustworthy, and self-describing for downstream consumers.
• Ability to bridge the gap between technical engineering and business value, translating stakeholder needs into robust data product specifications.
  

Why join AND Digital?

We’re building a culture where talented people can do meaningful work, continue growing, AND enjoy the journey along the way.

Our model is designed to build belonging and connection: we’re organised into regional ‘Clubs’ of no more than 80 people, so you (and our clients) get the benefits of that small company feel while also being connected to a larger whole.

Our Practice Areas act as a ‘second home’ for our ANDis - a place where you can innovate and learn with like-minded experts who care deeply about their craft, support each other generously, and believe the best ideas come from collaboration, not hierarchy.

Our culture is rooted in our values of Wonder, Share and Delight, and shows up through five traits that we celebrate and nurture in all our ANDis: we value curiosity, ambition and a growth-mindset. We are deeply client-centric. Most important of all we are human - we create an inclusive environment where people feel trusted, supported and able to be themselves.

By joining AND, we’ll provide:

• 25 days bookable holiday + flexible Bank Holidays
• Pension: 6% of salary paid by AND Digital with a further 2% paid by you (can be increased by choice).
• Aviva healthcare cover (including pre-existing condition cover) for you.
• Flexibenefit: £1000 assigned to you via our benefits portal to select or upgrade the benefits that suit you the most. Any unused allowance from the £1000 can be taken as cash.
• Life Assurance.
• Income Protection.
• Eye test + first pair of glasses.
• Parental Benefits: Generous Enhanced Maternity and Enhanced Partner (Paternity) Leave.

Equal Opportunities Statement

Diversity and inclusion are hugely important to us, and we’re committed to providing equal opportunities for all. We’re actively recruiting for a diverse and inclusive workforce so want to ensure we do everything we can to support your application.

We want you to feel safe and empowered to let us know if you need any adjustments to be made to your application or interview process, so please speak to our recruitment team.

AI Statement

We champion tech that helps people work smarter, but we want to get to know you! If you use AI to assist with your application or interview prep, please ensure all information submitted remains an accurate, truthful representation of your personal achievements and capabilities rather than generating false or misleading information. We may reject applications where AI is used inappropriately at any stage of the recruitment process.