Lead Data Engineer

慨正橡扯; Leeds; On-site; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Holiday allowance

Pension

Healthcare

Flexibenefit

Life Assurance

Income Protection

Eye care

Parental benefits

Job summary

AND Digital in the United Kingdom is seeking a Lead Data Engineer to design and maintain data pipelines, delivering modern data platforms within large organisations while adopting a DataOps culture.

You will work in fast-moving, agile teams, using Python and SQL with Snowflake and DataBricks, and help translate stakeholder needs into robust data product specifications to drive business value.

Qualifications

• Proficient in Python and SQL for data processing and modeling.
• Strong experience with Snowflake and DataBricks for data platforms.
• Hands-on experience designing and deploying data pipelines in cloud environments.
• Knowledge of DataOps concepts and data product mindset.

Responsibilities

• Design and Develop pipelines that bring data to life for decision making.
• Define architectures for data platforms like DataBricks.
• Understand the use of AI in tools that depend on data.
• Hands-on data work with focus on quality and governance.
• Bridge engineering work with business value through robust data product specs.

Skills

Python

SQL

Snowflake

DataBricks

Cloud platforms

DataOps

Data product mindset

Data pipelines

Tools

AWS

Azure

GCP

Job description

Who we are:

We’re on a mission to close the world’s tech skills gap.

We help organisations navigate the future of technology, combining human expertise, emerging tech and AI to deliver better outcomes, faster.

Since 2014, we’ve worked side-by-side with clients to solve complex challenges, build high-performing teams, and create lasting capability. As technology continues to evolve, we believe the most successful organisations will be those that combine the best of both: human ingenuity AND intelligent technology.

That belief is embedded in everything we do. We call it the genius of the AND: deep expertise AND practical delivery, innovation AND responsibility, ambitious work AND sustainable careers.

Through our Guide, Build and Equip approach, we help organisations embrace change, deliver meaningful impact, and develop the skills they need to thrive in an increasingly agentic world.

About you:

• You care deeply about producing high-quality work that delivers real value
• You’re comfortable navigating ambiguity and solving complex problems collaboratively
• You bring strong expertise in your craft, alongside a willingness to keep learning
• You communicate clearly and build trust quickly with clients and teammates
• You’re pragmatic, adaptable and outcome-focused
• You enjoy sharing knowledge and helping others grow
• You value low-ego collaboration and enjoy working as part of multidisciplinary teams

What you’ll bring to the table:

As a Lead Data Engineer, you’ll help our clients deploy and maintain data pipelines in a production-safe manner, using the latest technologies and with a DataOps culture. You’ll work in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations.

Your responsibilities:

• Design and Develop pipelines that brings data to life for decision making, either delivering insight or for more sophisticated data science applications
• Define architectures for data platforms like DataBricks
• Understand the use of AI in tools like Foundry/Bedrock that depend on data
• Experience in being hands on with data, applying the practicalities of quality, flow, and organisation of information.
• Be comfortable working in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations.
• Bring experience in coding in Python and SQL
• Have solid experience of Snowflake and/or DataBricks
• Understanding of at least one cloud platform (AWS, Azure or GCP) and experience of associated technologies (for example with AWS: DynamoDB, Redshift, Kinesis Pipelines, Glue, Lambda, QuickSight, etc)
• Have experience with DataOps concepts
• Have experience adopting a Data Product mindset, ensuring datasets are discoverable, addressable, trustworthy, and self-describing for downstream consumers.
• Ability to bridge the gap between technical engineering and business value, translating stakeholder needs into robust data product specifications.
  

Why join AND Digital?

We’re building a culture where talented people can do meaningful work, continue growing, AND enjoy the journey along the way.

Our model is designed to build belonging and connection: we’re organised into regional ‘Clubs’ of no more than 80 people, so you (and our clients) get the benefits of that small company feel while also being connected to a larger whole.

Our Practice Areas act as a ‘second home’ for our ANDis - a place where you can innovate and learn with like‑minded experts who care deeply about their craft, support each other generously, and believe the best ideas come from collaboration, not hierarchy.

Our culture is rooted in our values of Wonder, Share and Delight, and shows up through five traits that we celebrate and nurture in all our ANDis: we value curiosity, ambition and a growth‑mindset. We are deeply client‑centric. Most important of all we are human - we create an inclusive environment where people feel trusted, supported and able to be themselves.

By joining AND, we’ll provide:

• 25 days bookable holiday + flexible Bank Holidays
• Pension: 6% of salary paid by AND Digital with a further 2% paid by you (can be increased by choice).
• Aviva healthcare cover (including pre-existing condition cover) for you.
• Flexibenefit: £1000 assigned to you via our benefits portal to select or upgrade the benefits that suit you the most. Any unused allowance from the £1000 can be taken as cash.
• Life Assurance.
• Income Protection.
• Eye test + first pair of glasses.
• Parental Benefits: Generous Enhanced Maternity and Enhanced Partner (Paternity) Leave.

Equal Opportunities Statement

Diversity and inclusion are hugely important to us, and we’re committed to providing equal opportunities for all. We’re actively recruiting for a diverse and inclusive workforce so want to ensure we do everything we can to support your application.

We want you to feel safe and empowered to let us know if you need any adjustments to be made to your application or interview process, so please speak to our recruitment team.

AI Statement

We champion tech that helps people work smarter, but we want to get to know you! If you use AI to assist with your application or interview prep, please ensure all information submitted remains an accurate, truthful representation of your personal achievements and capabilities rather than generating false or misleading information. We may reject applications where AI is used inappropriately at any stage of the recruitment process.