QA engineer (auto) for data pipelines

AND Digital Limited; Greater London; Hybrid; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Blended Working model

Career scrum team

Training budget

Team socials

Safe environment

Holiday allowance

Share scheme

Flexifund benefits

Job summary

AND Digital Limited is seeking a data-focused QA Engineer (SDET) to ensure quality and performance of data pipelines and integrations across our data platform. You will test Snowflake, SQL-based transformations, and Apache Flink pipelines, and verify end-to-end data flows.

Join a blended working team with opportunities to work from home, client sites, or an office, plus a dedicated career scrum team and training budget to advance your skills.

Qualifications

• Experience validating SQL-based data transformations and pipelines.
• Ability to design and maintain automated data validation tests.
• Strong understanding of data models, rules, and reconciliation across sources/targets.

Responsibilities

• Test batch and streaming data pipelines to ensure accuracy and reliability.
• Validate transformations and data models using Snowflake and SQL.
• Test streaming processing, event handling, and fault tolerance for data systems.
• Verify end-to-end data flows between sources, processing platforms and targets.
• Develop and maintain automated data validation and regression tests.
• Identify data anomalies and validate pipeline performance, scalability, and reliability.
• Investigate data issues, document defects, and collaborate with engineering teams.
• Integrate automated testing into CI/CD workflows to improve test coverage.

Skills

SQL

Data testing

QA Automation

CI/CD

Data pipelines

Tools

Snowflake

Apache Flink

Python

Job description

Описание: AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We've been helping organisations build better digital products and stronger digital teams since 2014. We are seeking a data-focused QA Engineer (SDET) to ensure the quality, accuracy, reliability, and performance of data pipelines and integrations across our data platform. The role will focus on testing Snowflake, SQL-based data transformations, Apache Flink pipelines, and end-to-end data integrations.

Задачи:

• Test batch and streaming pipelines to ensure data accuracy, completeness, and reliability.


• Validate data transformations, business rules, data models, and source-to-target reconciliation using SQL and Snowflake.


• Test streaming data processing, event handling, data consistency, and fault tolerance.


• Verify end-to-end data flows between source systems, processing platforms, and target systems.


• Develop and maintain automated data validation and regression tests.


• Identify data anomalies and validate pipeline performance, scalability, and reliability.


• Investigate data issues, document defects, and collaborate with engineering teams to resolve them.


• Integrate automated testing into CI/CD workflows and improve overall test coverage.

Условия:

• Opportunities to work on projects with big clients and the chance to produce meaningful work that makes a difference to people's lives.


• A \"Blended Working\" model, meaning you will be able to work in a range of locations from; your home, in your clubhouse, on a client, as well as just a change of scenery.


• A dedicated career scrum team, designed to help you reach your career goals and develop the skills you need to be your best self.


• An annual budget for training and upskilling, including allocated days off so you don't have to study in your own free time.


• Monthly and quarterly team socials - on us - ranging from after work drinks, to driving experience days with your fellow club members.


• A safe environment for you to be yourself and challenge yourself.


• 26 days holiday allowance + bank holidays 13 days per year for innovation or upskilling 2 days per year for volunteering Share scheme A £1000 flexifund to use on a personalised list of benefits such Gym membership, Cycle to Work Scheme, Health, dental and optical cash plan