Data Quality Engineer

Stott and May; Cardiff; Hybrid; GBP 80,000 - 100,000; Full time

Job summary

A leading technology firm is seeking an experienced Data Quality Engineer in Cardiff. This hybrid role involves ensuring the integrity of data services through automation and CI/CD processes. The ideal candidate will possess strong data testing skills, particularly with Python or PySpark, along with experience in ETL testing and stakeholder management. This position offers a contract for 6 months with a daily rate of £510.

Qualifications

• Minimum experience in data testing with Python or PySpark required.
• Knowledge of ETL/DWH testing and SQL preferred.
• Proven experience in agile environments needed.

Responsibilities

• Define and maintain testing tools and strategies.
• Collaborate with development teams to establish best practices.
• Integrate automated testing into CI/CD pipelines.

Skills

Hands-on data testing with Python

ETL/DWH testing

Strong stakeholder management

Proficiency with BDD frameworks

Integration of automated tests into CI/CD pipelines

Tools

Azure DevOps

Jenkins

GitLab

Jira

Job description

Data Quality Engineer

Location: Cardiff, UK (Hybrid)
Day Rate: £510 (Inside IR35)
Contract Duration: 6 months (with potential extension)
Start Date: Immediate

Overview

We are seeking an experienced Data Quality Engineer to join a multi-disciplinary team building a cloud-based data platform. The successful candidate will be responsible for ensuring the quality and integrity of services and applications, with a strong focus on test automation, continuous improvement, and integration into CI/CD pipelines.

Key Responsibilities

• Define and maintain testing tools, frameworks and automation strategies.

• Identify opportunities for test automation and “shift-left” testing.

• Collaborate with development teams to establish best practices.

• Integrate automated testing into CI/CD pipelines (Azure DevOps, Jenkins, GitLab).

• Provide clear documentation of test approaches, processes and automation.

• Share best practice and champion testing processes across agile ceremonies.

• Contribute to continuous improvement of testing standards and practices.

• Stay up to date with advancements in testing, automation and quality engineering.

• Act as a liaison between QE teams and client stakeholders.

• Lead and mentor a mid-sized team of QAs working across multiple products.

Essential Skills & Experience

• Hands-on data testing with Python or PySpark.

• Strong knowledge of ETL/DWH testing and SQL (any RDBMS, preferably Oracle).

• Experience with stored procedures (reading, understanding and altering).

• Proficiency with BDD frameworks such as Cucumber.

• Integration of automated tests into CI/CD pipelines (Azure DevOps, Jenkins, GitLab).

• Knowledge of cloud platforms, ideally GCP (Storage Buckets, BigQuery, Dataflow, Cloud Functions).

• Experience with one or more programming languages (Java / JavaScript).

• Exposure to non-functional testing using JMeter or similar tools.

• Strong stakeholder management, communication and documentation skills.

• Demonstrated ability to define policies and best practices at programme level.

• Proven experience in agile environments, including active participation in ceremonies.

• Familiarity with Jira, Zephyr or similar test management tools.

Desirable Skills

• Test automation within cloud platforms.

• Strong Java programming knowledge.

• Experience in software development or data engineering.

• Ability to mentor teams and champion automation as “definition of done”.

• Experience leading test automation strategy.