Data Testing Manager

Jobtailor; Nottingham; On-site; GBP 60,000 - 80,000; Full time

Job summary

Jobtailor is seeking a data testing professional in the United Kingdom to lead QA and data engineering-focused testing initiatives. You will define testing scenarios, generate synthetic data, and apply AI-driven evaluation techniques to improve confidence in data-driven products.

Ideal candidates bring 5+ years of data testing/QA experience, strong analytical skills, and proven ability to drive large-scale data validation across environments.

Qualifications

• 5+ years in Data Testing, QA or Data Engineering.
• Strong experience in data regression testing and large-scale data validation.
• Experience with AI/LLM evaluation techniques (golden datasets, semantic testing)
• Strong analytical and problem-solving skills.

Responsibilities

• Analyze data to be tested and/or agent performance (HiTL rates, confidence scores)
• Define CDA testing scenarios, test cases and scorecards based on business priorities
• Propose and innovate testing approaches using deterministic and AI methods
• Generate production test data sets (Golden, representative etc.) to ensure sufficient confidence
• Produce and implement data testing plans in the data environment for milestone roadmap deliveries
• Produce and lead and continuously improve synthetic data for testing in lower environments

Skills

Data testing

QA engineering

Data engineering

AI evaluation

Regression testing

Large-scale validation

Analytical thinking

Problem solving

Job description

Responsibilities

• Analyze data to be tested and/or agent performance (HiTL rates, confidence scores)
• Define CDA testing scenarios, test cases and scorecards based on business priorities
• Propose and innovate testing approaches using deterministic and AI methods
• Generate production test data sets (Golden, representative etc.) to ensure sufficient confidence
• Produce, lead and continuously improve synthetic data for testing in lower environments
• Produce and implement data testing plans in the data environment for milestone roadmap deliveries

Requirements

• 5+ years in Data Testing, QA or Data Engineering
• Strong experience in data regression testing and large-scale data validation
• Experience with AI/LLM evaluation techniques (golden datasets, semantic testing)
• Strong analytical and problem-solving skills