Senior Data Testing Lead - AI-Driven QA and Data Validation

Jobtailor; Nottingham; On-site; GBP 60,000 - 80,000; Full time

Job summary

Jobtailor is seeking a data testing professional in the United Kingdom to lead QA and data engineering-focused testing initiatives. You will define testing scenarios, generate synthetic data, and apply AI-driven evaluation techniques to improve confidence in data-driven products.

Ideal candidates bring 5+ years of data testing/QA experience, strong analytical skills, and proven ability to drive large-scale data validation across environments.

Qualifications

• 5+ years in Data Testing, QA or Data Engineering.
• Strong experience in data regression testing and large-scale data validation.
• Experience with AI/LLM evaluation techniques (golden datasets, semantic testing)
• Strong analytical and problem-solving skills.

Responsibilities

• Analyze data to be tested and/or agent performance (HiTL rates, confidence scores)
• Define CDA testing scenarios, test cases and scorecards based on business priorities
• Propose and innovate testing approaches using deterministic and AI methods
• Generate production test data sets (Golden, representative etc.) to ensure sufficient confidence
• Produce and implement data testing plans in the data environment for milestone roadmap deliveries
• Produce and lead and continuously improve synthetic data for testing in lower environments

Skills

Data testing

QA engineering

Data engineering

AI evaluation

Regression testing

Large-scale validation

Analytical thinking

Problem solving

Job description

• Analyze data to be tested and/or agent performance (HiTL rates, confidence scores)
• Define CDA testing scenarios, test cases and scorecards based on business priorities
• Propose and innovate testing approaches using deterministic and AI methods
• Generate production test data sets (Golden, representative etc.) to ensure sufficient confidence
• Produce, lead and continuously improve synthetic data for testing in lower environments
• Produce and implement data testing plans in the data environment for milestone roadmap deliveries

Requirements

• 5+ years in Data Testing, QA or Data Engineering
• Strong experience in data regression testing and large-scale data validation
• Experience with AI/LLM evaluation techniques (golden datasets, semantic testing)
• Strong analytical and problem-solving skills

🔍 ATS Optimization Keywords
Below are skills and terms extracted directly from this job posting to improve Applicant Tracking System (ATS) visibility. This unique feature helps candidates tailor their applications more effectively — a feature exclusive to JobTailor job listings.

Hard Skills

• data testing
• QA
• data engineering
• data regression testing
• large-scale data validation
• AI evaluation techniques
• LLM evaluation techniques
• synthetic data production
• test case development
• data testing plans

Soft Skills

• analytical skills
• problem-solving skills