AI Quality Engineer: Build Evaluation Frameworks & Automation

iFindTech Ltd; Greater London; On-site; GBP 60,000 - 90,000; Full time

Job summary

iFindTech Ltd, a fast-growing AI company in the United Kingdom, seeks a QA Engineer to own how the quality of its AI products is measured, tested and improved. You’ll build evaluation pipelines, datasets and automated tests at the intersection of AI evaluation, software engineering and product quality.

Collaborating with engineering and product teams, you will identify failure modes, derive root causes and translate findings into measurable improvements, ensuring accuracy, reliability and

Qualifications

• Must have strong software engineering or technical background with hands-on experience in AI/ML systems.
• Experience building testing, evaluation or quality frameworks for AI-powered products.
• Proficiency in Python or similar programming, capable of building evaluation tooling and automation.
• Solid understanding of LLMs and Generative AI, including testing and evaluation approaches.
• Experience creating evaluation datasets, test cases and regression suites for complex AI features.
• Ability to analyze model outputs, identify failure patterns and root causes, and translate into improvements.
• Strong focus on accuracy, reliability and consistency when evaluating AI systems.
• Excellent analytical and problem-solving skills, especially for ambiguous or hard-to-measure problems.
• Comfortable communicating technical findings with Engineering and Product teams.

Responsibilities

• Own the quality measurement framework for AI products, including data pipelines, tests and evaluation tooling.
• Collaborate with Engineering and Product teams to identify failure modes and derive actionable improvements.
• Develop datasets, test cases and regression suites to ensure AI features meet production-ready standards.
• Design and run experiments to benchmark model outputs and refine evaluation metrics.
• Communicate findings clearly to technical and non-technical stakeholders and advocate for quality improvements.

Skills

AI/ML background

AI evaluation frameworks

Python development

LLMs / Generative AI

Evaluation datasets

Model output analysis

Accuracy & reliability

Analytical problem solving

Cross-functional communication

Job description

iFindTech Ltd, a fast-growing AI company in the United Kingdom, seeks a QA Engineer to own how the quality of its AI products is measured, tested and improved. You’ll build evaluation pipelines, datasets and automated tests at the intersection of AI evaluation, software engineering and product quality.

Collaborating with engineering and product teams, you will identify failure modes, derive root causes and translate findings into measurable improvements, ensuring accuracy, reliability and