QA AI Engineer for Trustworthy AI & Platform Quality

Xpansiv

Sheffield

On-site

GBP 60,000 - 70,000

Full time

4 days ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Xpansiv is seeking a QA AI Engineer to ensure the quality, reliability, and safety of AI-driven products and LLM infrastructure. You will design test plans, execute cases, and build evaluation pipelines in a cross-functional environment.

You will work with AI engineering, product, operations, and business stakeholders to embed testing, monitoring, and governance into the product lifecycle, supporting pilots, production rollouts, and post-release updates.

Qualifications

10+ years of software quality assurance experience.
Experience creating test plans and documenting test cases.
Experience with functional, end-to-end, regression, security, performance, API, and integration testing.
Experience testing AI/ML/LLM-powered systems.
Familiarity with Cypress, Playwright, Selenium, and API testing tools.

Responsibilities

Create test plans for AI-powered and traditional software applications.
Document test cases based on requirements and acceptance criteria.
Execute manual, automated, and exploratory testing across systems.
Build evaluation pipelines for AI-powered applications across lines of business.
Identify and reproduce AI-specific failure modes, including hallucinations and data leakage.
Develop AI evaluation frameworks and quality scorecards.