AI Quality Engineering Lead: Risk, Metrics & Reliability

Aviva plc; Warszawa; Hybrid; PLN 260,000 - 380,000; Full time

Benefits offered by this job

Private medical care

Performance Bonus

Group insurance

Employee Shares Plan

Hybrid working model

Job summary

Aviva plc is hiring an AI Quality Engineering Team Lead in Poland. You will lead the quality engineering strategy for GenAI and agentic AI solutions, combining hands-on evaluation with team leadership to ensure accuracy, safety, reliability and auditable findings for release decisions.

You will partner with product, engineering, data, risk and compliance teams, shaping reusable evaluation patterns and integrating testing into CI/CD workflows with traceability across datasets, prompts, models and

Qualifications

• Several years of professional quality engineering experience in AI/ML or software testing.
• Hands‑on evaluating AI/Large Language Models and agent‑based systems.
• Ability to turn technical findings into decision‑quality evidence for stakeholders.

Responsibilities

• Lead the AI quality engineering approach from risk assessment to release and monitoring.
• Evaluate multi-turn, RAG and agentic AI behaviour including guardrails and tool use.
• Build reusable evaluation components, automation, and reporting patterns for AI products.

Skills

Python

APIs

CI/CD

Quality engineering

Data analysis

Stakeholder comms

QA testing

Tools

DeepEval

Arize

Job description

Aviva plc is hiring an AI Quality Engineering Team Lead in Poland. You will lead the quality engineering strategy for GenAI and agentic AI solutions, combining hands-on evaluation with team leadership to ensure accuracy, safety, reliability and auditable findings for release decisions.

You will partner with product, engineering, data, risk and compliance teams, shaping reusable evaluation patterns and integrating testing into CI/CD workflows with traceability across datasets, prompts, models and