AI Quality Engineering Lead: Risk, Evaluation & Release

Aviva plc; Województwo mazowieckie; Hybrid; PLN 240,000 - 420,000; Full time

Benefits offered by this job

Performance Bonus

Private medical care

Cafeteria system of benefits

Employee Shares Plan

Hybrid working model

Job summary

Aviva plc is hiring an AI Quality Engineering Team Lead to establish trustworthy quality practices for GenAI and agentic AI at the Aviva Services Excellence Centre. You will lead testing, evaluation, and automation efforts across datasets, prompts, models, and metrics to support safe and reliable releases.

You will coach engineers, connect business risk with technical evidence, and collaborate with product, architecture, data, risk, and compliance teams to influence delivery decisions.

Qualifications

• Experience in quality engineering for AI solutions.
• Hands-on evaluation of AI models and outputs, with risk focus.
• Ability to design repeatable evaluations and automation for AI systems.

Responsibilities

• Lead the quality engineering approach for AI solutions from risk assessment to release and monitoring.
• Evaluate multi-turn and agentic AI behaviour, grounding and guardrails.
• Build reusable evaluation components and automated test pipelines.
• Provide auditable findings that support release decisions and risk communication.

Skills

Quality engineering

Software testing

Python

APIs

CI/CD

Observability

Data science

Risk assessment

Team leadership

Tools

DeepEval

Arize AI

SQL

CI/CD tooling

Job description

Aviva plc is hiring an AI Quality Engineering Team Lead to establish trustworthy quality practices for GenAI and agentic AI at the Aviva Services Excellence Centre. You will lead testing, evaluation, and automation efforts across datasets, prompts, models, and metrics to support safe and reliable releases.

You will coach engineers, connect business risk with technical evidence, and collaborate with product, architecture, data, risk, and compliance teams to influence delivery decisions.