GenAI Quality Engineering Lead

Aviva; Województwo mazowieckie; Hybrid; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Performance Bonus

Private medical care

MultiSport cafeteria card

Employee Shares Plan

Hybrid work from Poland

Job summary

Aviva is seeking an AI Quality Engineering Team Lead in Poland to shape scalable quality practices for GenAI and agentic AI solutions. You will combine hands-on evaluation with team leadership, driving auditable findings and release readiness across AI products.

You will connect business risk with datasets, evaluation metrics, and engineering controls, coaching engineers and aligning stakeholders to delivery decisions. A hybrid role with Warsaw office presence is offered.

Qualifications

• Several years of professional experience in quality engineering or related field.
• Hands-on evaluation of AI, LLM, RAG or agent-based systems.
• Practical Python and data/logs/SQL skills.
• Ability to design repeatable evaluations and automation.

Responsibilities

• Lead the quality engineering approach for AI solutions from risk assessment to release.
• Evaluate multi-turn, RAG and agentic AI behaviour with grounding and guardrails.
• Build datasets, assess coverage, bias, and privacy, and ensure auditable findings.
• Develop reusable evaluation components and automated test pipelines.
• Collaborate with product, engineering, data, risk and compliance teams.

Skills

Quality engineering

Python skills

AI evaluation

CI/CD

Stakeholder comm.

Leadership

Tools

DeepEval

Arize

Job description

Aviva is seeking an AI Quality Engineering Team Lead in Poland to shape scalable quality practices for GenAI and agentic AI solutions. You will combine hands-on evaluation with team leadership, driving auditable findings and release readiness across AI products.

You will connect business risk with datasets, evaluation metrics, and engineering controls, coaching engineers and aligning stakeholders to delivery decisions. A hybrid role with Warsaw office presence is offered.