Agentic AI Quality Engineer - AI Safety & Reliability Lead

parsionate; Amsterdam; On-site; EUR 90,000 - 120,000; Full time

Job summary

Accenture Netherlands in Amsterdam seeks an Agentic AI Quality Engineer to lead quality and performance evaluation for complex AI systems. You will drive testing, validation, and governance for safe, scalable AI deployments within Digital Core.

You will work with quality engineers, AI specialists, platform engineers, and business consultants to define metrics, implement automated tests, and ensure rapid, safe iterations aligned with client needs and industry standards.

Responsibilities

• Automate evaluation of multi-turn conversations and long-horizon tasks.
• Apply schema validation, tracing, and calibrated judges to detect issues in tool calls and loops.
• Perform red-team, jailbreak, and privacy tests across agent workflows.
• Monitor production telemetry and maintain data lineage for evaluations.
• Translate business risks into measurable quality criteria and release guidance.
• Communicate findings and residual risks for go/no-go decisions.

Skills

Quality Assurance

MLOps

CI/CD

Threat Modeling

Job description

Accenture Netherlands in Amsterdam seeks an Agentic AI Quality Engineer to lead quality and performance evaluation for complex AI systems. You will drive testing, validation, and governance for safe, scalable AI deployments within Digital Core.

You will work with quality engineers, AI specialists, platform engineers, and business consultants to define metrics, implement automated tests, and ensure rapid, safe iterations aligned with client needs and industry standards.