AI Quality Engineer – Agentic Systems & Validation

Sogeti; Phoenix (AZ); On-site; USD 140,000 - 200,000; Full time

Job summary

Sogeti is seeking a senior QA lead to own end-to-end quality strategy for AI Marketplace solutions. You will drive QE agent development, AI validation, and platform integration, while establishing standards for testing, observability, security, and performance.

You will mentor engineering teams to build scalable, agentic AI solutions. Responsibilities cover agent architecture, AI/LLM validation, QE automation, observability, cloud/platform engineering, and governance.

Qualifications

• Experience with Playwright, Selenium, API test automation is a must.
• Understanding of AI testing, validation, and governance principles.
• Familiarity with agentic AI concepts and multi-agent workflows.
• Knowledge of system observability, performance testing, and CI/CD integrations.

Responsibilities

• Define end-to-end quality strategy for AI Marketplace solutions, incl. QE agent development and AI validation.
• Set standards for AI testing, observability, security, and performance; enable reusable QE agents.
• Provide technical leadership and mentorship to engineering teams.

Skills

Playwright

Agentic AI fundamentals

LLM testing

API testing

LangChain

LangGraph

AutoGen

CrewAI

Semantic Kernel

MCP-based architectures

AI observability

Job description

Sogeti is seeking a senior QA lead to own end-to-end quality strategy for AI Marketplace solutions. You will drive QE agent development, AI validation, and platform integration, while establishing standards for testing, observability, security, and performance.

You will mentor engineering teams to build scalable, agentic AI solutions. Responsibilities cover agent architecture, AI/LLM validation, QE automation, observability, cloud/platform engineering, and governance.