Quality Manager - Knowledge AI Required (Clark, Pampanga)

Sutherland

Philippines

On-site

PHP 900,000 - 1,300,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Sutherland is seeking an operational Knowledge AI Quality Lead to oversee AI-driven customer service tools within a BPO partner's contact center. You will audit, test, and improve automated workflows, virtual agents, and human handovers to ensure reliable, accurate customer experiences.

The role emphasizes collaboration with client AI automation leads, KB managers, and product engineering to drive continuous improvements and safe expansion of containment coverage.

Qualifications

  • 2+ years in quality management or process improvement within a high-volume BPO/contact center.
  • Experience testing/auditing AI chatbots, conversational flows, or copilot integrations.
  • Travel industry experience preferred in travel, hospitality, or tech-enabled support.
  • Familiar with Lean, Six Sigma, Root Cause Analysis or 5 Whys.

Responsibilities

  • Operationalize client-approved QA frameworks and test scripts for AI chatbots and copilot tools.
  • Conduct daily audits of live AI interactions, resolutions, and self-service flows.
  • Assess AI-human handovers for context retention and data accuracy post-transfer.
  • Produce weekly defect analyses and feed insights to engineering and KB teams.
  • Monitor KPIs: intent accuracy, resolution precision, containment rate, and CSAT impact.

Skills

Conversational AI
Analytical
Cross-functional communication
Quality standards

Job description

Company Description:

We are seeking an operational Knowledge AI Quality Lead from our BPO partner to oversee, monitor, and elevate the performance of our AI-driven customer service tools and hybrid support workflows. Positioned within the partner's contact center operations, this role ensures that automated workflows, virtual assistants, agent copilots, and human-assist handovers deliver reliable, accurate, and compliant customer experiences.

The ideal candidate combines operational contact center auditing expertise with a deep understanding of AI conversational dynamics, acting as the frontline bridge between real-time vendor performance data and client-side engineering, product, and knowledge teams.

Job Description:
AI QA Framework & Testing
  • Operationalize and execute client-approved QA frameworks, evaluation rubrics, and test scripts tailored for AI chatbots, virtual agents, and copilot tools.
  • Perform routine pre-release User Acceptance Testing (UAT) and regression testing across prompt deployments, Knowledge Base (KB) updates, and automated workflow releases within the operational environment.
Operational Auditing & Performance Monitoring
  • Conduct daily audits of live AI-driven conversations, automated resolutions, and self-service interactions to detect intent misclassifications, system hallucinations, incorrect policy applications, or journey drops.
  • Audit the handover bridge between AI and Human-Assist agents to evaluate context retention, CRM data pass-through accuracy, and agent handle times post-transfer.
Closed-Loop Vendor Feedback & Defect Analysis
  • Perform root-cause defect analysis on resolution failures, escalation spikes, and recurring customer friction points.
  • Synthesize audit data into actionable weekly reports; feed continuous improvement insights to Client AI Automation Leads, KB Managers, and Product Engineering for system retuning and sprint updates.
  • Identify out-of-scope traveler queries and KB content gaps, recommending new intents and articles to safely broaden containment coverage.
Operational Metrics & SLA Compliance
  • Measure, track, and report on primary operational and AI quality KPIs:
  • Intent Recognition Accuracy
  • Resolution Precision & Answer Accuracy
  • Containment Rate & Defect Rate
  • Handover Context Retention Accuracy
  • Traveler Sentiment Score (TSS) / CSAT Impact
  • Hold operational teams and frontline agents accountable for adhering to updated AI copilot workflows and knowledge standards.
Qualifications:
Experience
  • Contact Center QA Background: 2+ years of experience in quality management, operational auditing, or process improvement within a high-volume BPO/contact center environment.
  • AI & Automation Auditing: Demonstrated experience testing, auditing, or evaluating AI chatbots, conversational flows, copilot integrations, or workflow automation tools.
  • Travel Industry (Preferred): Prior experience in travel, hospitality, or tech-enabled customer support operations is strongly preferred.
  • Methodology: Familiarity with operational process improvement tools (Lean, Six Sigma, Root Cause Analysis / 5 Whys).
Core Competencies & Skills
  • Conversational AI Fluency: Deep understanding of natural language processing (NLP/NLU) behavior, intent mapping structures, and failure patterns (e.g., hallucination, drift, misclassification).
  • Analytical & Data-Driven: Ability to turn transcript audits, CSS feedback, and performance dashboard data into actionable insights, using AI tools to support analysis and validating outputs for accuracy and relevance.
  • Cross-Functional Communication: Clear written and verbal reporting skills to present quality defects and technical feedback to both BPO leadership and client technical teams.
  • Quality Standard-Setting: Meticulous attention to detail with an unyielding commitment to brand trust and effortless traveler resolution.
Additional Information:

Interested candidates must be willing to work onsite in Clark, Pampanga.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Quality Manager - Knowledge AI Required (Clark, Pampanga) Sutherland Angeles, Philippines 6 hours ago
Quality Manager - Knowledge AI Required (Clark, Pampanga) Sutherland Angeles, Philippines 6 hours ago

Vochure • Mabalacat, Angeles

On-site
PHP 1,200,000 - 1,800,000
Quality Manager - Knowledge AI Required (Clark, Pampanga)
Quality Manager - Knowledge AI Required (Clark, Pampanga)

Sutherland • Angeles

On-site
PHP 900,000 - 1,200,000
Quality Lead - AI & Automation Auditing (BPO Contact Center)
Quality Lead - AI & Automation Auditing (BPO Contact Center)

Sutherland • Angeles

On-site
PHP 800,000 - 1,200,000
Quality Lead - AI & Automation Auditing (BPO Contact Center)
Quality Lead - AI & Automation Auditing (BPO Contact Center)

Sutherland Company • Angeles

On-site
PHP 800,000 - 1,500,000
Quality Lead/Supervisor - AI Automation Auditing (BPO/Contact Center)
Quality Lead/Supervisor - AI Automation Auditing (BPO/Contact Center)

Sutherland • Mabalacat

On-site
PHP 600,000 - 900,000
AI Quality Lead – Knowledge AI & Contact Center Ops
AI Quality Lead – Knowledge AI & Contact Center Ops

Sutherland • Angeles

On-site
PHP 900,000 - 1,200,000
AI Quality Lead & Automation Auditor
AI Quality Lead & Automation Auditor

Sutherland • Angeles

On-site
PHP 800,000 - 1,200,000
AI Quality Lead: Conversational Testing & Automation
AI Quality Lead: Conversational Testing & Automation

Sutherland Company • Angeles

On-site
PHP 800,000 - 1,500,000
Quality Assurance Analyst
Quality Assurance Analyst

Travelport • Makati

On-site
PHP 400,000 - 650,000
Hybrid working
Training and Quality Lead/Supervisor (BPO Contact Center) - Clark
Training and Quality Lead/Supervisor (BPO Contact Center) - Clark

Sutherland • Mabalacat

On-site
PHP 600,000 - 900,000
Top locations