AI QA Testing Engineer

Premier NX; Lahore; On-site; PKR 1,004,000 - 1,674,000; Full time

Benefits offered by this job

Market-competitive salary

Career growth opportunities

Learning & development programs

Medical Coverage (IPD)

Life Insurance

Paid Leaves

Provident Fund

Employee Old Age Benefits (EOBI)

Employee engagement & wellness initiatives

Employee wellness initiatives

Job summary

A tech solutions company in Lahore is seeking an AI Agent Testing Specialist responsible for ensuring quality in AI-driven voice and conversational agents. You'll evaluate AI performance in call scenarios and design tests to enhance interaction accuracy. Ideal candidates should have over 2 years experience in software testing, familiarity with AI systems, and strong analytical skills. The offer includes a competitive salary and opportunities for career growth, alongside comprehensive benefits including medical coverage and paid leaves.

Qualifications

• 2+ years of experience in software or QA testing, preferably with AI.
• Familiarity with conversational AI systems like ChatGPT or Dialogflow.
• Strong analytical and communication skills.
• Strong analytical and communication skills.
• Ability to think from the end-user perspective and evaluate interactions.
• Comfortable working in collaborative, cross-functional environments.

Responsibilities

• Design and execute scenario-based test cases.
• Test AI call flows and intent recognition.
• Collaborate with developers and QA teams.
• Collaborate with developers, AI trainers, and QA teams to refine conversational logic and performance.
• Analyze call logs, transcripts, and AI decision paths to suggest improvements.
• Support fine-tuning and validation of AI responses based on training data and feedback.
• Contribute to continuous test automation and test plan improvements.

Skills

Software or QA testing

Conversational AI systems

Analytical skills

Communication skills

End-user perspective evaluation

Collaborative, cross-functional work

Tools

Python

Postman

API testing tools

Job description

About the Role:

Were looking for a skilled and detail-oriented AI Agent Testing Specialist to help ensure the quality and performance of our AI-driven voice and conversational agents. This role goes beyond traditional software testing — youll be evaluating how AI behaves, responds, and performs in real-world call scenarios across our communication platforms.

If you enjoy testing interactive systems, analyzing conversational flows, and helping shape how intelligent virtual agents interact with customers, this role is for you.

Key Responsibilities:

• Design and execute scenario-based test cases to evaluate AI agent behavior, accuracy, and naturalness in simulated call environments.
• Test AI call flows, intent recognition, response accuracy, and escalation handling.
• Identify and document behavioral issues, misclassifications, or poor user experiences.
• Collaborate with developers, AI trainers, and QA teams to refine conversational logic and performance.
• Analyze call logs, transcripts, and AI decision paths to suggest improvements.
• Support the fine-tuning and validation of AI responses based on training data and feedback.
• Contribute to continuous test automation and test plan improvements.

Required Skills & Experience:

• 2+ years of experience in software or QA testing, preferably with AI, IVR, or contact center solutions (CCaaS, Amazon Connect, Twilio, 3CX, etc.)
• Familiarity with conversational AI systems (ChatGPT, Dialogflow, Lex, or similar).
• Understanding of test planning, scenario testing, and quality documentation.
• Strong analytical and communication skills.
• Ability to think from the end-user perspective and evaluate how interactions feel.
• Comfortable working in collaborative, cross-functional environments.

Preferred Experience:

• Experience with AI prompt design or conversational flow building.
• Background in speech recognition, NLP, or voice application testing.
• Exposure to Python, Postman, or API testing tools.

Training & Support:

We provide hands-on training on our specific AI testing platform, tools, and process.
Candidates with a strong QA foundation and a willingness to learn are highly encouraged to apply.

What we offer:

• Market-competitive salary
• Career growth opportunities
• Learning & development programs
• On-the-job training
• Medical Coverage (IPD)
• Life Insurance
• Paid Leaves (Annual, Casual, Sick, Marriage, Maternity, Paternity, Hajj, Beren
• Provident Fund
• Employee Old Age Benefits (EOBI)
• Employee engagement & wellness initiatives