AI Voice Agent (QA Engineer)

Seargin Ltd; Polska; On-site; PLN 90,000 - 130,000; Full time

Benefits offered by this job

B2B Contract

International Firm

Latest IT Projects

Competitive Rates

International Projects

MultiSport

Private Medical Care

Job summary

Seargin Ltd in Poland seeks a QA & Software Testing Engineer to join our dynamic international QA team. You will perform end-to-end testing of customer call scenarios, validate conversation flows, and ensure high-quality AI-driven interactions.

You will test across markets and languages, design comprehensive positive, negative, and edge-case tests, assess integration with CRM/ERP, and collaborate with product and development teams to drive quality improvements.

Qualifications

• QA & Software testing experience across functional, integration, and end-to-end testing.
• Experience testing voice bots, chatbots, AI assistants, and other conversational AI in business settings.
• Understanding of prompt engineering principles to optimize AI conversations.
• Experience with contact center & voice solutions, IVR, and call routing processes.
• Ability to design comprehensive positive, negative, and edge-case test scenarios.

Responsibilities

• Perform end-to-end testing of customer call scenarios and validate conversation flows.
• Verify intent recognition accuracy, request classification, and proper routing to support channels.
• Test across multiple markets, languages, and business scenarios for consistent experiences.
• Design and execute positive, negative, and edge-case scenarios for self-service validation.
• Validate data collection, dialogue management, exception handling, and decision logic.

Skills

QA Testing Experience

Conversational AI Testing

Prompt Engineering

Contact Center & Voice Solutions

Test Scenario Design

Intent Classification Validation

End-to-End Testing

Integration Testing

Analytical & Troubleshooting

Communication & Stakeholder Collab

Tools

CRM

ERP

APIs

Job description

• Perform end-to-end testing of customer call scenarios, validating conversation flows, user interactions, and overall voice agent behavior across business processes.
• Intent Recognition Validation
  • Verify intent classification accuracy, customer request understanding, and correct routing to appropriate support teams and service channels.
• Multi-Market & Multilingual Testing
  • Test customer journeys across different countries, languages, and business scenarios to ensure consistent user experiences and process execution.
• Self-Service Process Validation
  • Design and execute positive, negative, and edge-case scenarios to validate AI-driven self-service capabilities and automated customer interactions.
• Conversation Flow Testing
  • Verify data collection, dialogue management, exception handling, decision logic, and business rule execution within conversational workflows.
• Business Process Testing
  • Validate end-to-end business processes, including repair booking workflows and successful transaction creation in backend systems.
• Production Quality Analysis
  • Review customer feedback, analyze conversation logs and call transcripts, and evaluate the quality and effectiveness of AI-driven interactions.
• Reproduce reported issues, investigate AI behavior deviations, identify configuration gaps, and support resolution of quality-related defects.
• Integration Testing
  • Validate interactions between conversational AI platforms, contact center solutions, backend services, APIs, and supporting enterprise applications.
• Cross-Functional Collaboration
  • Work closely with Product Owners, Developers, Conversation Designers, Operations teams, and business stakeholders to improve solution quality and performance.

Requirements

• QA & Software Testing Experience
  • Strong background as a QA Engineer, Test Analyst, or Software Tester with proven experience across functional, integration, and end-to-end testing activities.
• Conversational AI Testing
  • Experience testing voice bots, chatbots, AI assistants, virtual agents, and other conversational AI solutions within business environments.
• Prompt Engineering Knowledge
  • Understanding of prompt engineering principles and the ability to optimize AI conversations through prompt design and refinement activities.
• Contact Center & Voice Solutions
  • Experience working with customer service platforms, telephony systems, IVR solutions, call routing processes, and voice-based customer interactions.
• Ability to design comprehensive positive, negative, and edge-case test scenarios covering diverse customer journeys and operational processes.
• Intent Classification Validation
  • Experience validating intent recognition, request classification, routing accuracy, and AI decision-making effectiveness.
• Business Process Testing
  • Hands-on experience testing complete business workflows and operational processes rather than only technical application functionality.
• Integration Testing Experience
  • Ability to validate integrations between AI platforms, CRM, ERP, contact center solutions, backend services, and supporting APIs.
• Analytical & Troubleshooting Skills
  • Strong analytical capabilities to investigate AI-related defects, identify root causes, and recommend solution improvements.
• Communication & Stakeholder Collaboration
  • Excellent communication skills with experience collaborating with product teams, developers, QA specialists, and business stakeholders.

What we offer

• B2B Contract
  • Employment based on a B2B contract
• Stable and Dynamic International Firm
  • Opportunity to work in a stable, dynamically developing international company
• Engaging Projects and Latest IT
  • Chance to participate in interesting projects and work with the latest information technologies
• Competitive Rates
  • Attractive remuneration rates offeres
• Renowned International Projects
  • Involvement in the most prestigious international project
• MultiSport and Private Medical Care
  • MultiSport and Private Medical Care

Nice to have

• Conversational AI Platforms
  • Experience working with conversational AI platforms and tools used for voice automation and virtual assistant development.
• Hands-On & Proactive Approach
  • Ability to independently explore solutions, identify improvement opportunities, and drive quality enhancements with minimal supervision.
• Strong English communication skills supporting collaboration within international teams and projects.

Work with us