Lead QA Engineer - AI Voice | Remote & Growth Opportunities

Lingaro Group; Polska; Hybrid; PLN 180,000 - 260,000; Full time

Job summary

Lingaro Group is seeking an experienced QA lead for voice AI testing to design strategy, drive end-to-end quality, and coordinate UAT across distributed teams. You will validate speech recognition and output, latency, and accents using cloud speech services and LLM evaluation tools.

The role requires strong collaboration with stakeholders, mentoring engineers, and ensuring compliance with quality metrics across markets. A hybrid work model and global projects are available.

Qualifications

• At least 6 years of experience in software QA.
• At least 2 years of experience in testing voice agents or conversational AI in live delivery.
• Has led E2E and UAT, and worked as the lone or lead QA with limited guidance.
• Experience in international or distributed teams.
• Voice AI testing: speech recognition and speech output, latency, interruptions, accents, noise.
• Voice quality metrics such as word error rate, intent accuracy and task completion.
• Practical understanding of how LLMs work and fail.
• Use of cloud speech services to generate test calls.
• Jira or Azure DevOps, and a test management tool.
• Troubleshooting from logs, transcripts and call recordings.
• Voice testing platforms is a plus.
• LLM evaluation tools is a plus.
• Telephony basics is a plus.
• ISTQB certification is a plus.
• Responsible-AI testing is a plus.
• Customer journeys across multiple markets is a plus.
• English at least B2.

Responsibilities

• Design the voice AI test strategy and process, from speech input through speech recognition (ASR), the LLM, tools and integrations, to speech output.
• Define the automation approach and how it scales, including multilingual coverage of around 100 languages.
• Test both predictable behaviour (intents, routing, integrations) and non-deterministic AI behaviour.
• Evaluate prompts and LLM responses, using test datasets and scoring criteria.
• Lead UAT: planning, scenarios, test data, coordination of business testers and sign-off recommendation.
• Gather business acceptance criteria and turn them into measurable targets.
• Own defect and risk management, and give release go/no-go recommendations.
• Replan and communicate options when development is delayed.
• Challenge stakeholders on readiness and quality, and mentor the Regular engineer.

Skills

Software QA

Voice AI testing

E2E testing

UAT

Distributed teams

Cloud speech services

Jira/Azure DevOps

Log analysis

Telephony basics

ISTQB

Responsible-AI testing

English B2

Tools

Jira

Azure DevOps

Test management tools

Job description

Lingaro Group is seeking an experienced QA lead for voice AI testing to design strategy, drive end-to-end quality, and coordinate UAT across distributed teams. You will validate speech recognition and output, latency, and accents using cloud speech services and LLM evaluation tools.

The role requires strong collaboration with stakeholders, mentoring engineers, and ensuring compliance with quality metrics across markets. A hybrid work model and global projects are available.