Senior QA Engineer, Voice & LLM for Healthcare AI

Vi

United States

Remote

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Vi operates AI-enabled voice agents in healthcare contexts and seeks a dedicated QA lead. You will own testing across voice calls, transcripts, and system integrations, turning vague failures into actionable tickets.

You will implement regression suites, manage non-deterministic outcomes, and shape release criteria for client deployments. You should have deep classical QA experience, especially with voice/LLM systems in production, and be proficient in Python and CI workflows.

Qualifications

  • Proven QA for voice-enabled systems, including real patients or synthetic calls.
  • Experience testing in production with LLM-based systems and nondeterministic outputs.
  • Ability to define pass criteria, tolerances, and reproducible tickets for engineers.

Responsibilities

  • Lead voice testing and debugging across speech-to-text, model, text-to-speech, and telephony layers.
  • Develop evaluation and regression plans, golden sets, and structured output validation.
  • Ensure release criteria are met and monitor production quality post-launch.

Skills

Voice QA
LLM QA
Test automation
Python
CI/CD
Regression testing
Bug triage
Release process

Education

Bachelor's degree in CS/Engineering or QA related field

Tools

CI tools

Job description

Vi operates AI-enabled voice agents in healthcare contexts and seeks a dedicated QA lead. You will own testing across voice calls, transcripts, and system integrations, turning vague failures into actionable tickets.

You will implement regression suites, manage non-deterministic outcomes, and shape release criteria for client deployments. You should have deep classical QA experience, especially with voice/LLM systems in production, and be proficient in Python and CI workflows.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior QA Engineer
Senior QA Engineer

Vi • United States

Remote
USD 120,000 - 180,000
Senior QA Engineer - AI & Voice Pipelines | Flexible PTO
Senior QA Engineer - AI & Voice Pipelines | Flexible PTO

Steer Health • United States

Remote
USD 120,000 - 170,000
Competitive salary
Autonomy with leadership
Clear goals & metrics
+1
Senior QA Engineer
Senior QA Engineer

Steer Health • United States

Remote
USD 120,000 - 170,000
Competitive salary
Autonomy with leadership
Clear goals & metrics
+1
Senior QA Automation Engineer
Senior QA Automation Engineer

IDT • United States

Remote
USD 120,000 - 160,000
Remote work
Annual performance review
Training & conference funding
+3
Senior QA Automation Engineer, Voice AI Platform
Senior QA Automation Engineer, Voice AI Platform

QuantumLoopAI • United States

Remote
USD 90,000 - 130,000
Competitive package
Share options
CPD support
+2
Remote QA Automation Engineer - Voice AI Platform
Remote QA Automation Engineer - Voice AI Platform

QuantumLoop Technologies Ltd • United States

Remote
USD 90,000 - 130,000
Competitive package
Share options
CPD support
+2
Remote Senior QA Engineer – AI Voice, LLM & SIP Testing
Remote Senior QA Engineer – AI Voice, LLM & SIP Testing

IDT Corporation • United States

Remote
USD 120,000 - 160,000
Remote work opportunity
Senior QA Automation Engineer - AI Healthcare Platform
Senior QA Automation Engineer - AI Healthcare Platform

Linear Health, Inc. • United States

Remote
USD 120,000 - 180,000
Claude licence
Paid 90-day trial
Overlap with US Central Time
Remote Senior QA Automation Engineer - AI Voice Testing
Remote Senior QA Automation Engineer - AI Voice Testing

IDT • United States

Remote
USD 120,000 - 160,000
Remote work
Annual performance review
Training & conference funding
+3
Senior Voice QA Lead — Remote, Multilingual UAT
Senior Voice QA Lead — Remote, Multilingual UAT

Lingaro • United States

Remote
USD 100,000 - 140,000
Remote work
Workation policy
Udemy access
+2