QA Engineer, Voice AI Agents

Ladders; United States; Remote; USD 180,000 - 200,000; Full time

Benefits offered by this job

PTO

Health/Dental/Vision insurance

Life & Disability Insurance

IRA Matching

Dev Budget for Training

Wellness Programs

Job summary

Ladders is seeking a QA Engineer for Voice AI Agents to join a leader in healthcare. This remote role focuses on ensuring the quality of live voice-based AI interactions, investigating issues across call flows, transcripts, and data handling, and collaborating with technical teams to improve production performance. Location: Remote.

Compensation: $180,000–$200,000 annually. You will build and maintain the QA framework, run pre-launch and ongoing QA on campaigns, write bug reports, and prioritize

Qualifications

• 3 to 5 years in QA, support engineering, or technical operations on a production software platform.
• Strong debugging skills with a focus on root cause analysis.
• Proficient in reading logs, querying data with SQL, and working with APIs and JSON/YAML.
• Experience writing trusted test plans and bug reports.
• Excellent written communication and documentation skills.
• Good judgment in prioritizing multiple live issues.

Responsibilities

• Investigate and debug issues on live campaigns, including call failures and data mismatches.
• Trace problems through call recordings, transcripts, and system logs to identify root causes.
• Write clear bug reports for engineers, detailing severity and member impact.
• Triage incoming issues, distinguishing between agent behavior and configuration errors.
• Run pre-launch QA on new campaigns, testing scripts and edge cases.
• Conduct ongoing conversation QA on live campaigns to maintain quality standards.
• Help build and maintain the QA framework, including test cases and regression suites.

Skills

QA & debugging

SQL

APIs & JSON

Bug reporting

Documentation

Job description

For our client, we are seeking a QA Engineer, Voice AI Agents to join the team of a leader in the Healthcare space.

This role focuses on ensuring the quality and reliability of live voice-based AI interactions in a healthcare environment. You will investigate issues across call flows, conversation outputs, and data handling, working closely with technical teams to identify root causes and improve production performance. The position combines hands-on debugging, thoughtful QA execution, and ongoing support for new and live campaigns.

Location: Remote

Compensation: $180,000 – $200,000 annually

Responsibilities

• Investigate and debug issues on live campaigns, including call failures and data mismatches.
• Trace problems through call recordings, transcripts, and system logs to identify root causes.
• Write clear bug reports for engineers, detailing severity and member impact.
• Triage incoming issues, distinguishing between agent behavior and configuration errors.
• Run pre-launch QA on new campaigns, testing scripts and edge cases.
• Conduct ongoing conversation QA on live campaigns to maintain quality standards.
• Help build and maintain the QA framework, including test cases and regression suites.

Qualifications

• 3 to 5 years in QA, support engineering, or technical operations on a production software platform.
• Strong debugging skills with a focus on root cause analysis.
• Proficient in reading logs, querying data with SQL, and working with APIs and JSON/YAML.
• Experience writing trusted test plans and bug reports.
• Excellent written communication and documentation skills.
• Good judgment in prioritizing multiple live issues.

Benefits

• Generous Paid Time Off (PTO) for work-life balance.
• Comprehensive Health, Vision, and Dental Insurance for you and your family.
• Life and Disability Insurance for financial security.
• Simple IRA Matching to support long-term financial goals.
• Professional Development Budget for continuous learning opportunities.
• Wellness Programs to support physical and mental health.

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.