Voice AI QA & Performance Analyst

US Health Partners, LLC; San Francisco (CA); On-site; USD 65,000 - 110,000; Full time

Job summary

Veritus Agent builds AI agents for borrower communication across the consumer lending lifecycle. This role sits at the intersection of testing, QA, and performance analytics.

You’ll help ensure our agents are ready for launch, monitor how they perform in production, and use both individual call reviews and aggregate call data to identify opportunities to improve performance for our clients. Responsibilities include conducting structured UAT on voice agents before launch, testing scripted and

Qualifications

• 2–4 years of QA, quality analyst, operations analyst, or similar experience in a voice-based environment.
• Familiarity with US consumer lending laws such as FDCPA, TCPA, ECOA, and SCRA.
• Strong attention to detail and ability to follow structured test plans and scorecards.
• Comfortable working with quantitative data and basic statistics to identify trends.
• Experience with spreadsheets or data analysis tools to analyze data.
• Ability to turn findings into clear conclusions and recommendations.
• Clear written English for defect reports and client-facing performance summaries.
• Comfortable giving and receiving detailed feedback on quality issues.

Responsibilities

• Conduct structured UAT on AI voice agents prior to client launch; document defects with steps.
• Test across scripted and adversarial scenarios to confirm agent behavior before go-live.
• Monitor ongoing live agent performance across deployments using QA scores.
• Listen to live calls and grade for accuracy, compliance, and tone.
• Analyze call data to identify trends, failures, and improvement opportunities.
• Track performance metrics over time and investigate anomalies in agent behavior.
• Prepare quarterly client performance reports with quantitative analysis and call reviews.
• Translate call data into actionable recommendations for clients and internal teams.
• Flag systemic issues to customer success and engineering teams.
• Maintain clear documentation of test results, call grades, and findings in tracking tools.

Skills

QA testing

Data analysis

Documentation

Communication

Education

BS degree or equivalent

Tools

Spreadsheets

SQL

BI tools

Job description

Veritus Agent builds AI agents for borrower communication across the consumer lending lifecycle. This role sits at the intersection of testing, QA, and performance analytics.

You’ll help ensure our agents are ready for launch, monitor how they perform in production, and use both individual call reviews and aggregate call data to identify opportunities to improve performance for our clients. Responsibilities include conducting structured UAT on voice agents before launch, testing scripted and