Voice Evaluation Engineer for Scalable Clinical AI

Concurrence Inc

New York (NY)

On-site

USD 120,000 - 170,000

Full time

43 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
Daily catered meals
Mental health support
Wellness stipend
Learning budget
Conference attendance budget
Unlimited PTO

Job summary

Concurrence in New York City and San Francisco is hiring a Software Engineer, Voice Evaluation to build the evaluation system for patient-facing voice agents. You’ll own realistic audio tests, scoring, and the release gate, ensuring only high-quality voice interactions ship to patients.

You will design simulated calls, calibrate judges against human assessments, and coordinate with clinical and product teams to define clear release criteria.

Qualifications

  • Built/evaluated evaluation or simulation for production agents at scale, preferably voice/audio.
  • Defined scoring and validated it against real behavior.
  • Able to explain what a score captures and misses with evidence.

Responsibilities

  • Build simulated callers and replay tests for the production voice path.
  • Test phone trees, queues, interruptions and escalation handling.
  • Develop scoring systems and align judges with human assessments.
  • Measure failure rates and validate simulation vs real calls.
  • Define release criteria and gate changes that fail criteria.
  • Convert production failures into regression tests and verify fixes.

Skills

Evaluation design
Simulation
Audio/voice processing
Release gating

Job description

Concurrence in New York City and San Francisco is hiring a Software Engineer, Voice Evaluation to build the evaluation system for patient-facing voice agents. You’ll own realistic audio tests, scoring, and the release gate, ensuring only high-quality voice interactions ship to patients.

You will design simulated calls, calibrate judges against human assessments, and coordinate with clinical and product teams to define clear release criteria.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Voice Evaluation Engineer — AI Medical Agents
Voice Evaluation Engineer — AI Medical Agents

Concurrence • New York (NY)

On-site
USD 220,000 - 300,000
Voice AI Evaluation Engineer - Release Gate Lead
Voice AI Evaluation Engineer - Release Gate Lead

Concurrence • San Francisco (CA)

On-site
USD 220,000 - 300,000
Health insurance
Daily catered meals
Unlimited PTO
Voice AI Research Engineer, Real-Time Clinical Speech
Voice AI Research Engineer, Real-Time Clinical Speech

Concurrence • San Francisco (CA)

On-site
USD 220,000 - 300,000
Health insurance
Daily catered lunch
Mental health support and wellness
+4
Voice AI Research Engineer — Real-Time Clinical Speech
Voice AI Research Engineer — Real-Time Clinical Speech

Concurrence • New York (NY)

On-site
USD 220,000 - 300,000
Health benefits
Lunch provided
Wellness stipend
+2
Software Engineer, Voice Evaluation [NYC or SF]
Software Engineer, Voice Evaluation [NYC or SF]

Concurrence • New York (NY)

On-site
USD 220,000 - 300,000
Remote Voice QA & AI Training Evaluator
Remote Voice QA & AI Training Evaluator

Inworld AI • United States

Remote
USD 28,000 - 76,000
Software Engineer, Voice Evaluation [NYC or SF]
Software Engineer, Voice Evaluation [NYC or SF]

Concurrence • San Francisco (CA)

On-site
USD 220,000 - 300,000
Health insurance
Daily catered meals
Unlimited PTO
Senior ML Engineer — AI Agent Evaluation & Voice Models
Senior ML Engineer — AI Agent Evaluation & Voice Models

Jobot • Austin (TX)

On-site
USD 200,000 - 300,000
Spanish Voice Actor for AI Training & Evaluation
Spanish Voice Actor for AI Training & Evaluation

Agency • United States

Remote
USD 21,000 - 39,000
ML Engineer: Voice Models & Evaluation Architect
ML Engineer: Voice Models & Evaluation Architect

Aircall.io, Inc. • San Francisco (CA)

On-site
USD 181,000 - 250,000
Competitive salary package
Growth opportunities