Voice AI Quality Assessor – Contract

Innodatainc

United States

Remote

USD 28,000 - 34,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Innodata is seeking a detail-oriented Voice Specialist for a 3-month, W2, full-time contract to evaluate AI model conversations in real time. You will compare two models using the same scenario, record your voice, and rate performance across five evaluation dimensions.

The role requires a Bachelor’s Degree and strong listening, comprehension, and written communication skills. You will follow strict evaluation guidelines and document observations to ensure a fair, consistent comparison and

Qualifications

  • Bachelor's Degree required.
  • Strong attention to detail and ability to notice subtle differences in conversational quality.
  • Excellent listening and comprehension skills.
  • Strong written communication skills, especially in documenting observations objectively.
  • Ability to follow detailed evaluation guidelines meticulously.

Responsibilities

  • Review an assigned scenario and roleplay a natural conversation with two different AI models.
  • Conduct comparable conversations with Model A and Model B, keeping the scenario and approach consistent.
  • Maintain approximately the same number of turns with each model for a fair comparison.
  • Record your voice during each interaction and evaluate model responses across five defined dimensions.
  • Identify and categorize error clusters that may occur in audio or conversation.
  • Compare model performances and select the stronger one based on evaluation criteria.
  • Write a detailed rationale referencing specific observations from both conversations.
  • Apply guidelines consistently across scenarios and model interactions.

Education

Bachelor's Degree

Job description

Innodata is seeking a detail-oriented Voice Specialist for a 3-month, W2, full-time contract to evaluate AI model conversations in real time. You will compare two models using the same scenario, record your voice, and rate performance across five evaluation dimensions.

The role requires a Bachelor’s Degree and strong listening, comprehension, and written communication skills. You will follow strict evaluation guidelines and document observations to ensure a fair, consistent comparison and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Voice AI Quality Analyst
Voice AI Quality Analyst

Innodata Inc. • Delaware

On-site
USD 28,000 - 37,000
Voice AI Quality Evaluator
Voice AI Quality Evaluator

Innodata • United States

Remote
USD 28,000 - 34,000
Voice AI Quality Evaluator
Voice AI Quality Evaluator

Innodata Inc. • Massachusetts

On-site
USD 28,000 - 37,000
AI Voice Quality Evaluator
AI Voice Quality Evaluator

Innodata Inc. • Indiana (PA)

On-site
USD 28,000 - 37,000
AI Voice Quality Evaluator
AI Voice Quality Evaluator

Innodata Inc. • New York (NY)

On-site
USD 28,000 - 37,000
Conversational AI Voice Evaluation Analyst
Conversational AI Voice Evaluation Analyst

Innodata • United States

Remote
USD 28,000 - 34,000
Remote AI Voice Evaluation Specialist (3-Month Contract)
Remote AI Voice Evaluation Specialist (3-Month Contract)

Innodata Inc. • United States

Remote
USD 28,000 - 34,000
Voice AI Quality Evaluator
Voice AI Quality Evaluator

Innodata Inc. • Arkansas

On-site
USD 28,000 - 37,000
Remote Contract: AI Voice Evaluation Specialist
Remote Contract: AI Voice Evaluation Specialist

Innodata • California

Hybrid
USD 19,000 - 24,000
AI Voice Evaluation Analyst
AI Voice Evaluation Analyst

Innodata Inc. • Alaska

On-site
USD 28,000 - 37,000