Remote Contract: AI Voice Evaluation Specialist

Innodata

California

Hybrid

USD 19,000 - 24,000

Full time

37 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Innodata is seeking detail-oriented Voice Specialists to evaluate AI model performance through real-time, voice-based conversations. You will interact with two AI models using the same assigned scenario and provide structured evaluations across five criteria.

The role is a 3-month, full-time contract (40 hours per week) with remote work from Canada. You will record your voice, compare Model A and Model B, and identify error clusters to guide improvements.

Qualifications

  • Strong attention to detail and ability to notice subtle differences in conversational quality.
  • Excellent listening and comprehension skills.
  • Clear and objective written communication of observations.
  • Ability to follow detailed evaluation guidelines consistently.

Responsibilities

  • Review an assigned scenario and roleplay a natural conversation with two different AI models.
  • Conduct comparable conversations with Model A and Model B, keeping the scenario and approach consistent.
  • Maintain similar number of turns with each model to support fairness.
  • Record your voice during interactions and assess model responses for quality.
  • Evaluate across five defined evaluation dimensions and identify error clusters.
  • Compare performances and select the stronger model.
  • Write a detailed rationale referencing observations from both conversations.
  • Apply guidelines consistently across different scenarios.

Skills

Attention to detail
Active listening
Written communication
Analytical thinking

Job description

Innodata is seeking detail-oriented Voice Specialists to evaluate AI model performance through real-time, voice-based conversations. You will interact with two AI models using the same assigned scenario and provide structured evaluations across five criteria.

The role is a 3-month, full-time contract (40 hours per week) with remote work from Canada. You will record your voice, compare Model A and Model B, and identify error clusters to guide improvements.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Voice Evaluation Specialist (3-Month Contract)
Remote AI Voice Evaluation Specialist (3-Month Contract)

Innodata Inc. • United States

Remote
USD 28,000 - 34,000
Remote Voice AI Evaluation Specialist
Remote Voice AI Evaluation Specialist

Innodata • Florida

Hybrid
USD 28,000 - 34,000
Conversational AI Voice Evaluation Analyst
Conversational AI Voice Evaluation Analyst

Innodata • United States

Remote
USD 28,000 - 34,000
Elite AI Voice Evaluation Specialist
Elite AI Voice Evaluation Specialist

Innodata Inc. • New Hampshire

On-site
USD 28,000 - 37,000
AI Voice Evaluation Analyst
AI Voice Evaluation Analyst

Innodata Inc. • Alaska

On-site
USD 28,000 - 37,000
AI Voice Evaluation Specialist - 3 month contract
AI Voice Evaluation Specialist - 3 month contract

Innodata Inc. • United States

Remote
USD 28,000 - 34,000
Voice AI Quality Assessor – Contract
Voice AI Quality Assessor – Contract

Innodatainc • United States

Remote
USD 28,000 - 34,000
AI Voice Evaluation Specialist - 3 month contract
AI Voice Evaluation Specialist - 3 month contract

Innodata • United States

Remote
USD 28,000 - 34,000
AI Voice Evaluation Analyst — Real-Time Model Compare
AI Voice Evaluation Analyst — Real-Time Model Compare

Innodata Inc. • New Jersey

On-site
USD 28,000 - 37,000
Remote AI Voice Evaluation Specialist - 3-Month Contract
Remote AI Voice Evaluation Specialist - 3-Month Contract

Inquigent Ltd. • United States

Remote
USD 28,000 - 34,000