Remote Voice AI Evaluation Specialist

Innodata

Florida

Hybrid

USD 28,000 - 34,000

Full time

13 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Innodata is seeking a detail-oriented Voice Specialist to evaluate AI models through real-time, voice-based conversations. You will interact with two different AI models, compare their performance, and provide structured evaluations across five criteria.

The role focuses on fairness of comparison, recording and analyzing voice interactions, and delivering a detailed rationale for the final model preference. Remote with flexible hours and appropriate compensation.

Responsibilities

  • Review an assigned scenario and roleplay a natural conversation with two different AI models.
  • Conduct comparable conversations with Model A and Model B, keeping the scenario and approach consistent.
  • Maintain approximately the same number of conversational turns for each model.
  • Record your voice during each interaction and evaluate model responses for quality and behavior.
  • Evaluate each model across five defined evaluation dimensions.
  • Identify and categorize relevant error clusters that may occur in audio or conversation.
  • Compare Model A and Model B and select the stronger overall performer based on the evaluation framework.
  • Write a detailed rationale referencing specific examples from both conversations.

Job description

Innodata is seeking a detail-oriented Voice Specialist to evaluate AI models through real-time, voice-based conversations. You will interact with two different AI models, compare their performance, and provide structured evaluations across five criteria.

The role focuses on fairness of comparison, recording and analyzing voice interactions, and delivering a detailed rationale for the final model preference. Remote with flexible hours and appropriate compensation.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Elite AI Voice Evaluation Specialist
Elite AI Voice Evaluation Specialist

Innodata Inc. • New Hampshire

On-site
USD 28,000 - 37,000
AI Voice Evaluation Analyst
AI Voice Evaluation Analyst

Innodata Inc. • Alaska

On-site
USD 28,000 - 37,000
AI Voice Evaluation Analyst — Real-Time Model Compare
AI Voice Evaluation Analyst — Real-Time Model Compare

Innodata Inc. • New Jersey

On-site
USD 28,000 - 37,000
Remote Contract: AI Voice Evaluation Specialist
Remote Contract: AI Voice Evaluation Specialist

Innodata • California

Hybrid
USD 19,000 - 24,000
Voice AI Quality Analyst
Voice AI Quality Analyst

Innodata Inc. • Delaware

On-site
USD 28,000 - 37,000
AI Voice Quality Evaluator
AI Voice Quality Evaluator

Innodata Inc. • New York (NY)

On-site
USD 28,000 - 37,000
Conversational AI Voice Evaluation Analyst
Conversational AI Voice Evaluation Analyst

Innodata • United States

Remote
USD 28,000 - 34,000
AI Voice Evaluation Specialist
AI Voice Evaluation Specialist

Innodata Inc. • Indiana (PA)

On-site
USD 28,000 - 37,000
AI Voice Evaluation Specialist
AI Voice Evaluation Specialist

Innodata Inc. • Arkansas

On-site
USD 28,000 - 37,000
Remote AI Voice Evaluation Specialist (3-Month Contract)
Remote AI Voice Evaluation Specialist (3-Month Contract)

Innodata Inc. • United States

Remote
USD 28,000 - 34,000