AI Voice Experience Evaluator

Innodata Inc.; Athens (GA); On-site; USD 28,000 - 34,000; Full time

Job summary

Innodata Inc. is seeking detail-oriented Voice Specialists to evaluate AI models through real-time voice conversations. You will roleplay with two models, compare responses, and document quality across five evaluation dimensions.

You will record audio, identify error clusters, and provide a structured, evidence-based recommendation on which model performs best. The role emphasizes consistent scenarios, fair turn counts, and clear written evaluations.

Qualifications

• Bachelor's degree or higher.
• Strong attention to detail and ability to notice subtle differences in conversational quality.
• Excellent listening and comprehension skills.

Responsibilities

• Evaluate two AI model conversations across five defined evaluation dimensions.
• Record voice during each interaction and assess model quality.
• Identify and categorize error clusters that may occur in audio or conversation.
• Provide a comparative evaluation and select the stronger model.
• Write a detailed rationale referencing specific observations from both conversations.

Skills

Attention to detail

Listening skills

Written communication

Critical thinking

Reliability

Fair evaluation

Education

Bachelor's degree

Job description

Innodata Inc. is seeking detail-oriented Voice Specialists to evaluate AI models through real-time voice conversations. You will roleplay with two models, compare responses, and document quality across five evaluation dimensions.

You will record audio, identify error clusters, and provide a structured, evidence-based recommendation on which model performs best. The role emphasizes consistent scenarios, fair turn counts, and clear written evaluations.