AI Voice Quality Evaluator

Innodata Inc.; Indiana (PA); On-site; USD 28,000 - 37,000; Full time

Job summary

Innodata Inc. seeks detail-oriented Voice Specialists to evaluate AI models via real-time, voice-based conversations. You will compare two models using the same scenario, maintain similar turn counts, and record your voice during each interaction.

You will evaluate across five defined dimensions, identify error clusters, and draft a rationale favoring the stronger overall performance. The role requires a Bachelor’s degree, sharp listening skills, and clear, objective communication.

Qualifications

• Bachelor's degree required.
• Strong listening and comprehension skills.
• Excellent written communication to explain observations clearly.

Responsibilities

• Review assigned scenarios and roleplay conversations with two AI models.
• Conduct comparable conversations with Model A and Model B maintaining consistency.
• Record voice during interactions and assess model responses across five evaluation dimensions.
• Identify error clusters and provide a structured evaluation rationale comparing models.

Skills

Attention to detail

Active listening

Written communication

Critical thinking

Evaluation skills

Education

Bachelor's degree

Job description

Innodata Inc. seeks detail-oriented Voice Specialists to evaluate AI models via real-time, voice-based conversations. You will compare two models using the same scenario, maintain similar turn counts, and record your voice during each interaction.

You will evaluate across five defined dimensions, identify error clusters, and draft a rationale favoring the stronger overall performance. The role requires a Bachelor’s degree, sharp listening skills, and clear, objective communication.