Voice AI Evaluator: Compare, Rate & Refine Models

Innodata Inc.; South Carolina; On-site; USD 28,000 - 37,000; Full time

Job summary

Innodata Inc. in the United States seeks a detail-oriented Voice Specialist to evaluate AI model conversations in real time, comparing two models (A and B) using the same scenario and criteria.

You will record the interactions, keep similar turn counts, identify error clusters, and write a reasoned rationale for the stronger model. A Bachelor's degree and sharp listening and written communication skills are required, with disciplined, objective evaluation.

Qualifications

• Bachelor's degree required.
• Excellent listening and comprehension skills.
• Ability to follow detailed evaluation guidelines.

Responsibilities

• Review scenarios and roleplay conversations with two AI models.
• Conduct comparable conversations with Model A and Model B.
• Maintain similar number of turns for fair comparison.
• Record voice and evaluate model responses across five dimensions.
• Identify error clusters and provide rationale for preferred model.

Skills

Attention to detail

Listening skills

Written communication

Critical thinking

Objective evaluation

Education

Bachelor's degree

Job description

Innodata Inc. in the United States seeks a detail-oriented Voice Specialist to evaluate AI model conversations in real time, comparing two models (A and B) using the same scenario and criteria.

You will record the interactions, keep similar turn counts, identify error clusters, and write a reasoned rationale for the stronger model. A Bachelor's degree and sharp listening and written communication skills are required, with disciplined, objective evaluation.