AI Voice Quality Analyst

Innodata Inc.; Lorida (FL); On-site; USD 28,000 - 34,000; Part time

Job summary

Innodata is seeking detail-oriented Voice Specialists to evaluate AI models through real-time, voice-based conversations. You will compare two AI models using the same scenario, ensuring consistent approach and turn counts, while recording and evaluating each interaction across predefined criteria.

The role emphasizes careful observation, structured feedback, and a final rationale selecting the stronger model based on clear evidence from both conversations. Bachelor's degree required.

Qualifications

• Bachelor's degree required.
• Excellent listening and comprehension skills.
• Strong written communication, especially for objective observations.
• Ability to follow detailed evaluation guidelines consistently.

Responsibilities

• Review an assigned scenario and roleplay conversations with two AI models.
• Conduct comparable conversations with Model A and Model B, keeping scenario and approach consistent.
• Maintain approximately the same number of turns with each model for a fair comparison.
• Record your voice during interactions and monitor model quality.
• Evaluate both models across five defined evaluation dimensions and identify error clusters.

Skills

Attention to detail

Active listening

Analytical thinking

Structured evaluation

Clear written communication

Education

Bachelor's degree

Job description

Innodata is seeking detail-oriented Voice Specialists to evaluate AI models through real-time, voice-based conversations. You will compare two AI models using the same scenario, ensuring consistent approach and turn counts, while recording and evaluating each interaction across predefined criteria.

The role emphasizes careful observation, structured feedback, and a final rationale selecting the stronger model based on clear evidence from both conversations. Bachelor's degree required.