Lead AI Voice Quality Evaluator

Innodata Inc.; Ohio; On-site; USD 28,000 - 34,000; Full time

Job summary

Innodata seeks a Voice Specialist to evaluate AI model performances through real-time, voice-based conversations. You will interact with two models, Model A and Model B, and provide structured evaluations across five dimensions to determine the stronger performer.

You will record sessions and document error clusters, ensuring fair, consistent comparisons. The role requires attention to detail, excellent listening and written communication skills, and the ability to follow detailed evaluation

Qualifications

• Bachelor's degree required.
• Strong listening and comprehension skills.
• Clear, objective written communication expected.

Responsibilities

• Review an assigned scenario and roleplay a natural conversation with two different AI models.
• Conduct comparable conversations with Model A and Model B, keeping the scenario consistent.
• Maintain approximately the same number of turns with each model for fair comparison.
• Record your voice during each interaction and observe model responses.
• Evaluate each model across five defined evaluation dimensions.
• Identify and categorize relevant error clusters in audio or conversation.
• Compare performance and select the stronger overall model.
• Provide a detailed rationale referencing specific observations from both conversations.
• Apply guidelines consistently across scenarios.

Skills

Detail-oriented

Active listening

Analytical thinking

Excellent communication

Education

Bachelor's Degree

Job description

Innodata seeks a Voice Specialist to evaluate AI model performances through real-time, voice-based conversations. You will interact with two models, Model A and Model B, and provide structured evaluations across five dimensions to determine the stronger performer.

You will record sessions and document error clusters, ensuring fair, consistent comparisons. The role requires attention to detail, excellent listening and written communication skills, and the ability to follow detailed evaluation