Voice AI Evaluation & Model Comparison Specialist

Innodata Inc.; Maryland; On-site; USD 28,000 - 37,000; Full time

Job summary

Innodata Inc. in the United States seeks a detail-oriented Voice Specialist to evaluate AI models through real-time, voice-based conversations. You will roleplay with two different AI models, compare responses, and deliver structured evaluations across five dimensions.

You will record your voice during interactions, maintain consistent turn counts, identify error clusters, and write a detailed rationale comparing Model A and Model B. Bachelor’s degree required; hourly compensation $20–$27.

Qualifications

• Detail-oriented with strong listening and comprehension skills.
• Excellent written communication and objective observation abilities.
• Ability to follow detailed evaluation guidelines consistently.
• Familiarity with AI assistants, voice-based AI, or conversational systems is a plus.

Responsibilities

• Review an assigned scenario and roleplay a natural conversation with two different AI models.
• Conduct comparable conversations with Model A and Model B, keeping the scenario and approach consistent.
• Maintain similar number of conversational turns to support a fair comparison.
• Record your voice during each interaction and observe model responses for quality and behavior.
• Evaluate each model across five defined evaluation dimensions.
• Identify and categorize relevant error clusters in the audio or conversation.
• Compare model performances and select the stronger overall option.
• Write a detailed rationale referencing observations from both conversations.

Skills

Attention to detail

Active listening

Written communication

Critical thinking

Evaluation guidelines

Education

Bachelor's degree

Job description

Innodata Inc. in the United States seeks a detail-oriented Voice Specialist to evaluate AI models through real-time, voice-based conversations. You will roleplay with two different AI models, compare responses, and deliver structured evaluations across five dimensions.

You will record your voice during interactions, maintain consistent turn counts, identify error clusters, and write a detailed rationale comparing Model A and Model B. Bachelor’s degree required; hourly compensation $20–$27.