Voice AI Quality Evaluator

Innodata Inc.; Clifton (TX); On-site; USD 28,000 - 34,000; Full time

Job summary

Innodata Inc. is seeking detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. You will interact with two AI models using the same scenario, compare responses, and provide structured evaluations based on predefined quality criteria.

Expected hourly salary range is $20-$25, based on experience and qualifications. The role requires a Bachelor's degree, strong attention to detail, and reliability in completing structured evaluation

Qualifications

• Bachelor's degree required.
• Strong attention to detail and ability to notice subtle differences in conversational quality.
• Ability to compare two interactions fairly without allowing personal preferences to influence the evaluation.
• Reliability and consistency when completing structured evaluation tasks.
• Familiarity with AI assistants, voice-based AI, or conversational systems.

Responsibilities

• Evaluate AI model performance through real-time, voice-based conversations.
• Record voice during each interaction and assess quality and behavior of model responses.
• Identify and categorize relevant error clusters in audio or conversation.
• Compare Model A and Model B and select stronger overall performer per evaluation framework.

Skills

Attention to detail

Fair evaluation

Reliability

AI/conversational familiarity

Voice evaluation

Education

Bachelor's Degree

Job description

Innodata Inc. is seeking detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. You will interact with two AI models using the same scenario, compare responses, and provide structured evaluations based on predefined quality criteria.

Expected hourly salary range is $20-$25, based on experience and qualifications. The role requires a Bachelor's degree, strong attention to detail, and reliability in completing structured evaluation