Real-Time Voice AI Quality Evaluator

Innodata Inc.

Williamstown (NJ)

On-site

USD 28,000 - 34,000

Full time

7 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Innodata Inc. is seeking detail-oriented Voice Specialists to evaluate AI model performance through real-time, voice-based conversations.

You will roleplay with two models using the same scenario and provide structured evaluations based on quality criteria. Responsibilities include recording your voice during each interaction, identifying error clusters, and comparing Model A and Model B to select the strongest overall performer according to the evaluation framework.

Qualifications

Bachelor's degree required.
Strong attention to detail and ability to notice subtle differences in conversational quality.
Ability to compare two interactions fairly without personal preferences influence.
Reliability and consistency when completing structured evaluation tasks.
Familiarity with AI assistants, voice-based AI, or conversational systems.

Responsibilities

Interact with two AI models using the same assigned scenario.
Record your voice during each interaction and assess quality.
Identify and categorize relevant error clusters that may occur in the audio or conversation.
Compare the performance of Model A and Model B based on the evaluation criteria.
Select the model that demonstrated the strongest overall performance according to the evaluation framework.