Remote AI Voice Evaluation Specialist (3-Month Contract)

Innodata Inc.; United States; À distance; USD 28 000 - 34 000; Plein temps

Résumé du poste

Innodata Inc. in the United States is seeking a detail-oriented Voice Specialist for a 3-month W2 contract to evaluate AI model performance through real-time voice conversations.

You will compare two AI models across defined evaluation dimensions, roleplay scenarios, and produce structured assessments with a final model recommendation. Strong listening, articulation, and objective reporting are essential.

Qualifications

• Attention to detail is essential for evaluating nuanced model responses.
• Strong listening skills to accurately assess conversations.
• Clear, objective written reports documenting observations.
• Ability to follow structured evaluation guidelines consistently.

Responsabilités

• Review an assigned scenario and roleplay with two AI models.
• Conduct comparable conversations with Model A and Model B.
• Maintain similar turn counts for a fair evaluation.
• Record voice during each interaction and assess model behavior.
• Evaluate across five defined evaluation dimensions.
• Identify and categorize error clusters in audio or conversation.
• Compare performances and select the stronger model.
• Provide a detailed rationale referencing observed examples.
• Apply guidelines consistently across scenarios.

Connaissances

Attention to detail

Listening skills

Written communication

Evaluation guidelines

Description du poste

Innodata Inc. in the United States is seeking a detail-oriented Voice Specialist for a 3-month W2 contract to evaluate AI model performance through real-time voice conversations.

You will compare two AI models across defined evaluation dimensions, roleplay scenarios, and produce structured assessments with a final model recommendation. Strong listening, articulation, and objective reporting are essential.