Remote Audio Speech Evaluator for AI Conversations

Innodata Inc.; Philippines; Remote; PHP 353,000 - 706,000; Full time

Job summary

Innodata Inc. is seeking experienced Audio Speech Evaluators to support an AI speech evaluation project. The role involves engaging in natural conversations with an AI bot and evaluating tone, accent, pronunciation, fluency, naturalness, and overall conversational quality.

Each task lasts about 20 minutes, and evaluators must provide accurate, objective feedback following project guidelines. This is a 100% remote freelance opportunity with a duration of 1-2 months and flexible daily hours.

Qualifications

• Must be a highly proficient English speaker.
• Ability to identify subtle differences in tone, accent, pronunciation, and conversational style.
• Comfortable participating in approximately 20-minute conversational sessions.
• Experience in audio evaluation, speech data collection, linguistic evaluation, AI/LLM evaluation, content moderation, quality assurance, or similar roles is preferred but not mandatory.

Responsibilities

• Engage in natural, conversational interactions with an AI bot across different topics and scenarios.
• Follow the provided task instructions while maintaining a natural conversational flow.
• Evaluate the AI's speech and conversational responses after completing each task.
• Assess aspects such as tone, accent, pronunciation, fluency, naturalness, clarity, pacing, and overall conversational quality.
• Provide clear and specific feedback based on the evaluation guidelines and defined rubrics.
• Complete assigned tasks within the expected turnaround time and maintain required productivity levels.

Skills

Proficient English

Tone & pace analysis

Session endurance

Job description

Innodata Inc. is seeking experienced Audio Speech Evaluators to support an AI speech evaluation project. The role involves engaging in natural conversations with an AI bot and evaluating tone, accent, pronunciation, fluency, naturalness, and overall conversational quality.

Each task lasts about 20 minutes, and evaluators must provide accurate, objective feedback following project guidelines. This is a 100% remote freelance opportunity with a duration of 1-2 months and flexible daily hours.