Audio Speech Evaluator

Innodata India; India; On-site; INR 413,000 - 827,000; Full time

Job summary

Innodata India is seeking Audio Speech Evaluator Experts for a 1-month project. You will engage in natural conversations with an AI bot in English and evaluate tone, accent, pronunciation, fluency, naturalness, clarity and overall conversational quality.

Each task lasts about 20 minutes, and you must provide objective feedback according to project guidelines. Prior experience in audio evaluation or related roles is preferred but not mandatory.

Qualifications

• High proficiency in English and near-native level
• Ability to identify subtle differences in tone, accent, pronunciation and conversational style
• Comfort with 20-minute conversational sessions and rapid task turnaround

Responsibilities

• Engage in natural, conversational interactions with an AI bot across topics and scenarios
• Follow task instructions while maintaining a natural conversational flow
• Evaluate the AI's speech and responses after each task using rubrics
• Assess tone, accent, pronunciation, fluency, naturalness, clarity, pacing and overall quality
• Provide clear, specific feedback based on evaluation guidelines
• Complete assigned tasks within the expected turnaround time and maintain productivity

Skills

Native English speaker

Analytical listening

Attention to detail

Job description

Project Details

Job Role: Audio Speech Evaluator Expert

Duration: 1 month (extendable)

Language : Near native proficiency in english

There will be 3 hour paid assessment which has to be qualified and then only you will be onboarded for the project.

We are looking for experienced Audio Speech Evaluators who are near native English to support an AI speech evaluation project. The role involves having natural, unscripted conversations with an AI bot, followed by evaluating the interaction based on tone, accent, pronunciation, fluency, naturalness, clarity, and overall conversational quality.

Each task takes approximately 20 minutes, and evaluators must provide accurate, objective, and constructive feedback based on the project guidelines.

Key Responsibilities

• Engage in natural, conversational interactions with an AI bot across different topics and scenarios.
• Follow the provided task instructions while maintaining a natural conversational flow.
• Evaluate the AI's speech and conversational responses after completing each task.
• Assess aspects such as tone, accent, pronunciation, fluency, naturalness, clarity, pacing, and overall conversational quality.
• Provide clear and specific feedback based on the evaluation guidelines and defined rubrics.
• Complete assigned tasks within the expected turnaround time and maintain required productivity levels.

Candidate Requirements

• Must be a highly proficient English speaker.
• Ability to identify subtle differences in tone, accent, pronunciation, and conversational style.
• Comfortable participating in approximately 20-minute conversational sessions.
• Prior experience in audio evaluation, speech data collection, linguistic evaluation, AI/LLM evaluation, content moderation, quality assurance, or similar roles is preferred but not mandatory, unless otherwise specified.