Remote Voice QA & AI Training Evaluator

Inworld AI; United States; Remote; USD 28,000 - 76,000; Full time

Job summary

Inworld AI is seeking a voice evaluation specialist who will listen to paired or grouped speech samples, judge naturalness and accuracy, and help refine voices for real-time applications. This role is remote within the United States and involves structured reporting to engineering teams.

You will evaluate pronunciation, prosody, and timing, and contribute to localization efforts. A trained ear from audio production, linguistics, or related fields and strong written English are essential, with

Qualifications

• Background in audio production, broadcast, voice acting, linguistics, or phonetics.
• Ability to hear subtle differences in prosody, timing, pronunciation, and audio quality.
• Consistent, careful judgment across large batches of similar samples.
• Comfort with beta web tools, VPN access, and spreadsheets, and willingness to troubleshoot minor access issues.
• Strong written English for reporting findings.
• Ability to turn tasks around within a day when needed, including occasional weekend availability.

Responsibilities

• Listen to paired or grouped speech samples and judge which sounds more natural, expressive, or faithful to instructions
• Score voices against rubrics for naturalness, clarity, emotion, pacing, and delivery style
• Label voice attributes such as perceived gender, age, accent or dialect, and tone, and flag mismatches with existing metadata
• Judge how closely cloned voices match their source speaker
• Review batches of new voices for audio quality and suitability before public release
• Test new speech features in pre-release environments and report bugs, edge cases, and usability issues
• Write clear, structured findings that engineers can act on
• For multilingual roles: evaluate pronunciation, dialect accuracy, and naturalness in your native language

Skills

Trained ear

Audio production

English writing

Fast turnarounds

Tools

VPN access

Spreadsheets

Job description

Inworld AI is seeking a voice evaluation specialist who will listen to paired or grouped speech samples, judge naturalness and accuracy, and help refine voices for real-time applications. This role is remote within the United States and involves structured reporting to engineering teams.

You will evaluate pronunciation, prosody, and timing, and contribute to localization efforts. A trained ear from audio production, linguistics, or related fields and strong written English are essential, with