Remote AI Voice Quality Analyst

Inworld; Oregon; Hybrid; USD 28,000 - 76,000; Full time

Job summary

Inworld is seeking a focused evaluator to listen to paired or grouped speech samples and judge naturalness, expressiveness, and fidelity to instructions. You’ll score voices, label attributes, and flag mismatches to support high-quality voice synthesis and narration at scale.

You will review new voices for audio quality, test features in pre-release environments, and document clear findings for engineers. Multilingual evaluation may be required in your native language.

Qualifications

• Background in audio production, broadcast, voice acting, music, linguistics, phonetics, or similar.
• Ability to hear and describe subtle differences in prosody, timing, pronunciation, and audio quality.
• Consistent, careful judgment across large batches of similar samples.
• Comfort with beta web tools, VPN access, and spreadsheets, and willingness to troubleshoot minor access issues.
• Strong written English for reporting findings.
• Ability to turn tasks around within a day when needed, including occasional weekend availability.

Responsibilities

• Listen to paired or grouped speech samples and judge which sounds more natural, expressive, or faithful to instructions.
• Score voices against rubrics for naturalness, clarity, emotion, pacing, and delivery style.
• Label voice attributes such as perceived gender, age, accent or dialect, and tone, and flag mismatches with existing metadata.
• Judge how closely cloned voices match their source speaker.
• Review batches of new voices for audio quality and suitability before public release.
• Test new speech features in pre-release environments and report bugs, edge cases, and usability issues.
• Write clear, structured findings that engineers can act on.
• For multilingual roles: evaluate pronunciation, dialect accuracy, and naturalness in your native language.

Skills

A trained ear

Audio production

Strong written English

Fast turnaround

Job description

Inworld is seeking a focused evaluator to listen to paired or grouped speech samples and judge naturalness, expressiveness, and fidelity to instructions. You’ll score voices, label attributes, and flag mismatches to support high-quality voice synthesis and narration at scale.

You will review new voices for audio quality, test features in pre-release environments, and document clear findings for engineers. Multilingual evaluation may be required in your native language.