AI Trainer (Contractor), Voice and Speech Evaluation - USA

Inworld, Inc.; Mountain View (CA); Hybrid; USD 28,000 - 76,000; Part time

Job summary

Inworld, Inc. is seeking an AI Trainer (Contractor) for Voice and Speech Evaluation in the USA. You will listen to speech samples, judge naturalness and fidelity, and provide structured findings for engineers.

This remote role offers flexible hours and an hourly rate depending on region and language specialty. The ideal candidate has a trained ear in audio production or linguistics, strong written English, and the ability to turn around tasks quickly, including occasional weekend availability.

Qualifications

• A trained ear.
• Ability to hear and describe subtle differences in prosody, timing, pronunciation, and audio quality
• Consistent, careful judgment across large batches of similar samples
• Comfort with beta web tools, VPN access, and spreadsheets, and willingness to troubleshoot minor access issues
• Strong written English for reporting findings
• Ability to turn tasks around within a day when needed, including occasional weekend availability

Responsibilities

• Listen to paired or grouped speech samples and judge which sounds more natural, expressive, or faithful to instructions
• Score voices against rubrics for naturalness, clarity, emotion, pacing, and delivery style
• Label voice attributes such as perceived gender, age, accent or dialect, and tone, and flag mismatches with existing metadata
• Judge how closely cloned voices match their source speaker
• Review batches of new voices for audio quality and suitability before public release
• Test new speech features in pre-release environments and report bugs, edge cases, and usability issues
• Write clear, structured findings that engineers can act on
• For multilingual roles: evaluate pronunciation, dialect accuracy, and naturalness in your native language

Skills

Audio evaluation

Prosody analysis

Voice quality assessment

Attention to detail

Tools

VPN access

Spreadsheets

Job description

Introducing Inworld Inference, built for consumer AI.

Nearly 8× faster time to first token than most other providers.

AI Trainer (Contractor), Voice and Speech Evaluation - USA

Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads.

Hundreds of millions of users interact with Inworld powered apps every day and we serve over 10 trillion LLM tokens per month. Our models and infrastructure support consumer applications across companions, healthcare, fitness, education, media, and more. Our work spans model research, realtime inference, large-scale serving infrastructure, and the APIs developers use to bring these capabilities into production.

We’ve raised more than $125M from Lightspeed Venture Partners, Section 32, Kleiner Perkins, Microsoft’s M12 venture fund, Founders Fund, Meta, Stanford, and others. Our technology has powered experiences from companies including NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs, Wishroll, Little Umbrella, and Bible Chat. Inworld has also been recognized by CB Insights as one of the 100 most promising AI companies globally and named one of LinkedIn’s Top 10 Startups in the USA.

What you'll do

Listen to paired or grouped speech samples and judge which sounds more natural, expressive, or faithful to instructions

Score voices against rubrics for naturalness, clarity, emotion, pacing, and delivery style

Label voice attributes such as perceived gender, age, accent or dialect, and tone, and flag mismatches with existing metadata

Judge how closely cloned voices match their source speaker

Review batches of new voices for audio quality and suitability before public release

Test new speech features in pre-release environments and report bugs, edge cases, and usability issues

Write clear, structured findings that engineers can act on

For multilingual roles: evaluate pronunciation, dialect accuracy, and naturalness in your native language

What we're looking for

A trained ear. Background in audio production, broadcast, voice acting, music, linguistics, phonetics, or similar

Ability to hear and describe subtle differences in prosody, timing, pronunciation, and audio quality

Consistent, careful judgment across large batches of similar samples

Comfort with beta web tools, VPN access, and spreadsheets, and willingness to troubleshoot minor access issues

Strong written English for reporting findings

Ability to turn tasks around within a day when needed, including occasional weekend availability

Nice to have

Native or near-native fluency in Hindi, Tamil, Telugu, Bengali, Marathi, Brazilian Portuguese, or a regional Spanish dialect

Experience with TTS, voice AI, dubbing, or localization QA

Familiarity with A/B evaluation or annotation work

Location: Remote within the United States.

Compensation: $20-$55 per hour. Rate depends on region and language specialty.