Audio Annotator (Conversation Rating)

Perit AI (YC F26); India; On-site; INR 254,000 - 304,000; Full time

Job summary

Perit AI (YC F26) is hiring contributors to listen to conversations between a person and an AI voice agent and rate every agent turn on what was said and how it sounded, with a concise written justification.

We seek a sharp ear for American English, strong writing, and the ability to defend your judgments with specific notes. No prior experience required; training provided.

Qualifications

• Excellent listening in American English and ability to distinguish voice identity and pacing.
• Strong writing skills to justify judgments concisely.
• Ability to defend opinions with specific, short justifications.
• Willingness to work without relying on AI for all responses.

Responsibilities

• Listen to recordings of conversations between a person and an AI voice agent.
• Rate each agent turn on content and delivery, with brief written justification.

Skills

American English listening

Excellent writing

Critical thinking

Attention to detail

Job description

About Perit

Perit builds AI and ML training data for frontier labs. We work across audio, image, video, and reinforcement learning environments, producing the high-quality, human-generated datasets that the next generation of models is trained on.

The work

You listen to recorded conversations between a person and an AI voice agent, and rate every agent turn on two things what it said, and how it sounded each with a short written justification in your own words.

What we're looking for

• A good ear for American English. You notice when a voice slips: a robotic patch mid-sentence, a shift in voice identity between turns, pacing that's a beat off, stress landing on the wrong word.
• Real listening comprehension. You can follow fast, casual, overlapping speech without replaying it three times.
• Opinions you can defend. Most of this job is writing one or two sentences on why a response was weak - specifically. "It was okay" is worth nothing to us.
• Your own writing. AI-generated justifications are obvious and we reject them. This is a writing job as much as a listening one.
• The nerve to call something bad. The most common failure we see is someone noticing a problem and then giving it a generous score anyway.

Not for you if you were planning to run the task through ChatGPT, or you want something to half-watch while doing other work. The bar is high, and it's checked.

Terms

• Pay: INR 25000/month, depending on output
• Fixed Term Contract
• Commitment: 8 hours a day
• No prior experience required - we train you