Audio Conversation Rater (Fixed Contract)

Perit AI; United States; Remote; USD 2,900 - 3,300; Full time

Benefits offered by this job

Remote work

Flexible schedule

Job summary

Perit AI is seeking detail-oriented evaluators to listen to recorded conversations between a person and an AI voice agent. You will rate each turn for content and delivery, and write concise justifications in your own words. This is a fixed-term, fully remote writing-focused role with eight-hour shifts.

Ideal candidates have a sharp ear for American English, excellent writing skills, and can defend their judgments. Prior experience is not required, as training is provided.

Qualifications

• Good ear for American English and ability to notice speech issues.

Responsibilities

• Listen to recorded conversations between a person and an AI voice agent.
• Rate each agent turn on what was said and how it sounded.
• Write a short justification for each rating in your own words.

Skills

Listening

English fluency

Writing

Job description

Perit builds AI and ML training data for frontier labs. We work across audio, image, video, and reinforcement learning environments, producing the high-quality, human-generated datasets that the next generation of models is trained on. You listen to recorded conversations between a person and an AI voice agent, and rate every agent turn on two things — what it said, and how it sounded — each with a short written justification in your own words. Not for you if you were planning to run the task through ChatGPT, or you want something to half-watch while doing other work. The bar is high, and it's checked.

What you'll be doing

• Listening to recorded conversations between a person and an AI voice agent.
• Rating every agent turn on what it said and on how it sounded.
• Writing a short justification for each rating, in your own words.
• Calling a weak response weak — the most common failure is noticing a problem and scoring it generously anyway.

What you'll need

A good ear for American English. You notice when a voice slips: a robotic patch mid-sentence, a shift in voice identity between turns, pacing that's a beat off, stress landing on the wrong word. Real listening comprehension. You can follow fast, casual, overlapping speech without replaying it three times. Opinions you can defend. Most of this job is writing one or two sentences on why a response was weak — specifically. 'It was okay' is worth nothing to us. Your own writing. AI-generated justifications are obvious and we reject them. This is a writing job as much as a listening one. No prior experience required — we train you. Eight hours a day on a fixed-term contract.

Pay

₹25,000 a month, depending on output. Fixed-term contract, eight hours a day, fully remote.

Listed rate: $260/month.

Perit is a Y Combinator-backed speech-data company. Work is remote;