Remote AI Response Evaluator — Flexible Hours

Outlier

Salt Lake City (UT)

Remote

USD 20,000 - 29,000

Full time

12 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible hours

Remote work

Weekly payments

Free LLM access

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a self-directed schedule. You will rate live AI voice model conversations, compare image/video pairs, and explain what went wrong in writing, with attention to adherence and realism.

Responsibilities include holding live conversations, evaluating outputs, and providing concise explanations in English. Eligible applicants from multiple countries can participate, with weekly ACH/paypal payments.

Qualifications

Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech.
Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off.
Experience writing short, evidence-based explanations or reviews.
Comfortable making a clear decision when both options have flaws.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video.
Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard.