Remote AI Evaluator: Spot AI Errors & Rate Outputs

Outlier

Flagstaff (AZ)

Remote

USD 17,000 - 24,000

Full time

32 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Free access to leading LLMs

Flexible, remote work schedule

Weekly payment options (ACH/PayPal/Air

Job summary

Outlier is seeking detail-oriented reviewers to assess AI-generated media via live conversations with AI voice models. You will compare image/video pairs, explain what’s off, and work remotely on your own schedule.

Ideal candidates are fluent in English, with strong written communication and a sharp eye for detail. A Bachelor's degree or higher is a plus; flexible, freelance-like engagement with weekly payments is provided.

Qualifications

Fluent English with strong written communication.
Excellent attention to detail and careful listening skills.
Comfortable thinking on your feet and describing decisions clearly.
Experience writing short, evidence-based explanations or reviews.
Bachelor's degree or higher is nice to have.

Responsibilities

Holding live, scenario-based conversations in English with AI voice models.
Ranking naturalness and usefulness of outputs and explaining judgments in writing.
Comparing AI-generated images and videos and judging adherence to prompts.
Inspecting outputs closely to spot distortions, flickering, misalignment or audio-video mismatches.
Rating outputs across dimensions and providing a concise English rationale.