Remote AI Rater — Spot Flaws & Earn Flexible Pay

Outlier; Harrisburg (Dauphin County); Hybrid; USD 12,000 - 21,000; Part time

Benefits offered by this job

Weekly payments

Flexible hours

Free LLM access

Remote work

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked or sounded wrong in writing.

Your work helps advance frontier AI research and real-world performance. Additional incentives include free access to leading LLMs and the chance to earn weekly compensation.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to explain observations clearly.
• Ability to think logically and make decisions when presented with imperfect information.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking how natural, useful, and clear each one sounds.
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video.
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard.
• Common tasks include image evaluations, video evaluations, video caption labeling, and audio/voice evaluations.

Skills

Fluent English

Strong written communication

Attention to detail

Clear decision-making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked or sounded wrong in writing.

Your work helps advance frontier AI research and real-world performance. Additional incentives include free access to leading LLMs and the chance to earn weekly compensation.