Remote AI Media Evaluator: Spot What AI Gets Wrong

Outlier; Las Cruces (NM); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Weekly payments

Remote work

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will conduct live conversations with AI voice models, compare image and video outputs, and explain what looked off, remotely and on your own schedule.

You'll rate adherence, quality, and realism, then provide concise explanations in writing. Enjoy flexible hours, weekly payments, and free access to leading LLMs while helping AI systems improve.

Qualifications

• Fluent English with clear written communication and comfort with everyday conversational speech.
• Strong attention to detail, ability to replay or zoom in when something seems off.
• Nice to have: Pursuing or holding a Bachelor's degree or above.
• Able to think on your feet and discuss realistic situations naturally.
• Experience writing concise, evidence-based explanations or reviews.
• Comfortable making a clear decision when options have flaws.
• Currently accepting applicants from: Australia, Canada, Ireland, United Kingdom, United States.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
• Rating outputs across dimensions like adherence, quality, and realism, then writing a specific English explanation of what was seen or heard.

Skills

Fluent English

Attention to detail

Decision making

Explanations writing

Verbal communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will conduct live conversations with AI voice models, compare image and video outputs, and explain what looked off, remotely and on your own schedule.

You'll rate adherence, quality, and realism, then provide concise explanations in writing. Enjoy flexible hours, weekly payments, and free access to leading LLMs while helping AI systems improve.