Remote AI Media Evaluator: Spot Errors & Rate Outputs

Outlier; Bloomington (IN); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments

Free access to leading LLMs

Missions with surge incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason and learn. You’ll rate outputs, write explanations in English, and contribute to improving real-world AI performance. Remote, freelance arrangement with weekly payments and access to leading LLMs.

Qualifications

• Fluent English speaker with strong written communication.
• High attention to detail and ability to replay or zoom in to spot issues.
• Experience writing concise, evidence-based explanations or reviews.
• Comfortable thinking on your feet and explaining realistic scenarios.
• Able to decide clearly when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural and useful each sounded.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or misaligned audio.
• Rating each output across dimensions like adherence, quality, and realism, then writing a brief explanation in English.
• Documenting findings and providing concise, evidence-based feedback.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based writing

Decision making with flaws

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason and learn. You’ll rate outputs, write explanations in English, and contribute to improving real-world AI performance. Remote, freelance arrangement with weekly payments and access to leading LLMs.