Remote AI Media Evaluator: Spot Issues & Explain

Outlier; Charlottesville (VA); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Up to $15/hr

Free access to leading LLMs

Job summary

Outlier offers a remote contracting role where you will review AI-generated media, hold live conversations with AI voice models, and assess how well outputs follow prompts. You will compare images and videos, explain discrepancies in writing, and work on a flexible schedule from anywhere.

Paid weekly and with access to AI tools. Ideal candidates are fluent in English, detail-oriented, and able to justify assessments with concise explanations.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Strong attention to detail and careful analysis of outputs.
• Usually pursuing or holding a Bachelor's degree or above.
• Able to think on your feet and discuss realistic scenarios clearly.
• Experience writing concise, evidence-based explanations or reviews.
• Capable of making clear decisions when both options have flaws.

Responsibilities

• Holding live conversations in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot distortions, flickering, or misalignments.
• Providing written explanations of what was observed, in English.
• Engaging in image/video evaluation tasks and caption labeling as described by the tasks.
• Reviewing audio and voice evaluations for naturalness and alignment with prompts.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based explanations

Decision making under ambiguity

Education

Bachelor's degree or higher

Job description

Outlier offers a remote contracting role where you will review AI-generated media, hold live conversations with AI voice models, and assess how well outputs follow prompts. You will compare images and videos, explain discrepancies in writing, and work on a flexible schedule from anywhere.

Paid weekly and with access to AI tools. Ideal candidates are fluent in English, detail-oriented, and able to justify assessments with concise explanations.