Remote AI Media Evaluator: Judge Image & Video Quality

Outlier; Portland (ME); Remote; USD 12,000 - 21,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model and score each exchange, compare generated images and videos to judge adherence to prompts, and explain what looked or sounded wrong, remotely and on your schedule.

Work from home with flexible hours and weekly payments. Earn up to $15 USD/hr and gain access to leading LLMs for free. Your work helps shape AI systems for real-world performance.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and careful reviewing.
• Experience writing concise, evidence-based explanations is a plus.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distortions, flickering, or mismatched audio.
• Rating each output across dimensions like adherence, quality, and realism, and writing a clear English explanation.

Skills

Fluent English

Attention to detail

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model and score each exchange, compare generated images and videos to judge adherence to prompts, and explain what looked or sounded wrong, remotely and on your schedule.

Work from home with flexible hours and weekly payments. Earn up to $15 USD/hr and gain access to leading LLMs for free. Your work helps shape AI systems for real-world performance.