Remote AI Media Evaluator — Live Conversational QA

Outlier; Santa Ana (CA); Hybrid; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Weekly pay

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely on your own schedule.

You’ll rate outputs for naturalness and adherence, describe what you saw in clear English, and help improve how AI systems reason in real-world tasks. This is freelance with flexible hours and weekly payments.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to replay or zoom in on content.
• Bachelor's degree or higher preferred.
• Conversational ability and clear decision-making in tricky scenarios.
• Experience writing short, evidence-based explanations or reviews.
• Capable of thinking on your feet during realistic scenarios.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, or audio-video mismatches.
• Rating outputs across dimensions and writing clear explanations in English explaining what you saw.
• Common tasks include evaluating image quality, video prompts, and caption labeling.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable in conversation

Explanations/writing

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely on your own schedule.

You’ll rate outputs for naturalness and adherence, describe what you saw in clear English, and help improve how AI systems reason in real-world tasks. This is freelance with flexible hours and weekly payments.