Remote AI Media Evaluator: Spot What AI Gets Wrong

Outlier; Fayetteville (AR); Remote; USD 20,000 - 29,000; Part time

Benefits offered by this job

Up to $18 USD/hr

Flexible hours

Free access to leading LLMs

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay live conversations with AI voice models, compare image and video pairs, and explain what’s off, all on a flexible schedule.

Responsibilities include rating outputs for adherence, quality, and realism, and writing concise explanations in English. Applicants from multiple countries are welcomed, with pay up to $18/hr and weekly payments.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay or zoom in to spot errors.
• Comfortable thinking on your feet and speaking through realistic scenarios.
• Experience writing concise, evidence-based reviews or explanations.
• Able to decide clearly when options have flaws even under time pressure.

Responsibilities

• Hold live conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos, judging alignment with prompts.
• Inspect outputs closely to spot issues like distorted visuals, flickering, or misaligned audio.
• Write specific, English explanations pointing to observed issues and rationale for ratings.

Skills

Fluent English

Attention to detail

Think on your feet

Clear explanations writing

Decision making under imperfect info

Conversational communication

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay live conversations with AI voice models, compare image and video pairs, and explain what’s off, all on a flexible schedule.

Responsibilities include rating outputs for adherence, quality, and realism, and writing concise explanations in English. Applicants from multiple countries are welcomed, with pay up to $18/hr and weekly payments.