AI Media Evaluator — Remote & Flexible Hours

Outlier; Amherst (MA); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Earn Up to $18 USD/hr - Plus incentive

Flexible hours, remote from anywhere

Free access to leading LLMs

Missions bonus potential

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Responsibilities include comparing AI-generated media to prompts, judging adherence and quality, and providing concise justification in English. This is a remote, flexible-hour opportunity with earnings up to $18/hour.

Qualifications

• Fluent English speaker with clear written communication and comfortable with everyday conversational speech.
• Strong attention to detail, with patience to look and listen closely, and to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.
• Able to think on your feet and explain decisions clearly when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or mismatched audio.
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English.

Skills

Fluent English

Attention to detail

Clear communication

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Responsibilities include comparing AI-generated media to prompts, judging adherence and quality, and providing concise justification in English. This is a remote, flexible-hour opportunity with earnings up to $18/hour.