AI Media Evaluator — Remote & Flexible Hours

Outlier; Wilmington (NC); Hybrid; USD 12,000 - 21,000; Full time

Benefits offered by this job

Weekly payments

Remote work

Free LLM access

Flexible schedule

Job summary

Outlier is hiring detail-oriented, English-speaking evaluators to review AI-generated media on a flexible schedule. You will assess live conversations with AI voice models, compare images and videos, and explain what is off, all from home.

Remote work with weekly payments supports diverse time zones and independent study of frontier AI research. Ideal candidates have a Bachelor's degree or above and strong written communication skills.

Qualifications

• Fluent English with clear written communication and comfortable with natural conversational speech.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.
• Willingness to think on your feet and discuss realistic scenarios clearly.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distortions, flickering, or audio-video mismatches.
• Rating each output across dimensions like adherence, quality, and realism, then writing a concise explanation in English.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under uncertainty

Education

Bachelor's degree or above

Job description

Outlier is hiring detail-oriented, English-speaking evaluators to review AI-generated media on a flexible schedule. You will assess live conversations with AI voice models, compare images and videos, and explain what is off, all from home.

Remote work with weekly payments supports diverse time zones and independent study of frontier AI research. Ideal candidates have a Bachelor's degree or above and strong written communication skills.