AI Media Evaluator — Remote & Flexible Hours

Outlier; Austin (TX); Remote; USD 15,000 - 25,000; Part time

Benefits offered by this job

Flexible hours

Weekly payments

Remote work

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and roleplay live conversations with AI voice models, rating each exchange for naturalness and usefulness. You will compare AI-generated images and videos, judge which follows prompts better, and explain what looked or sounded off in writing, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason and improve.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and careful listening.
• Bachelor's degree or above preferred.
• Comfortable discussing realistic situations naturally.
• Experience writing concise, evidence-based reviews.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos and judge which follows prompts better.
• Inspect outputs closely to spot distortions, flicker, text errors, or audio-video mismatch.
• Provide written explanations of findings in English.
• Rate outputs on adherence, quality, and realism.
• Work remotely with flexible hours and on your own schedule.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based explanations

Decision making under uncertainty

Conversation analysis

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and roleplay live conversations with AI voice models, rating each exchange for naturalness and usefulness. You will compare AI-generated images and videos, judge which follows prompts better, and explain what looked or sounded off in writing, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason and improve.