Remote AI Media Evaluator

Outlier; Fort Collins (CO); Hybrid; USD 17,000 - 21,000; Full time

Benefits offered by this job

Remote work

Job summary

Outlier seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare generated images and videos to judge which follows prompts better, and explain what looked or sounded wrong, all remotely and on your own schedule.

Responsibilities include comparing image and video outputs, spotting issues like distorted motion or mismatches, and writing concise explanations in English.

Qualifications

• Fluent English speaker with strong written communication and natural everyday conversational speech.
• Excellent attention to detail and patience to replay or zoom in when something seems off.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging which better follows prompts.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or misalignment between audio and video.
• Rating outputs on dimensions like adherence, quality, and realism and writing English explanations of observed issues.

Skills

Fluent English

Attention to detail

Conversational thinking

Written explanations

Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare generated images and videos to judge which follows prompts better, and explain what looked or sounded wrong, all remotely and on your own schedule.

Responsibilities include comparing image and video outputs, spotting issues like distorted motion or mismatches, and writing concise explanations in English.