Remote AI Evaluator: Real-World Media Quality

Outlier; Portland (ME); Hybrid; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Weekly payments

Job summary

Outlier is offering a fully remote, flexible-hours opportunity to review AI-generated media. You will engage in live conversations with AI voice models, compare image and video pairs, and write clear explanations of what’s off, all on your schedule.

Ideal candidates are fluent English speakers with keen attention to detail. Nice to have a Bachelor’s degree or higher; experience writing concise reviews is a plus. Applicants from multiple countries, including the US, are welcomed.

Qualifications

• Fluent English with clear, written communication.
• Strong attention to detail; ability to replay or zoom in to catch issues.
• Bachelor's degree or higher is nice to have.
• Able to think on your feet and explain realistic scenarios clearly in writing.
• Experience writing concise, evidence-based reviews.

Responsibilities

• Hold live, scenario-based conversations with AI voice models.
• Rank how natural and useful each interaction sounds and explain why.
• Compare pairs of AI-generated images/videos and judge adherence to prompts.
• Inspect outputs for distortions, flickering, or audio-visual mismatches.
• Provide clear English explanations detailing observations for each task.

Skills

Fluent English

Attention to detail

Education

Bachelor's degree or higher

Job description

Outlier is offering a fully remote, flexible-hours opportunity to review AI-generated media. You will engage in live conversations with AI voice models, compare image and video pairs, and write clear explanations of what’s off, all on your schedule.

Ideal candidates are fluent English speakers with keen attention to detail. Nice to have a Bachelor’s degree or higher; experience writing concise reviews is a plus. Applicants from multiple countries, including the US, are welcomed.