Remote AI Response Evaluator — Flexible Hours

Outlier; Corvallis (OR); Remote; USD 17,000 - 25,000; Part time

Benefits offered by this job

Free access to leading LLMs

Flexible hours

Weekly payments

Remote work from home or while you’re

Job summary

Outlier is offering a remote, flexible-hours reviewer role focused on evaluating AI-generated media. You will conduct live conversations with AI voice models, compare media pairs, and explain findings in writing.

This freelance position is paid hourly and supports work from home or while traveling. The role emphasizes attention to detail, clear communication, and the ability to judge how well AI outputs follow prompts.

Qualifications

• Fluent English speaker with strong written communication.
• Excellent attention to detail and the ability to replay or zoom in when something seems off.
• Currently accepting applicants from multiple countries including the US.
• Comfortable thinking on your feet and discussing realistic scenarios in natural speech.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models.
• Ranking how natural, useful, and clear each response was.
• Comparing AI-generated images and videos and judging which follows the prompt.
• Inspecting outputs closely to spot problems like distorted motion or audio-video mismatch.
• Rating outputs across dimensions and writing a specific English explanation.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable thinking on your feet

Education

Bachelor's degree or above

Job description

Outlier is offering a remote, flexible-hours reviewer role focused on evaluating AI-generated media. You will conduct live conversations with AI voice models, compare media pairs, and explain findings in writing.

This freelance position is paid hourly and supports work from home or while traveling. The role emphasizes attention to detail, clear communication, and the ability to judge how well AI outputs follow prompts.