AI Response Evaluator - Remote & Flexible Hours

Outlier; Naperville (IL); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Additional incentives

Job summary

Outlier invites English-speaking reviewers to evaluate AI-generated media from home with flexible hours and remote work across global participants. You will engage in live conversations with AI voice models, compare image and video outputs, rate alignment with prompts, and write clear explanations in English of what looked off or sounded inconsistent.

Earnings are up to $18/hour with weekly payments and additional incentives.

Qualifications

• Fluent English speaker with strong written communication.
• High attention to detail and patience to replay or zoom in when something seems off.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to make clear decisions when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations with AI voice models, then ranking naturalness and usefulness.
• Comparing AI-generated images and videos against prompts and judging adherence.
• Inspecting outputs closely to spot problems like artifacts, flickering, or audio/video mismatch.
• Writing a clear, English explanation pointing to what was seen or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable with natural conversations

Explain and justify judgments

Education

Bachelor's degree or above preferred

Job description

Outlier invites English-speaking reviewers to evaluate AI-generated media from home with flexible hours and remote work across global participants. You will engage in live conversations with AI voice models, compare image and video outputs, rate alignment with prompts, and write clear explanations in English of what looked off or sounded inconsistent.

Earnings are up to $18/hour with weekly payments and additional incentives.