AI Response Rater — Remote, Flexible Evaluations

Outlier; Madison (WI); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to 18 USD/hr

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English-speaking reviewers to assess AI-generated media. You will conduct live conversations with AI voice models, rate the naturalness and usefulness of responses, and compare AI-produced images and videos to a given prompt.

You will explain in writing what looked or sounded off, remotely and on your schedule. Ideal candidates have strong attention to detail, enjoy precise analysis, and can articulate decisions clearly.

Qualifications

• Fluent English with clear written communication and natural conversational speech.
• Strong attention to detail; patient to replay or zoom in on outputs.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable thinking on your feet and explaining decisions clearly.

Responsibilities

• Hold live conversations with AI voice models, then rate how natural and clear each exchange sounds.
• Compare AI-generated images and videos, judging which better follows prompts.
• Inspect outputs closely for artifacts, misalignments, or audio-video mismatches.
• Write a concise English explanation pointing to observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Conversational English

Education

Bachelor's degree or above (nice to have)

Job description

Outlier is seeking detail-oriented English-speaking reviewers to assess AI-generated media. You will conduct live conversations with AI voice models, rate the naturalness and usefulness of responses, and compare AI-produced images and videos to a given prompt.

You will explain in writing what looked or sounded off, remotely and on your schedule. Ideal candidates have strong attention to detail, enjoy precise analysis, and can articulate decisions clearly.