AI Output Evaluator — Remote, Flexible Hours

Outlier; Fargo (ND); Hybrid; USD 12,000 - 21,000; Full time

Benefits offered by this job

Fully remote

Flexible hours

Weekly payments

Free access to leading LLMs

Earn up to $15 USD/hr

Job summary

Outlier is hiring reviewers to evaluate AI-generated media. You will conduct live conversations with AI voice models, compare outputs and explain in writing what looks off, all from your home with a flexible schedule.

As an English speaker with strong attention to detail, you’ll rate outputs across adherence, quality, and realism, and provide evidence-based notes. This is a remote, 1099 contract role with generous hourly pay and access to leading LLMs.

Qualifications

• Fluent English is required with clear written communication.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Pursuing or holding a Bachelor's degree or above.
• Able to think on your feet and explain scenarios clearly in conversation.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video.
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English.

Skills

Fluent English speaker

Clear written communication

Attention to detail

Evidence-based explanations

Decision making under imperfect info

Education

Bachelor's degree or above (pursuing/holding)

Job description

Outlier is hiring reviewers to evaluate AI-generated media. You will conduct live conversations with AI voice models, compare outputs and explain in writing what looks off, all from your home with a flexible schedule.

As an English speaker with strong attention to detail, you’ll rate outputs across adherence, quality, and realism, and provide evidence-based notes. This is a remote, 1099 contract role with generous hourly pay and access to leading LLMs.