Remote AI Content Evaluator — Flexible Hours & Pay

Outlier; Champaign (IL); Remote; USD 17,000 - 25,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis with flexible hours. You will evaluate live conversations with AI voice models, compare AI-generated images and videos, and explain what went wrong in writing.

Earn up to $15/hour with additional incentives and weekly payments. Ideal candidates are fluent in English, highly detail-oriented, and comfortable discussing realistic scenarios.

Qualifications

• Fluent English with strong written communication and comfortable with natural, everyday conversational speech.
• Attention to detail with patience to replay or zoom in when something seems off.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Able to think on your feet and discuss realistic situations in a natural, conversational way.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video.
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard.
• Image evaluations: compare two AI-generated images for the same text prompt and pick the better one, judging how well each follows the instructions, visual quality and visible AI artifacts; some tasks rank edited images against the original.
• Video evaluations: rank AI-generated videos against a text prompt, or edited videos against their source clip.
• Video caption labeling: label first-person videos of people or robots doing hands-on tasks; create precise captions from an AI draft.

Skills

Fluent English

Education

Bachelor's degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis with flexible hours. You will evaluate live conversations with AI voice models, compare AI-generated images and videos, and explain what went wrong in writing.

Earn up to $15/hour with additional incentives and weekly payments. Ideal candidates are fluent in English, highly detail-oriented, and comfortable discussing realistic scenarios.