AI Response Rater - Remote, Flexible Hours, Up to $18/hr

Outlier; Raleigh (NC); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will rate live conversations with AI voice models, compare image and video outputs, and explain what is off, all in writing. Compensation is hourly with weekly payments via common methods.

Role focuses on accuracy, adherence to prompts, and clear explanations, across tasks like image, video, and audio evaluations. Remote-friendly and globally accessible.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.
• Ability to make clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn’t match the video.
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard.

Education

Bachelor's degree

Above bachelor’s degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will rate live conversations with AI voice models, compare image and video outputs, and explain what is off, all in writing. Compensation is hourly with weekly payments via common methods.

Role focuses on accuracy, adherence to prompts, and clear explanations, across tasks like image, video, and audio evaluations. Remote-friendly and globally accessible.