Remote AI Quality Rater (English) – Flexible Hours

Outlier; West Lafayette (IN); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Weekly payments (ACH/PayPal/AirTM)

Remote work

Free access to leading LLMs

Job summary

Outlier is offering a remote, flexible freelance role where you review AI-generated media by holding live conversations with AI voice models, comparing outputs, and writing concise explanations. You can work from home or while traveling, with the pay up to $15 per hour and weekly payments.

This 1099 contract opportunity supports your schedule and location flexibility. Ideal candidates are fluent English speakers with sharp attention to detail, the ability to reason clearly, and prior experience

Qualifications

• Fluent English speaker with clear written communication and comfort with everyday conversational speech.
• Strong attention to detail, able to replay or zoom in when something seems off.
• Nice to have: pursuing or holding a bachelor's degree or above.
• Comfortable thinking on your feet and describing realistic scenarios clearly.
• Experience writing brief, evidence-based explanations or reviews.
• Comfortable making clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking how natural, useful, and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering, or mismatches.
• Rating each output across dimensions like adherence, quality, and realism, then writing a concise English explanation of what you saw or heard.
• Image evaluations: compare two AI-generated images for the same text prompt and pick the better one.
• Video evaluations: rank AI-generated videos against a text prompt or compare edited videos to originals.
• Video caption labeling: describe hands-on tasks in first-person videos with precise captions.
• Audio and voice evaluations: rate AI-generated speech for naturalness, pronunciation, and voice match.

Job description

Outlier is offering a remote, flexible freelance role where you review AI-generated media by holding live conversations with AI voice models, comparing outputs, and writing concise explanations. You can work from home or while traveling, with the pay up to $15 per hour and weekly payments.

This 1099 contract opportunity supports your schedule and location flexibility. Ideal candidates are fluent English speakers with sharp attention to detail, the ability to reason clearly, and prior experience