Remote AI Quality Evaluator (English)

Outlier; Amherst (MA); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Weekly payments

Job summary

Outlier is hiring evaluators to review AI-generated media from the comfort of your home. You will hold live conversations with AI voice models, compare image and video pairs, and explain what is off, all on your own schedule.

The role requires fluent English, strong attention to detail, and the ability to write clear explanations. This is a 1099 freelance opportunity with remote, flexible hours and weekly payments.

Qualifications

• Fluent English with clear written communication.
• Bachelor's degree or above.
• Detail-oriented with ability to explain findings.
• Comfortable reviewing AI outputs and writing explanations.
• You must be authorized to work in your country of residence.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt more accurately.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, text errors, and audio-video mismatches.
• Rating outputs across dimensions like adherence, quality, and realism and writing a concise English explanation.

Skills

Fluent English

Education

Bachelor's degree or above

Job description

Outlier is hiring evaluators to review AI-generated media from the comfort of your home. You will hold live conversations with AI voice models, compare image and video pairs, and explain what is off, all on your own schedule.

The role requires fluent English, strong attention to detail, and the ability to write clear explanations. This is a 1099 freelance opportunity with remote, flexible hours and weekly payments.