AI Quality Evaluator — Remote & Flexible Hours

Outlier; Saint Paul (MN); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Weekly pay via ACH/PayPal/AirTM

Free access to leading LLMs

Job summary

Outlier invites detail-oriented English speakers to review AI-generated media from the comfort of a home office. You will conduct live conversations with AI voice models, compare media pairs, and write precise explanations of what went wrong.

Earn per hour with flexible scheduling and weekly payments. Candidates should be fluent in English, capable of clear written communication, and comfortable evaluating complex media outputs.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to replay or zoom in to spot issues.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot distortions, flickering, or misaligned audio/video.
• Rating outputs across dimensions and writing specific explanations in English.

Skills

Fluent English

Attention to detail

Written communication

Conversational fluency

Education

Bachelor's degree

Job description

Outlier invites detail-oriented English speakers to review AI-generated media from the comfort of a home office. You will conduct live conversations with AI voice models, compare media pairs, and write precise explanations of what went wrong.

Earn per hour with flexible scheduling and weekly payments. Candidates should be fluent in English, capable of clear written communication, and comfortable evaluating complex media outputs.