Remote AI Quality Evaluator (English) – Flexible Hours

Outlier; Albuquerque (NM); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible remote work hours

Weekly payments via ACH/PayPal

Free access to leading LLMs

Up to $15/hr earnings

Job summary

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media from home, with flexible, remote hours. You will hold live conversations with AI voice models, compare AI-generated images and videos, and explain what’s off in writing, all on a freelance, 1099 basis.

Ideal candidates are fluent in English, with strong written communication, keen attention to detail, and the ability to make clear calls when both options have flaws.

Qualifications

• Fluent English speaker with strong written communication and comfort with everyday conversational speech.
• Strong attention to detail and the patience to replay or zoom in when something seems off.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Able to think on your feet and explain realistic situations in a natural, conversational way.
• Experience writing short, evidence-based explanations or reviews.
• Able to make a clear decision when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely—zooming in and replaying—to spot problems like distorted anatomy, flickering or unrelated audio.
• Rating each output on adherence, quality, and realism and writing a written explanation in English.

Skills

Fluent English

Education

Bachelor's degree

Job description

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media from home, with flexible, remote hours. You will hold live conversations with AI voice models, compare AI-generated images and videos, and explain what’s off in writing, all on a freelance, 1099 basis.

Ideal candidates are fluent in English, with strong written communication, keen attention to detail, and the ability to make clear calls when both options have flaws.