AI Quality Evaluator — Remote & Flexible

Outlier; Boulder (CO); Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Free access to leading LLMs

Flexible hours / remote work

Paid weekly

Job summary

Outlier is recruiting detail-oriented evaluators to review AI-generated media. You will engage in live conversations with AI voice models, compare image and video pairs, and explain in writing what looked or sounded wrong, all from home and on a flexible schedule.

Ideal candidates are fluent English speakers with strong written communication and meticulous attention to detail. A Bachelor’s degree or higher is preferred, and applicants from multiple countries—including the United States—are

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in on content.
• Preferred but not required: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate how natural and clear the exchanges sound.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, or misaligned audio and video, then explain findings in writing.
• Rate each output on dimensions such as adherence, quality, and realism and provide a concise explanation in English.

Skills

Fluent English

Attention to detail

Clear written communication

Education

Bachelor's degree or above

Job description

Outlier is recruiting detail-oriented evaluators to review AI-generated media. You will engage in live conversations with AI voice models, compare image and video pairs, and explain in writing what looked or sounded wrong, all from home and on a flexible schedule.

Ideal candidates are fluent English speakers with strong written communication and meticulous attention to detail. A Bachelor’s degree or higher is preferred, and applicants from multiple countries—including the United States—are