Remote AI Quality Evaluator

Outlier; Frisco (TX); Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media remotely on a flexible schedule. You will conduct live conversations with AI voice models, compare image and video outputs, and explain in writing what looked off.

This freelance role supports frontier AI research with real-world impact. Ideal candidates are Fluent English speakers with strong attention to detail, capable of clear written explanations, and comfortable deciding between imperfect options.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and careful listening and viewing.
• Experience writing concise, evidence-based explanations or reviews.
• Comfortable making clear decisions when two options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models.
• Ranking how natural and useful each response sounds.
• Comparing AI-generated images and videos and judging prompt adherence.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or misalignment of audio and video.
• Rating outputs on dimensions like adherence, quality, and realism and writing a concise explanation in English.

Skills

Fluent English

Attention to detail

Clear written explanations

Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media remotely on a flexible schedule. You will conduct live conversations with AI voice models, compare image and video outputs, and explain in writing what looked off.

This freelance role supports frontier AI research with real-world impact. Ideal candidates are Fluent English speakers with strong attention to detail, capable of clear written explanations, and comfortable deciding between imperfect options.