Remote AI Quality Evaluator — Flexible Hours

Outlier; City of Syracuse (NY); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible hours

Work from anywhere

Free access to leading LLMs

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare image and video pairs, and explain in writing what looked or sounded wrong.

This remote role offers flexible hours and weekly payments, with free access to leading LLMs. Responsibilities include evaluating naturalness, usefulness, and clarity of AI outputs, rating across multiple dimensions, and providing concise explanations in writing.

Qualifications

• Fluent English speaker with strong, clear written communication.
• High attention to detail and the ability to replay or zoom in when something looks off.
• Pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and explaining realistic scenarios in a natural, conversational way.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio mismatches.
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific English explanation.

Skills

Fluent English

Clear written communication

Attention to detail

Effective communicator

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare image and video pairs, and explain in writing what looked or sounded wrong.

This remote role offers flexible hours and weekly payments, with free access to leading LLMs. Responsibilities include evaluating naturalness, usefulness, and clarity of AI outputs, rating across multiple dimensions, and providing concise explanations in writing.