Remote AI Media QA & Evaluation Specialist

Outlier; Aurora; Remote; CAD 23,000 - 39,000; Full time

Benefits offered by this job

Up to $15 USD/hr

Missions incentive pay

Flexible hours

Free access to leading LLMs

Remote work from anywhere

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Responsibilities include rating outputs for adherence, quality, and realism; spotting issues like distorted anatomy, flickering, or audio mismatches; and producing concise, evidence-based explanations in English.

Qualifications

• Fluent English with clear written communication and natural conversational speech.
• Strong attention to detail and the ability to replay or zoom in when something seems off.
• Bachelor’s degree or above preferred.
• Ability to think on your feet and discuss realistic situations clearly.
• Experience writing concise, evidence-based explanations or reviews.
• Able to decide between options when both have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounds.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely—zooming in and replaying—to spot distorted anatomy, flickering, or misaligned audio/video.
• Rating outputs across dimensions like adherence, quality, and realism, then writing a specific English explanation.
• Common tasks include image evaluations, video evaluations, video caption labeling, and audio/voice evaluations.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based writing

Decision making with flaws

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Responsibilities include rating outputs for adherence, quality, and realism; spotting issues like distorted anatomy, flickering, or audio mismatches; and producing concise, evidence-based explanations in English.