Remote AI Evaluator: Media QA & Feedback

Outlier; Providence (RI); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will hold live conversations with AI voice models, score exchanges for naturalness and accuracy, and explain in writing what looked or sounded wrong.

Your insights help improve how AI systems reason and respond in real-world tasks. Ideal candidates are fluent in English, highly attentive to detail, and able to deliver concise, evidence-based explanations.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail, patient with replaying and zooming in to spot issues.
• Experience writing brief, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural and clear each one sounded.
• Comparing AI-generated image and video pairs and judging which better follows the prompt.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, text errors, and misaligned audio.
• Rating outputs on dimensions like adherence, quality, and realism and writing a concise English explanation.

Skills

Fluent English

Attention to detail

Clear written communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will hold live conversations with AI voice models, score exchanges for naturalness and accuracy, and explain in writing what looked or sounded wrong.

Your insights help improve how AI systems reason and respond in real-world tasks. Ideal candidates are fluent in English, highly attentive to detail, and able to deliver concise, evidence-based explanations.