Remote AI Writing & Media Evaluator

Scale AI; Outaouais; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Free access to LLMs

Job summary

Outlier seeks detail-oriented English speakers to evaluate AI-generated media. You will roleplay live conversations with AI voice models, compare AI-generated images and videos for prompt adherence, and provide written explanations of found issues.

Remote work with flexible hours is available and you can sign up as a freelancer on the Outlier platform. Eligible applicants may review tasks across image, video, caption labeling, and audio evaluations, with weekly payment processing.

Qualifications

• Fluent English with strong written communication and comfortable with everyday conversational speech.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Able to think on your feet and discuss realistic scenarios naturally.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images/videos and judge prompt adherence.
• Inspect outputs closely to spot issues like distortion, flickering, or misalignment of audio and video.
• Write detailed explanations in English highlighting what was observed or heard.

Skills

Fluent English

Written communication

Attention to detail

Decision making

Education

Bachelor’s degree or higher

Job description

Outlier seeks detail-oriented English speakers to evaluate AI-generated media. You will roleplay live conversations with AI voice models, compare AI-generated images and videos for prompt adherence, and provide written explanations of found issues.

Remote work with flexible hours is available and you can sign up as a freelancer on the Outlier platform. Eligible applicants may review tasks across image, video, caption labeling, and audio evaluations, with weekly payment processing.