AI Media Evaluator — Remote, Flexible Hours

Outlier

Sherwood Park

Remote

CAD 24,000 - 34,000

Full time

2 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Free access to leading LLMs

Flexible hours

Remote work

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with an AI voice model and score each exchange, compare generated images and videos to judge which follows the prompt better, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason, learn, and improve.

Qualifications

Fluent English with clear written communication and comfortable with natural conversational speech.
Strong attention to detail and patience to replay or zoom in on material.
Bachelor's degree or higher is nice to have.
Able to think on your feet and discuss realistic situations conversationally.
Experience writing concise explanations or reviews.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each exchange sounded.
Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio misalignment.
Rating each output across dimensions like adherence, quality, and realism, and writing an English explanation.