AI Evaluator — Remote, Flexible Hours, Up to $15/hr

Outlier; Penticton; Remote; CAD 24,000 - 34,000; Part time

Benefits offered by this job

Weekly payments via ACH/PayPal/AirTM

Free access to leading LLMs

Fully remote with flexible hours

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will hold live conversations with AI voice models, compare image and video pairs, and explain in writing what looked or sounded wrong, all on your own schedule.

Ideal candidates are fluent in English with strong written communication, exceptional attention to detail, and the ability to decide clearly when options have flaws. Prior coursework or a Bachelor's degree is a plus.

Qualifications

• Fluent English with clear writing
• Attention to detail, patience to replay/zoom in
• Pursuing or holding a Bachelor's degree or above
• Able to think on your feet and explain in realistic scenarios
• Experience writing concise explanations or reviews

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking how natural each sounded.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely (zoom/replay) to spot problems like distorted anatomy, flickering, or audio-video mismatch.
• Rating outputs across dimensions (adherence, quality, realism) and writing a written explanation in English.

Skills

Fluent English

Attention to detail

Bachelor's degree (pursuing/holding)

Clear written communication

Decision making under conflicting info

Experience writing explanations/review

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will hold live conversations with AI voice models, compare image and video pairs, and explain in writing what looked or sounded wrong, all on your own schedule.

Ideal candidates are fluent in English with strong written communication, exceptional attention to detail, and the ability to decide clearly when options have flaws. Prior coursework or a Bachelor's degree is a plus.