Remote AI Conversation Evaluator – English Speaker

Outlier; Lethbridge; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Fully remote work

Flexible hours

Free access to leading LLMs

Weekly payments

1099 contract

Job summary

Outlier is offering a remote, flexible schedule opportunity to review AI-generated media. You will hold live conversations with AI voice models, compare images and videos, and write concise explanations in English. The role supports global applicants and pays hourly with potential incentives.

Earn up to 15 USD per hour, with weekly payments and access to leading LLMs. This is a contract-style, freelance opportunity suited for detail-oriented individuals who can work independently.

Qualifications

• Fluent English with clear written comms.
• Strong attention to detail and listening skills.
• Bachelor's degree or above preferred.
• Able to think on your feet and explain decisions clearly.
• Experience writing short, evidence-based reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, or misaligned audio/video.
• Rate outputs across dimensions (adherence, quality, realism) and provide written explanations.
• Image evaluations: compare two AI-generated images and judge instruction-following and quality.
• Video evaluations: rank AI-generated videos against a text prompt or source clip.
• Video caption labeling: create precise captions from first-person videos and refine AI drafts.
• Audio evaluations: rate speech naturalness and alignment with a target voice.

Skills

Fluent English

Written communication

Attention to detail

Patience and listening

Bachelor’s degree preferred

Quick thinking

Evidence‑based writing

Decision making under uncertainty

Education

Bachelor's degree or above

Job description

Outlier is offering a remote, flexible schedule opportunity to review AI-generated media. You will hold live conversations with AI voice models, compare images and videos, and write concise explanations in English. The role supports global applicants and pays hourly with potential incentives.

Earn up to 15 USD per hour, with weekly payments and access to leading LLMs. This is a contract-style, freelance opportunity suited for detail-oriented individuals who can work independently.