Remote AI Evaluator: Flexible Hours + Free LLM Access

Outlier; Providence (RI); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible hours

Remote work from anywhere

Weekly payments

Job summary

Outlier is seeking detail-oriented English-speaking evaluators to review AI-generated media from home. You will roleplay live conversations with AI voice models, score outputs, and explain why certain responses diverge from the prompt.

Flexible scheduling and remote work are core features of this freelance role. Contributors can earn up to $15 USD per hour, with additional incentives through Outlier Missions.

Qualifications

• Fluent English speaker with clear communication.
• Strong attention to detail and ability to zoom in when something seems off.
• Bachelor's degree or higher preferred.
• Able to think on your feet and discuss realistic situations naturally.
• Experience writing concise, evidence-based explanations.

Responsibilities

• Hold a live, English-language conversation with AI voice models.
• Rank outputs for naturalness, usefulness, and clarity.
• Compare AI-generated images and videos to prompts and judge adherence.
• Write specific explanations in English highlighting observed issues.
• Review image/video tasks and provide precise captions or notes.

Skills

Fluent English

Attention to detail

Written explanations

Verbal reasoning

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English-speaking evaluators to review AI-generated media from home. You will roleplay live conversations with AI voice models, score outputs, and explain why certain responses diverge from the prompt.

Flexible scheduling and remote work are core features of this freelance role. Contributors can earn up to $15 USD per hour, with additional incentives through Outlier Missions.