Remote AI Response Evaluator (Entry-Level)

Outlier Ai; Glasgow (KY); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Large expert community

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank naturalness and clarity, and assess how well images and videos follow prompts. You will describe issues in writing and compare different outputs for quality and realism.

The role is a flexible, freelance, 1099 contract opportunity. Remote work is supported with weekly payments and project-based incentives, with variety in tasks and locations.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay and zoom in to spot issues.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to make clear decisions when two options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and clarity.
• Compare AI-generated images and videos and judge prompt adherence.
• Inspect outputs closely to spot distortions, flickering, or misalignment between audio and video.
• Provide written explanations highlighting observed issues and rationale.

Skills

Fluent English

Attention to detail

Written explanations

Decision making

Bachelor's degree (optional)

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank naturalness and clarity, and assess how well images and videos follow prompts. You will describe issues in writing and compare different outputs for quality and realism.

The role is a flexible, freelance, 1099 contract opportunity. Remote work is supported with weekly payments and project-based incentives, with variety in tasks and locations.