Remote AI Output Quality Evaluator

Outlier; State College (Centre County); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Fully remote work

Free access to leading LLMs

Weekly payments (ACH/PayPal)

Job summary

Outlier is hiring detail-oriented reviewers to assess AI-generated media. You will engage in live conversations with AI voice models, compare image and video outputs, and explain what is off in written English. This is a fully remote role with flexible hours and weekly payments.

Experts review prompts across media types, rate adherence and realism, and contribute evaluations that help improve AI systems. At Outlier, your work feeds frontier research into real-world AI performance.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and ability to replay or zoom in to verify issues.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to make clear decisions when options have flaws.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos to judge prompt adherence.
• Inspect outputs closely for artifacts, flickering, or misaligned audio and visuals; explain issues in writing in English.
• Provide written explanations highlighting what was seen or heard and why a given result was chosen.

Skills

Fluent English

Attention to detail

Strong written communication

Good decision making

Explain reasoning clearly

Education

Bachelor's degree or higher

Job description

Outlier is hiring detail-oriented reviewers to assess AI-generated media. You will engage in live conversations with AI voice models, compare image and video outputs, and explain what is off in written English. This is a fully remote role with flexible hours and weekly payments.

Experts review prompts across media types, rate adherence and realism, and contribute evaluations that help improve AI systems. At Outlier, your work feeds frontier research into real-world AI performance.