AI Media Evaluator — Remote, Flexible Hours

Outlier; Manchester (NH); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Fully remote work

Weekly payments via ACH, PayPal andAir

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from anywhere, on your own schedule. You will roleplay live conversations with AI voice models, compare image and video pairs, and explain what’s off in writing, remotely and independently.

Your insights help improve how advanced AI systems reason and respond. Ideal candidates are fluent in English, highly attentive to detail, and able to produce concise, evidence-based explanations.

Qualifications

• Fluent English with clear written communication and comfort with everyday conversational speech.
• Excellent attention to detail and patience to replay or zoom in on outputs.
• Ability to write concise, evidence-based explanations of AI outputs.
• Willingness to think on your feet and reason through realistic scenarios in a natural conversation.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, or misaligned audio, with precise notes in English.
• Rating outputs across dimensions and writing specific explanations describing observed issues.

Skills

Fluent English

Detail oriented

Strong written communication

Clear explanations

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from anywhere, on your own schedule. You will roleplay live conversations with AI voice models, compare image and video pairs, and explain what’s off in writing, remotely and independently.

Your insights help improve how advanced AI systems reason and respond. Ideal candidates are fluent in English, highly attentive to detail, and able to produce concise, evidence-based explanations.