Remote AI Media Evaluator: Spot Flaws & Improve Models

Outlier; Blacksburg (VA); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to LLMs

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, remote schedule. You will engage in live conversations with AI voice models, compare images and videos, and explain in writing what looks off or inconsistent with the prompt.

Responsibilities include ranking outputs by adherence and quality, and providing concise, evidence-based explanations. This is a freelance, 1099 opportunity with weekly payments and access to leading LLMs.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and careful analysis.
• Ability to explain complex observations concisely.
• Comfort with making decisions when presented with imperfect options.

Responsibilities

• Hold live conversations with AI voice models in English and rate how natural and useful each response sounds.
• Compare pairs of AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like artifacts, flicker, or audio-video mismatch and describe them in writing.
• Provide written explanations in English highlighting observed problems and reasoning for rankings.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under uncertainty

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, remote schedule. You will engage in live conversations with AI voice models, compare images and videos, and explain in writing what looks off or inconsistent with the prompt.

Responsibilities include ranking outputs by adherence and quality, and providing concise, evidence-based explanations. This is a freelance, 1099 opportunity with weekly payments and access to leading LLMs.