Remote AI Evaluator: Spot Flaws & Rate Outputs

Outlier; Plano (TX); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Weekly payments

Remote work

Free LLM access

Incentives

Job summary

Outlier seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare images and videos to judge prompt adherence, and explain what looked off in writing, all remotely and on your own schedule.

Your work helps shape how advanced AI systems reason and improve, contributing to frontier research and real-world performance. Join a growing evaluation team with flexible hours.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in when something seems off.
• Pursuing or holding a Bachelor's degree or above.
• Comfortable articulating explanations in writing.

Responsibilities

• Holding live conversations with AI voice models and ranking naturalness, usefulness and clarity.
• Comparing AI-generated images and videos to judge adherence to prompts.
• Inspecting outputs closely, zooming in, to spot problems like artifacts or misalignment.
• Rating outputs and writing specific explanations in English.

Skills

English fluency

Attention to detail

Written communication

Decision making

Education

Bachelor's degree or above

Job description

Outlier seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare images and videos to judge prompt adherence, and explain what looked off in writing, all remotely and on your own schedule.

Your work helps shape how advanced AI systems reason and improve, contributing to frontier research and real-world performance. Join a growing evaluation team with flexible hours.