Remote AI Evaluator: Spot Errors & Rate AI Media

Outlier; Amherst (MA); Remote; USD 17,000 - 28,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Weekly payments

Job summary

Outlier seeks detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what went off, across images, videos, and captions.

This work helps shape how advanced AI systems reason and improve, all from home or while traveling. Responsibilities include ranking outputs for naturalness and usefulness, inspecting multimedia pairs, and writing concise explanations

Qualifications

• Fluent English with strong written communication.
• Attention to detail and careful review of outputs.
• Ability to explain decisions clearly in writing.
• Comfortable with conversational, scenario-based tasks.
• Open to pursuing or holding a Bachelor's degree or above.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models.
• Rank naturalness and usefulness of outputs and compare image/video pairs.
• Inspect outputs closely to spot issues like distortions or audio-video misalignment.
• Provide written explanations pointing to observed issues and give feedback.

Skills

Fluent English

Clear written communication

Attention to detail

Bachelor's degree in progress

Ability to reason aloud

Education

Bachelor's degree or above

Job description

Outlier seeks detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what went off, across images, videos, and captions.

This work helps shape how advanced AI systems reason and improve, all from home or while traveling. Responsibilities include ranking outputs for naturalness and usefulness, inspecting multimedia pairs, and writing concise explanations