Remote AI Media Evaluator - Spot Errors & Improve Models

Outlier; State College (Centre County); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Free access to leading LLMs

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare AI-generated images and videos, and explain in writing what looked or sounded off, remotely and on your own schedule.

Join Outlier to help shape how advanced AI systems reason and improve, with free access to top LLMs and flexible hours. Your work feeds frontier research into real-world performance improvements.

Qualifications

• Fluent English speaker with strong written communication
• Excellent attention to detail and ability to replay/zoom in on outputs
• Experience writing concise, evidence-based explanations or reviews
• Able to think on your feet and articulate reasoning clearly in natural conversations
• Currently accepting applicants from listed countries including United States

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images and videos and judge which follows prompts better.
• Inspect outputs closely (zoom/replay) to spot issues like artifacts, motion problems, or misaligned audio.
• Write a specific English explanation highlighting what you saw or heard that violated the prompt.

Skills

English fluency

Attention to detail

Effective writing

Remote collaboration

Adaptability

Feet on the ground thinking

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare AI-generated images and videos, and explain in writing what looked or sounded off, remotely and on your own schedule.

Join Outlier to help shape how advanced AI systems reason and improve, with free access to top LLMs and flexible hours. Your work feeds frontier research into real-world performance improvements.