Remote AI Media Evaluator — English Feedback

Outlier; Aurora (CO); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Fully remote

Weekly payments

Free access to LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media entirely remotely on a flexible schedule. You will engage in live conversations with AI voice models, rate outputs, and write concise explanations of issues identified.

This role supports development of AI evaluation and feedback loops to improve real-world performance. Compensation includes up to $18 USD/hr with weekly payments and free access to leading LLMs, plus optional incentives.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in on outputs.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and discussing realistic scenarios.
• Experience writing short, evidence-based explanations or reviews.
• Ability to make clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking naturalness and usefulness.
• Comparing AI-generated images and videos to determine which follows prompts better.
• Inspecting outputs closely to spot problems like distorted artifacts or misaligned audio.
• Writing explanations in English detailing what you saw or heard.

Skills

Fluent English

Attention to detail

Written communication

Decision making

Clear communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media entirely remotely on a flexible schedule. You will engage in live conversations with AI voice models, rate outputs, and write concise explanations of issues identified.

This role supports development of AI evaluation and feedback loops to improve real-world performance. Compensation includes up to $18 USD/hr with weekly payments and free access to leading LLMs, plus optional incentives.