Remote AI Media Evaluator - Flexible Hours

Outlier; Scottsdale (AZ); Hybrid; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Weekly payments via ACH/PayPal/AirTM

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, rank outputs, and explain in writing what looked or sounded off.

This remote opportunity lets you work on your own schedule while contributing to evaluating AI systems in real-world scenarios. You will compare images and videos, judge adherence to prompts, and provide concise, evidence-based explanations.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay/zoom in on outputs.
• Bachelor's degree or higher is a plus.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely to spot issues like distortions, flickering, text errors, or audio-video mismatch.
• Write a specific English explanation pointing to what you saw or heard, for each exchange.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making when flaws exist

Able to review AI outputs

Education

Bachelor's degree (nice to have)

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, rank outputs, and explain in writing what looked or sounded off.

This remote opportunity lets you work on your own schedule while contributing to evaluating AI systems in real-world scenarios. You will compare images and videos, judge adherence to prompts, and provide concise, evidence-based explanations.