AI Media Evaluator — Remote, Flexible Hours

Outlier; Madison (WI); Hybrid; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will conduct live conversations with AI voice models, compare image and video outputs, and explain what is off, all remotely and on your schedule.

Your work helps shape how AI systems reason and improve through careful evaluation and feedback. Ideal candidates are fluent in English, possess strong attention to detail, and can write concise, evidence-based explanations.

Qualifications

• Fluent English with clear written communication.
• Great attention to detail and ability to replay or zoom in when something seems off.
• Bachelor's degree or higher preferred.
• Able to think on your feet and explain realistic situations clearly.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rank how natural, useful, and clear each one sounded.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, text errors, and audio-video mismatches.
• Write a concise, evidence-based explanation in English describing what you saw or heard.

Skills

Detail oriented

Written English

Decision making

Strong communication

Education

Bachelor's degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will conduct live conversations with AI voice models, compare image and video outputs, and explain what is off, all remotely and on your schedule.

Your work helps shape how AI systems reason and improve through careful evaluation and feedback. Ideal candidates are fluent in English, possess strong attention to detail, and can write concise, evidence-based explanations.