AI Model Evaluator - Remote, Flexible Hours + LLM Access

Outlier; Boise (ID); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Weekly payments

Remote work

Free access to leading LLMs

Flexible hours

Up to $18/hr

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, score exchanges, compare generated images and videos, and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your work helps shape how AI systems reason, learn, and improve, turning frontier research into AI that performs better in the real world. You can work from home or while traveling, with flexible hours.

Qualifications

• Fluent English with clear written communication and comfort with everyday conversational speech.
• Strong attention to detail and ability to replay or zoom in when something seems off.
• Nice to have a Bachelor’s degree or higher.
• Able to think on your feet and discuss realistic situations naturally.
• Experience writing short, evidence-based explanations or reviews.
• Able to decide clearly when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking how natural, useful, and clear each sounded.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, text errors, and audio-video mismatch.
• Rating outputs across dimensions and writing specific English explanations.

Skills

Fluent English

Attention to detail

Written communication

Conversational thinking

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, score exchanges, compare generated images and videos, and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your work helps shape how AI systems reason, learn, and improve, turning frontier research into AI that performs better in the real world. You can work from home or while traveling, with flexible hours.