Remote AI Evaluator: Spot Flaws & Improve Models

Outlier; Missoula (MT); Remote; USD 12,000 - 21,000; Part time

Benefits offered by this job

Free access to leading LLMs

Weekly payments via ACH/PayPal/AirTM

Flexible hours

Job summary

Outlier is offering a remote, flexible opportunity for English-speaking evaluators to review AI-generated media. You’ll host live conversations with AI voice models, compare outputs, and write clear, concise explanations of what looked off. Depend on your schedule as a 1099 contractor, with weekly payments and access to top LLMs.

Add to that the chance to influence how AI systems reason and improve, while earning hourly pay and working from anywhere with internet access.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and willingness to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatch.
• Rating outputs across dimensions like adherence, quality, and realism and writing a specific English explanation of what you saw or heard.

Skills

Fluent English

Clear writing

Attention to detail

Evidence-based reviews

Education

Bachelor's degree or higher

Job description

Outlier is offering a remote, flexible opportunity for English-speaking evaluators to review AI-generated media. You’ll host live conversations with AI voice models, compare outputs, and write clear, concise explanations of what looked off. Depend on your schedule as a 1099 contractor, with weekly payments and access to top LLMs.

Add to that the chance to influence how AI systems reason and improve, while earning hourly pay and working from anywhere with internet access.