AI Response Evaluator — Remote, Flexible Hours, Free LLM Access

Outlier; Charleston (WV); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Free access to leading LLMs (worth $-)

Flexible schedule

Job summary

Outlier invites detail-oriented English speakers to review AI-generated media by rating conversations with AI voice models, comparing image and video pairs, and explaining what’s off. Work remotely on your own schedule with weekly payments in USD, up to $18 per hour, and free access to leading LLMs.

You will help shape how AI systems reason and improve through careful evaluations, rankings, and written explanations, contributing to frontier research translated into real-world AI performance.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay/zoom in when something seems off.
• Bachelor's degree or above is desirable.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models, rank naturalness and usefulness, and explain what sounded off.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely, zoom/replay to spot issues like distorted anatomy, flickering, text errors, or audio-video misalignment.
• Rate each output across dimensions and write a concise English explanation describing observations.

Skills

Fluent English

Attention to detail

Clear written communication

Education

Bachelor's degree or above

Job description

Outlier invites detail-oriented English speakers to review AI-generated media by rating conversations with AI voice models, comparing image and video pairs, and explaining what’s off. Work remotely on your own schedule with weekly payments in USD, up to $18 per hour, and free access to leading LLMs.

You will help shape how AI systems reason and improve through careful evaluations, rankings, and written explanations, contributing to frontier research translated into real-world AI performance.