Remote AI Response Evaluator — Flexible Hours

Outlier; Cleveland (OH); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Performance incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote schedule. You will rate live conversations with AI voice models, compare images and videos, and write clear explanations of what looked off or incorrect.

Responsibilities include identifying issues in output, judging adherence to prompts, and providing precise, written feedback. This role supports AI systems improving real-world performance.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to zoom in on specifics.
• Bachelor's degree or higher preferred.
• Comfortable discussing realistic scenarios clearly.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank how natural, useful, and clear each one sounded.
• Compare pairs of AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely, zooming in and replaying to spot problems like artifacts, glitches, or misalignment.
• Rate outputs across dimensions like adherence, quality, and realism, then write concise explanations in English.

Skills

Fluent English

Attention to detail

Clear writing

Conversational thinking

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote schedule. You will rate live conversations with AI voice models, compare images and videos, and write clear explanations of what looked off or incorrect.

Responsibilities include identifying issues in output, judging adherence to prompts, and providing precise, written feedback. This role supports AI systems improving real-world performance.