AI Response Evaluator — Remote, Flexible Hours

Outlier; Blacksburg (VA); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay live conversations with an AI voice model, score outputs, compare image/video pairs, and explain in writing what looked off, all on your own schedule.

Ideal candidates communicate clearly in English, pay close attention to detail, and can produce concise explanations. The role supports flexible hours and remote work, with payments and access to leading LLMs provided.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to replay or zoom in to assess issues.
• Bachelor's degree or higher is nice to have.
• Ability to think on your feet and discuss realistic scenarios conversationally.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and rank naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot issues like distortion, flickering, or mismatched audio/video.
• Writing a detailed explanation in English describing what was observed and why.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

On-the-fly thinking

Experience writing reviews

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay live conversations with an AI voice model, score outputs, compare image/video pairs, and explain in writing what looked off, all on your own schedule.

Ideal candidates communicate clearly in English, pay close attention to detail, and can produce concise explanations. The role supports flexible hours and remote work, with payments and access to leading LLMs provided.