AI Response Evaluator — Remote & Flexible

Outlier; Tucson (AZ); Remote; USD 17,000 - 24,000; Full time

Job summary

Outlier is hiring detail-oriented reviewers to assess AI-generated media from anywhere in the world. You’ll engage in live conversations with AI voice models, compare AI-generated images and videos to prompts, and write concise explanations of what looked or sounded off, all remotely and on your own schedule.

Great candidates are fluent in English with strong written communication and keen attention to detail.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Strong attention to detail and ability to replay or zoom in closely to spot issues.
• Nice to have: Pursuing or holding a Bachelor’s degree or above.
• Able to think on your feet and discuss realistic situations conversationally.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then rating how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or mismatched audio.
• Rating outputs across dimensions and writing a written explanation in English detailing observations.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making with imperfect options

Education

Bachelor’s degree or above (nice to have)

Job description

Outlier is hiring detail-oriented reviewers to assess AI-generated media from anywhere in the world. You’ll engage in live conversations with AI voice models, compare AI-generated images and videos to prompts, and write concise explanations of what looked or sounded off, all remotely and on your own schedule.

Great candidates are fluent in English with strong written communication and keen attention to detail.