Remote AI Quality Evaluator — Spot Issues & Explain

Outlier; Gilbert (AZ); Hybrid; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments via ACH/PayPal/AirTM

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, score exchanges, and compare AI-created images and videos to determine which better follows the prompt. You will explain in writing what looked or sounded off, all remotely and on your own schedule.

Join Outlier to help shape how advanced AI systems reason and improve. This is a 1099 freelance opportunity with flexible hours and remote work from anywhere.

Qualifications

• Fluent English speaker with clear written communication and comfort with natural conversation.
• Strong attention to detail and patience to replay or zoom in on content when something seems off.
• Bachelor's degree or above is nice to have.
• Comfortable thinking on your feet and discussing realistic situations.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and rating naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos against prompts and judging adherence to instructions.
• Inspecting outputs closely for issues like distorted anatomy, flickering, or mismatched audio/video and describing issues in writing.
• Rating each output across dimensions and writing a concise explanation in English referencing what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under imperfect data

Written explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, score exchanges, and compare AI-created images and videos to determine which better follows the prompt. You will explain in writing what looked or sounded off, all remotely and on your own schedule.

Join Outlier to help shape how advanced AI systems reason and improve. This is a 1099 freelance opportunity with flexible hours and remote work from anywhere.