AI Model Quality Evaluator - Remote & Flexible

Outlier; New Haven (CT); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, score exchanges, and explain what looks or sounds off, all remotely and on your own schedule.

Responsibilities include comparing AI-generated images and videos to evaluate adherence to prompts, and writing concise explanations in English that highlight issues, helping advance AI systems in real-world use.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and patience to replay or zoom in.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows prompts better.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, text errors, or misaligned audio.
• Write specific explanations in English pointing to what you saw or heard.

Skills

Fluent English

Attention to detail

Clear decision-making

Strong written communication

Experience in reviews

Comfortable thinking on your feet

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, score exchanges, and explain what looks or sounds off, all remotely and on your own schedule.

Responsibilities include comparing AI-generated images and videos to evaluate adherence to prompts, and writing concise explanations in English that highlight issues, helping advance AI systems in real-world use.