Remote Prompt QA Evaluator for AI Media

Outlier; Denver (CO); Hybrid; USD 20,000 - 29,000; Part time

Benefits offered by this job

Flexible hours

Free access to LLMs

Earn up to $18/hr

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, score exchanges, and compare image and video pairs to judge prompt adherence.

You will explain in writing what looked or sounded off, all remotely and on your own schedule. Work from home with flexible hours, and earn compensation based on expertise and project requirements.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in on content.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable thinking on your feet and discussing realistic scenarios.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images and videos and judge which follows prompts better.
• Inspect outputs closely to spot problems such as distorted anatomy, flickering, or misaligned audio.
• Write a concise explanation in English detailing what you saw or heard.

Skills

Fluent English

Attention to detail

Clear writing

Comfort with conversations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, score exchanges, and compare image and video pairs to judge prompt adherence.

You will explain in writing what looked or sounded off, all remotely and on your own schedule. Work from home with flexible hours, and earn compensation based on expertise and project requirements.