AI Output Quality Evaluator — Remote & Flexible Hours

Outlier; Albuquerque (NM); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home with a flexible schedule. You will roleplay live conversations with AI voice models, compare media, and explain in writing what looked or sounded off.

Your work helps improve AI reasoning and performance through a structured evaluation process. Contributors review images, videos, and captions, rating adherence, quality, and realism.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and patience to replay or zoom in.
• Ability to articulate judgments clearly in writing.
• Comfortable working remotely with a flexible schedule.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like distortions, flickering, or audio-video mismatches.
• Write targeted explanations in English describing what was observed and why.

Skills

Fluent English

Attention to detail

Clear communication

Decision making

Explaining reviews

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home with a flexible schedule. You will roleplay live conversations with AI voice models, compare media, and explain in writing what looked or sounded off.

Your work helps improve AI reasoning and performance through a structured evaluation process. Contributors review images, videos, and captions, rating adherence, quality, and realism.