AI Media Quality Evaluator - Remote, Flexible Hours

Outlier; Arlington (VA); Remote; USD 20,000 - 29,000; Part time

Job summary

Outlier seeks detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will roleplay live conversations with AI voice models, rate outputs for adherence to prompts, and provide written explanations of any issues observed.

Work is fully remote with flexible hours and weekly payments. This role helps shape how AI systems reason and improve, with access to leading LLMs and the chance to impact frontier research.

Qualifications

• Fluent English required with clear, written communication.
• Strong attention to detail and careful listening.
• Bachelors degree or higher preferred.
• Comfortable thinking and speaking clearly in everyday conversations.
• Experience writing concise, evidence-based explanations.

Responsibilities

• Hold live conversations with AI voice models and rank naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely and note issues like distorted visuals, flickering, or misaligned audio.
• Write English explanations pointing to what you saw or heard for each interaction.

Skills

Fluent English

Attention to detail

Clear written communication

Natural conversation style

Fast learner

Education

Bachelors degree or above

Job description

Outlier seeks detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will roleplay live conversations with AI voice models, rate outputs for adherence to prompts, and provide written explanations of any issues observed.

Work is fully remote with flexible hours and weekly payments. This role helps shape how AI systems reason and improve, with access to leading LLMs and the chance to impact frontier research.