AI Media Quality Evaluator - Remote & Flexible Hours

Outlier; Houston (TX); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Up to $18/hr

Flexible hours

Free LLM access

Surge pricing bonus

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll hold live conversations with AI voice models, rank responses by naturalness and usefulness, and explain what sounded off in writing.

Tasks include comparing AI-generated images and videos to prompts, inspecting outputs for artifacts or misalignment, and rating across dimensions with a concise rationale. This remote role offers flexible hours.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in on outputs.
• Bachelor's degree or above preferred.
• Comfortable speaking in natural, conversational English.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely, including zooming and replaying, to spot problems like distorted anatomy, flickering, or misaligned text/audio.
• Rating each output across dimensions and writing a concise explanation in English that points to what you saw or heard.

Skills

Fluent English

Attention to detail

Strong written communication

Bachelor's degree or above

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll hold live conversations with AI voice models, rank responses by naturalness and usefulness, and explain what sounded off in writing.

Tasks include comparing AI-generated images and videos to prompts, inspecting outputs for artifacts or misalignment, and rating across dimensions with a concise rationale. This remote role offers flexible hours.