AI Model Quality Evaluator — Remote, Flexible Hours

Outlier; Lexington (KY); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free LLM access

Incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will role-play live conversations with an AI voice model and rate how natural, useful, and clear each exchange sounds, then explain what looked or sounded off, remotely and on your own schedule.

Responsibilities include comparing AI-generated images and videos to prompts, inspecting outputs for issues, and writing concise explanations in English. Remote work with flexible hours is available.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in.
• Nice to have: Bachelor's degree or above.
• Comfortable thinking on your feet and explaining decisions clearly.
• Experience writing concise, evidence-based explanations or reviews.
• Able to decide when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging which follows prompts better.
• Inspect outputs closely, spotting distortions, flicker, or misalignment and describing issues in writing.
• Rating outputs across dimensions like adherence, quality, and realism and writing explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under ambiguity

Experience writing explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will role-play live conversations with an AI voice model and rate how natural, useful, and clear each exchange sounds, then explain what looked or sounded off, remotely and on your own schedule.

Responsibilities include comparing AI-generated images and videos to prompts, inspecting outputs for issues, and writing concise explanations in English. Remote work with flexible hours is available.