Remote AI Evaluation Specialist - English Speaker

Outlier; United States; Remote; USD 14,000 - 21,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Free LLM access

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll roleplay live conversations with AI voice models, score exchanges, and explain in writing what sounded off, remotely and on your own schedule.

Responsibilities include comparing AI-generated images and videos, judging which follows the prompt more closely, and writing concise explanations in English to help improve AI systems.

Qualifications

• Fluent English and clear written communication.
• Strong attention to detail and patience to replay/s analyze.
• Bachelor's degree or higher preferred but not required.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking how natural, useful, and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely, spotting issues like distorted anatomy, flickering, or audio-video misalignment.
• Writing concise, evidence-based explanations in English describing what was observed.

Skills

Fluent English

Attention to detail

Written communication

Clear explanations

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll roleplay live conversations with AI voice models, score exchanges, and explain in writing what sounded off, remotely and on your own schedule.

Responsibilities include comparing AI-generated images and videos, judging which follows the prompt more closely, and writing concise explanations in English to help improve AI systems.