AI Output Evaluator — Remote & Flexible Hours

Outlier; Morgantown (WV); Hybrid; USD 17,000 - 25,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to evaluate AI-generated media from anywhere with a flexible schedule. You will engage in live conversations with AI voice models, compare media pairs, and judge alignment with prompts while providing written explanations of issues observed.

Tasks include rating outputs on adherence, quality, and realism, and using zoomed-in inspection to spot anomalies in video, image and audio data.

Qualifications

• Fluent English with clear written communication and comfortable with natural conversational speech.
• Strong attention to detail and patience to replay or zoom in when things seem off.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Holding live conversations in English with AI voice models and ranking how natural and clear they sound.
• Comparing AI-generated images and videos, judging which better follows the prompt.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, text or audio-video mismatches.
• Writing a specific English explanation pointing to what was observed for each output.

Skills

Fluent English

Attention to detail

Excellent written communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to evaluate AI-generated media from anywhere with a flexible schedule. You will engage in live conversations with AI voice models, compare media pairs, and judge alignment with prompts while providing written explanations of issues observed.

Tasks include rating outputs on adherence, quality, and realism, and using zoomed-in inspection to spot anomalies in video, image and audio data.