AI Response Evaluator — Remote, Flexible Hours

Outlier; Toledo (OH); Hybrid; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Weekly payments

Job summary

Outlier invites detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will engage in live conversations with AI voice models, compare image and video outputs, and explain what’s off in writing. Your insights help steer AI systems toward more accurate, realistic results.

Work remotely with weekly payments and access to leading LLMs. Ideal candidates have strong attention to detail and the ability to articulate issues clearly in English.

Qualifications

• Fluent English speaker with strong written communication.
• Great attention to detail and ability to replay or zoom in to spot issues.
• Bachelor’s degree or above is nice to have.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking how natural, useful, and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
• Rating outputs across dimensions (adherence, quality, realism) and writing a concise English explanation of findings.

Skills

Fluent English

Attention to detail

Clear written communication

Education

Bachelor's degree

Job description

Outlier invites detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will engage in live conversations with AI voice models, compare image and video outputs, and explain what’s off in writing. Your insights help steer AI systems toward more accurate, realistic results.

Work remotely with weekly payments and access to leading LLMs. Ideal candidates have strong attention to detail and the ability to articulate issues clearly in English.