AI Response Evaluator — Remote, Flexible, Up to $18/hr

Outlier; Providence (RI); Remote; USD 20,000 - 29,000; Part time

Benefits offered by this job

Rate up to $18/hr

Flexible schedule

Free LLM access

Missions surge pay

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will role-play live conversations, compare AI outputs, and explain what’s off in writing, from home on your own schedule.

Pay is up to $18 USD per hour with weekly payments and access to leading LLMs. This opportunity emphasizes accuracy, consistency, and clear, evidence-based explanations across diverse AI tasks.

Qualifications

• Fluent English with strong, clear written communication.
• Excellent written explanation of what is wrong in AI outputs.
• Ability to think and write clearly under evaluation tasks.
• Comfortable deciding when both options have flaws.

Responsibilities

• Holding live conversations with AI voice models and ranking naturalness and clarity.
• Comparing AI-generated images/videos and judging adherence to prompts.
• Inspecting outputs closely to spot issues like artifacts, inconsistent audio, and motion.
• Writing concise, evidence-based explanations in English describing findings.

Skills

Fluent English

Evidence-based writing

Attention to detail

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will role-play live conversations, compare AI outputs, and explain what’s off in writing, from home on your own schedule.

Pay is up to $18 USD per hour with weekly payments and access to leading LLMs. This opportunity emphasizes accuracy, consistency, and clear, evidence-based explanations across diverse AI tasks.