AI Response Evaluator — Remote, Flexible Hours

Outlier; Richmond (VA); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay live conversations with AI voice models, score each exchange, and explain what looked or sounded off in writing. This is a flexible, home-based role with no minimum hours and weekly payments.

You’ll review images, videos, and captions, providing precise, evidence-based feedback. Applicants from multiple countries are welcome, including the United States, with pay up to $18

Qualifications

• Fluent English with strong written communication and careful review skills.
• Detail-oriented reviewer able to explain observations clearly.
• Bachelor’s degree or higher is preferred but not required for the right candidate.

Responsibilities

• Hold live conversations with AI voice models, then rank naturalness and usefulness.
• Compare AI-generated images and videos, judging which better follows prompts.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, or audio-video misalignment.
• Rate outputs on adherence, quality, and realism, and write a written explanation in English.

Skills

Fluent English

Attention to detail

Clear written communication

Adaptability

Fast learner

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay live conversations with AI voice models, score each exchange, and explain what looked or sounded off in writing. This is a flexible, home-based role with no minimum hours and weekly payments.

You’ll review images, videos, and captions, providing precise, evidence-based feedback. Applicants from multiple countries are welcome, including the United States, with pay up to $18