Remote AI Evaluation Specialist - Flexible Hours

Outlier; Bellevue (WA); Remote; USD 17,000 - 24,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate how well responses follow prompts. You will hold live conversations with an AI voice model, compare generated images and videos, and explain in writing what looked off, all remotely and on your own schedule.

Work from home with flexible hours, earning up to $15 USD/hr, with weekly payments. You’ll get free access to leading LLMs to aid evaluations as you contribute to AI improvements.

Qualifications

• Fluent English with strong written communication.
• Attention to detail and ability to replay or zoom in for accuracy.
• Bachelor's degree or above (nice to have).
• Comfortable speaking in natural, conversational English.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging adherence to the prompt.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or audio-video mismatch.
• Writing explanations in English that clearly point to observed issues.

Skills

Fluent English

Clear written communication

Attention to detail

Conversational English

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate how well responses follow prompts. You will hold live conversations with an AI voice model, compare generated images and videos, and explain in writing what looked off, all remotely and on your own schedule.

Work from home with flexible hours, earning up to $15 USD/hr, with weekly payments. You’ll get free access to leading LLMs to aid evaluations as you contribute to AI improvements.