Remote AI Response Evaluator

Outlier; Fort Worth (TX); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Fully remote

Flexible hours

Weekly payments

Free LLM access

Missions surge pricing

Job summary

Outlier is hiring English-speaking evaluators to review AI-generated media from home, on a flexible schedule. You will rate live conversations with AI voice models, compare AI-created images and videos to the prompts, and explain in writing what looked or sounded off.

Ideal candidates have strong attention to detail, clear written English, and the ability to decide between imperfect options. Remote work is supported globally with weekly payments.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and careful review skills.
• Nice to have a Bachelor's degree or above.
• Comfortable thinking on your feet and describing scenarios.
• Experience writing brief, evidence-based explanations.
• Ability to decide when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos and judge prompt adherence.
• Inspect outputs closely (zoom/rewind) to spot issues like artifacts, flickering, or mismatched audio.
• Write a concise, English explanation pointing to observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Voice model conversation

Education

Bachelor's degree or higher

Job description

Outlier is hiring English-speaking evaluators to review AI-generated media from home, on a flexible schedule. You will rate live conversations with AI voice models, compare AI-created images and videos to the prompts, and explain in writing what looked or sounded off.

Ideal candidates have strong attention to detail, clear written English, and the ability to decide between imperfect options. Remote work is supported globally with weekly payments.