AI Response Evaluator — Remote & Flexible Hours

Outlier; Boca Raton (FL); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn Up to $18 USD/hr

Flexible schedule

Free LLM access

Missions incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay live conversations with AI voice models, rate outputs, and explain what looked or sounded off in writing.

Work on your own schedule from anywhere, with weekly payments and access to leading LLMs. Ideal candidates have strong attention to detail and clear written communication, plus a Bachelor’s degree or higher is a plus.

Qualifications

• Fluent English with clear written communication and comfortable with everyday conversational speech.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Bachelor’s degree or higher is nice to have.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, or audio-video misalignment.
• Write specific explanations in English detailing what you saw or heard.

Skills

Fluent English

Attention to detail

Written communication

Oral communication

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay live conversations with AI voice models, rate outputs, and explain what looked or sounded off in writing.

Work on your own schedule from anywhere, with weekly payments and access to leading LLMs. Ideal candidates have strong attention to detail and clear written communication, plus a Bachelor’s degree or higher is a plus.