Remote AI Response Evaluator - Flexible Hours

Outlier; Santa Ana (CA); Remote; USD 17,000 - 21,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible hours

Weekly payments (ACH, PayPal, AirTM)

Job summary

Outlier is seeking detail-oriented English speakers to evaluate AI-generated media on a flexible schedule. You will roleplay live conversations with AI voice models, compare image and video outputs, and explain what was off in writing, remotely from your home or while traveling.

The work helps shape AI systems, with payments weekly and access to top LLMs. Ideal candidates are fluent in English, detail-focused, and able to provide concise, evidence-based reviews.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and patience to replay or zoom in.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making clear decisions when both options have flaws.
• Nice to have a Bachelor's degree or higher.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural and useful each sounded.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely, spotting problems like distorted anatomy, flickering, or misaligned audio.
• Rating outputs across dimensions and writing a concise explanation in English.

Skills

Fluent English

Attention to detail

Written explanations

Education

Bachelor's degree preferred

Job description

Outlier is seeking detail-oriented English speakers to evaluate AI-generated media on a flexible schedule. You will roleplay live conversations with AI voice models, compare image and video outputs, and explain what was off in writing, remotely from your home or while traveling.

The work helps shape AI systems, with payments weekly and access to top LLMs. Ideal candidates are fluent in English, detail-focused, and able to provide concise, evidence-based reviews.