AI Evaluation Specialist — Remote, Flexible Hours

Outlier; Honolulu (HI); Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Flexible schedule

Weekly payments via PayPal/Ach

Free access to leading LLMs

Global Outlier Experts community

Job summary

Outlier is seeking detail-oriented English-speaking reviewers to evaluate AI-generated media. You will engage in live conversations with AI voice models, compare image/video prompts, and provide written explanations of observed issues. Flexible remote work with weekly pay and access to AI tools.

Ideal candidates have strong written English, attention to detail, and the ability to make clear decisions when both options have flaws. A Bachelor's degree is a plus.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Experience writing concise, evidence-based explanations or reviews.
• Nice to have: pursuing or holding a Bachelor's degree or above.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely to spot problems like distorted anatomy, flickering, or audio-video mismatch.
• Write a specific English explanation pointing to what you saw or heard.
• Label first-person videos of tasks, splitting into actions and writing precise captions.
• Rate speech on naturalness and matching a target voice.

Skills

English fluency

Written communication

Attention to detail

Decision making

Education

Bachelor's degree

Job description

Outlier is seeking detail-oriented English-speaking reviewers to evaluate AI-generated media. You will engage in live conversations with AI voice models, compare image/video prompts, and provide written explanations of observed issues. Flexible remote work with weekly pay and access to AI tools.

Ideal candidates have strong written English, attention to detail, and the ability to make clear decisions when both options have flaws. A Bachelor's degree is a plus.