AI Evaluation Specialist — Remote & Flexible Hours

Outlier; Phoenix (AZ); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours, work from anywhere

Free access to leading LLMs

Missions surge earnings

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will participate in live conversations with AI voice models, score each exchange, and explain in writing what looked off, with tasks ranging from image and video evaluations to caption labeling and audio assessments.

Ideal candidates are fluent in English, highly detail-focused, and comfortable thinking on your feet.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in when something seems off.
• Pursuing or holding a Bachelor?s degree or above.
• Comfortable thinking on your feet and discussing realistic situations in a natural, conversational way.
• Experience writing concise explanations or reviews.
• Able to decide clearly when both options have flaws.
• Eligible from multiple countries including United States, United Kingdom, Canada, Ireland, Australia.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely (zoom, replay) to spot problems like distorted anatomy, flicker, or audio-video mismatch.
• Write specific English explanations pointing to what you saw or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Conversational speaking

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will participate in live conversations with AI voice models, score each exchange, and explain in writing what looked off, with tasks ranging from image and video evaluations to caption labeling and audio assessments.

Ideal candidates are fluent in English, highly detail-focused, and comfortable thinking on your feet.