AI Evaluation Specialist | Remote & Flexible Hours

Outlier; United States; Hybrid; USD 17,000 - 28,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible hours & remote work

Weekly payments (ACH/PayPal)

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, remotely and on your own schedule.

Earn up to $15 USD/hr with flexible hours, weekly payments, and access to leading LLMs. Contribute to shaping AI that performs better in real-world use cases while working from home or while traveling.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail; ability to replay and zoom in when something seems off.
• Pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet in realistic situations.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models.
• Ranking how natural, useful, and clear each one sounded.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Spotting problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatch.
• Writing explanations in English that point to what you saw or heard.
• Rating outputs across dimensions like adherence, quality, and realism.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under pressure

Adaptability

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, remotely and on your own schedule.

Earn up to $15 USD/hr with flexible hours, weekly payments, and access to leading LLMs. Contribute to shaping AI that performs better in real-world use cases while working from home or while traveling.