AI Evaluation Specialist — Remote, Flexible Hours

Outlier; Arlington (TX); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare images and videos, and explain what looked or sounded off, all remotely and on your own schedule.

Join Outlier to help shape AI systems and earn paid contributions with flexible hours. You will receive weekly payments and free access to leading LLMs, with potential bonuses through Missions.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to replay/zoom to verify content.
• Bachelor's degree or above is nice to have.
• Comfortable thinking on your feet and discussing realistic scenarios.

Responsibilities

• Hold live English conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely (zoom/replay) to spot issues like distorted anatomy, flicker, or text/audio mismatch.
• Rate outputs on adherence, quality, and realism and write a concise English explanation.

Skills

Fluent English

Attention to detail

Bachelor's degree or higher

Thinking on your feet

Written explanations

Clear decision making

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare images and videos, and explain what looked or sounded off, all remotely and on your own schedule.

Join Outlier to help shape AI systems and earn paid contributions with flexible hours. You will receive weekly payments and free access to leading LLMs, with potential bonuses through Missions.