Remote AI Evaluation Specialist

Outlier; Aurora (CO); Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Free LLM access

Weekly payments

Job summary

Outlier seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges for naturalness and usefulness, and explain in writing what looked or sounded off, all remotely on your schedule.

At Outlier, your insights help shape how advanced AI systems reason and improve. You will evaluate images, videos, and audio for alignment with prompts and overall quality, with flexible hours and access to leading LLMs.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and the ability to replay or zoom in when something seems off.
• Bachelor's degree or higher preferred.
• Ability to think on your feet and discuss realistic situations in a natural, conversational way.
• Experience writing concise explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations with AI voice models, then rank how natural, useful, and clear each one sounded.
• Compare AI-generated images and videos to assess which better follows the prompt.
• Inspect outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio/video mismatch.
• Rate each output across dimensions like adherence, quality, and realism, then write a specific English explanation.

Skills

Fluent English

Strong written communication

Attention to detail

Adaptability

Clear speaking

Education

Bachelor's degree or higher

Job description

Outlier seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges for naturalness and usefulness, and explain in writing what looked or sounded off, all remotely on your schedule.

At Outlier, your insights help shape how advanced AI systems reason and improve. You will evaluate images, videos, and audio for alignment with prompts and overall quality, with flexible hours and access to leading LLMs.