AI Evaluation Specialist — Remote & Flexible

Outlier Ai; United States; Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Weekly payments

Incentives and surge pricing

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible schedule. You will roleplay live conversations with an AI voice model, rank outputs, and write concise explanations of any issues observed.

You will compare AI-generated images, videos, and captions, rating adherence, quality, and realism, with tasks spanning image evaluations, video evaluations, and captions labeling. This freelance role offers weekly payments and generous incentives.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Comfortable thinking on your feet and explaining realistic situations in a natural, conversational way.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.
• Nice to have: pursuing or holding a Bachelor's degree or above.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely, spotting issues like distorted anatomy, flickering, text errors, or audio-video mismatches.
• Write explanations in English detailing observations and reasoning.

Skills

Fluent English

Attention to detail

Clear written communication

Experience writing explanations

Decision making with flaws

Bachelor's degree (nice to have)

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible schedule. You will roleplay live conversations with an AI voice model, rank outputs, and write concise explanations of any issues observed.

You will compare AI-generated images, videos, and captions, rating adherence, quality, and realism, with tasks spanning image evaluations, video evaluations, and captions labeling. This freelance role offers weekly payments and generous incentives.