Remote Video & AI Media Evaluator — Freelance

Torentify; United States; Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Fully remote freelance work

Flexible schedule

Free access to leading LLMs

Global contributor community

Job summary

Outlier is seeking detail-oriented English speakers to evaluate AI-generated media, including voice conversations, images, and videos. Contributors will interact with AI voice models and compare outputs to prompts, providing clear, evidence-based feedback.

This is a remote freelance opportunity with a flexible schedule and no minimum weekly hours. Contributors may work on different evaluation tasks across projects as available.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail when reviewing visual and audio content.
• Able to think quickly and respond naturally in realistic conversational scenarios.
• Bachelor’s degree or higher is a plus.

Responsibilities

• Conduct live, scenario-based conversations in English with AI voice models and evaluate their naturalness, usefulness, and clarity.
• Compare AI-generated media to determine which output better follows the given prompt.
• Inspect visual and audio content to identify errors and inconsistencies.
• Identify issues such as distorted anatomy, unnatural movement, flickering, text errors, and mismatched audio.
• Rate outputs based on prompt adherence, quality, realism, and other evaluation criteria.
• Write specific explanations in English describing the issues observed in each output.
• Evaluate AI-generated images, including edited images compared with original versions.
• Review AI-generated videos against text prompts or source clips.
• Label first-person videos of people or robots performing hands-on tasks by identifying actions and writing captions.
• Evaluate AI-generated speech for naturalness, pronunciation, and similarity to a target voice.
• Record short voice explanations when required by a project.

Skills

Fluent English

Attention to detail

Written communication

Quick thinking

Patience

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to evaluate AI-generated media, including voice conversations, images, and videos. Contributors will interact with AI voice models and compare outputs to prompts, providing clear, evidence-based feedback.

This is a remote freelance opportunity with a flexible schedule and no minimum weekly hours. Contributors may work on different evaluation tasks across projects as available.