AI Quality Evaluator - Remote, Flexible Hours

Outlier; Fargo (ND); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Free access to leading LLMs

Weekly payments via ACH/PayPal/AirTM

Job summary

Outlier is hiring detail-oriented reviewers to evaluate AI-generated media through live conversations with AI voice models and by comparing AI-generated images and videos. You will rate adherence to prompts, realism, and quality, then provide written explanations in English for each evaluation.

This is a fully remote, flexible-hours contractor role, paid weekly on an hourly basis at up to $15/hr, with additional incentives.

Qualifications

• Fluent English with clear written communication
• Strong attention to detail and ability to replay/review content
• Desirable: pursuing or holding a Bachelor's degree or above
• Ability to think and explain decisions clearly in writing
• Willingness to work remotely with flexible scheduling

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking naturalness and usefulness
• Comparing AI-generated images and videos to assess prompt adherence
• Inspecting outputs for distortions, flickering, or misalignment between audio and video
• Providing written explanations detailing observed issues and rationale
• Creating precise, concise feedback in English for each task

Skills

Fluent English

Attention to detail

Clear written communication

Bachelor's degree or above (inferred)

Education

Bachelor's degree or above

Job description

Outlier is hiring detail-oriented reviewers to evaluate AI-generated media through live conversations with AI voice models and by comparing AI-generated images and videos. You will rate adherence to prompts, realism, and quality, then provide written explanations in English for each evaluation.

This is a fully remote, flexible-hours contractor role, paid weekly on an hourly basis at up to $15/hr, with additional incentives.