AI Response Evaluator — Remote, Flexible Hours

Outlier; Tacoma (WA); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free LLM access

Missions incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay live conversations with AI voice models, score outputs for naturalness and alignment with prompts, and write concise explanations of what looked or sounded off.

You’ll compare AI-generated images and videos, assess distortions or artifacts, and provide feedback remotely. Training and access to leading LLMs are provided.

Qualifications

• Fluent English with clear written communication.
• High attention to detail and careful reviewing.
• Ability to explain observations concisely.
• Comfort with evaluating AI-generated media.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models.
• Ranking naturalness, usefulness, and clarity of outputs.
• Comparing AI-generated images and videos to judge prompt adherence.
• Writing specific English explanations of what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay live conversations with AI voice models, score outputs for naturalness and alignment with prompts, and write concise explanations of what looked or sounded off.

You’ll compare AI-generated images and videos, assess distortions or artifacts, and provide feedback remotely. Training and access to leading LLMs are provided.