Remote AI Evaluation Specialist - Flexible Hours

Outlier; Worcester (MA); Remote; USD 17,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home, on a flexible schedule. You will roleplay live conversations with AI voice models and evaluate outputs for prompt compliance and quality.

Responsibilities include comparing image/video pairs, identifying issues, and writing concise explanations in English. Remote work offers flexible hours and weekly payments, with access to leading LLMs.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail with patience to replay or zoom in.
• Experience writing concise, evidence-based reviews or explanations.
• Comfortable thinking on your feet and discussing realistic scenarios in conversation.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos to judge adherence to prompts.
• Inspect outputs closely (zoom/replay) to spot issues like artifacts, flickering, or misalignment.
• Write specific English explanations pointing to what was seen or heard.

Skills

Fluent English

Attention to detail

Evidence-based explanations

Clear written communication

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home, on a flexible schedule. You will roleplay live conversations with AI voice models and evaluate outputs for prompt compliance and quality.

Responsibilities include comparing image/video pairs, identifying issues, and writing concise explanations in English. Remote work offers flexible hours and weekly payments, with access to leading LLMs.