AI Evaluation Specialist: Remote & Flexible Hours

Outlier; Amherst (MA); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free LLM access

Weekly payments

Job summary

Outlier is hiring detail-oriented reviewers to evaluate AI-generated media from the comfort of your home. You will engage in live conversations with AI voice models, compare images and videos to prompts, and provide written explanations of issues found.

This remote role offers flexible hours and weekly payments. You will assess adherence, quality, and realism across audio, video, and visuals, then describe why a given output didn’t meet the prompt.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in on content.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making clear decisions when there are flaws in options.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or audio-video misalignment.
• Writing explanations in English detailing what looked or sounded off, with specifics.

Skills

Fluent English

Attention to detail

Clear writing

Decision making

Education

Bachelor's degree

Job description

Outlier is hiring detail-oriented reviewers to evaluate AI-generated media from the comfort of your home. You will engage in live conversations with AI voice models, compare images and videos to prompts, and provide written explanations of issues found.

This remote role offers flexible hours and weekly payments. You will assess adherence, quality, and realism across audio, video, and visuals, then describe why a given output didn’t meet the prompt.