Remote AI Evaluation Specialist — Flexible Hours

Outlier; Amherst (MA); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours

Free access to leading LLMs

Missions surge incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate conversations with AI voice models. You will compare image and video outputs to prompts, explain what looked or sounded off, and work remotely on a flexible schedule.

Ideal candidates are fluent in English, highly detail-oriented, and able to provide concise, evidence-based explanations. This remote role offers up-to-date access to leading LLMs and no minimum hours required.

Qualifications

• Fluent English speaker with strong written communication and comfortable with conversational speech.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Nice to have: Pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and explaining your reasoning clearly.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos to judge adherence to prompts.
• Inspecting outputs closely, noting distortions, artifacts, or mismatches, and describing findings in writing.
• Rating outputs across dimensions and writing detailed explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Bachelor's degree (nice to have)

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate conversations with AI voice models. You will compare image and video outputs to prompts, explain what looked or sounded off, and work remotely on a flexible schedule.

Ideal candidates are fluent in English, highly detail-oriented, and able to provide concise, evidence-based explanations. This remote role offers up-to-date access to leading LLMs and no minimum hours required.