Remote AI Conversation Evaluator — English Speaker

Outlier; Manchester (NH); Remote; USD 14,000 - 21,000; Full time

Benefits offered by this job

Weekly payments

Remote work

Free access to leading LLMs

Job summary

Outlier offers a remote, flexible opportunity to review AI-generated media by holding live conversations with AI voice models and rating how well responses follow prompts. You will compare AI-generated images and videos, explain issues in writing, and contribute to improving frontier AI systems from the comfort of your home on your own schedule.

We pay on a weekly basis and provide access to leading LLMs. This freelance contract supports remote work worldwide, and rates vary by expertise and

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Capable of thinking on your feet and explaining in natural conversation.
• Experience writing concise, evidence-based explanations.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking responses.
• Comparing AI-generated images and videos and judging prompt adherence.
• Inspecting outputs closely, spotting problems like distortions or mismatched audio.
• Rating outputs on adherence, quality, realism; writing explanations in English.

Skills

Fluent English

Attention to detail

Written communication

Education

Bachelor's degree or above

Job description

Outlier offers a remote, flexible opportunity to review AI-generated media by holding live conversations with AI voice models and rating how well responses follow prompts. You will compare AI-generated images and videos, explain issues in writing, and contribute to improving frontier AI systems from the comfort of your home on your own schedule.

We pay on a weekly basis and provide access to leading LLMs. This freelance contract supports remote work worldwide, and rates vary by expertise and