Remote AI Conversation Evaluator – English Speaker

Outlier; North Las Vegas (NV); Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Weekly payments

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models and assess how well outputs follow prompts, then explain what looked wrong in writing.

This contract-type work leverages your ability to spot artifacts across images, videos, and audio while contributing to frontier AI research. Ideal candidates have strong written communication, a degree or higher, and comfort with rapid

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and careful review of content.
• Bachelor's degree or higher is advantageous or required.
• Able to think on your feet and explain scenarios clearly.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely (zooming in, replaying) to spot issues like distortion or mismatches.
• Rating outputs across dimensions (adherence, quality, realism) and writing explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models and assess how well outputs follow prompts, then explain what looked wrong in writing.

This contract-type work leverages your ability to spot artifacts across images, videos, and audio while contributing to frontier AI research. Ideal candidates have strong written communication, a degree or higher, and comfort with rapid