Remote AI Conversation Evaluator — English, Flexible Hours

Outlier; Irving (TX); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Fully remote

Flexible hours

Paid weekly via ACH/PayPal/AirTM

Free access to leading LLMs

Job summary

Outlier is offering a fully remote, flexible-hours role for English-speaking evaluators to review AI-generated media. You will hold live conversations with AI voice models, compare outputs, and explain discrepancies in writing, all on your own schedule.

Paid weekly for contract work, with rate up to $15/hr and additional incentives based on project needs and performance. Access to leading LLMs is included, along with guidance on rating realism and adherence to prompts.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in on content.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making a clear decision when both options have flaws.
• Pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which followed the prompt better.
• Inspecting outputs closely, spotting issues like distortions, flickering, or misaligned audio/video.
• Rating outputs across dimensions and writing a concise explanation in English.
• Contributing to common evaluation tasks like image, video, and caption labeling reviews.

Skills

Fluent English

Attention to detail

Clear written communication

Strong reasoning under pressure

Quick decision making

Bachelor's degree in progress

Education

Bachelor’s degree or higher

Job description

Outlier is offering a fully remote, flexible-hours role for English-speaking evaluators to review AI-generated media. You will hold live conversations with AI voice models, compare outputs, and explain discrepancies in writing, all on your own schedule.

Paid weekly for contract work, with rate up to $15/hr and additional incentives based on project needs and performance. Access to leading LLMs is included, along with guidance on rating realism and adherence to prompts.