Remote AI Quality Evaluator: Live-Conversation Reviews

Outlier; Chandler (AZ); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Free access to leading LLMs

Work from home or while traveling

Weekly payments via ACH/PayPal/AirTM

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and compare generated images and videos to judge which follows the prompt more accurately, explaining in writing what looked or sounded off, all remotely and on your own schedule.

This contract role helps shape how advanced AI systems reason, learn, and improve through evaluation and feedback, with payments made weekly and flexible hours to

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and careful listening.
• Pursuing or holding a Bachelor's degree or above.

Responsibilities

• Hold live conversations with AI voice models and rank how natural, useful, and clear each one sounded.
• Compare AI-generated images and videos for prompt adherence and quality.
• Inspect outputs closely to spot distortions, flicker, text errors, or audio mismatches.
• Provide written explanations detailing observed issues and decisions.

Skills

Fluent English

Attention to detail

Written communication

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and compare generated images and videos to judge which follows the prompt more accurately, explaining in writing what looked or sounded off, all remotely and on your own schedule.

This contract role helps shape how advanced AI systems reason, learn, and improve through evaluation and feedback, with payments made weekly and flexible hours to