Remote English AI Evaluator: Spot Flaws & Improve Models

Outlier; Bellevue (WA); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Up to $18 USD/hr

Flexible hours

Free access to leading LLMs

Missions surge pricing bonus

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on your own schedule. You will hold live conversations with AI voice models, compare outputs, and explain what looked off or inaccurate.

You'll rate responses across adherence and realism and provide written explanations in English. The role is remote with flexible hours, and payments are issued weekly via ACH, PayPal or AirTM.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Excellent attention to detail and patience to replay or zoom in on details.
• Bachelor's degree or above is preferred.
• Ability to think on your feet and articulate reasoning clearly in writing.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging prompt-adherence.
• Inspecting outputs closely to spot problems like distortions or mismatches and describe issues in English.
• Rating outputs across dimensions like adherence, quality, and realism, with written explanations.

Skills

Fluent English

Attention to detail

Written explanations

Decision making

Clear communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on your own schedule. You will hold live conversations with AI voice models, compare outputs, and explain what looked off or inaccurate.

You'll rate responses across adherence and realism and provide written explanations in English. The role is remote with flexible hours, and payments are issued weekly via ACH, PayPal or AirTM.