Remote English AI Reviewer — Live Conversation Evaluator

Outlier

Fargo (ND)

Remote

USD 20,000 - 29,000

Part time

28 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible schedule
Remote work
Free access to LLMs
Incentives (Missions)

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, all remotely and on your own schedule.

You will compare AI-generated images and videos to prompts, identify issues such as distorted motion or audio-video mismatches, and provide written explanations to help improve the systems.

Qualifications

  • Fluent English with clear written communication.
  • Excellent attention to detail and the ability to rewatch material.
  • Experience writing short, evidence-based explanations or reviews.
  • Comfortable thinking on your feet and discussing scenarios naturally.

Responsibilities

  • Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
  • Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
  • Inspecting outputs closely—including zooming in and replaying—to spot issues like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
  • Rating each output across dimensions like adherence, quality, and realism, then writing a specific English explanation that points to what you saw or heard.

Skills

Fluent English
Attention to detail
Written explanations
Decision making

Education

Bachelor's degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, all remotely and on your own schedule.

You will compare AI-generated images and videos to prompts, identify issues such as distorted motion or audio-video mismatches, and provide written explanations to help improve the systems.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote English AI Evaluator - Live Dialog & Media QA
Remote English AI Evaluator - Live Dialog & Media QA

Outlier • Chapel Hill (NC)

Remote
USD 20,000 - 29,000
Flexible hours
Remote work
Free access to leading LLMs
Remote AI Conversation Evaluator — English Expert
Remote AI Conversation Evaluator — English Expert

Outlier • Kansas City (MO)

Remote
USD 17,000 - 28,000
Competitive pay
Incentives
Flexible schedule
+1
Remote English AI Reviewer — Help AI Get It Right
Remote English AI Reviewer — Help AI Get It Right

Outlier • Arlington (TX)

Remote
USD 20,000 - 29,000
Up to $18/hr
Flexible hours, remote work
Free access to leading LLMs
+1
Remote English AI Evaluator
Remote English AI Evaluator

Outlier • Des Moines (IA)

Remote
USD 20,000 - 29,000
Flexible schedule
Free access to leading LLMs
Remote AI Media Evaluator — English Reviewer
Remote AI Media Evaluator — English Reviewer

Outlier • Saint Paul (MN)

Remote
USD 15,000 - 25,000
Flexible hours
Remote work from anywhere
Free access to leading LLMs
Remote AI Conversation Evaluator — English Speaker
Remote AI Conversation Evaluator — English Speaker

Outlier • Pittsburgh

Remote
USD 17,000 - 24,000
Flexible hours
Remote work
Weekly payments via ACH/PayPal
Remote English Conversational AI Evaluator
Remote English Conversational AI Evaluator

Scale AI • United States

Remote
USD 17,000 - 24,000
Remote English AI Reviewer - Spot AI Flaws & Improve
Remote English AI Reviewer - Spot AI Flaws & Improve

Outlier • Iowa City (IA)

Remote
USD 20,000 - 29,000
Pay up to 18 USD/hr
Flexible remote work
Free access to leading LLMs
+1
Remote English AI Reviewer - Live Conversation Evaluator
Remote English AI Reviewer - Live Conversation Evaluator

Outlier • Akron (OH)

Remote
USD 19,000 - 30,000
Hourly pay up to $18 USD
Flexible hours, work from home or on‑a
Free access to leading LLMs
+1
Remote English Evaluator: Judge AI Media & Prompts
Remote English Evaluator: Judge AI Media & Prompts

Outlier • Boca Raton (FL)

Remote
USD 15,000 - 25,000
Flexible hours
Fully remote
Weekly payments via ACH, PayPal andAir
+1