Remote English AI Evaluator & Quality Auditor

Outlier

Phoenix (AZ)

Remote

USD 20,000 - 29,000

Full time

22 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Weekly payments
Remote work
Free access to leading LLMs
No minimum hours

Job summary

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media by holding live conversations with AI voice models and scoring outputs. You will compare image and video pairs, assess how well prompts are followed, and explain in writing what looked wrong, all remotely and on your own schedule.

Ideal candidates speak fluent English, have strong written communication, and pay close attention to details.

Qualifications

  • Fluent English with clear written communication.
  • Strong attention to detail and ability to replay or zoom in when something seems off.
  • Nice to have: Bachelor’s degree or above.
  • Experience writing short, evidence-based explanations or reviews.

Responsibilities

  • Hold live, scenario-based conversation in English with AI voice models and rank how natural, useful, and clear each one sounded.
  • Compare AI-generated images and videos and judge which follows the prompt better.
  • Inspect outputs closely for distortions, flickering, unnatural motion, text errors, and audio sync issues.
  • Write a specific English explanation pointing to what you saw or heard.

Skills

Fluent English
Attention to detail
Written communication
Prompt decision making
Evidence-based writing

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media by holding live conversations with AI voice models and scoring outputs. You will compare image and video pairs, assess how well prompts are followed, and explain in writing what looked wrong, all remotely and on your own schedule.

Ideal candidates speak fluent English, have strong written communication, and pay close attention to details.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote English Evaluator: AI Media Quality Review
Remote English Evaluator: AI Media Quality Review

Outlier • Manchester (NH)

Remote
USD 20,000 - 29,000
Free access to leading LLMs — worth $
Remote English AI Quality Evaluator & Feedback Expert
Remote English AI Quality Evaluator & Feedback Expert

Outlier • Baltimore (MD)

Remote
USD 15,000 - 25,000
Flexible hours
Remote work
Free access to leading LLMs
Remote English AI Reviewer & Evaluator
Remote English AI Reviewer & Evaluator

Outlier • Stamford (CT)

Remote
USD 15,000 - 25,000
Incentives
Remote work
Flexible hours
+1
Remote English AI Media Evaluator
Remote English AI Media Evaluator

Outlier • Greenville (SC)

Remote
USD 20,000 - 29,000
Flexible schedule
Remote work from anywhere
Free access to LLMs
+1
Remote English Evaluator: Judge AI Media & Prompts
Remote English Evaluator: Judge AI Media & Prompts

Outlier • Boca Raton (FL)

Remote
USD 15,000 - 25,000
Flexible hours
Fully remote
Weekly payments via ACH, PayPal andAir
+1
Remote English AI Voice Model Evaluator
Remote English AI Voice Model Evaluator

Outlier • Tampa (FL)

Remote
USD 17,000 - 24,000
Weekly payments (ACH/PayPal/AirTM)?
Free access to leading LLMs
Remote English AI Media Evaluator
Remote English AI Media Evaluator

Outlier • Columbia (SC)

Remote
USD 20,000 - 29,000
Free access to leading LLMs
Flexible hours
Weekly payments via ACH/PayPal/AirTM
+1
Remote English AI Quality Reviewer
Remote English AI Quality Reviewer

Outlier • Little Rock (AR)

Remote
USD 20,000 - 29,000
Weekly payments
Remote work
Free access to leading LLMs
+1
Remote AI Quality Evaluator — English Speaker
Remote AI Quality Evaluator — English Speaker

Outlier • Gilbert (AZ)

Remote
USD 20,000 - 29,000
Up to $18 USD/hr
Flexible hours
Remote work from anywhere
+1
Remote English AI Evaluator
Remote English AI Evaluator

Outlier • Des Moines (IA)

Remote
USD 20,000 - 29,000
Flexible schedule
Free access to leading LLMs