Remote AI Evaluation & QA Specialist (English)

Outlier

Scottsdale (AZ)

Remote

USD 12,000 - 21,000

Full time

16 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work
Flexible hours
Weekly payments
Free access to leading LLMs

Job summary

Outlier invites detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You’ll role-play conversations with AI voice models, compare AI-produced images and videos, and explain what went wrong in writing. Your work helps steer AI systems toward clearer, more reliable outputs.

Ideal candidates have strong written English, keen attention to detail, and the ability to justify judgments with concise explanations. This is a 1099-style, freelance opportunity.

Qualifications

  • Fluent English speaker with strong written communication skills.
  • Great attention to detail and the patience to replay/zoom in when something seems off.
  • Nice to have: pursuing or holding a Bachelor’s degree or above.
  • Able to think on your feet and discuss realistic scenarios naturally.
  • Experience writing short, evidence-based explanations or reviews.
  • Able to decide clearly when both options have flaws.

Responsibilities

  • Holding a live, scenario-based conversation in English with AI voice models and ranking how natural, useful, and clear each sounded.
  • Comparing AI-generated image and video pairs and judging which follows the prompt better.
  • Inspecting outputs closely (zooming in, replaying) to spot problems like distortions, flickering, text errors, or misaligned audio.
  • Rating outputs across dimensions like adherence, quality, and realism and writing a concise English explanation.

Skills

Fluent English
Attention to detail
Clear written communication
Decision making
Experience writing explanations

Education

Bachelor’s degree or above

Job description

Outlier invites detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You’ll role-play conversations with AI voice models, compare AI-produced images and videos, and explain what went wrong in writing. Your work helps steer AI systems toward clearer, more reliable outputs.

Ideal candidates have strong written English, keen attention to detail, and the ability to justify judgments with concise explanations. This is a 1099-style, freelance opportunity.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation Specialist - English
Remote AI Evaluation Specialist - English

Outlier • Naperville (IL)

Remote
USD 12,000 - 21,000
Weekly payments (ACH/PayPal/AirTM)
Free access to leading LLMs
Remote work with flexible hours
Remote AI Evaluation Specialist - English
Remote AI Evaluation Specialist - English

Outlier • Pasadena (CA)

Remote
USD 12,000 - 21,000
Flexible hours
Remote work
Free access to leading LLMs
Remote AI Evaluation & Feedback Specialist
Remote AI Evaluation & Feedback Specialist

Outlier • Laredo (TX)

Remote
USD 17,000 - 21,000
Flexible hours
Remote work
Weekly payments
+1
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Outlier • City of Syracuse (NY)

Hybrid
USD 17,000 - 28,000
Flexible hours
Remote work from home
Free access to leading LLMs
Remote AI Evaluation Specialist (English)
Remote AI Evaluation Specialist (English)

Outlier • Eugene (OR)

Remote
USD 17,000 - 21,000
Remote work
Flexible hours
Weekly payments
+1
Remote AI Quality Evaluator — English Speaker
Remote AI Quality Evaluator — English Speaker

Outlier • Laredo (TX)

Remote
USD 17,000 - 24,000
Fully remote
Flexible hours
Up to $15 USD/hr
+1
Remote AI Media QA Analyst (English)
Remote AI Media QA Analyst (English)

Outlier • Gilbert (AZ)

Remote
USD 17,000 - 24,000
Paid weekly via ACH
Flexible hours
Remote work
+1
Remote AI Evaluator — English QA & Insights
Remote AI Evaluator — English QA & Insights

Outlier • Santa Barbara (CA)

Remote
USD 17,000 - 24,000
Flexible hours
Fully remote work
Weekly payments via ACH, PayPal andAir
+1
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Outlier • New Haven (CT)

Remote
USD 17,000 - 24,000
Remote work
Flexible hours
Free access to leading LLMs
+1
Remote AI QA Evaluator (English) - Flexible Hours
Remote AI QA Evaluator (English) - Flexible Hours

Outlier • Phoenix (AZ)

Remote
USD 17,000 - 24,000
Free access to leading LLMs