Remote AI Evaluator — English QA & Insights

Outlier

Santa Barbara (CA)

Remote

USD 17,000 - 24,000

Full time

20 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible hours
Fully remote work
Weekly payments via ACH, PayPal andAir
Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media entirely remotely and on flexible hours. In this role, you will roleplay live conversations with AI voice models, score exchanges for naturalness and usefulness, and explain in writing what looked or sounded off.

You will compare AI-generated images and videos to determine which follows prompts better, inspect outputs closely for artifacts, and provide concise, evidence-based explanations in English.

Qualifications

  • Fluent English with clear written communication.
  • Excellent attention to detail and ability to review closely.
  • Bachelor's degree or higher preferred.
  • Comfortable discussing realistic scenarios and reasoning aloud.
  • Experience writing concise, evidence-based reviews.
  • Ability to decide clearly when options have flaws.

Responsibilities

  • Holding live, scenario-based conversations in English with AI voice models.
  • Ranking how natural, useful, and clear each response sounds.
  • Comparing AI-generated images and videos and judging prompt adherence.
  • Inspecting outputs to spot distortions, flickering, or audio-video mismatches.
  • Writing explanations in English pointing to observed issues.

Skills

Fluent English
Attention to detail
Decision making
Concise writing

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media entirely remotely and on flexible hours. In this role, you will roleplay live conversations with AI voice models, score exchanges for naturalness and usefulness, and explain in writing what looked or sounded off.

You will compare AI-generated images and videos to determine which follows prompts better, inspect outputs closely for artifacts, and provide concise, evidence-based explanations in English.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluator (English) — Media & Speech QA
Remote AI Evaluator (English) — Media & Speech QA

Outlier • Florida

Remote
USD 12,000 - 21,000
Weekly payments
Remote work
Free access to leading LLMs
+1
Remote AI Media Evaluator (English) — Flexible Hours
Remote AI Media Evaluator (English) — Flexible Hours

Outlier • United States

Remote
USD 17,000 - 24,000
Fully remote work
Flexible hours
Weekly payment
+1
Remote AI Evaluator: Media QA & Feedback
Remote AI Evaluator: Media QA & Feedback

Outlier • Providence (RI)

Remote
USD 12,000 - 21,000
Flexible hours
Remote work
Weekly payments
Remote AI Media Evaluator (English)
Remote AI Media Evaluator (English)

Outlier • Santa Fe (NM)

Remote
USD 12,000 - 21,000
Free access to leading LLMs
Remote AI Voice & Media Evaluator (English)
Remote AI Voice & Media Evaluator (English)

Outlier • Little Rock (AR)

Remote
USD 17,000 - 24,000
Up to $15 USD/hr pay rate
Flexible hours
Remote work from anywhere
+1
Remote AI Quality Evaluator — English (Flexible Hours)
Remote AI Quality Evaluator — English (Flexible Hours)

Outlier • Berkeley (CA)

Remote
USD 14,000 - 21,000
Fully remote
Flexible hours
Weekly payments via ACH, PayPal andAir
+2
Remote AI Media Evaluator (English) | Flexible Hours
Remote AI Media Evaluator (English) | Flexible Hours

Outlier • North Las Vegas (NV)

Remote
USD 17,000 - 24,000
Weekly payments
Remote work
Free access to leading LLMs
Remote AI Media Evaluator (English)
Remote AI Media Evaluator (English)

Outlier • Berkeley (CA)

Remote
USD 12,000 - 21,000
Free access to leading LLMs
Weekly payments via ACH, PayPal & AirТ
Up to $15/hr earnings
+1
Remote AI Media Evaluator — English Speaker
Remote AI Media Evaluator — English Speaker

Outlier • Ames (IA)

Remote
USD 17,000 - 24,000
Flexible hours
Remote work from anywhere
Free access to leading LLMs
Remote AI Quality Evaluator (English) — Flexible Hours
Remote AI Quality Evaluator (English) — Flexible Hours

Outlier • Knoxville (TN)

Remote
USD 17,000 - 24,000
Fully remote
Flexible hours
Weekly payments
+1