Remote AI Quality Evaluator: Spot Flaws & Score

Outlier

Long Beach (CA)

Remote

USD 17,000 - 24,000

Full time

26 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Fully remote
Flexible hours
Weekly pay via ACH/PayPal/AirTM
Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of a remote setup. You will engage in live conversations with AI voice models, compare image and video outputs, and explain what’s off in writing, all while working on your own schedule.

We emphasize accuracy and clear communication, and a Bachelor's degree or higher is preferred. This is a flexible, remote role with weekly payments and access to top LLM tools.

Qualifications

  • Fluent English with clear written communication and comfortable with natural conversation.
  • Strong attention to detail, ability to replay or zoom in when something seems off.
  • Experience explaining findings in writing with concise reasoning.
  • Comfortable thinking on your feet and discussing realistic scenarios.

Responsibilities

  • Holding live, scenario-based conversations with AI voice models in English and assessing naturalness and clarity.
  • Comparing AI-generated image and video pairs and judging which follows prompts better.
  • Inspecting outputs closely for distortions, flickering, misaligned audio, or other issues and writing explanations in English.
  • Rating outputs across dimensions like adherence, quality, and realism and providing specific written justifications.

Skills

Fluent English
Attention to detail
Clear written communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of a remote setup. You will engage in live conversations with AI voice models, compare image and video outputs, and explain what’s off in writing, all while working on your own schedule.

We emphasize accuracy and clear communication, and a Bachelor's degree or higher is preferred. This is a flexible, remote role with weekly payments and access to top LLM tools.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluator: Spot Flaws & Compare AI Media
Remote AI Evaluator: Spot Flaws & Compare AI Media

Outlier • Laredo (TX)

Remote
USD 17,000 - 24,000
Remote work
Flexible hours
Weekly payments
+1
Remote AI Evaluator: Spot Flaws & Explain Judgments
Remote AI Evaluator: Spot Flaws & Explain Judgments

Outlier • San Francisco (CA)

Remote
USD 12,000 - 21,000
Remote work
Flexible hours
Free access to leading LLMs
+1
Remote AI Media Evaluator — Spot Flaws & Explain
Remote AI Media Evaluator — Spot Flaws & Explain

Outlier • Boulder (CO)

Remote
USD 12,000 - 21,000
Flexible hours
Remote work
1099 freelance contract
+1
Remote AI Media Evaluator — Spot Flaws & Improve AI
Remote AI Media Evaluator — Spot Flaws & Improve AI

Outlier • Aurora (CO)

Remote
USD 12,000 - 21,000
Free access to leading LLMs
Weekly payments (ACH/PayPal/AirTM)
Fully remote work
Remote AI Media Evaluator: Spot Flaws & Improve Models
Remote AI Media Evaluator: Spot Flaws & Improve Models

Outlier • Blacksburg (VA)

Remote
USD 17,000 - 24,000
Flexible hours
Remote work
Free access to LLMs
+1
Remote AI Quality Auditor - Spot Flaws & Earn
Remote AI Quality Auditor - Spot Flaws & Earn

Outlier • Worcester (MA)

Remote
USD 17,000 - 24,000
Free access to leading LLMs
Flexible hours
Remote work from anywhere
Remote AI Evaluator: Spot AI Flaws & Rate Outputs
Remote AI Evaluator: Spot AI Flaws & Rate Outputs

Outlier • Columbia (SC)

Remote
USD 17,000 - 21,000
Remote work
Flexible schedule
Free access to leading LLMs
Remote AI Content Evaluator — Spot Flaws & Score AI Outputs
Remote AI Content Evaluator — Spot Flaws & Score AI Outputs

Outlier • Chesapeake (VA)

Remote
USD 17,000 - 21,000
Remote work
Flexible hours
Free access to leading LLMs
Remote AI Media Evaluator – Spot AI Flaws
Remote AI Media Evaluator – Spot AI Flaws

Outlier • Charleston (WV)

Remote
USD 17,000 - 24,000
Flexible hours
Fully remote
Free access to leading LLMs
Remote AI Quality Evaluator — Spot Gaps & Improve
Remote AI Quality Evaluator — Spot Gaps & Improve

Outlier • Fort Wayne (IN)

Hybrid
USD 17,000 - 24,000
Flexible hours
Fully remote work
Weekly pay via ACH/PayPal/AirTM
+1