Remote AI Quality Auditor: Spot AI Mistakes & Improve Models

Outlier

Mesa (AZ)

Remote

USD 12,000 - 21,000

Full time

23 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible hours
Remote work
Weekly payments via ACH/PayPal/AirTM
Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare generated images and videos, and explain in writing what looked or sounded wrong, all remotely on your own schedule.

Join Outlier to help shape how advanced AI systems reason, learn, and improve via evaluation and feedback loops. This freelance opportunity emphasizes flexible hours, remote work, and ongoing access to leading LLMs.

Qualifications

  • Fluent English speaker with strong, clear written communication.
  • Excellent attention to detail and ability to spot issues in AI outputs.
  • Experience writing short, evidence-based explanations or reviews.
  • Comfortable thinking on your feet and discussing realistic scenarios clearly.

Responsibilities

  • Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
  • Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
  • Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video.
  • Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard.

Skills

Fluent English
Attention to detail
Clear written communication
Problem explanation

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare generated images and videos, and explain in writing what looked or sounded wrong, all remotely on your own schedule.

Join Outlier to help shape how advanced AI systems reason, learn, and improve via evaluation and feedback loops. This freelance opportunity emphasizes flexible hours, remote work, and ongoing access to leading LLMs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluator: Spot AI Errors & Improve Models
Remote AI Evaluator: Spot AI Errors & Improve Models

Outlier • San Luis Obispo (CA)

Remote
USD 17,000 - 24,000
Earn up to $15 USD/hr
Flexible hours
Free access to leading LLMs
Remote AI Media Evaluator - Spot Flaws & Improve Models
Remote AI Media Evaluator - Spot Flaws & Improve Models

Outlier • Columbia (SC)

Hybrid
USD 17,000 - 24,000
Weekly payments via ACH/PayPal
Remote work
Free access to leading LLMs
Remote AI Quality Auditor - Spot Flaws & Earn
Remote AI Quality Auditor - Spot Flaws & Earn

Outlier • Worcester (MA)

Remote
USD 17,000 - 24,000
Free access to leading LLMs
Flexible hours
Remote work from anywhere
Remote AI Evaluator: Spot Flaws & Improve Models
Remote AI Evaluator: Spot Flaws & Improve Models

Outlier • Savannah (GA)

Remote
USD 17,000 - 24,000
Flexible hours
Remote work from anywhere
Free access to leading LLMs
Remote AI Content Evaluator — Spot AI Mistakes
Remote AI Content Evaluator — Spot AI Mistakes

Outlier • Sacramento (CA)

Remote
USD 17,000 - 24,000
Flexible hours
Remote work
Free access to leading LLMs
Remote AI Evaluator — Spot AI Media Errors
Remote AI Evaluator — Spot AI Media Errors

Outlier • Stamford (CT)

Remote
USD 17,000 - 24,000
Free access to leading LLMs
Remote work
Flexible hours
Remote AI Quality Evaluator — Spot Issues & Explain
Remote AI Quality Evaluator — Spot Issues & Explain

Outlier • Gilbert (AZ)

Hybrid
USD 17,000 - 24,000
Flexible hours
Remote work
Weekly payments via ACH/PayPal/AirTM
+1
Remote AI Content Evaluator: Spot Mistakes & Rate Quality
Remote AI Content Evaluator: Spot Mistakes & Rate Quality

Outlier • Norman (OK)

Remote
USD 12,000 - 21,000
Remote work
Flexible hours
Weekly payments
+1
Remote AI Media Evaluator — Spot Mistakes & Improve Quality
Remote AI Media Evaluator — Spot Mistakes & Improve Quality

Outlier • Fort Wayne (IN)

Remote
USD 12,000 - 21,000
Flexible hours
Remote work
Free LLM access
+1
Remote AI Quality Evaluator & Feedback Specialist
Remote AI Quality Evaluator & Feedback Specialist

Outlier • Fort Collins (CO)

Remote
USD 17,000 - 24,000
Fully remote
Flexible hours
Weekly payments via ACH/PayPal
+1