AI Quality Evaluator — Remote, Flexible Hours

Outlier

Austin (TX)

Remote

USD 20,000 - 29,000

Full time

11 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible hours
Remote work from anywhere
Weekly payments via ACH/PayPal/AirTM
Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare generated images and videos to judge prompt adherence, and explain what looked or sounded off, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason and improve, supporting frontier research turned into real-world AI performance. Flexible, remote work with weekly payments.

Qualifications

  • Fluent English with clear written communication.
  • Strong attention to detail; ability to replay or zoom in to spot issues.
  • Experience writing short, evidence-based explanations or reviews.

Responsibilities

  • Holding live conversations with AI voice models and ranking naturalness and clarity.
  • Comparing AI-generated images and videos and judging adherence to prompts.
  • Inspecting outputs to spot distortions, flickering, or misalignment between audio and video.
  • Writing specific English explanations that point to observed issues.

Skills

Fluent English
Attention to detail
Written communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare generated images and videos to judge prompt adherence, and explain what looked or sounded off, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason and improve, supporting frontier research turned into real-world AI performance. Flexible, remote work with weekly payments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Quality Evaluator - Remote & Flexible Hours
AI Quality Evaluator - Remote & Flexible Hours

Outlier • St. Louis (MO)

Remote
USD 20,000 - 29,000
Weekly payments
Remote work
Free access to leading LLMs
+1
AI Quality Evaluator — Remote, Flexible Hours
AI Quality Evaluator — Remote, Flexible Hours

Outlier • Chattanooga (TN)

Hybrid
USD 152,000 - 248,000
Weekly payments via ACH
PayPal payments
AirTM payments
+3
AI Quality Evaluator - Remote & Flexible Hours
AI Quality Evaluator - Remote & Flexible Hours

Outlier • Tulsa (OK)

Remote
USD 20,000 - 29,000
Hourly pay up to $18
Flexible hours
Remote work
+2
AI Quality Evaluator (Remote, Flexible Hours)
AI Quality Evaluator (Remote, Flexible Hours)

Outlier • Portland (OR)

Remote
USD 20,000 - 29,000
Flexible hours
Remote work from anywhere
Free access to leading LLMs
+1
AI Quality Evaluator — Remote & Flexible Hours
AI Quality Evaluator — Remote & Flexible Hours

Outlier • Anchorage (AK)

Remote
USD 20,000 - 29,000
Flexible hours
Remote work from anywhere
Free access to leading LLMs
AI Quality Evaluator - Remote, Flexible Hours
AI Quality Evaluator - Remote, Flexible Hours

Outlier • Minneapolis (MN)

Remote
USD 15,000 - 25,000
Earn up to $18 USD/hr
Flexible hours, no minimum hours
Free access to leading LLMs
+1
AI Quality Evaluator — Remote, Flexible Hours
AI Quality Evaluator — Remote, Flexible Hours

Outlier • Pittsburgh

Remote
USD 15,000 - 25,000
Flexible hours
Free LLM access
Weekly payments
AI Quality Evaluator — Remote & Flexible Hours
AI Quality Evaluator — Remote & Flexible Hours

Outlier • Toledo (OH)

Remote
USD 20,000 - 29,000
Up to $18/hr
Flexible hours
Free LLM access
+1
AI Quality Evaluator — Remote & Flexible Hours
AI Quality Evaluator — Remote & Flexible Hours

Outlier • Fort Worth (TX)

Remote
USD 15,000 - 25,000
Free access to leading LLMs
Weekly payments via ACH/PayPal/AirTM
Flexible, remote work hours
AI Media Quality Evaluator — Remote, Flexible Hours
AI Media Quality Evaluator — Remote, Flexible Hours

Outlier • Harrisburg

Remote
USD 15,000 - 25,000
Earn up to $18 USD/hr
Flexible schedule
Remote work from anywhere
+2