Remote AI Evaluator — Rate & Improve AI Outputs

Outlier

Memphis (TN)

Hybrid

USD 12,000 - 21,000

Part time

30 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible hours
Remote work
Weekly payments
Free LLM access

Job summary

Outlier is hiring detail-oriented English speakers to review AI-generated media remotely on your own schedule. You will conduct live conversations with AI voice models, compare image/video pairs, and explain what’s off in writing.

This freelance, 1099 role pays up to $15 per hour with weekly payments in USD, and offers flexible hours you can work from home while traveling. Contributors help improve AI systems by evaluating realism, adherence to prompts, and overall quality, with additional

Qualifications

  • Fluent English with clear written communication.
  • Strong attention to detail and the ability to replay or zoom in when something seems off.
  • Pursuing or holding a Bachelor's degree or above.
  • Comfortable thinking on your feet and discussing realistic scenarios in a natural, conversational way.
  • Experience writing concise, evidence-based explanations.
  • Able to make a clear decision when both options have flaws.
  • Applicants from Australia, Canada, Ireland, United Kingdom, and United States are accepted.

Responsibilities

  • Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
  • Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
  • Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
  • Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard.

Skills

Fluent English
Attention to detail
Clear written communication
Bachelor's degree awareness
Decisive under ambiguity
Evidence-based explanations
Geographic eligibility awareness

Education

Bachelor's degree or above

Job description

Outlier is hiring detail-oriented English speakers to review AI-generated media remotely on your own schedule. You will conduct live conversations with AI voice models, compare image/video pairs, and explain what’s off in writing.

This freelance, 1099 role pays up to $15 per hour with weekly payments in USD, and offers flexible hours you can work from home while traveling. Contributors help improve AI systems by evaluating realism, adherence to prompts, and overall quality, with additional

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Quality Evaluator — Rate & Improve AI Media
Remote AI Quality Evaluator — Rate & Improve AI Media

Outlier • Worcester (MA)

Hybrid
USD 17,000 - 24,000
Remote work
Flexible hours
Free LLM access
Remote AI Media Evaluator — Rate & Improve AI Output
Remote AI Media Evaluator — Rate & Improve AI Output

Outlier • Winston-Salem (NC)

Remote
USD 18,000 - 23,000
Fully remote
Flexible hours
Up to $15/hr
+2
Remote AI Data Evaluator — English
Remote AI Data Evaluator — English

Outlier • Chesapeake (VA)

Remote
USD 17,000 - 24,000
Incentives and surge bonuses
Weekly payments
Remote AI Evaluator: Rate AI Outputs & Earn Up to $15/hr
Remote AI Evaluator: Rate AI Outputs & Earn Up to $15/hr

Outlier • Boca Raton (FL)

Hybrid
USD 17,000 - 24,000
Remote work from anywhere
Free access to leading LLMs
Weekly payments and flexible hours
Remote AI Evaluator (English) – Rate & Explain Outputs
Remote AI Evaluator (English) – Rate & Explain Outputs

Outlier • Sacramento (CA)

Remote
USD 12,000 - 21,000
Remote work
Flexible hours
Free access to leading LLMs
Remote AI Media Evaluator — Rate & Improve AI Outputs
Remote AI Media Evaluator — Rate & Improve AI Outputs

Outlier • Scottsdale (AZ)

Remote
USD 12,000 - 21,000
Weekly payments
Remote work
Free access to leading LLMs
Remote AI Evaluator & Feedback Specialist
Remote AI Evaluator & Feedback Specialist

Outlier • Morgantown (WV)

Remote
USD 17,000 - 24,000
Fully remote
Flexible hours
Free access to leading LLMs
Remote AI Evaluator: Rate AI Media & Spot Issues
Remote AI Evaluator: Rate AI Media & Spot Issues

Outlier • Burlington (VT)

Remote
USD 12,000 - 21,000
Free access to leading LLMs
Remote AI Media Evaluator — Rate & Improve AI Outputs
Remote AI Media Evaluator — Rate & Improve AI Outputs

Outlier • Indianapolis (IN)

Hybrid
USD 17,000 - 24,000
Fully remote
Flexible hours
Paid weekly via ACH/PayPal/AirTM
+2
Remote AI Output Evaluator (English)
Remote AI Output Evaluator (English)

Outlier • Bloomington (IN)

Remote
USD 17,000 - 24,000
Remote work
Flexible hours
Weekly pay
+2