Remote AI Evaluation Specialist

Outlier Ai

United States

Remote

USD 17,000 - 24,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible schedule
Remote work from anywhere
Free access to leading LLMs
Weekly payments via PayPal/AirTM/ACH

Job summary

Outlier AI is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare generated images and videos to judge which follows the prompt more closely.

You will explain in writing what looked or sounded wrong, rate outputs across adherence, quality, and realism, and provide concise explanations. The role is remote with flexible hours, weekly payments, and higher rates based on expertise.

Qualifications

  • Fluent English with strong written communication.
  • Strong attention to detail and ability to notice subtle issues.
  • Comfortable thinking on your feet and explaining decisions clearly.
  • Experience writing short, evidence-based explanations or reviews.

Responsibilities

  • Review AI-generated media including images, videos, and audio.
  • Roleplay live conversations with an AI voice model and score exchanges.
  • Explain in writing what looked or sounded wrong and how it compares to the prompt.
  • Rate outputs on adherence, quality, and realism and provide concise explanations.

Skills

Fluent English
Attention to detail
Clear written communication
Adaptive / quick thinker

Education

Bachelor's degree or above

Job description

Outlier AI is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare generated images and videos to judge which follows the prompt more closely.

You will explain in writing what looked or sounded wrong, rate outputs across adherence, quality, and realism, and provide concise explanations. The role is remote with flexible hours, weekly payments, and higher rates based on expertise.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Outlier • Honolulu (HI)

Remote
USD 17,000 - 21,000
Weekly payments
Free access to leading LLMs
Remote work from anywhere
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Outlier Ai • East Lansing (MI)

Hybrid
USD 17,000 - 24,000
Free access to leading LLMs
Flexible schedule
900K+ Outlier Experts across 52+ coun"
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Healing Strides Counseling • United States

Remote
USD 17,000 - 24,000
Flexible schedule
Free access to leading LLMs
Global network of experts
Remote AI Quality Evaluator
Remote AI Quality Evaluator

Outlier • Honolulu (HI)

Remote
USD 20,000 - 29,000
Up to $18/hr
Remote work
Free access to leading LLMs
+1
Remote AI Evaluation Specialist — English Speaker
Remote AI Evaluation Specialist — English Speaker

Outlier • Missoula (MT)

Hybrid
USD 20,000 - 29,000
Fully remote
Flexible hours
Weekly payments
+1
Remote AI Evaluation Specialist (Flexible Hours)
Remote AI Evaluation Specialist (Flexible Hours)

Outlier Ai • United States

Remote
USD 17,000 - 24,000
Free LLM access
Flexible schedule
Global community
Remote AI Evaluation Specialist (Text/Image/Video)
Remote AI Evaluation Specialist (Text/Image/Video)

Outlier (by Scale AI) • United States

Remote
USD 17,000 - 24,000
Flexible schedule
Free access to leading LLMs
Global expert community
Remote AI Evaluation Specialist: Spot Flaws & Rate Outputs
Remote AI Evaluation Specialist: Spot Flaws & Rate Outputs

Outlier • Seattle (WA)

Hybrid
USD 15,000 - 25,000
Up to $18 USD/hr
Flexible hours
Free access to leading LLMs
+1
Remote AI Evaluator & Quality Assessor
Remote AI Evaluator & Quality Assessor

Outlier • United States

Remote
USD 17,000 - 24,000
Flexible schedule
Remote work from anywhere
Free access to leading LLMs
Remote AI Data Evaluator - Flexible, Detail-Driven Review
Remote AI Data Evaluator - Flexible, Detail-Driven Review

Scale AI • United States

Remote
USD 17,000 - 24,000
Free access to leading LLMs
Flexible schedule
Weekly payments