Remote AI Evaluation Specialist — English Reviews

Outlier

Lexington (KY)

Remote

USD 12,000 - 21,000

Part time

37 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Fully remote

Flexible hours

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on your own schedule. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, scoring each exchange for adherence and realism.

Responsibilities include evaluating AI outputs, documenting evidence-based explanations, and operating remotely with flexible hours. Experience in precise written communication is valued; a Bachelor's degree or higher is nice to

Qualifications

Fluent English with clear written communication and comfortable with everyday conversational speech.
Strong attention to detail and patience to look and listen closely.
Nice to have: pursuing or holding a Bachelor's degree or above.
Comfortable thinking on your feet and explaining realistic scenarios verbally.
Experience writing short, evidence-based explanations or reviews.
Able to make clear decisions when both options have flaws.

Responsibilities

Holding live, scenario-based conversations in English with AI voice models.
Ranking how natural, useful, and clear each interaction sounded.
Comparing AI-generated images and videos and judging adherence to prompts.
Inspecting outputs closely to spot problems like distorted anatomy, flickering, or mismatched audio.
Writing a concise, written explanation in English pointing to observed issues.
Rating outputs across dimensions such as adherence, quality, and realism.