Remote AI Evaluation Specialist

Outlier

Birmingham (AL)

Remote

USD 12,000 - 21,000

Full time

24 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Fully remote

Flexible hours

Weekly payments

Free LLM access

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media, ranking AI outputs and explaining what looks off. You’ll work remotely on your own schedule, assessing live conversations with AI voice models and comparing image/video pairs.

Responsibilities include evaluating outputs for naturalness, adherence to prompts, and quality, and providing concise, evidence-based explanations in written English. This freelance, 1099 role offers weekly payments and access to leading LLMs.

Qualifications

Fluent English speaker with strong, clear written communication.
Great attention to detail and ability to replay or zoom in when something seems off.
Pursuing or holding a Bachelor's degree or above.
Comfortable thinking on your feet and explaining realistic scenarios in a natural, conversational way.
Experience writing concise explanations or reviews.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural and clear each one sounded.
Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
Inspecting outputs closely to spot problems like distortions, flickering, or mismatched audio/video.
Rating outputs across dimensions like adherence, quality, and realism, then writing a concise explanation in English.