AI Evaluation Specialist — Remote, Flexible Hours

Outlier

Nashville (TN)

Hybrid

USD 20,000 - 29,000

Full time

33 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible hours

Fully remote

Weekly payments

Free LLM access

Missions surge pricing

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare generated images and videos to prompts, and write explicit explanations of what looked or sounded off, all remotely and on your own schedule.

Join Outlier to help shape how advanced AI systems reason and learn. This role supports flexible hours, remote work, and weekly payments. Free access to leading LLMs is provided.

Qualifications

Fluent English with strong written communication and natural conversational ability.
Excellent attention to detail and ability to replay or zoom in for accuracy.
Experience writing concise, evidence-based explanations or reviews.
Comfortable making clear decisions when options both have flaws.

Responsibilities

Hold live conversations with AI voice models and rate naturalness and usefulness.
Compare pairs of AI-generated images/videos and judge adherence to prompts.
Inspect outputs for artifacts like distorted anatomy, flickering, or misaligned audio.
Write concise explanations in English describing what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under uncertainty

Evidence-based reviews

Explain assessment clearly

Education

Bachelor's degree or above

Job description

Join Outlier to help shape how advanced AI systems reason and learn. This role supports flexible hours, remote work, and weekly payments. Free access to leading LLMs is provided.

Get your free, confidential resume review.

or drag and drop your file here.