Remote AI Eval Specialist — Flexible Hours + Free LLMs

Outlier; Columbia (SC); Remote; USD 17,000 - 25,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off, helping advance AI systems in real-world use.

Access to leading LLMs is included and payments are weekly. Ideal candidates are fluent in English, highly attentive, and able to produce concise, evidence-based explanations.

Qualifications

• Fluent English with clear written communication and ability to explain observations.
• Excellent attention to detail with patience to replay or zoom in on outputs.
• Bachelor's degree or higher preferred.
• Comfortable thinking on your feet and discussing realistic scenarios in a natural, conversational way.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Hold live conversations with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images and videos and judge which follows prompts better.
• Inspect outputs closely, zooming and replaying to spot issues such as distortions or misalignment.
• Rate each output and write a clear English explanation pointing to observed issues.

Skills

Fluent English

Attention to detail

Written communication

Think on your feet

Explanations/reviews

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off, helping advance AI systems in real-world use.

Access to leading LLMs is included and payments are weekly. Ideal candidates are fluent in English, highly attentive, and able to produce concise, evidence-based explanations.