AI Evaluation Specialist — Remote & Flexible Hours

Outlier; Aurora (CO); Remote; USD 17,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate how closely outputs follow prompts. You will role-play live conversations with AI voice models, compare image and video pairs, and explain shortfalls in writing. This remote role offers flexible hours and weekly payments.

Join a team shaping how advanced AI systems reason and improve, using your meticulous attention to detail and ability to articulate findings clearly.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and careful examination of outputs.
• Experience writing short, evidence-based explanations or reviews.
• Ability to think on your feet and discuss realistic scenarios clearly.

Responsibilities

• Hold live conversations in English with AI voice models and rate naturalness, usefulness and clarity.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely, zoom in or replay to identify issues (artifacts, misalignment, motion).
• Provide written explanations in English detailing what was seen or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based explanations

Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate how closely outputs follow prompts. You will role-play live conversations with AI voice models, compare image and video pairs, and explain shortfalls in writing. This remote role offers flexible hours and weekly payments.

Join a team shaping how advanced AI systems reason and improve, using your meticulous attention to detail and ability to articulate findings clearly.