AI Evaluation Specialist — Remote, Flexible Hours

Outlier; Boise (ID); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Hourly pay up to $18 USD

Flexible hours, remote work

Free access to leading LLMs

Job summary

Outlier is hiring detail-oriented evaluators to review AI-generated media from home on a flexible schedule. You will participate in live conversations with AI voice models, rank outputs, and explain issues in written English.

Responsibilities include evaluating images, videos, and audio, and reporting why a given output diverged from the prompt. Remote work and weekly payments are offered.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and careful listening/observation.
• Ability to explain in writing what was observed or heard.
• Comfortable thinking on your feet and discussing realistic scenarios.

Responsibilities

• Hold live conversations with AI voice models, assessing naturalness and clarity.
• Compare AI-generated images and videos, judging adherence to prompts.
• Inspect outputs closely to spot distortions, flickering, or misaligned audio/video.
• Provide concise, written explanations of issues in English.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making with imperfect options

Education

Bachelor's degree or above

Job description

Outlier is hiring detail-oriented evaluators to review AI-generated media from home on a flexible schedule. You will participate in live conversations with AI voice models, rank outputs, and explain issues in written English.

Responsibilities include evaluating images, videos, and audio, and reporting why a given output diverged from the prompt. Remote work and weekly payments are offered.