Remote AI Evaluation Specialist – Flexible Hours

Outlier; Cheyenne (WY); Hybrid; USD 17,000 - 24,000; Full time

Benefits offered by this job

Fully remote

Flexible hours

Weekly payments

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate live conversations with AI voice models from the comfort of your home. You will compare image and video pairs, explain what stands out or goes wrong, and work on a flexible schedule.

Roles involve ranking naturalness and usefulness of outputs, identifying issues like misaligned audio, artifacts, or distortions, and providing clear written explanations. Remote work and non-traditional timings are supported.

Qualifications

• Fluent English and clear written communication are required.
• Strong attention to detail and the ability to explain decisions in writing.
• Comfortable with evaluating AI-generated media and providing reasoned feedback.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely to spot issues such as distorted anatomy, flickering, text errors, or audio-video mismatches.
• Rating outputs across dimensions and writing a concise English explanation of the observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under ambiguity

Explanations writing

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate live conversations with AI voice models from the comfort of your home. You will compare image and video pairs, explain what stands out or goes wrong, and work on a flexible schedule.

Roles involve ranking naturalness and usefulness of outputs, identifying issues like misaligned audio, artifacts, or distortions, and providing clear written explanations. Remote work and non-traditional timings are supported.