Remote English AI Quality Evaluator

Outlier; Ann Arbor (MI); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Weekly payments

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will roleplay live conversations with AI voice models, rate outputs, and explain in writing what looked or sounded off.

We offer up to $15 USD/hr with weekly payments. Work from home or while traveling, and gain free access to leading LLMs. This is a 1099-style contract opportunity on Outlier.ai platform.

Qualifications

• Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech.
• Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off.
• Nice to have: Pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making a clear decision when both options have flaws.

Responsibilities

• Holding live English conversations with AI voice models, rating naturalness and clarity.
• Comparing AI-generated images and videos to judge adherence to prompts.
• Inspecting outputs closely (zoom/replay) to spot issues like glitches or misalignment.
• Rating outputs on adherence, quality, and realism with written explanations.
• Image evaluations: compare two images for the same prompt and pick the better one.
• Video evaluations: rank AI-generated videos against a text prompt or source clip.
• Video caption labeling: annotate first-person videos with precise action captions.
• Audio/voice evaluations: rate naturalness and pronunciation relative to a target voice.

Skills

Fluent English

Clear written communication

Attention to detail

Think on your feet

Clear decision making

Experience writing explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will roleplay live conversations with AI voice models, rate outputs, and explain in writing what looked or sounded off.

We offer up to $15 USD/hr with weekly payments. Work from home or while traveling, and gain free access to leading LLMs. This is a 1099-style contract opportunity on Outlier.ai platform.