AI Response Evaluator — Remote, Flexible Hours

Outlier; Harrisburg (Dauphin County); Remote; USD 17,000 - 25,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what was off, remotely and on your own schedule.

Responsibilities include comparing AI-generated media, spotting issues, and providing written explanations. The role offers fully remote work with flexible hours and weekly payments, with compensation up to $18 per hour and free access to leading LLMs.

Qualifications

• Fluent English and strong written communication.
• Excellent attention to detail and patience to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable deciding when both options have flaws.
• Nice to have: pursuing or holding a Bachelor's degree or above.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos, judge adherence to prompts.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, text errors, or audio-video misalignment.
• Write a concise, English explanation pointing to what you saw or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based writing

Ability to think on feet

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what was off, remotely and on your own schedule.

Responsibilities include comparing AI-generated media, spotting issues, and providing written explanations. The role offers fully remote work with flexible hours and weekly payments, with compensation up to $18 per hour and free access to leading LLMs.