Remote AI Response Evaluator — Flexible Hours

Outlier; Charlotte (NC); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours

Fully remote

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of a remote setup. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off, all on your own schedule.

Responsibilities include comparing AI-generated media, identifying issues such as misalignment with prompts, and delivering concise, evidence-based explanations. This role offers flexible hours and payments weekly.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in when something seems off.
• Bachelor's degree or higher preferred.
• Comfortable thinking on your feet and talking through realistic situations in a natural way.
• Experience writing concise, evidence-based reviews.
• Able to decide clearly when both options have flaws.
• Currently accepting applicants from: Australia, Canada, Ireland, United Kingdom, United States.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos to determine which follows prompts better and explain why.
• Inspect outputs closely (zoom/replay) to spot problems like anatomy distortions, flickering, or audio-video mismatches.
• Rate outputs across dimensions and write a specific English explanation of what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Decision-making under ambiguity

Evidence-based writing

Conversational skills

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of a remote setup. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off, all on your own schedule.

Responsibilities include comparing AI-generated media, identifying issues such as misalignment with prompts, and delivering concise, evidence-based explanations. This role offers flexible hours and payments weekly.