AI Response Evaluator — Remote & Flexible Hours

Outlier; Las Cruces (NM); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work

LLM access

Incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage live with AI voice models, score exchanges, and compare images and videos to assess prompt adherence. You will explain in writing what looked off, remotely and on your own schedule.

Join Outlier to help shape AI behavior through evaluation, with flexible hours, remote work, and access to leading LLMs. Earn up to $18/hr with incentives in a global, remote setting.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Excellent attention to detail and ability to replay or zoom in to spot issues.
• Bachelor's degree or higher is nice to have.
• Able to think on your feet and explain decisions clearly in writing.

Responsibilities

• Hold live conversations with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which better follows prompts.
• Inspect outputs closely to spot problems like distorted anatomy, flickering, text errors, or audio-video mismatches.
• Write concise, evidence-based explanations in English describing what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage live with AI voice models, score exchanges, and compare images and videos to assess prompt adherence. You will explain in writing what looked off, remotely and on your own schedule.

Join Outlier to help shape AI behavior through evaluation, with flexible hours, remote work, and access to leading LLMs. Earn up to $18/hr with incentives in a global, remote setting.