Remote AI Evaluation Specialist — Spot AI Mistakes

Outlier; Fresno (CA); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Weekly pay via ACH/PayPal/AirTM

Free access to leading LLMs

Flexible hours

Job summary

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media remotely on a flexible schedule. You will engage in live conversations with AI voice models, compare image and video pairs, and explain what’s off, helping improve AI systems.

Ideal candidates are fluent in English, have strong writing skills, and can commit to regular, schedule-based work from home. Prior degrees are favorable, but not required, with competitive hourly pay.

Qualifications

• Fluent English required with clear written communication.
• Strong attention to detail and ability to follow prompts precisely.
• Bachelor’s degree or higher preferred but not always required.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot distortions, flickering, or misalignment, and explain findings in writing.
• Provide structured explanations of decisions in English based on observed evidence.

Skills

Fluent English

Attention to detail

Strong written communication

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media remotely on a flexible schedule. You will engage in live conversations with AI voice models, compare image and video pairs, and explain what’s off, helping improve AI systems.

Ideal candidates are fluent in English, have strong writing skills, and can commit to regular, schedule-based work from home. Prior degrees are favorable, but not required, with competitive hourly pay.