Remote AI Quality Evaluator & Feedback Specialist

Outlier; Santa Fe (NM); Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Job summary

Outlier is offering a remote, flexible, freelance evaluation role where you will review AI-generated media. You’ll conduct live English conversations with AI voice models, compare AI-generated images and videos to prompts, and explain what looked off in writing from your home or while traveling.

Compensation scales with expertise and project needs, with payments weekly. Expect dynamic tasks across image, video, and audio evaluations, with opportunities to access leading LLMs and participate in

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to explain findings clearly.
• Bachelor's degree or higher preferred or helpful.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate how natural, useful, and clear each exchange sounds.
• Compare pairs of AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely, zoom in and replay to spot problems like distorted anatomy, flickering, or unsynced audio.
• Rate each output across dimensions like adherence, quality, and realism and provide written explanations in English.

Skills

Fluent English

Strong written communication

Attention to detail

Education

Bachelor's degree or above

Job description

Outlier is offering a remote, flexible, freelance evaluation role where you will review AI-generated media. You’ll conduct live English conversations with AI voice models, compare AI-generated images and videos to prompts, and explain what looked off in writing from your home or while traveling.

Compensation scales with expertise and project needs, with payments weekly. Expect dynamic tasks across image, video, and audio evaluations, with opportunities to access leading LLMs and participate in