AI Response Evaluator — Remote, Flexible Hours

Outlier; West Lafayette (IN); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible schedule, remote work

Free access to leading LLMs

Additional incentives via Missions

Job summary

Outlier is seeking detail-oriented contributors to review AI-generated media on a flexible, remote schedule. You will participate in live conversations with AI voice models, rate how natural the responses sound, and evaluate prompts against images and videos.

You’ll document findings in clear English while working from home or while traveling. Ideal candidates are fluent in English, meticulous, and able to articulate concise explanations.

Qualifications

• Fluent English and clear written communication.
• Strong attention to detail and ability to replay/zoom in to verify issues.
• Bachelor's degree or higher preferred.
• Ability to think on your feet and explain reasoning clearly.
• Experience writing concise, evidence-based reviews.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs to identify issues like distortions, flicker, text errors, or audio-video mismatch.
• Provide written explanations in English describing what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Writing experience

Decision making

Quick thinking

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented contributors to review AI-generated media on a flexible, remote schedule. You will participate in live conversations with AI voice models, rate how natural the responses sound, and evaluate prompts against images and videos.

You’ll document findings in clear English while working from home or while traveling. Ideal candidates are fluent in English, meticulous, and able to articulate concise explanations.