AI Media Quality Evaluator - Remote & Flexible Hours

Outlier; Louisville (KY); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Weekly payments via ACH, PayPal andAir

Free access to leading LLMs

Work from anywhere

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of their home. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely and on your own schedule.

In this role you will assess output across text, images, videos, and audio, ranking naturalness and adherence to prompts, and provide written explanations to help improve AI systems.

Qualifications

• Fluent English with strong written communication and comfort with natural conversational speech.
• Excellent attention to detail and ability to replay or zoom in to identify issues.
• Experience writing concise, evidence-based explanations or reviews.
• Willingness to assess AI outputs across text, image, video, and audio modalities.

Responsibilities

• Holding live conversations with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images/videos and judging adherence to prompts.
• Inspecting outputs closely and explaining issues in writing in English.
• Rating outputs across dimensions and providing targeted explanations.

Skills

Attention to detail

Clear written English

Decision making under uncertainty

Evidence-based reviews

Fast learner

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of their home. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely and on your own schedule.

In this role you will assess output across text, images, videos, and audio, ranking naturalness and adherence to prompts, and provide written explanations to help improve AI systems.