AI Media Evaluator — English Speaker (Remote)

Outlier; Columbia (MD); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Free access to leading LLMs

Flexible schedule

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay conversations with AI voice models and rate how well outputs adhere to prompts, comparing images and videos to judge accuracy and realism, then provide written explanations.

Ideal candidates are fluent in English, highly detail-oriented, and able to explain complex judgments clearly.

Qualifications

• Fluent English speaker with strong written communication and comfort with natural conversation.
• Excellent attention to detail and patience to replay or zoom in to spot issues.
• Nice to have: Pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and explaining realistic scenarios.
• Experience writing concise explanations or reviews.
• Able to decide clearly when both options have flaws.
• Currently accepting applicants from: Australia, Canada, Ireland, United Kingdom, United States.

Responsibilities

• Hold live conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely and note problems like distorted anatomy, flicker, or audio-video mismatch.
• Rate outputs on adherence, quality, and realism and provide written explanations.

Skills

Attention to detail

Clear written communication

English proficiency

Explains clearly in writing

Decision making under ambiguity

Education

Bachelor’s degree (nice to have)

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay conversations with AI voice models and rate how well outputs adhere to prompts, comparing images and videos to judge accuracy and realism, then provide written explanations.

Ideal candidates are fluent in English, highly detail-oriented, and able to explain complex judgments clearly.