Remote Text Annotator — Evaluate AI Media Quality

Outlier; Columbia (SC); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Weekly payments

Flexible hours

Free access to leading LLMs

Remote work from anywhere

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with an AI voice model, score exchanges, and explain in writing what looked off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how AI systems reason and improve. You will review outputs across images, videos, and audio to evaluate adherence to prompts and quality, contributing to real-world AI performance improvements.

Qualifications

• Fluent English with clear written communication and comfortable with everyday conversational speech.
• Strong attention to detail, patience to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making a clear decision when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely (zoom, replay) to spot problems like distorted anatomy or misaligned audio.
• Write a concise English explanation pointing to what you saw or heard for each evaluation.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under uncertainty

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with an AI voice model, score exchanges, and explain in writing what looked off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how AI systems reason and improve. You will review outputs across images, videos, and audio to evaluate adherence to prompts and quality, contributing to real-world AI performance improvements.