Remote English AI Evaluator & Feedback Specialist

Outlier; Rochester (MN); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Work from anywhere

Free access to leading LLMs

Missions surge pricing

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home, on your own schedule. You will roleplay conversations with AI voice models, rate outputs, and explain what looked or sounded off in writing.

Work remotely with flexible hours. You’ll help shape how advanced AI systems reason and improve, contributing to the evaluation and feedback loop across image, video, and audio tasks.

Qualifications

• Fluent English and clear written communication.
• Excellent attention to detail with patience to replay or zoom in.
• Bachelor's degree or above preferred.
• Comfortable thinking on your feet and discussing realistic scenarios.
• Experience writing concise, evidence-based explanations or reviews.
• Able to make a clear decision when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations with AI models and rate naturalness and usefulness.
• Compare pairs of AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot distortions, flickers, text errors, or misaligned audio.
• Write specific English explanations that point to observed issues, with evidence.

Skills

Fluent English

Attention to detail

Clear written communication

Decisive reasoning under ambiguity

Experience writing explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home, on your own schedule. You will roleplay conversations with AI voice models, rate outputs, and explain what looked or sounded off in writing.

Work remotely with flexible hours. You’ll help shape how advanced AI systems reason and improve, contributing to the evaluation and feedback loop across image, video, and audio tasks.