Remote AI Conversation Evaluator - English Speaker

Outlier

Town of Hartford (WI)

Remote

USD 20,000 - 29,000

Full time

2 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Earn Up to $18 USD/hr

Flexible remote hours

Free access to leading LLMs

Surge pricing bonuses

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, rate how natural and useful each response is, and compare AI-generated images and videos to judge adherence to prompts.

You’ll explain in writing what looked or sounded off, remotely and on your own schedule. At Outlier, your work helps shape how advanced AI systems reason and improve, contributing to research that translates into real-world AI performance.

Qualifications

Fluent English with clear written communication.
Strong attention to detail and ability to replay or zoom in to spot issues.
Experience writing concise, evidence-based explanations or reviews.
Ability to think on your feet and make clear decisions in conversations with AI.

Responsibilities

Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
Compare AI-generated images and videos to determine which better follows a prompt.
Inspect outputs for distortions, flickering, or misalignment between audio and video and note issues.
Write a concise explanation in English pointing to observed issues for each exchange.