AI Response Evaluator — Remote & Flexible Hours

Outlier

Henderson (NV)

Remote

USD 12,000 - 21,000

Full time

35 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible hours

Fully remote

Free access to leading LLMs

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate naturalness and adherence, and explain in writing what looked or sounded off.

Work remotely on your own schedule, with weekly payments and access to leading LLMs. Rates vary by expertise and project requirements, with up to $15 USD/hr compensation and flexible remote work.

Qualifications

Fluent English speaker with clear written communication.
A high attention to detail and ability to replay/zoom in when something seems off.
Experience writing concise explanations or reviews is a plus.
Comfortable making a clear decision when both options have flaws.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering, or audio-video mismatches.
Rating each output across dimensions like adherence, quality, and realism, with a written explanation in English.

Skills

Fluent English

Attention to detail

Clear writing

Verbal reasoning

Evidence-based explanations

Education

Bachelor's degree or above

Job description

Work remotely on your own schedule, with weekly payments and access to leading LLMs. Rates vary by expertise and project requirements, with up to $15 USD/hr compensation and flexible remote work.

Get your free, confidential resume review.

or drag and drop your file here.