AI Evaluator: Remote, Flexible Hours, Up to $15/hr

Outlier; Cape Coral (FL); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Weekly payments

Free access to leading LLMs

1099 contract

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media by holding live conversations with AI voice models and evaluating image and video outputs. This remote, flexible role pays up to $15/hr with weekly payments and the ability to work from home or while traveling.

You will rate outputs for adherence, quality, and realism, and provide written explanations in English. This freelance opportunity includes access to leading LLMs for your evaluations.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Strong attention to detail and patience to look and listen closely.
• Nice to have a Bachelor's degree or above.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio mis-match.
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English.

Skills

Fluent English

Strong written communication

Attention to detail

Decision making under imperfect info

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media by holding live conversations with AI voice models and evaluating image and video outputs. This remote, flexible role pays up to $15/hr with weekly payments and the ability to work from home or while traveling.

You will rate outputs for adherence, quality, and realism, and provide written explanations in English. This freelance opportunity includes access to leading LLMs for your evaluations.