Remote AI Response Evaluator - Flexible Hours + Free LLM

Outlier; Tucson (AZ); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Weekly payments

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will role-play live conversations with an AI voice model, score exchanges, and compare generated visuals against prompts. You will explain in writing what looked off, remotely and on a flexible schedule.

At Outlier, your evaluations help shape how advanced AI systems reason and learn. You contribute to turning frontier research into real-world improved AI performance.

Qualifications

• Fluent English with clear written communication.
• Nice to have a Bachelor's degree or above.
• Excellent attention to detail and the ability to explain findings in writing.
• Comfortable making quick, grounded decisions when reviewing AI outputs.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot artifacts like distorted anatomy, flickering, or audio mismatches.
• Provide written explanations pointing to observed issues in English.

Skills

Fluent English

Attention to detail

Strong writing

Communication skills

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will role-play live conversations with an AI voice model, score exchanges, and compare generated visuals against prompts. You will explain in writing what looked off, remotely and on a flexible schedule.

At Outlier, your evaluations help shape how advanced AI systems reason and learn. You contribute to turning frontier research into real-world improved AI performance.