Remote AI Response Evaluator - Flexible Hours

Outlier; Dayton (OH); Remote; USD 17,000 - 25,000; Full time

Benefits offered by this job

Flexible schedule

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare AI-generated images and videos, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your expertise shapes how AI systems reason, learn, and improve through evaluation and feedback, with payment on a flexible, weekly basis.

Qualifications

• Fluent English speaker with clear written communication.
• Excellent attention to detail and ability to replay or zoom in.
• Nice to have a Bachelor's degree or higher.
• Able to think on your feet and discuss realistic scenarios naturally.
• Experience writing short, evidence-based explanations or reviews.
• Able to decide clearly when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rank naturalness, usefulness and clarity.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, or misalignment of audio and video.
• Write specific English explanations pointing to observed issues, across multiple outputs.

Skills

Fluent English

Attention to detail

Strong written communication

Decision making under ambiguity

Review writing experience

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare AI-generated images and videos, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your expertise shapes how AI systems reason, learn, and improve through evaluation and feedback, with payment on a flexible, weekly basis.