AI Quality Evaluator — Remote & Flexible Hours

Outlier; Toledo (OH); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Up to $18/hr

Flexible hours

Free LLM access

Missions/bonus incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare AI-generated images and videos to prompts, and explain in writing what looked or sounded off, all remotely and on your own schedule.

As part of the role, you will rate outputs on adherence, quality, and realism, provide written explanations, and help refine AI systems.

Qualifications

• Fluent English with strong written communication.
• Great attention to detail and patience to replay or zoom in when something seems off.
• Comfortable explaining observations in writing with specific points.
• Ability to decide clearly when both options have flaws.
• Willingness to work remotely and schedule flexibility.

Responsibilities

• Hold live conversations with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images/videos and judge alignment with prompts.
• Inspect outputs closely to spot issues like distortions, flickering, or audio-video mismatch.
• Write a concise, evidence-based explanation of what was seen or heard.

Skills

Attention to detail

Clear written English

Adaptability

Decision making

Independent worker

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare AI-generated images and videos to prompts, and explain in writing what looked or sounded off, all remotely and on your own schedule.

As part of the role, you will rate outputs on adherence, quality, and realism, provide written explanations, and help refine AI systems.