AI Voice Model Evaluator - Remote & Flexible Hours

Outlier; Pittsburgh (Allegheny County); Remote; USD 12,000 - 21,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare image and video pairs, and explain what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your work helps shape how AI systems reason, learn, and improve, turning frontier research into real-world AI performance improvements. This is a freelance, 1099 opportunity with flexible hours.

Qualifications

• Fluent English speakers with clear written communication and comfortable conversational style.
• Strong attention to detail, patience to replay/zoom in on details.
• Nice to have a Bachelor's degree or above.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models.
• Ranking how natural, useful, and clear each response sounded.
• Comparing AI-generated images and videos and judging prompt adherence.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or mismatched audio.
• Rating outputs across dimensions and writing a concise English explanation of what you saw.

Skills

Fluent English

Clear written communication

Attention to detail

Conversational thinking

Evidence-based explanations

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, compare image and video pairs, and explain what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your work helps shape how AI systems reason, learn, and improve, turning frontier research into real-world AI performance improvements. This is a freelance, 1099 opportunity with flexible hours.