AI Response Evaluator — Remote & Flexible Hours

Outlier; Philadelphia (Philadelphia County); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Pay up to $18/hr

Flexible hours

Free LLM access

Missions bonuses

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, remotely and on your own schedule.

At Outlier, your work helps shape how AI systems reason and improve. Earn up to $18/hr, with weekly payments and flexible hours, plus free access to leading LLMs.

Qualifications

• Fluent English and clear written communication required.
• Strong attention to detail and ability to explain observations precisely.
• Bachelor's degree or higher is preferred.

Responsibilities

• Holding live conversations with AI voice models and ranking naturalness and clarity.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely and writing explanations of issues in English.
• Rating outputs across dimensions and providing concise evaluations.

Skills

Fluent English

Clear written communication

Attention to detail

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, remotely and on your own schedule.

At Outlier, your work helps shape how AI systems reason and improve. Earn up to $18/hr, with weekly payments and flexible hours, plus free access to leading LLMs.