AI Evaluation Specialist — Remote & Flexible Hours

Outlier; Little Rock (AR); Hybrid; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked off, all remotely and on your own schedule.

Work from home with flexible hours, earn up to $15 per hour, and gain free access to leading LLMs. This freelance 1099 opportunity lets you contribute to frontier AI research while staying fully remote.

Qualifications

• Fluent English speaker with strong written communication and ability to explain findings clearly.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and explaining realistic scenarios in a natural, conversational way.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models, then ranking how natural and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering, or audio-visual mismatches.
• Rating outputs across dimensions like adherence, quality, and realism, then writing explanations in English.

Skills

Fluent English

Attention to detail

Bachelor's degree (nice to have)

Clear written explanations

Decision making under flaws

Education

Bachelor's degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked off, all remotely and on your own schedule.

Work from home with flexible hours, earn up to $15 per hour, and gain free access to leading LLMs. This freelance 1099 opportunity lets you contribute to frontier AI research while staying fully remote.