AI Evaluation Specialist — Remote & Flexible Hours

Outlier; Irving (TX); Remote; USD 17,000 - 28,000; Full time

Benefits offered by this job

Flexible hours

Fully remote work

Weekly payments (ACH/PayPal)

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, schedule-flexible basis. You will roleplay live conversations with AI voice models, rate outputs, and provide written explanations of what looked or sounded off.

Earn up to $15 per hour, with weekly payments and access to top LLMs. This freelance opportunity spans multiple countries, including the United States, and invites applicants who can work asynchronously from home or while traveling.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to explain observations clearly.
• Able to think on your feet and discuss realistic scenarios conversationally.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos to judge which follows the prompt better.
• Inspecting outputs closely to spot problems like distortions, flickering, or audio-video mismatches.
• Rating outputs across dimensions like adherence, quality, and realism and writing explanations in English.

Skills

Fluent English

Strong written communication

Attention to detail

Decision making under uncertainty

Education

Bachelor’s degree or above (nice to have)

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, schedule-flexible basis. You will roleplay live conversations with AI voice models, rate outputs, and provide written explanations of what looked or sounded off.

Earn up to $15 per hour, with weekly payments and access to top LLMs. This freelance opportunity spans multiple countries, including the United States, and invites applicants who can work asynchronously from home or while traveling.