Remote English AI Evaluation Specialist

Outlier

Davis (CA)

Remote

USD 17,000 - 24,000

Full time

7 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Weekly payments

Remote work

Free LLM access

Flexible hours

Job summary

Outlier seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Work from home or while travelling, with flexible hours and weekly payments. Rates vary by expertise and project requirements, with access to leading LLMs and extra incentives based on performance. This is a freelance 1099 opportunity.

Qualifications

Fluent English with clear written communication and comfortable with natural everyday conversational speech.
Strong attention to detail and patience to replay or zoom in when something seems off.
Bachelor's degree or higher preferred.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
Comparing pairs of AI-generated images and videos and judging which follows the prompt.
Inspecting outputs to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match video.
Rating outputs across dimensions like adherence, quality, and realism and writing a specific English explanation.