Remote AI Evaluation Specialist
Outlier
Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Benefits offered by this job
Job summary
Outlier is seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model and score each exchange, compare generated images and videos to judge alignment with prompts, and explain what looked or sounded wrong, all remotely and on your own schedule.
Responsibilities include inspecting outputs for distortions or misalignment, rating across dimensions, and writing concise explanations in English.
Qualifications
- Fluent English with strong written communication.
- Detail-oriented with excellent observation and description skills.
- Experience writing concise, evidence-based explanations or reviews.
- Able to work independently with a flexible schedule.
- Comfortable making clear decisions when options have flaws.
Responsibilities
- Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
- Compare pairs of AI-generated images/videos to judge prompt adherence.
- Inspect outputs for distortions, flicker, text errors, or audio-video misalignment.
- Rate outputs across adherence, quality, and realism, and write specific explanations in English.
- Label and segment video captions, and provide precise, structured annotations.
- Evaluate audio/speech for naturalness and voice match, possibly including brief explanations.
Skills
Education
Tools
Job description
Outlier is seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model and score each exchange, compare generated images and videos to judge alignment with prompts, and explain what looked or sounded wrong, all remotely and on your own schedule.
Responsibilities include inspecting outputs for distortions or misalignment, rating across dimensions, and writing concise explanations in English.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
