Remote AI Evaluation Specialist - Part-Time

Outlier; Honolulu (HI); Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Free access to leading LLMs

Join 900K+ Outlier Experts

Performance-based incentives

Job summary

Outlier is seeking a detail-oriented, entry-level AI tester to review AI-generated media from home. Work schedule is flexible with a part-time, remote setup. You will rate live conversations, compare AI outputs, and provide written explanations of issues, contributing to high-quality AI training data.

Must have strong English and attention to detail. Ideal candidates are comfortable making quick decisions when presented with imperfect options and may hold a Bachelor's degree.

Qualifications

• Fluent English speaker with strong, clear written communication and comfortable with natural, everyday conversational speech
• Strong attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off
• Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way
• Experience writing short, evidence-based explanations or reviews
• Comfortable making a clear decision when both options have flaws
• Nice to have: Pursuing or holding a Bachelor's degree or above

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard

Skills

Fluent English

Attention to detail

Written communication

Evidence-based explanations

Decision-making

Bachelor's degree (nice to have)

Education

Bachelor's degree or above

Job description

Outlier is seeking a detail-oriented, entry-level AI tester to review AI-generated media from home. Work schedule is flexible with a part-time, remote setup. You will rate live conversations, compare AI outputs, and provide written explanations of issues, contributing to high-quality AI training data.

Must have strong English and attention to detail. Ideal candidates are comfortable making quick decisions when presented with imperfect options and may hold a Bachelor's degree.