Remote AI Evaluation Specialist

Outlier; Harrisburg (Dauphin County); Hybrid; USD 17,000 - 25,000; Full time

Benefits offered by this job

Up to $18 USD/hr

Flexible schedule

Weekly payments

Free access to leading LLMs

Job summary

Outlier seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare generated images and videos to judge prompt adherence, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

Responsibilities include evaluating image/video pairs, rating outputs across dimensions, and writing precise explanations in English.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in on content.
• Ability to write concise, evidence-based explanations.
• Comfortable making decisions when options have flaws.

Responsibilities

• Holding live conversations with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging prompt adherence.
• Inspecting outputs closely to spot issues like motion or text errors.
• Writing specific English explanations pointing to what was seen or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based writing

Education

Bachelor's degree or above

Job description

Outlier seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare generated images and videos to judge prompt adherence, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

Responsibilities include evaluating image/video pairs, rating outputs across dimensions, and writing precise explanations in English.