Remote AI Evaluation Specialist

Outlier; Oklahoma City (OK); Hybrid; USD 15,000 - 25,000; Full time

Benefits offered by this job

Earn Up to $18 USD/hr - Plus bonuses

Work flexibly from anywhere

Free access to leading LLMs

Additional Missions incentives

Weekly payments via ACH, PayPal, AirTM

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models and score exchanges, then explain what looked off in writing.

Tasks include comparing AI images and videos for prompt fidelity and spotting artifacts or misalignment. Responsibilities also involve rating outputs across dimensions and providing specific English explanations.

Qualifications

• Fluent English with strong written communication.
• Great attention to detail and careful listening.
• Ability to explain observations clearly in writing.
• Comfortable discussing realistic scenarios and decisions.
• Capable of quick, on-your-feet thinking during reviews.

Responsibilities

• Holding live conversations with AI voice models and ranking naturalness.
• Comparing AI-generated images and videos for prompt adherence.
• Inspecting outputs and spotting issues like artifacts and mismatch.
• Writing concise explanations in English describing findings.

Skills

Fluent English

Attention to detail

Clear written communication

Excellent listening

Comfortable explaining on the fly

Decision making with flaws

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models and score exchanges, then explain what looked off in writing.

Tasks include comparing AI images and videos for prompt fidelity and spotting artifacts or misalignment. Responsibilities also involve rating outputs across dimensions and providing specific English explanations.