AI Evaluation Specialist, Remote & Flexible Hours

Outlier; Silver Spring (MD); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr plus incentives

Flexible hours, remote from anywhere

Free access to leading LLMs (worth $-)

Job summary

Outlier is offering a remote, flexible opportunity to review AI-generated media by engaging in live conversations with AI voice models. You will compare media across text prompts, images, and videos, and provide written explanations of what’s off, all on a schedule that suits you.

Ideal candidates are fluent in English, highly detail-oriented, and capable of clear, concise explanations. A Bachelor’s degree is welcome, and the role supports remote work from multiple countries.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay or zoom in when something seems off.
• Nice to have: Bachelor’s degree or above.
• Able to think on your feet and explain scenarios clearly.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and rank how natural, useful, and clear each one sounded.
• Comparing AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, text errors, and audio-video mismatches.
• Writing concise, evidence-based explanations in English that point to observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Experience writing explanations

Education

Bachelor's degree or higher

Job description

Outlier is offering a remote, flexible opportunity to review AI-generated media by engaging in live conversations with AI voice models. You will compare media across text prompts, images, and videos, and provide written explanations of what’s off, all on a schedule that suits you.

Ideal candidates are fluent in English, highly detail-oriented, and capable of clear, concise explanations. A Bachelor’s degree is welcome, and the role supports remote work from multiple countries.