Remote AI Response Evaluator - Free LLM Access

Outlier; Amherst (MA); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Hourly pay up to $18

Flexible work from anywhere

Free access to leading LLMs

Missions bonus surge pricing

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, score responses, and compare generated media to determine which follows prompts more accurately.

You will explain what looked off in writing to help improve AI systems. Ideal candidates are fluent in English, highly attentive to detail, and capable of producing concise, evidence-based explanations.

Qualifications

• Fluent English with strong, clear written communication.
• Excellent attention to detail and patience to replay or zoom in on outputs.
• Bachelor’s degree or higher preferred.
• Ability to think on your feet and explain scenarios clearly.
• Experience writing concise, evidence-based reviews or explanations.

Responsibilities

• Hold live conversations with AI voice models and score exchanges.
• Compare AI-generated images and videos for compliance with prompts.
• Inspect outputs to spot problems like distorted anatomy, flickering, or misalignment.
• Write a precise English explanation pointing to what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Adaptable in conversations

Evidence-based explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, score responses, and compare generated media to determine which follows prompts more accurately.

You will explain what looked off in writing to help improve AI systems. Ideal candidates are fluent in English, highly attentive to detail, and capable of producing concise, evidence-based explanations.