Remote AI Quality Evaluator (English) - Realism

Outlier; Burlington (VT); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Free access to leading LLMs

Weekly payments via ACH/PayPal

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and compare image and video pairs to judge adherence to prompts.

You will write concise explanations in English describing what looked or sounded off, remotely and on a flexible schedule. Join Outlier to contribute to evaluating frontier AI systems and help improve real-world AI performance.

Qualifications

• Fluent English speaking and strong written communication.
• Excellent attention to detail and careful review of outputs.
• Experience writing concise, evidence-based explanations or reviews.
• Able to articulate reasoning clearly when two options have flaws.

Responsibilities

• Hold live conversations with AI voice models and rate how natural and useful the exchanges are.
• Compare pairs of AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely to spot problems like distortions, flickering, or mismatched audio.
• Provide written explanations in English detailing what was observed and why.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based explanations

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and compare image and video pairs to judge adherence to prompts.

You will write concise explanations in English describing what looked or sounded off, remotely and on a flexible schedule. Join Outlier to contribute to evaluating frontier AI systems and help improve real-world AI performance.