Remote AI Response Evaluator — Flexible Hours, LLM Access

Outlier; Denton (TX); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free LLM access

Surge pricing bonuses

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, score each exchange, and explain in writing what looked or sounded off.

You’ll compare AI-produced images and videos for prompt adherence and report your findings with precise explanations. Ideal candidates are fluent in English with strong written communication, keen attention to detail, and the ability to work

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and patience to replay or zoom in.
• Experience writing short, evidence-based explanations or reviews.
• Bachelor's degree or above preferred.

Responsibilities

• Hold live conversations in English with AI voice models and rank how natural and clear each exchange sounds.
• Compare AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely to spot problems like artifacts or misalignment and explain findings in writing.
• Rate outputs across dimensions (adherence, quality, realism) and provide a concise explanation in English.

Skills

Fluent English

Attention to detail

Clear written communication

Education

Bachelor's degree preferred

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, score each exchange, and explain in writing what looked or sounded off.

You’ll compare AI-produced images and videos for prompt adherence and report your findings with precise explanations. Ideal candidates are fluent in English with strong written communication, keen attention to detail, and the ability to work