Remote AI Output Evaluator — Shape Next‑Gen AI

Outlier; College Station (TX); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Remote work from anywhere

Free LLM access

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media entirely remotely on a flexible schedule. You will roleplay live conversations with AI voice models and assess how well outputs follow prompts, then explain what looked off in writing.

The role supports global participation and pays weekly, with access to leading LLMs. Ideal candidates are fluent in English, highly attentive, and able to justify their judgments clearly.

Qualifications

• Fluent English with strong written communication skills.
• Detail-oriented mindset with patience to replay or zoom in when something seems off.
• Experience writing concise, evidence-based reviews or explanations.
• Ability to make clear decisions when two options have flaws.
• Final applicants from multiple eligible regions are welcomed.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness, usefulness and clarity.
• Compare AI-generated images and videos and judge prompt adherence.
• Inspect outputs closely for artifacts like distorted anatomy, flicker, timing, or audio mismatches.
• Provide written explanations pointing to observed issues in English.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based explanations

Decision making under uncertainty

Education

Bachelor’s degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media entirely remotely on a flexible schedule. You will roleplay live conversations with AI voice models and assess how well outputs follow prompts, then explain what looked off in writing.

The role supports global participation and pays weekly, with access to leading LLMs. Ideal candidates are fluent in English, highly attentive, and able to justify their judgments clearly.