Remote AI Conversation Evaluator - English Speaker

Outlier; Cleveland (OH); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Weekly payments

Remote work

Free access to LLMs

Flexible hours

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare outputs, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Work from home or while you travel, on a freelance 1099 contract with weekly payments. Rates vary by expertise, up to $15 per hour, with access to leading LLMs included and flexible hours.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and ability to replay/zoom in.
• Bachelor's degree or above preferred.
• Able to think clearly when evaluating AI outputs.
• Experience writing concise explanations or reviews.
• Capable of making decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models.
• Ranking how natural, useful, and clear each model sounded.
• Comparing pairs of AI-generated images and videos to judge prompt adherence.
• Inspecting outputs closely to spot issues like distortions or misalignment.
• Rating outputs across dimensions and writing English explanations.
• Image evaluations: compare two AI-generated images and judge fidelity.
• Video evaluations: rank AI videos against a prompt or source.
• Video caption labeling and audio-visual alignment checks.

Skills

Fluent English

Attention to detail

Clear written communication

Bachelor's degree

Decision-making under ambiguity

Evidence-based writing

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare outputs, and explain in writing what looked or sounded off, all remotely and on your own schedule.

Work from home or while you travel, on a freelance 1099 contract with weekly payments. Rates vary by expertise, up to $15 per hour, with access to leading LLMs included and flexible hours.