Remote AI Conversation Evaluator (English Speaker)

Outlier; Princeton (NJ); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Flexible hours

Fully remote

Weekly payments

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, rate how well outputs follow prompts, and explain issues in writing, all remotely and on a flexible schedule.

Your work helps shape AI systems by providing ratings on realism, adherence, and quality. This is a freelance, 1099 contract opportunity with weekly payments and access to leading LLMs.

Qualifications

• Fluent English with clear written communication.
• High attention to detail and ability to review AI outputs closely.
• Able to think on your feet and explain decisions clearly.
• Experience writing concise, evidence-based explanations is a plus.
• Bachelor's degree or higher is preferred.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models.
• Ranking how natural, useful, and clear each output sounds.
• Comparing AI-generated images and videos and judging prompt adherence.
• Writing a detailed explanation in English pointing to observed issues.
• Inspecting outputs closely for distortions, flickering, or audio-video mismatches.
• Rating outputs on adherence, quality, and realism.

Skills

Fluent English

Clear written communication

Attention to detail

Decision making under ambiguity

Explain explanations in writing

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, rate how well outputs follow prompts, and explain issues in writing, all remotely and on a flexible schedule.

Your work helps shape AI systems by providing ratings on realism, adherence, and quality. This is a freelance, 1099 contract opportunity with weekly payments and access to leading LLMs.