Remote AI Conversation Evaluator – Fluent English

Outlier; Mesa (AZ); Remote; USD 17,000 - 25,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, compare image and video pairs, and write explanations of what looked wrong to help improve AI systems.

As a 1099 contractor, you can work from home or while traveling. Rates vary by expertise, with weekly payments and access to leading LLMs. Applicants from multiple countries, including the US, are welcome.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to replay or zoom in when something seems off.
• Nice to have a Bachelor’s degree or higher.
• Able to explain decisions clearly in writing when options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking how natural, useful, and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely—zooming and replaying—to spot problems like distorted anatomy, flickering, or audio-video mismatches.
• Rating each output on adherence, quality, and realism and writing a concise English explanation of what you saw.

Skills

Fluent English

Attention to detail

Written explanations

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, compare image and video pairs, and write explanations of what looked wrong to help improve AI systems.

As a 1099 contractor, you can work from home or while traveling. Rates vary by expertise, with weekly payments and access to leading LLMs. Applicants from multiple countries, including the US, are welcome.