Remote AI Response Quality Evaluator

Outlier (by Scale AI); United States; A distancia; USD 17.000 - 24.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible schedule

Free access to leading LLMs

Global expert community

Weekly payments

Descripción de la vacante

Outlier, an AI training platform by Scale AI, seeks detail-oriented English speakers to review AI-generated media and roleplay live conversations with an AI voice model, scoring each exchange and explaining discrepancies. Work remotely with a flexible schedule.

Responsibilities include image, video, and audio evaluations, noting artifacts, and providing concise, written explanations. Prior experience in writing evidence-based reviews is a plus. Freelance contractor opportunity.

Formación

• Fluent English with clear written communication.
• Attention to detail and patience to replay or zoom in when needed.
• Ability to describe observations and decisions in writing.
• Comfortable thinking on your feet and handling realistic scenarios.
• Willingness to provide concise, evidence-based explanations.

Responsabilidades

• Hold live, scenario-based conversations in English with AI voice models.
• Rank naturalness, usefulness, and clarity of exchanges.
• Compare AI-generated images and videos to judge prompt adherence.
• Inspect outputs closely and spot issues like artifacts or mismatches.
• Write explanations describing what was observed and why.

Conocimientos

Fluent English

Attention to detail

Clear written communication

Decision making

Explain past observations

Comfortable improvising

Educación

Bachelor's degree or above

Descripción del empleo

Outlier, an AI training platform by Scale AI, seeks detail-oriented English speakers to review AI-generated media and roleplay live conversations with an AI voice model, scoring each exchange and explaining discrepancies. Work remotely with a flexible schedule.

Responsibilities include image, video, and audio evaluations, noting artifacts, and providing concise, written explanations. Prior experience in writing evidence-based reviews is a plus. Freelance contractor opportunity.