Remote AI Quality Evaluator & Feedback Specialist

YO AI Labs; Barcelona; A distancia; EUR 74.000 - 147.000; A tiempo parcial

Descripción de la vacante

YO AI Labs is seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You will evaluate AI-generated responses against rubrics for accuracy, relevance, and adherence to guidelines, and provide actionable feedback to help improve AI systems.

This remote contractor role involves working independently on high-volume evaluation tasks, maintaining documentation, and collaborating on rubric development and process

Formación

• Experience in grading, QA, editorial review or similar analytical roles.
• Daily use of AI assistants (ChatGPT, Claude, etc.).
• Strong written communication and attention to detail.

Responsabilidades

• Evaluate AI-generated outputs against rubrics for accuracy, relevance, and quality.
• Provide concise, actionable feedback highlighting strengths and areas for improvement.
• Document evaluations and recommendations clearly and consistently.
• Contribute to rubric interpretation discussions and evolving quality standards.

Conocimientos

Quality assurance

Editorial review

Annotation

AI tools

Rubric development

Process improvement

Analytical thinking

Independent work

Herramientas

ChatGPT

Claude

Descripción del empleo

YO AI Labs is seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You will evaluate AI-generated responses against rubrics for accuracy, relevance, and adherence to guidelines, and provide actionable feedback to help improve AI systems.

This remote contractor role involves working independently on high-volume evaluation tasks, maintaining documentation, and collaborating on rubric development and process