Remote AI Quality Evaluator & Feedback Specialist

YO AI Labs; Cape Town; Teletrabalho; ZAR 573 000 - 1 031 000; Tempo integral

Resumo da oferta

YO AI Labs is seeking a remote contractor AI Evaluation Specialist to assess AI-generated responses against detailed rubrics and contribute to quality improvements. You will provide concise feedback, identify gaps, and help evolve evaluation standards in a fast-paced, high-volume setting.

Strong analytical writing, attention to detail, and experience with AI tools like ChatGPT or Claude are valued as you work independently to ensure consistent, fair assessments across diverse datasets.

Qualificações

• Experience in grading, QA, editorial review, assessment, annotation, or similar analytical work.
• Advanced daily use of AI assistants such as ChatGPT, Claude, or similar tools.
• Strong ability to analyze complex information and communicate findings clearly in writing.
• Experience with process improvement, rubric development, or quality assessment.

Responsabilidades

• Evaluate AI-generated outputs against detailed rubrics for accuracy, relevance, quality, and guideline adherence.
• Apply consistent, objective judgment across large volumes of examples.
• Identify reasoning gaps, tool-use issues, and inconsistencies.
• Provide concise, actionable feedback highlighting strengths and areas for improvement.
• Participate in rubric interpretation discussions and evolving quality standards.
• Maintain accurate documentation of evaluations and recommendations.

Conhecimentos

Quality assessment

Editorial review

Analytical thinking

Attention to detail

Ferramentas

ChatGPT

Claude

Descrição da oferta de emprego

YO AI Labs is seeking a remote contractor AI Evaluation Specialist to assess AI-generated responses against detailed rubrics and contribute to quality improvements. You will provide concise feedback, identify gaps, and help evolve evaluation standards in a fast-paced, high-volume setting.

Strong analytical writing, attention to detail, and experience with AI tools like ChatGPT or Claude are valued as you work independently to ensure consistent, fair assessments across diverse datasets.