Remote AI Quality Evaluator & Feedback Specialist

YO AI Labs; San Jose (CA); Remote; USD 60,000 - 100,000; Full time

Job summary

YO AI Labs is seeking an AI Evaluation Specialist to assess AI assistant outputs for an enterprise training program. This contractor role is remote, spanning US, Canada, UK, Ireland, Australia, and New Zealand, with independent, high-volume evaluation tasks.

You will apply rubrics to judge accuracy, relevance, and adherence to guidelines, identify gaps, and provide concise, actionable feedback to help improve AI systems.

Qualifications

• Experience in grading or QA environments.
• Ability to evaluate AI outputs against rubrics.
• Excellent written communication to document findings.

Responsibilities

• Evaluate AI outputs against rubrics for accuracy and quality.
• Provide actionable feedback to improve AI systems.
• Document evaluations and recommendations clearly.

Skills

Quality assurance

Editorial review

Annotation

Assessment

Strong written communication

ChatGPT

Claude

Tools

ChatGPT

Claude

Job description

YO AI Labs is seeking an AI Evaluation Specialist to assess AI assistant outputs for an enterprise training program. This contractor role is remote, spanning US, Canada, UK, Ireland, Australia, and New Zealand, with independent, high-volume evaluation tasks.

You will apply rubrics to judge accuracy, relevance, and adherence to guidelines, identify gaps, and provide concise, actionable feedback to help improve AI systems.