AI Workflow QA Specialist

YO AI Labs; San Jose (CA); Remote; USD 69,000 - 124,000; Part time

Job summary

YO AI Labs is seeking experienced AI Agent Power Users to contribute to an enterprise AI training project. This contractor role focuses on evaluating and improving AI assistants in real-world business workflows, with hands-on testing and actionable feedback.

No formal AI background required; candidates should bring strong documentation skills and proficiency with AI tools like ChatGPT or Claude.

Qualifications

• 5+ years of professional experience in any business function involving technology and operational problem-solving.
• Bachelor's degree or higher in any discipline.
• Daily, hands-on experience using ChatGPT and/or Claude for real professional work.
• Experience creating or applying evaluation rubrics, QA scorecards, content review guidelines, or similar frameworks.

Responsibilities

• Run complex, multi-step business workflows using AI assistants such as ChatGPT and Claude.
• Document workflows and identify where AI performance meets or falls short of real business requirements.
• Evaluate AI-generated outputs using defined rubrics and quality criteria.
• Provide clear, actionable feedback to AI research and product teams.
• Identify recurring AI strengths, weaknesses, and opportunities for process improvement.
• Connect AI tools with workplace platforms such as Google Drive, Gmail, Slack, and Notion.
• Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.

Education

Bachelor's degree or higher

Tools

ChatGPT

Claude

Job description

YO AI Labs is seeking experienced AI Agent Power Users to contribute to an enterprise AI training project. This contractor role focuses on evaluating and improving AI assistants in real-world business workflows, with hands-on testing and actionable feedback.

No formal AI background required; candidates should bring strong documentation skills and proficiency with AI tools like ChatGPT or Claude.