Remote AI Agent Power User: Enterprise Workflow Evaluator

YO AI Labs; Santa Cruz (CA); Remote; USD 55,000 - 124,000; Full time

Job summary

YO AI Labs seeks experienced AI Agent Power Users to contribute to an enterprise AI training project. You will test complex business workflows, evaluate outputs, and provide actionable feedback to AI research and product teams.

No formal AI background is required, but hands-on use of AI tools is essential. The role emphasizes documenting workflows, rubrics-based evaluation, and clear communication with cross-functional teams.

Qualifications

• 5+ years of professional experience in any business function involving technology and operational problem-solving.
• Bachelor’s degree or higher in any discipline.
• Daily, hands‑on experience using ChatGPT and/or Claude for real professional work.
• Experience creating or applying evaluation rubrics, QA scorecards, content review guidelines, or similar frameworks.
• Comfortable working with AI tools and common workplace productivity platforms.
• Excellent written English and strong documentation skills.
• Authorized for contract work and located in the US, Canada, UK, Ireland, Australia, or New Zealand.

Responsibilities

• Run complex, multi-step business workflows using AI assistants such as ChatGPT and Claude.
• Document workflows and identify where AI performance meets or falls short of real business requirements.
• Evaluate AI-generated outputs using defined rubrics and quality criteria.
• Provide clear, actionable feedback to AI research and product teams.
• Identify recurring AI strengths, weaknesses, and opportunities for process improvement.
• Connect AI tools with workplace platforms such as Google Drive, Gmail, Slack, and Notion.
• Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.

Skills

AI tools usage

English writing

Documentation skills

ChatGPT/Claude usage

Education

Bachelor’s degree or higher

Tools

ChatGPT

Claude

Google Drive

Gmail

Slack

Notion

Job description

YO AI Labs seeks experienced AI Agent Power Users to contribute to an enterprise AI training project. You will test complex business workflows, evaluate outputs, and provide actionable feedback to AI research and product teams.

No formal AI background is required, but hands-on use of AI tools is essential. The role emphasizes documenting workflows, rubrics-based evaluation, and clear communication with cross-functional teams.