Remote AI Workflow Evaluator & Feedback Lead

YO AI Labs; Washington (District of Columbia); Remote; USD 138,000 - 220,000; Part time

Job summary

YO AI Labs is seeking experienced AI Agent Power Users to test enterprise AI workflows and improve real-world business processes. You will leverage tools like ChatGPT and Claude to run complex scenarios, document results, and provide actionable feedback to research and product teams.

No formal AI background is required; strong written English and documentation skills are essential. This is a remote, contractor role spanning the US, Canada, UK, Ireland, Australia and New Zealand.

Qualifications

• 5+ years in a business/tech role with problem-solving.
• Bachelor's degree or higher in any discipline.
• Daily hands-on use of ChatGPT and/or Claude for real work.
• Experience creating or applying evaluation rubrics/QA scorecards.
• Comfort with AI tools and common productivity platforms.
• Excellent written English and documentation skills.
• Authorized for contract work and located in US, Canada, UK, Ireland, Australia or New Zealand.

Responsibilities

• Run complex, multi-step business workflows using AI assistants.
• Document workflows and identify performance gaps vs business requirements.
• Evaluate AI outputs using defined rubrics and quality criteria.
• Provide clear, actionable feedback to AI teams.
• Identify recurring strengths/weaknesses and process improvement opportunities.
• Connect AI tools with Google Drive, Gmail, Slack and Notion.
• Maintain detailed, clear, and reproducible documentation.

Skills

5+ years experience

Written English

Problem solving

QA experience

Documentation

Education

Bachelor's degree or higher

Tools

ChatGPT

Claude

Job description

YO AI Labs is seeking experienced AI Agent Power Users to test enterprise AI workflows and improve real-world business processes. You will leverage tools like ChatGPT and Claude to run complex scenarios, document results, and provide actionable feedback to research and product teams.

No formal AI background is required; strong written English and documentation skills are essential. This is a remote, contractor role spanning the US, Canada, UK, Ireland, Australia and New Zealand.