Remote AI Workflow QA Specialist

YO AI Labs

Kraków

Remote

PLN 352,000 - 508,000

Part time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

YO AI Labs seeks experienced AI Agent Power Users for an enterprise AI training project, working remotely in the US, Canada, UK, Ireland, Australia, and New Zealand. You will test AI assistants in real business workflows, document results, and provide actionable feedback to product teams.

No formal AI background required, but strong English and documentation are essential. You will connect AI tools with common platforms and help identify improvements across processes, ensuring reproducible

Qualifications

5+ years of professional experience in any business function involving technology and operational problem-solving.
Bachelor's degree or higher in any discipline.
Daily, hands-on experience using ChatGPT and/or Claude for real professional work.
Experience creating or applying evaluation rubrics, QA scorecards, content review guidelines, or similar frameworks.
Comfortable working with AI tools and common workplace productivity platforms.
Excellent written English and strong documentation skills.
Authorized for contract work and located in the US, Canada, UK, Ireland, Australia, or New Zealand.

Responsibilities

Run complex, multi-step business workflows using AI assistants such as ChatGPT and Claude.
Document workflows and identify where AI performance meets or falls short of real business requirements.
Evaluate AI-generated outputs using defined rubrics and quality criteria.
Provide clear, actionable feedback to AI research and product teams.
Identify recurring AI strengths, weaknesses, and opportunities for process improvement.
Connect AI tools with workplace platforms such as Google Drive, Gmail, Slack, and Notion.
Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.