AI Agent Power User - Remote

YO AI Labs; Madrid; A distancia; EUR 74.000 - 123.000; A tiempo parcial

Descripción de la vacante

YO AI Labs is seeking an AI Agent Power User on a contract basis to test and improve AI assistants in real-world business workflows. You will run complex tasks, document processes, and provide actionable feedback to product teams from a remote setting.

The role requires hands-on use of AI tools like ChatGPT and Claude, plus strong written English and a track record of crafting evaluation rubrics or QA scorecards.

Formación

• 5+ years of professional experience in technology/operational problem-solving.
• Bachelor's degree or higher in any discipline.
• Daily, hands-on experience using ChatGPT and/or Claude for real professional work.
• Experience creating or applying evaluation rubrics, QA scorecards, content review guidelines, or similar frameworks.
• Comfortable working with AI tools and common workplace productivity platforms.
• Excellent written English and strong documentation skills.
• Authorized for contract work and located in the US, Canada, UK, Ireland, Australia, or New Zealand.

Responsabilidades

• Run complex, multi-step business workflows using AI assistants like ChatGPT/Claude.
• Document workflows and identify where AI performance meets business requirements.
• Evaluate AI outputs using defined rubrics and quality criteria.
• Provide clear, actionable feedback to AI research and product teams.
• Identify recurring AI strengths, weaknesses, and opportunities for process improvement.
• Connect AI tools with workplace platforms (Google Drive, Gmail, Slack, Notion).
• Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.

Conocimientos

5+ years experience

Educación

Bachelor's degree

Herramientas

ChatGPT

Claude

Descripción del empleo

AI Agent Power User

Role Type: Contractor
Location: Remote - US, Canada, UK, Ireland, Australia, New Zealand

We are seeking experienced AI Agent Power Users to contribute to an enterprise AI training project focused on evaluating and improving AI assistants in real-world business workflows.

You'll use your professional experience and hands-on knowledge of AI tools to test complex scenarios, evaluate outputs, and provide actionable feedback. No formal AI background is required.

Scope of Work

• Run complex, multi-step business workflows using AI assistants such as ChatGPT and Claude.
• Document workflows and identify where AI performance meets or falls short of real business requirements.
• Evaluate AI-generated outputs using defined rubrics and quality criteria.
• Provide clear, actionable feedback to AI research and product teams.
• Identify recurring AI strengths, weaknesses, and opportunities for process improvement.
• Connect AI tools with workplace platforms such as Google Drive, Gmail, Slack, and Notion.
• Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.

Preferred Qualifications

• 5+ years of professional experience in any business function involving technology and operational problem-solving.
• Bachelor's degree or higher in any discipline.
• Daily, hands-on experience using ChatGPT and/or Claude for real professional work.
• Experience creating or applying evaluation rubrics, QA scorecards, content review guidelines, or similar frameworks.
• Comfortable working with AI tools and common workplace productivity platforms.
• Excellent written English and strong documentation skills.
• Authorized for contract work and located in the US, Canada, UK, Ireland, Australia, or New Zealand.