Remote AI Agent Power User: Workflow Evaluator

YO AI Labs

Roma

Remoto

EUR 80.000 - 116.000

Tempo pieno

43 ore fa

Candidati tra i primi

Aumenta le possibilità di ricevere una risposta da questo datore di lavoro

Il tuo curriculum e una lettera di presentazione personalizzati, che corrispondono esattamente a ciò che sta cercando.

Supera i filtri ATS

Descrizione del lavoro

YO AI Labs seeks AI Agent Power Users to contribute to an enterprise AI training project, evaluating and improving AI assistants in real-world business workflows. You will test complex scenarios and provide actionable feedback; no formal AI background is required.

You will document workflows, evaluate outputs with defined rubrics, and connect AI tools to Google Drive, Gmail, Slack and Notion. Candidates with 5+ years in technology-enabled roles and fluent English are preferred.

Competenze

5+ years of professional experience in technology-enabled business roles.
Bachelor's degree or higher in any discipline.
Daily hands-on experience using ChatGPT and/or Claude for real work.
Experience creating or applying evaluation rubrics, QA scorecards, or guidelines.
Excellent written English and documentation skills.
Authorized for contract work and located in the US, Canada, UK, Ireland, Australia, or New Zealand.

Mansioni

Run complex, multi-step business workflows using AI assistants such as ChatGPT and Claude.
Document workflows and identify where AI performance meets or falls short of real business requirements.
Evaluate AI-generated outputs using defined rubrics and quality criteria.
Provide clear, actionable feedback to AI research and product teams.
Identify recurring AI strengths, weaknesses, and opportunities for process improvement.
Connect AI tools with workplace platforms such as Google Drive, Gmail, Slack, and Notion.
Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.