AI Agent Power User

micro1; United States; Remote; USD 55.000 - 96.000; Teilzeit

Zusammenfassung

micro1 is seeking an AI Agent Power User as a remote contractor to contribute to an enterprise AI training project. You will run complex business scenarios using AI assistants, document steps, and evaluate outputs against rubrics to guide AI research and product teams.

Applicants should have 5+ years in any tech-enabled business role, strong English writing, and a track record with ChatGPT or Claude. This role is remote with US-focused preference.

Qualifikationen

• 5+ years of professional experience in any business function with technology to solve operational challenges
• Bachelor's degree or higher in any discipline
• Regular use of ChatGPT and/or Claude for real work
• Experience grading or creating evaluation rubrics, QA scorecards, or content review guidelines
• Comfort integrating AI tools with business software and productivity platforms
• Excellent written English with clear documentation and feedback
• Authorized for contract work; based in US, Canada, UK, Ireland, Australia, or New Zealand (US preferred)

Aufgaben

• Run complex, multi-step business scenarios using AI assistants reflecting real professional workflows
• Document steps and compare AI performance to realistic business needs
• Evaluate and score AI outputs using rubrics for quality, completeness and relevance
• Draft clear, actionable feedback to inform AI research and product teams
• Identify recurring AI behavior patterns and opportunities for process improvement
• Connect AI tools to workplace platforms (e.g., Google Drive, Gmail, Slack, Notion)
• Maintain meticulous written records and communicate findings in professional English

Kenntnisse

AI Agents

Rubric-Based Evaluation

Quality Assurance

AI Adoption

Process Improvement

Ausbildung

Bachelor's degree

Jobbeschreibung

pay

Required Skills

• AI Agents
• Rubric-Based Evaluation
• Quality Assurance
• AI Adoption
• Process Improvement

About micro1

micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise settings.

Our AI recruiting agent sources and vets domain experts for our data platform that enables rapid production of high-quality training data. Our research spans high-value, specialized domains (legal, medical, finance, coding, etc.), where expert-level data is the hardest to produce and most valuable for advanced model performance. Our pipeline performance system ensures both quality and velocity.

Role Title: AI Agent Power User

Role Type: Contractor

Location: Remote (US, CA, UK, IE, AU, NZ)

micro1 is engaging AI Agent Power Users to contribute to an enterprise AI training project with a leading customer. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required - your domain knowledge is what matters.

Scope of Work

• Run complex, multi-step business scenarios using AI assistants such as ChatGPT and Claude, reflecting genuine professional workflows.
• Document each step, highlighting where AI performance aligns with or diverges from realistic business needs.
• Evaluate and score AI-generated outputs using specified rubrics and criteria, focusing on quality, completeness, and relevance.
• Draft clear, constructive, and actionable feedback based on rubric findings to inform AI research and product teams.
• Identify recurring patterns in AI behavior - strengths, weaknesses, and opportunities for process improvement.
• Connect AI tools to frequently used workplace platforms (e.g., Google Drive, Gmail, Slack, Notion) to mirror authentic use cases.
• Maintain meticulous written records and communicate findings in professional English, ensuring transparency and reproducibility.

Preferred Qualifications

• 5+ years of professional experience in any business function, utilizing technology to solve operational challenges.
• Completed Bachelor's degree or higher in any discipline.
• Consistent, hands-on daily use of ChatGPT and/or Claude for actual work, not just experimentation.
• Experience grading, applying, or creating evaluation rubrics, QA scorecards, or content review guidelines (academic, QA, hiring, or annotation experience strongly valued).
• General comfort integrating AI tools with business software and productivity platforms.
• Demonstrated excellence in written English, with a focus on clear, actionable documentation and feedback.
• Authorized for contract work and based in the US, Canada, UK, Ireland, Australia, or New Zealand (US strongly preferred).
• Email