AI Agent Evaluator

Aiworkexpert; Northern (KY); Hybrid; USD 34,000 - 62,000; Part time

Job summary

micro1 is seeking a remote Work Expert contractor to evaluate AI agent performance. You will run real-life scenarios such as bills, returns, and bookings, approving or stopping the agent at key steps and screening each attempt.

You will score results across completion, quality, and time, then share clear feedback on the agent experience. The role requires a US-based candidate with a Bachelor's degree who already uses AI in daily life.

Qualifications

• US-based with a Bachelor's degree.
• Candidates already using AI in daily life preferred.
• Contractor role; remote work.

Responsibilities

• Run real-life scenarios: bills, returns, emails, bookings, shopping, travel, forms.
• Approve or stop the agent at key steps.
• Screen record every attempt.
• Score each run on completion, quality, control issues, satisfaction, and time.
• Provide clear written feedback on the agent experience.

Skills

ChatGPT

Muse

AI agents

Attention to detail

Following instructions

Screen recording

Education

Bachelor's degree

Job description

# AI Agent Evaluator$45per hourContractor Remote Last verified 21 Jul 2026Listed on micro1 micro1.aiApplyAffiliate disclosureWork Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are not affiliated with or endorsed by micro1. Applying takes you to the platform's own website, where we may be recorded as the referring source. We may receive a referral fee at no additional cost to you. Read our full affiliate disclosure →## About the RoleOpportunity Snapshot Time per task: ~1.5 hours per run (evidence and scoring included) Project kickoff: Monday, October 12## What You'll Do* Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms* Approve or stop the agent at key steps* Screen record every attempt* Score each run on completion, quality, control issues, satisfaction, and time* Share clear written feedback on the agent experience* Who we’re looking for* US-based, with a Bachelor’s degree* Someone who already uses AI in daily life## You're a Good Fit If You* Required skills: ChatGPT, Muse, AI agents, Attention to Detail, Following Instructions, Screen RecordingGet ready for micro1Design a resume for micro1 Prepare for the micro1 interview## Role HighlightsPay$25-$45/hContractContractorLocationRemoteCategoryModel evaluationPosted5 days agoJob IDWE-7430