AI Agent Tester

micro1

United States

Remote

USD 34,000 - 62,000

Full time

46 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Sidequest is seeking a Europe-based contractor to run real-life scenarios evaluating two AI agents on daily tasks. You will use your own accounts and a smartphone to screen record, approve or stop at key steps, and score outcomes while documenting feedback on completion quality and user control.

The role requires 2–3 years of experience and a bachelor’s degree or local equivalent, with no coding background needed.

Qualifications

  • Bachelor’s degree or local equivalent.
  • 2–3 years of experience.
  • Experience using AI in daily life.

Responsibilities

  • Run real-life scenarios with two AI agents and record results.
  • Score outcomes and provide feedback on completion quality and user control.
  • Operate from your own smartphone on your schedule.
  • Follow a defined test protocol and document observable evidence.

Skills

AI in daily life
Generalist

Education

Bachelor's degree or local equivalent

Job description

Test two AI agents side by side on everyday errands, recording each attempt and evaluating completion, quality, user control, satisfaction, and time. This remote contractor role is for Europe-based generalists who use AI in daily life and can complete structured tests from a screen-recording smartphone.

The work

You will run the same real-life scenarios with two AI agents using your own accounts and smartphone. Scenarios may involve bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, or forms. During each attempt, you will approve or stop the agent at key steps, screen record the process, score the result, and write clear feedback about what worked, what failed, and how much control the user retained.

What the screening assesses

The platform looks for a Europe-based candidate with a bachelor’s degree or local equivalent, 2 to 3 years of experience, and existing use of AI in daily life. Engineering, business management, and office or operations experience is preferred, while generalists are welcome and domain experts are preferred. No coding or AI development background is required. Screening is likely to focus on whether you can follow a test protocol, document observable evidence, distinguish task completion from task quality, and make sound decisions when an agent reaches a consequential step.

Practical details
  • Remote within Europe, contractor arrangement
  • Work is completed from your phone on your own schedule
  • A typical run takes about 1.5 hours, including evidence capture and scoring
  • You need an active personal account on a popular AI service, using a Free, Go, Plus, or Pro tier, plus a smartphone that can screen record
  • The interview typically lasts 15 to 30 minutes, and onboarding typically takes 24 to 48 hours after presentation to the hiring manager

Pay band: $25–45/hr

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Agent Tester
AI Agent Tester

Frontier AI Lab • United States

Remote
USD 34,000 - 62,000
AI Agent Tester
AI Agent Tester

confidential • United States

Remote
USD 34,000 - 62,000
AI Agent Evaluator - Remote
AI Agent Evaluator - Remote

YO AI Labs • New York (NY)

Remote
USD 55,000 - 83,000
AI Agent Tester - Real-World Tasks
AI Agent Tester - Real-World Tasks

confidential • United States

Remote
USD 34,000 - 62,000
AI Agent Evaluator
AI Agent Evaluator

micro1 Inc. • United States

Remote
USD 34,000 - 62,000
AI Agent Evaluator Micro1
AI Agent Evaluator Micro1

Aitrainergigs • United States

Remote
USD 34,000 - 62,000
Everyday AI Agent Tester - Remote
Everyday AI Agent Tester - Remote

YO AI Labs • New York (NY)

Remote
USD 20,000 - 40,000
AI Agent Evaluator
AI Agent Evaluator

AI Trainer HQ • United States

Remote
USD 34,000 - 62,000
AI Agent Tester for Real-World Task Evaluation
AI Agent Tester for Real-World Task Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 34,000 - 62,000
AI Agent Tester Real-World Tasks - Remote
AI Agent Tester Real-World Tasks - Remote

YO AI Labs • United States

Remote
USD 34,000 - 55,000