Remote AI Agent Tester — Real-World Tasks

Zekai

United States

Remote

USD 34,000 - 62,000

Part time

12 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Zekai is seeking an AI Agent Tester to evaluate real-world AI assistants on everyday tasks. This is a 100% remote contractor role based in the United States, with pay of $25-45 per hour and onboarding within 24–48 hours of selection.

You will run real-life scenarios with two AI agents on your own smartphone, screen-record each attempt, approve or stop at key steps, and score outcomes for completion, quality, control issues, and user satisfaction.

Qualifications

  • Detail-oriented and able to follow instructions with precision.
  • Clear written communication is essential for feedback.
  • 2–3 years of relevant experience in engineering, business, or operations.

Responsibilities

  • Run real-life scenarios with two AI agents on your own smartphone.
  • Screen-record each attempt and document results.
  • Score runs on completion, quality, control issues, and user satisfaction.

Skills

Detail-oriented
Written communication
2-3 years experience

Education

Bachelor's degree

Tools

Screen recording

Job description

Zekai is seeking an AI Agent Tester to evaluate real-world AI assistants on everyday tasks. This is a 100% remote contractor role based in the United States, with pay of $25-45 per hour and onboarding within 24–48 hours of selection.

You will run real-life scenarios with two AI agents on your own smartphone, screen-record each attempt, approve or stop at key steps, and score outcomes for completion, quality, control issues, and user satisfaction.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Agent Evaluator (Contractor)
Remote AI Agent Evaluator (Contractor)

Zekai • United States

Remote
USD 34,000 - 62,000
Remote AI Agent Tester — Real‑World Tasks (Phone‑Only)
Remote AI Agent Tester — Real‑World Tasks (Phone‑Only)

Remolity, Inc. • United States

Remote
USD 28,000 - 41,000
Remote AI Agent Tester: Real-World Task Evaluator
Remote AI Agent Tester: Real-World Task Evaluator

OpenTrain AI, Inc. • United States

Remote
USD 34,000 - 62,000
AI Agent Evaluator - Remote Smartphone Task Tester
AI Agent Evaluator - Remote Smartphone Task Tester

OpenTrain AI, Inc. • Northern (KY)

Remote
USD 34,000 - 62,000
Remote AI Chat Evaluator & Task Feedback Specialist
Remote AI Chat Evaluator & Task Feedback Specialist

Zekai • United States

Remote
USD 34,000 - 49,000
Remote AI Agent Evaluator: Test & Score Real-Life Tasks
Remote AI Agent Evaluator: Test & Score Real-Life Tasks

RemoteJobsOne • Houston (TX)

Remote
USD 34,000 - 62,000
Remote work
Phone-Only AI Agent Tester — Real-Life Tasks
Phone-Only AI Agent Tester — Real-Life Tasks

Remotebridge • United States

Remote
USD 34,000 - 62,000
Phone-based work
Flexible schedule
AI Agent Tester – Real-World Tasks (Contractor)
AI Agent Tester – Real-World Tasks (Contractor)

Softechub • United States

On-site
USD 34,000 - 62,000
Remote Sci/Eng AI Evaluation Specialist
Remote Sci/Eng AI Evaluation Specialist

Zekai • United States

Remote
USD 95,000 - 136,000
AI Agent Tester for Real-World Task Evaluation
AI Agent Tester for Real-World Task Evaluation

OpenTrain AI, Inc. • United States

Remote
USD 34,000 - 62,000