AI Agent Tester for Real-World Task Evaluation

OpenTrain AI, Inc.; United States; Remote; USD 34,000 - 62,000; Part time

Job summary

OpenTrain AI, Inc. is seeking individuals to remotely test two AI agents on everyday tasks using a smartphone. As a part-time contractor in the United States, you will guide agents, screen record sessions, and provide detailed feedback on completion, control, and user satisfaction.

Applicants should have a Bachelor's degree and 2–3 years of relevant experience in engineering, business, or operations. Candidates must be detail-oriented, able to follow precise instructions, and capable of clear

Qualifications

• Bachelor's degree required.
• 2–3 years of experience preferred in engineering, business management, office, or operations.
• Strong attention to detail and precise instruction following.

Responsibilities

• Test two AI agents on everyday tasks using a smartphone.
• Screen record each attempt and provide feedback on usability and performance.
• Score runs and document interactions from start to finish.
• Provide written feedback on agent experience and time efficiency.

Skills

Attention to detail

Clear writing

Instruction following

Documentation

Education

Bachelor's degree

Job description

Test two AI agents on everyday tasks such as bookings, shopping, forms, and returns using your smartphone. This remote U.S. contractor role pays $25 to $45 per hour.

Remote Hourly · $25–$45/hr

$25–$45/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Oct 24, 2026

Posted

Open to applicants in

United States

The Work

You will test two AI agents side by side on realistic everyday errands. You will use your phone and personal accounts, guide each agent when needed, and observe how well it completes each task.

You will screen record every attempt and explain what worked, what failed, and how the experience felt. Your feedback will cover completion, quality, user control, satisfaction, and time.

• Run scenarios involving bills, returns, email follow-ups, bookings, shopping, groceries, travel, outings, forms, and other errands.
• Approve or stop an agent when an important action needs your control.
• Document each interaction clearly from start to finish.
• Score each run and provide precise written feedback about the agent experience.

What It Pays And Takes

This is remote, part-time contractor work for candidates based in the United States. You will complete the work with a smartphone, personal accounts, and the required testing tools.

• Pay: $25 to $45 per hour.
• Location: Open to candidates in the United States.
• Education: Bachelor's degree required.
• Experience: Two to three years of experience preferred, especially in engineering, business management, office, or operations work.
• Skills: Strong attention to detail, precise instruction following, clear writing, and careful step-by-step documentation.
• Background: You should use AI in daily life. Generalists are welcome, and no coding background is required.
• Equipment and accounts: A smartphone that can record its screen, an active personal AI assistant account on the Plus tier, and active access to the required testing tools.
• Testing purchases: A payment card is required, and test purchases are reimbursed afterward.

About AI Training Work

AI training is the human work behind artificial intelligence. People test systems, review their outputs, and explain what needs to improve so AI tools work better in real situations.

Requirements

• Experience: Entry level