Everyday AI Agent Experience Tester

OpenTrain AI, Inc.

Northern (KY)

Remote

USD 34,000 - 62,000

Part time

47 hours ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Remote work
Part-time contract
Smartphone required
Screen-recording capability

Job summary

OpenTrain AI, Inc. is seeking a detail‑oriented contractor to run live tests with two AI agents on a smartphone. You will supervise workflows, approve or stop actions at key moments, and collect evidence through screen recordings.

Each session lasts about 1.5 hours, with remote, part‑time scheduling. Candidates should have a Bachelor's degree, 2–3 years in related fields, and comfort with daily AI tools. Fluent English writing is essential for feedback and documentation.

Qualifications

  • Bachelor's degree required.
  • Two to three years of experience in engineering, business management, office work, or operations.
  • Regular experience using AI tools in daily life.
  • Strong attention to detail and ability to follow instructions.
  • Clear written communication and documentation skills.

Responsibilities

  • Test two AI agents side by side on a smartphone.
  • Supervise important actions and document outcomes.
  • Screen record every attempt and preserve interaction evidence.
  • Score completion, quality, control issues, satisfaction, and time.
  • Provide clear feedback on what worked and what failed.

Skills

Attention to detail
Written communication
AI tool familiarity

Education

Bachelor's degree

Tools

Screen recording

Job description

The Work

You will test two AI agents side by side on a smartphone while they handle realistic everyday errands. You will use personal accounts, supervise important actions, and document what happens during each attempt.


Scenarios may include bill payments, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms.



  • Run realistic everyday scenarios with two AI agents.

  • Approve or stop agent actions at important points.

  • Screen record every attempt and preserve interaction evidence.

  • Score completion, quality, control issues, satisfaction, and time.

  • Write clear feedback about what worked, what failed, and how the experience felt.


What It Pays And Takes

This is a remote contractor role for candidates based in the United States. You will work from a smartphone on your own schedule, with each run taking about 1.5 hours, including evidence collection and scoring.



  • Pay: $25 to $45 per hour.

  • Location: Open to candidates in the United States.

  • Work arrangement: Remote, part-time contract work.

  • Language: Fluent English for written feedback and documentation.

  • Education: Bachelor's degree required.

  • Experience: Two to three years preferred, especially in engineering, business management, office work, or operations.

  • Regular experience using AI tools in daily life.

  • Strong attention to detail and careful instruction following.

  • Thorough step-by-step documentation and clear written communication.

  • A smartphone with screen-recording capability.

  • Access to the personal AI accounts needed for assignments.

  • No coding or prior AI background is required. Generalists are welcome.


About AI Training Work

AI training work is the human side of building artificial intelligence. People test systems, review their results, and provide examples or feedback that help AI tools become more useful, accurate, and easier to control.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Everyday AI Agent Tester
Everyday AI Agent Tester

Remolity, Inc. • United States

Remote
USD 60,000 - 75,000
Get paid to use AI tools you already使用
Work entirely from your phone
Direct input on next-gen AI agents
Everyday AI Agent Tester
Everyday AI Agent Tester

Remotebridge • United States

Remote
USD 34,000 - 62,000
AI Agent Evaluator
AI Agent Evaluator

Remolity, Inc. • United States

Remote
USD 28,000 - 41,000
Phone-only work
Paid AI usage
Influence AI development
Everyday AI Agent Tester – Remote
Everyday AI Agent Tester – Remote

RemoteJobsOne • Jacksonville (FL)

Remote
USD 34,000 - 62,000
AI Agent Evaluator, Remote- Contract Remote (United States)
AI Agent Evaluator, Remote- Contract Remote (United States)

Dover • Northern (KY)

Remote
USD 3,444,000 - 4,822,000
Remote work
AI Agent Evaluator
AI Agent Evaluator

Remotebridge • United States

Remote
USD 34,000 - 62,000
Phone-based work
Flexible schedule
Direct impact on AI products
Everyday AI Agent Tester, Remote- Contract Remote (United States)
Everyday AI Agent Tester, Remote- Contract Remote (United States)

Dover • Northern (KY)

Remote
USD 34,000 - 55,000
Everyday AI Agent Tester at micro1
Everyday AI Agent Tester at micro1

Aitrainer • Northern (KY)

Remote
USD 34,000 - 62,000
AI Agent Evaluator – Remote
AI Agent Evaluator – Remote

RemoteJobsOne • Houston (TX)

Remote
USD 34,000 - 62,000
Remote work
AI Agent Evaluator at micro1
AI Agent Evaluator at micro1

Aitrainer • Northern (KY)

Remote
USD 34,000 - 62,000
Refer and Earn