Remote AI Agent Usability Tester (Phone-Only)

HumanitApp; United States; Remote; USD 34,000 - 62,000; Part time

Job summary

HumanitApp is seeking US-based evaluators to test real-life AI agents that handle errands such as paying bills, booking trips, and shopping. You’ll use your own phone, screen record every attempt, and rate completion, quality, control issues, and user satisfaction.

You must have a Bachelor’s degree, 2–3 years of experience in relevant fields, and routinely use AI in daily life. Compensation ranges from $25 to $45 per hour; final rate, workload, and payment terms will be confirmed during the

Qualifications

• US-based with a Bachelor’s degree.
• 2–3 years of experience in engineering, business management, or office/operations.
• Detail-oriented and good at following instructions and documenting steps.
• Generalists welcome; domain experts preferred.
• No coding or AI background needed.

Responsibilities

• Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms.
• Approve or stop the agent at key steps.
• Screen record every attempt.
• Score each run on completion, quality, control issues, satisfaction, and time.
• Share clear written feedback on the agent experience.

Skills

Detail-oriented

Documentation

Instruction following

Education

Bachelor’s degree

Job description

HumanitApp is seeking US-based evaluators to test real-life AI agents that handle errands such as paying bills, booking trips, and shopping. You’ll use your own phone, screen record every attempt, and rate completion, quality, control issues, and user satisfaction.

You must have a Bachelor’s degree, 2–3 years of experience in relevant fields, and routinely use AI in daily life. Compensation ranges from $25 to $45 per hour; final rate, workload, and payment terms will be confirmed during the