Everyday AI Agent Tester - Remote

YO AI Labs; New York (NY); Remote; USD 27,552,000 - 55,104,000; Full time

Job summary

YO AI Labs is seeking an Everyday AI Agent Tester based in the United States to evaluate AI agents performing common tasks. You will compare two agents side by side, document results, and provide actionable feedback to improve user experience and reliability.

Responsibilities include testing bookings, shopping, travel, emails, bill payments, and forms; deciding when to approve or stop agents; screen-recording sessions; evaluating task completion, quality, user control, and satisfaction; and

Qualifications

• Based in the United States with a bachelor's degree.
• Regularly use AI tools in daily life.
• 2–3 years of experience, preferably in engineering, business management, or office operations.
• Strong attention to detail and ability to follow instructions.
• Excellent written communication and documentation skills.
• An active personal AI account (Free, Go, or Plus; not Pro) and a smartphone capable of screen recording.
• Preferred: Domain expertise in relevant everyday workflows. No coding or AI development experience is required.

Responsibilities

• Test AI agents on everyday tasks, including bookings, shopping, travel, emails, bill payments, and forms.
• Approve or stop agents at key decision points.
• Screen-record each testing session.
• Evaluate task completion, quality, user control, satisfaction, and time.
• Provide clear written feedback on agent performance and usability.

Skills

Attention to detail

Excellent written communication

Documentation skills

Regular AI tool usage

Education

Bachelor's degree

Job description

Role Title: Everyday AI Agent Tester

Role Type: Contractor
Location: United States

We are seeking detail-oriented, U.S.-based professionals to test AI agents performing everyday tasks. You'll evaluate two AI agents side by side, document their performance, and provide feedback to improve user experience and reliability.

Key Responsibilities

• Test AI agents on everyday tasks, including bookings, shopping, travel, emails, bill payments, and forms.
• Approve or stop agents at key decision points.
• Screen-record each testing session.
• Evaluate task completion, quality, user control, satisfaction, and time.
• Provide clear written feedback on agent performance and usability.

Required Qualifications

• Based in the United States with a bachelor's degree.
• Regularly use AI tools in daily life.
• 2–3 years of experience, preferably in engineering, business management, or office operations.
• Strong attention to detail and ability to follow instructions.
• Excellent written communication and documentation skills.
• An active personal AI account (Free, Go, or Plus; not Pro) and a smartphone capable of screen recording.

Preferred: Domain expertise in relevant everyday workflows. No coding or AI development experience is required.

Selection Process

1. Attend a brief interview (15–30 minutes).
2. Complete profile review and onboarding.

Availability: Onboarding is scheduled before the project kickoff, with tasks expected to begin on Monday, October 12.