Remote AI Agent Tester - Real-World Task Evaluator

RemoteJobsOne; Jacksonville (FL); Remote; USD 34,000 - 62,000; Part time

Job summary

RemoteJobsOne is seeking an Everyday AI Agent Tester for a fully remote contractor role based in the United States. You will run real-life scenarios with two AI agents, screen record each attempt, and score results on completion, quality, control issues, and user satisfaction.

Onboarding starts today and you’ll provide clear feedback on the agent experience. The position requires a US-based candidate with a Bachelor’s degree and 2–3 years of relevant experience.

Qualifications

• Bachelor’s degree required.
• US-based with AI usage in daily life.
• 2–3 years of experience in engineering, business management, or office/operations.
• No coding or AI background required.

Responsibilities

• Run real-life scenarios with two AI agents.
• Approve or stop at key steps.
• Screen record every attempt.
• Score runs on completion, quality, control issues, satisfaction, and time.
• Provide written feedback on agent experience.

Skills

Detail-oriented

Documentation

Instruction following

Education

Bachelor's degree

Job description

RemoteJobsOne is seeking an Everyday AI Agent Tester for a fully remote contractor role based in the United States. You will run real-life scenarios with two AI agents, screen record each attempt, and score results on completion, quality, control issues, and user satisfaction.

Onboarding starts today and you’ll provide clear feedback on the agent experience. The position requires a US-based candidate with a Bachelor’s degree and 2–3 years of relevant experience.