Mobile AI Agent Evaluator: Real-World Testing & Feedback

Aitrainer; Northern (KY); Remoto; USD 34.000 - 62.000; Part-time

Vantaggi offerti da questo lavoro

Refer and Earn

Descrizione del lavoro

Aitrainer is hiring an AI Agent Evaluator to test upcoming AI agents using your own phone from anywhere in the United States. You will compare two agents performing real-life tasks such as paying bills, travel bookings, shopping, and more.

Your role includes scoring, documenting steps, and providing actionable feedback to improve agent behavior. Applicants should have a Bachelor's degree, 2–3 years in relevant fields, and a habit of using AI tools in daily life.

Competenze

• US-based and eligible to work in the United States.
• Bachelor's degree required or equivalent.
• Active AI usage in daily life and comfort with mobile tools.
• 2–3 years of experience in engineering, business, or operations.
• Detail-oriented with strong instruction-following and documentation.
• Clear written communication; generalists welcome, domain experts preferred.

Mansioni

• Run real-life scenarios: bills, bookings, shopping, and more.
• Approve or stop the AI agent at key steps during runs.
• Screen record every attempt for review and scoring.
• Score each run on completion, quality, and time.
• Provide clear written feedback on the agent experience.

Conoscenze

ChatGPT

Muse

AI agents

Attention to Detail

Following Instructions

Screen Recording

About micro1

Formazione

Bachelor's degree

Descrizione del lavoro

Aitrainer is hiring an AI Agent Evaluator to test upcoming AI agents using your own phone from anywhere in the United States. You will compare two agents performing real-life tasks such as paying bills, travel bookings, shopping, and more.

Your role includes scoring, documenting steps, and providing actionable feedback to improve agent behavior. Applicants should have a Bachelor's degree, 2–3 years in relevant fields, and a habit of using AI tools in daily life.