Generative AI Evaluator | $20/hr Remote

Crossing Hurdles; United States; Remote; USD 28,000 - 40,000; Full time

Job summary

Crossing Hurdles is seeking a Personal Account Generalist Raters for a remote contractor assignment. You will review AI prompts and responses in English, providing ratings and feedback. This role requires 20-40 hours per week at $25 per hour.

Work from anywhere in the United States with flexible scheduling and strict guidelines to ensure consistency. You will help improve the reliability of next-generation AI systems by evaluating relevance, accuracy, and personalization.

Qualifications

• Must have a primary Google Pixel 8 or newer device.
• Must use Android 17 or higher.
• Regular user of the Google Messages app for personal SMS/RCS conversations.
• Comfortable reviewing AI content in English.

Responsibilities

• Review AI-generated prompts and responses in English.
• Evaluate responses for relevance, accuracy, helpfulness, and personalization.
• Assess how well AI understands everyday context, preferences, relationships, routines, and experiences.
• Provide clear ratings, explanations, and feedback.
• Follow project guidelines and maintain a high level of consistency.
• Help improve the quality and reliability of next-generation AI systems.

Job description

Position: Personal Account Generalist Raters

Type: Contractor assignment

Compensation: $25/hr

Location: Remote

Commitment: 20-40 hrs/week

Role Responsibilities

• Review AI-generated prompts and responses in English.
• Evaluate responses for relevance, accuracy, helpfulness, and personalization.
• Assess how well AI understands everyday context, preferences, relationships, routines, and experiences.
• Provide clear ratings, explanations, and feedback.
• Follow project guidelines and maintain a high level of consistency.
• Help improve the quality and reliability of next-generation AI systems.

Requirements

• Must have a primary Google Pixel 8 or newer device.
• Must use Android 17 or higher.
• Regular user of the Google Messages app for personal SMS/RCS conversations.
• Comfortable reviewing AI content in English.