Remote Part-Time: Personalized AI Response Evaluator

OpenTrain AI; United States; On-site; USD 28,000 - 41,000; Part time

Job summary

OpenTrain AI is seeking a Personalized AI Response Evaluator to assess AI-generated responses using prompts that retrieve context from connected email, photo, calendar, and file-management apps. This is a hands-on evaluation role for careful generalists in a remote, part-time contractor capacity.

You will review relevance, accuracy, and personalization, follow confidentiality guidelines, and provide detailed written feedback to help improve model behavior.

Qualifications

• Bachelor's degree or equivalent practical experience.
• AI evaluation experience is helpful but not required.
• Data annotation or content review experience is helpful but not required.
• Quality assurance or other analytical experience is helpful but not required.

Responsibilities

• Evaluate personalized AI interactions based on professional email history and business account activity.
• Follow evaluation guidelines consistently, protect private information, and meet confidentiality expectations while completing your work independently.
• Identify incorrect personalization, unsupported assumptions, subtle inconsistencies, and irrelevant recommendations.
• Write clear, detailed, and well-reasoned feedback to support model improvement.
• Review AI responses using connected email, photo, calendar, and file-management applications.

Skills

Analytical thinking

Attention to detail

Excellent written communication

Education

Bachelor's degree or equivalent practical experience

Job description

OpenTrain AI is seeking a Personalized AI Response Evaluator to assess AI-generated responses using prompts that retrieve context from connected email, photo, calendar, and file-management apps. This is a hands-on evaluation role for careful generalists in a remote, part-time contractor capacity.

You will review relevance, accuracy, and personalization, follow confidentiality guidelines, and provide detailed written feedback to help improve model behavior.