Korean AI Personalization Evaluator (Remote Contractor)

Turing; United States; Remote; USD 28,000 - 50,000; Full time

Job summary

Turing, based in San Francisco, is seeking US-based generalist raters to participate in Gemini Personalization Evals. You will evaluate AI-generated interactions, focusing on relevance, accuracy, and personalization across connected Google apps.

Responsibilities include rating model outputs, comparing responses, and providing detailed feedback while upholding data privacy and confidentiality. The role is contractor with 4+ hours daily and up to 40 hours weekly, requiring independent remote work

Qualifications

• Bachelor's degree or equivalent practical experience.
• Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required.

Responsibilities

• Evaluate AI-generated responses based on professional email history and business account activity.
• Assess relevance, accuracy, helpfulness, and personalization of responses.
• Identify issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations.
• Compare multiple AI responses to determine better overall user experience.
• Provide clear, detailed, and well-reasoned evaluation feedback to support model improvements.
• Follow project guidelines to ensure consistent, accurate, and high-quality evaluations.
• Maintain data privacy and adhere to all project confidentiality requirements.

Skills

AI evaluation

Data annotation

Quality assurance

Content review

Analytical thinking

Attention to detail

Communication

Independent work

Education

Bachelor's degree or equivalent

Tools

Google Apps

Google Workspace

Job description

Turing, based in San Francisco, is seeking US-based generalist raters to participate in Gemini Personalization Evals. You will evaluate AI-generated interactions, focusing on relevance, accuracy, and personalization across connected Google apps.

Responsibilities include rating model outputs, comparing responses, and providing detailed feedback while upholding data privacy and confidentiality. The role is contractor with 4+ hours daily and up to 40 hours weekly, requiring independent remote work