Remote AI Personalization Evaluator – Canada

Bilinguallink; New Glasgow; À distance; CAD 22 042 000 - 44 083 000; Temps partiel

Résumé du poste

Gramian Consultancy is seeking AI Personalization Raters based in Canada to evaluate how AI models retrieve and use context from Google applications such as Gmail, Calendar, Drive, and Photos. You will assess relevance, accuracy, helpfulness, and personalization quality, providing structured feedback to support model improvements.

This contractor role requires detail-oriented individuals with strong analytical thinking, excellent written English, and active use of Google apps.

Qualifications

• Based in Canada with permission to access Google apps.
• Strong written English and structured feedback skills.
• Ability to work independently in a remote setup.

Responsabilités

• Evaluate AI responses using personalized prompts and information retrieved from connected Google applications.
• Assess whether responses are relevant, accurate, helpful, and appropriately personalized.
• Identify incorrect personalization, unsupported assumptions, irrelevant recommendations, and inconsistencies.
• Compare multiple AI-generated responses and assess their overall user experience.
• Provide clear, detailed, and well-reasoned evaluation feedback.
• Follow project guidelines to ensure consistent and high-quality ratings.
• Identify subtle strengths and weaknesses in AI-generated responses.
• Maintain data privacy and comply with project confidentiality requirements.

Connaissances

Analytical thinking

Attention to detail

Written English

Remote work

Google apps usage

Formation

Bachelor’s degree or equivalent

Outils

Google Workspace

Description du poste

Gramian Consultancy is seeking AI Personalization Raters based in Canada to evaluate how AI models retrieve and use context from Google applications such as Gmail, Calendar, Drive, and Photos. You will assess relevance, accuracy, helpfulness, and personalization quality, providing structured feedback to support model improvements.

This contractor role requires detail-oriented individuals with strong analytical thinking, excellent written English, and active use of Google apps.