AI Personalization Evaluator - Australia

Braintrust; United States; Remote; USD 15,000 - 21,000; Full time

Job summary

Turing is seeking a detail-oriented contractor to help evaluate how an AI assistant uses information from connected Google apps for personalized prompts. This remote project targets Australia-based reviewers and pays hourly, with 20 hours per week for up to 16 weeks.

You will assess AI responses for relevance and accuracy, provide written feedback, and follow strict guidelines to ensure confidentiality and consistent evaluation across tasks.

Qualifications

• Currently resident in Australia.
• Bachelor’s degree or equivalent practical experience in any field.
• Active use of Google apps with account history to support tasks.
• Strong analytical judgment, attention to detail and written communication.
• Desktop or laptop computer with reliable internet.
• AI evaluation/annotation or QA experience is helpful but not required.

Responsibilities

• Evaluate AI-generated answers for relevance, accuracy and use of context.
• Compare responses, identify unsupported assumptions or missed information, and provide written feedback.
• Follow project guidelines for confidential and consistent evaluation.

Skills

Analytical thinking

Attention to detail

Written communication

Education

Bachelor's degree or equivalent practical experience

Tools

Google apps

Job description

• Rate: $13/hr
• Hours: 20 hours / week
• Experience: 1 - 3 years
• Location: Argentina | Belize | Bolivia + 15 more

Help evaluate how an AI assistant uses information from connected Google apps to respond to personalized prompts. This remote project is for people based in Australia who can review AI responses carefully and explain what works and what does not.

What you’ll do

• Evaluate AI-generated answers for relevance, accuracy and appropriate use of context.
• Compare responses, identify unsupported assumptions or missed information, and provide clear written feedback.
• Follow project guidelines for consistent, confidential evaluation work.

Important account-access requirement

This project requires you to connect eligible Google apps to Gemini and grant the permissions needed for personalized evaluations. These may include Gmail, Google Drive, Google Calendar and Google Photos. Shortlisted candidates will receive the project’s consent and onboarding details before participation.

What we’re looking for

• Currently resident in Australia.
• Bachelor’s degree or equivalent practical experience in any field.
• Active use of Google apps with enough account history to support personalized evaluation tasks.
• Strong analytical judgment, attention to detail and written communication.
• Desktop or laptop computer and reliable internet access.
• AI evaluation, annotation, content review or quality assurance experience is helpful but not required.

Engagement and pay

• Remote contractor assignment for up to 16 weeks.
• Plan for 20 hours per week, with potential for up to 40 hours depending on project needs, and four hours of daily overlap with Pacific Time.
• $13.00 per hour.
• Selected applicants may be invited to complete an interest form, which is mandatory to move forward in the hiring process.

Company: Turing