AI Personalization QA Analyst (English) - Remote

Aitrainer; San Francisco (CA); Remote; USD 70,000 - 110,000; Part time

Job summary

Turing, based in San Francisco, seeks an AI Quality Analyst to evaluate a personalization feature for Gemini, using your own experiences to design prompts and assess grounding, integration, and helpfulness.

You will write clear rationales, reference turn numbers, and collaborate within a global 24-hour team as a remote contractor, ensuring privacy and data hygiene throughout the process.

Qualifications

• BS/BA degree or equivalent in a relevant field.
• Experience in data annotation, AI quality evaluation, content moderation, or related role preferred.

Responsibilities

• Design and execute multi-turn prompts based on personal context to test the model.
• Evaluate model responses for personalization and whether personalization was applied.
• Analyze grounding, ensuring evidence supports claims and avoiding hallucinations.
• Assess integration quality of personal data without robotic overnarration.
• Rank two responses side-by-side (SxS) by usefulness, clarity, and enjoyment.
• Write defensible rationales referencing exact turn numbers in conversations.
• Extract and verify 'Debug Info' from the model usage logs.
• Maintain strict data hygiene by deleting evaluation conversations.

Skills

English proficiency

Personal account usage

Schedule flexibility

Analytical thinking

Creative prompt engineering

Evaluation acumen

Attention to detail

Written communication

Feedback

Communication

Independence

Technical setup

Education

BS/BA degree or equivalent

Job description

Turing, based in San Francisco, seeks an AI Quality Analyst to evaluate a personalization feature for Gemini, using your own experiences to design prompts and assess grounding, integration, and helpfulness.

You will write clear rationales, reference turn numbers, and collaborate within a global 24-hour team as a remote contractor, ensuring privacy and data hygiene throughout the process.