AI Personalization QA Specialist

Turing; San Francisco (CA); Remote; USD 55,000 - 83,000; Part time

Job summary

Turing, based in San Francisco, seeks an AI Quality Analyst to evaluate a personalization feature for Gemini. You will design prompts from personal experience and assess model responses for grounding, integration, and helpfulness.

The role emphasizes clear written rationales, side-by-side comparisons, and meticulous data hygiene. Commitment: at least 4 hours/day, 40 hours/week max, contractor engagement for 3 months with overlap across PST.

Qualifications

• BS/BA degree or equivalent in a relevant analytical field.
• Experience in data annotation, AI quality evaluation, or content moderation preferred.

Responsibilities

• Design and execute multi-turn prompts (1–5 turns) using personal context.
• Evaluate personalization quality across grounding, integration, and usefulness.
• Write clear rationales and reference specific turn numbers in evaluations.
• Extract and verify model debug info to confirm data sources used.

Skills

English

Personal data usage

Scheduling flexibility

Analytical thinking

Prompt engineering

Evaluation acumen

Clear written communication

Independence

Technical setup

Education

BS/BA or equivalent

Job description

Turing, based in San Francisco, seeks an AI Quality Analyst to evaluate a personalization feature for Gemini. You will design prompts from personal experience and assess model responses for grounding, integration, and helpfulness.

The role emphasizes clear written rationales, side-by-side comparisons, and meticulous data hygiene. Commitment: at least 4 hours/day, 40 hours/week max, contractor engagement for 3 months with overlap across PST.