Remote AI Personalization QA Analyst - Contractor

Turing

United States

Remote

USD 39,000 - 76,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Turing, based in San Francisco, invites applications for an AI Quality Analyst to evaluate a new personalization feature for Gemini. You will craft prompts from personal context and assess model responses across grounding, integration, and usefulness.

Responsibilities include designing prompts, ranking model outputs, writing precise rationales, and verifying debug information. This is a contractor role with remote flexibility and global oversight.

Qualifications

  • BS/BA degree or equivalent experience in a relevant field.
  • Experience in data annotation, AI quality evaluation, content moderation, or related role is strongly preferred.

Responsibilities

  • Design and execute multi-turn conversational prompts (typically 1–5 turns) requiring the AI to use your personal information and experiences.
  • Evaluate model responses based on intent from the starting prompt, checking personalization was applied.
  • Analyze responses for grounding, ensuring claims about you are supported by evidence and not flawed inferences.
  • Assess integration quality so personal data is woven naturally without robotic overnarration.
  • Rigorously rank two model responses side-by-side (SxS) for usefulness, usability and enjoyment.
  • Write clear, defensible rationales for comparisons with references to conversation turns.
  • Extract and verify debug info from the model to confirm proper data sources used.
  • Maintain strict data hygiene by deleting evaluation conversations.

Skills

English proficiency
Personal account usage
Schedule flexibility
Analytical thinking
Prompt engineering
Evaluation acumen
Attention to detail
Written communication
Feedback annotations
Communication
Independence
Technical setup

Education

BS/BA or equivalent

Job description

Turing, based in San Francisco, invites applications for an AI Quality Analyst to evaluate a new personalization feature for Gemini. You will craft prompts from personal context and assess model responses across grounding, integration, and usefulness.

Responsibilities include designing prompts, ranking model outputs, writing precise rationales, and verifying debug information. This is a contractor role with remote flexibility and global oversight.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Personalization Quality Analyst (Contractor)
Remote AI Personalization Quality Analyst (Contractor)

Turing • United States

Remote
USD 23,000 - 32,000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • United States

Remote
USD 23,000 - 32,000
Remote AI Quality Analyst: Personalization Evaluation
Remote AI Quality Analyst: Personalization Evaluation

Turing • United States

Remote
USD 17,000 - 24,000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • United States

Remote
USD 17,000 - 25,000
Competitive hourly rate
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • United States

Remote
USD 17,000 - 24,000
Contractor
3 months engagement
Remote AI Personalization QA Analyst — Prompt Engineer
Remote AI Personalization QA Analyst — Prompt Engineer

Turing • United States

Remote
USD 17,000 - 24,000
AI Personalization Quality Analyst (Remote Contractor)
AI Personalization Quality Analyst (Remote Contractor)

Turing • United States

Remote
USD 17,000 - 24,000
AI Personalization Quality Analyst — Remote Contractor
AI Personalization Quality Analyst — Remote Contractor

Turing • United States

Remote
USD 17,000 - 24,000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • United States

Remote
USD 17,000 - 24,000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • United States

Remote
USD 17,000 - 24,000