AI Quality Analyst: Personalization & Evaluation

Turing

United States

Remoto

USD 17.000 - 24.000

Tempo pieno

14 giorni+

Aumenta le possibilità di ricevere una risposta da questo datore di lavoro

Il tuo curriculum e una lettera di presentazione personalizzati, che corrispondono esattamente a ciò che sta cercando.

Supera i filtri ATS

Descrizione del lavoro

Turing is seeking an AI Quality Analyst to evaluate a new personalization feature for Gemini. You will design and assess prompts, using your personal experiences to test model behavior and responses.

You will evaluate grounding, integration, and helpfulness while providing clear, turn-specific rationales. This contractor role requires attention to detail, strong written communication, and the ability to delete evaluation data after review.

Competenze

  • Chinese reading/writing Proficiency required.
  • Experience designing multi-turn prompts to test model capabilities.
  • Ability to identify incorrect personalization and flawed inferences.
  • Attention to detail in evaluating model responses.
  • Clear, structured rationales referencing specific turns.

Mansioni

  • Design and execute multi-turn prompts that rely on personal context.
  • Analyze responses for grounding issues and evidence support.
  • Stack-rank two model responses for overall usefulness and clarity.
  • Write defensible rationales with references to conversation turns.
  • Extract and verify Debug Info from the model to confirm data sources used.
  • Maintain data hygiene by deleting evaluation conversations.

Conoscenze

Chinese Proficiency
Creative Prompt Engineering
Strong Evaluation Acumen
Meticulous Attention to Detail
Excellent Written Communication
Feedback

Formazione

BS/BA degree or equivalent

Descrizione del lavoro

Turing is seeking an AI Quality Analyst to evaluate a new personalization feature for Gemini. You will design and assess prompts, using your personal experiences to test model behavior and responses.

You will evaluate grounding, integration, and helpfulness while providing clear, turn-specific rationales. This contractor role requires attention to detail, strong written communication, and the ability to delete evaluation data after review.

Ottieni la revisione del curriculum gratis e riservata.

o trascina qui il file.

Similar jobs

Offerte di lavoro simili che vale la pena confrontare

Remote AI Quality Analyst: Personalization Evaluation
Remote AI Quality Analyst: Personalization Evaluation

Turing • Stati Uniti

Remoto
USD 17.000 - 24.000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • Stati Uniti

Remoto
USD 17.000 - 25.000
Competitive hourly rate
AI Personalization Quality Analyst — Remote Contractor
AI Personalization Quality Analyst — Remote Contractor

Turing • Stati Uniti

Remoto
USD 17.000 - 24.000
Remote AI Quality Analyst — Personalization & Evaluation
Remote AI Quality Analyst — Personalization & Evaluation

Turing • Stati Uniti

Remoto
USD 17.000 - 24.000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • Stati Uniti

Remoto
USD 17.000 - 28.000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • Stati Uniti

Remoto
USD 17.000 - 24.000
Contractor
3 months engagement
Remote AI Personalization Quality Analyst (Contractor)
Remote AI Personalization Quality Analyst (Contractor)

Turing • Stati Uniti

Remoto
USD 23.000 - 32.000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • Stati Uniti

Remoto
USD 17.000 - 24.000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • Stati Uniti

Remoto
USD 23.000 - 32.000
Remote AI Personalization Quality Analyst
Remote AI Personalization Quality Analyst

Turing • Stati Uniti

Remoto
USD 17.000 - 24.000