AI Personalization Quality Analyst

Hire Feed

Italia

In loco

EUR 40.000 - 60.000

Tempo pieno

2 giorni fa

Candidati tra i primi

Generatore di candidature

Trasforma questa candidatura in un colloquio — un curriculum e una lettera di presentazione creati in base a ciò questo datore di lavoro sta cercando.

Supera i filtri ATS

Descrizione del lavoro

Hire Feed is seeking an AI Quality Analyst (English) to join our team on a full-time basis. You will evaluate a new personalization feature for an AI model, assessing how well it integrates data from past conversations, email, search and activity to deliver relevant responses.

The role blends creative prompt design with rigorous analysis of AI outputs, designing prompts, reviewing answers for grounding and usefulness, and providing detailed feedback to improve personalization performance.

Competenze

English proficiency with a high degree of competence in reading and writing.
Experience in prompt engineering or designing test cases for AI models.
Ability to analyze nuanced and ambiguous AI responses with analytical rigor.
Familiarity with personalization concepts and evaluation metrics in AI systems.
Attention to detail to identify subtle discrepancies in model outputs.
Willingness to use your primary personal Google account and enable personal data sources for assessment.
Full-time availability in your local time zone to support a global, 24-hour operations team.

Mansioni

Evaluate the quality of personalized responses from an AI model using your own personal experiences as context.
Design creative, multi-turn prompts that test the model’s ability to integrate personal data sources accurately.
Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections.
Review side-by-side comparisons of AI responses to detect subtle differences in relevance and accuracy.
Provide detailed feedback on model behavior to improve personalization performance.