AI Quality Analyst: Personalization & Prompt Design

Hire Feed; Argentina; Presencial; ARS 60.397.000 - 105.694.000; Jornada completa

Descripción de la vacante

Hire Feed is seeking an AI Quality Analyst (English) to join on a full-time basis. You will evaluate a new personalization feature for an AI model, testing how well it integrates information from past conversations, email, search, and activity to deliver relevant responses.

The role combines creative prompt design with analytical evaluation, demanding meticulous attention to detail and the ability to operate across a global 24-hour team in your local time zone.

Formación

• English proficiency with a high degree of reading and writing ability.
• Experience in prompt engineering or designing test cases for AI models.
• Ability to analyze nuanced and ambiguous AI responses with analytical rigor.
• Familiarity with personalization concepts and evaluation metrics in AI systems.
• Attention to detail to identify subtle discrepancies in model outputs.
• Willingness to use your primary personal Google account and enable personal data sources for assessment.
• Full-time availability in your local time zone to support a global, 24-hour operations team.

Responsabilidades

• Evaluate the quality of personalized responses from an AI model using your own experiences as context.
• Design creative, multi-turn prompts that test the model’s ability to integrate personal data sources accurately.
• Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections.
• Review side-by-side comparisons of AI responses to detect subtle differences in relevance and accuracy.
• Provide detailed feedback on model behavior to improve personalization performance.

Conocimientos

English proficiency

Prompt engineering

Analytical evaluation

Personalization concepts

Attention to detail

Personal data sources

Global time zones

Descripción del empleo

Hire Feed is seeking an AI Quality Analyst (English) to join on a full-time basis. You will evaluate a new personalization feature for an AI model, testing how well it integrates information from past conversations, email, search, and activity to deliver relevant responses.

The role combines creative prompt design with analytical evaluation, demanding meticulous attention to detail and the ability to operate across a global 24-hour team in your local time zone.