AI Quality Analyst - Prompt Design & Evaluation (Remote)

Hire Feed; Rimini; Remoto; EUR 52.000 - 78.000; Tempo pieno

Vantaggi offerti da questo lavoro

Remote work

Global team

Descrizione del lavoro

Hire Feed is seeking a remote Quality Analyst to evaluate AI-driven personalization features. This full-time role focuses on prompt design, evaluation of model outputs, and delivering actionable feedback to improve accuracy and relevance.

You'll design multi-turn prompts, assess grounding and usefulness, and collaborate with a global team across time zones. Requirements include strong English writing, experience with prompt engineering, analytical rigor, attention to detail, and willingness to

Competenze

• English proficiency with a high degree of competence in reading and writing.
• Experience in prompt engineering or designing test cases for AI models.
• Ability to analyze nuanced and ambiguous AI responses with analytical rigor.
• Familiarity with personalization concepts and evaluation metrics in AI systems.
• Attention to detail to identify subtle discrepancies in model outputs.
• Willingness to use your primary personal Google account and enable personal data sources for assessment.
• Full-time availability in your local time zone to support a global, 24-hour operations team.

Mansioni

• Evaluate the quality of personalized responses from an AI model using your own personal experiences as context.
• Design creative, multi-turn prompts that test the model’s ability to integrate personal data sources accurately.
• Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections.
• Review side-by-side comparisons of AI responses to detect subtle differences in relevance and accuracy.
• Provide detailed feedback on model behavior to improve personalization performance.

Conoscenze

Prompt engineering

AI evaluation

Analytical thinking

Attention to detail

English proficiency

Prompt design creativity

Descrizione del lavoro

Hire Feed is seeking a remote Quality Analyst to evaluate AI-driven personalization features. This full-time role focuses on prompt design, evaluation of model outputs, and delivering actionable feedback to improve accuracy and relevance.

You'll design multi-turn prompts, assess grounding and usefulness, and collaborate with a global team across time zones. Requirements include strong English writing, experience with prompt engineering, analytical rigor, attention to detail, and willingness to