AI Personalization QA Analyst (Hindi) - Remote

Hire Feed; United Arab Emirates; Remote; AED 220,000 - 331,000; Full time

Job summary

Hire Feed is seeking an AI Quality Analyst (Personalization) to evaluate personalization features in Hindi. This remote, full-time role analyzes how AI models use past data to tailor responses, with a focus on grounding, integration, and user intent alignment.

Responsibilities include designing multi-turn prompts, evaluating outputs, and providing actionable feedback to improve model performance for diverse, global users. Remote work from anywhere supports a 24-hour operations team.

Qualifications

• Proficiency in reading and writing Hindi.
• Experience evaluating AI-generated content in personalization contexts.
• Ability to design creative and contextually relevant prompts for testing AI models.
• Strong attention to detail to assess nuanced AI responses.
• Willingness to use a personal Google account with enabled data sources for genuine evaluation.
• Familiarity with AI personalization concepts like grounding and user intent alignment.
• Experience in multi-turn conversation analysis and response evaluation.
• Comfort with handling personal user data and privacy considerations.
• Ability to work full-time with flexibility to support a global 24-hour operations team.

Responsibilities

• Design and refine multi-turn prompts based on personal experiences to test the AI model's personalization capabilities.
• Evaluate the quality of AI-generated responses across dimensions such as grounding, integration, and helpfulness.
• Identify instances of incorrect personalization, flawed inferences, or forced connections in model outputs.
• Compare side-by-side model responses to detect subtle differences and assess consistency.
• Provide detailed feedback on the model's ability to align with user-specific context and intent.

Skills

Hindi proficiency

AI evaluation

Prompts design

Attention to detail

Data privacy awareness

Multi-turn analysis

Job description

Hire Feed is seeking an AI Quality Analyst (Personalization) to evaluate personalization features in Hindi. This remote, full-time role analyzes how AI models use past data to tailor responses, with a focus on grounding, integration, and user intent alignment.

Responsibilities include designing multi-turn prompts, evaluating outputs, and providing actionable feedback to improve model performance for diverse, global users. Remote work from anywhere supports a 24-hour operations team.