AI Quality Analyst - Remote Prompt Testing

applydubaijob.com; Dubai; On-site; AED 220,000 - 331,000; Full time

Job summary

Hire Feed is seeking a Remote Quality Analyst to evaluate and improve advanced AI systems. The role focuses on assessing AI-generated responses, testing personalization features, and providing detailed feedback to enhance model performance.

You will design prompts, analyze outputs, and collaborate with a global team to drive quality improvements across time zones. This is a full-time remote position with global applicability.

Qualifications

• Bachelor’s degree in Computer Science, Data Science or AI-related field.
• Experience in prompt engineering or AI model testing preferred.
• Strong English reading and writing skills.
• Ability to analyze complex and ambiguous AI responses.
• Willingness to use a Google account and enable personal data sources for assessment purposes.

Responsibilities

• Evaluate the quality and relevance of personalized AI-generated responses.
• Create multi-turn prompts to test AI models and personalization features.
• Analyze AI outputs for accuracy, grounding, helpfulness, and proper information integration.
• Review side-by-side AI response comparisons to identify differences in quality and relevance.
• Provide detailed feedback to improve AI model performance.
• Identify incorrect personalization, inconsistencies, and potential improvements.
• Support ongoing AI evaluation projects and quality improvement initiatives.

Skills

Prompt engineering

AI model testing

English proficiency

Analytical thinking

Attention to detail

Test case design

Data analysis

AI personalization

Team collaboration

Education

Bachelor’s degree in Computer Science/Data Science/Artificial Intelligence or related field

Job description

Hire Feed is seeking a Remote Quality Analyst to evaluate and improve advanced AI systems. The role focuses on assessing AI-generated responses, testing personalization features, and providing detailed feedback to enhance model performance.

You will design prompts, analyze outputs, and collaborate with a global team to drive quality improvements across time zones. This is a full-time remote position with global applicability.