Arabic Content Evaluator for AI Support & LLM Benchmarking

Innodata Inc.; Doha; On-site; QAR 60,000 - 110,000; Full time

Job summary

Innodata Inc. seeks detail-oriented Content Evaluators to support an enterprise AI customer support product. You will evaluate AI-generated interactions in Arabic, benchmarking responses against quality rubrics and approved sources.

The role is freelance, with a 2-month engagement and an expected commitment of 6 hours per day. You will work with web-based evaluation and labeling tools to ensure accurate, consistent assessments.

Qualifications

• Experience in customer service, call centers, retail, or customer communications.
• Excellent English proficiency with strong grammar, tone, and comprehension.
• Strong analytical and attention-to-detail skills.
• Ability to follow complex guidelines consistently.
• Comfortable working with web-based evaluation and labeling tools.

Responsibilities

• Evaluate AI-generated customer interactions using defined quality parameters.
• Verify AI responses against FAQs, product catalogs, SOPs, and other approved sources.
• Participate in dual reviews and daily calibration to maintain evaluation consistency.
• Follow detailed rubrics and logic trees while meeting productivity targets.
• Maintain an average handling time of approximately 45 minutes per job.

Skills

Customer service

English proficiency

Analytical thinking

Attention to detail

Guideline adherence

Web labeling tools

Tools

Labeling tools

Job description

Innodata Inc. seeks detail-oriented Content Evaluators to support an enterprise AI customer support product. You will evaluate AI-generated interactions in Arabic, benchmarking responses against quality rubrics and approved sources.

The role is freelance, with a 2-month engagement and an expected commitment of 6 hours per day. You will work with web-based evaluation and labeling tools to ensure accurate, consistent assessments.